Archive of RubyForge sup-devel mailing list
 help / color / mirror / Atom feed
* [sup-devel] [Heliotrope] search for cyrillic terms does not work
@ 2012-02-24  5:43 Serge Z
  2012-02-25  6:42 ` William Morgan
  0 siblings, 1 reply; 4+ messages in thread
From: Serge Z @ 2012-02-24  5:43 UTC (permalink / raw)
  To: sup-devel


Hi!
I've submitted issue #36 at github.com on this problem.

> Search for cyrillic terms does not work both in web-interface and turnsole.
> 
> The search term is present in utf-8 and windows-1251 encodings in different mails.
> My system encoding is utf-8.
> 
> Ruby 1.9
> 
> Please inform if this is not an issue with ruby 1.8 or any other environment

Can you please suppose why that could happen or offer a simple workaround?
This issue is the only one which stops me from migrating to Heliotrope/Turnsole.

I'd not got this problem with sup.
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel


^ permalink raw reply	[flat|nested] 4+ messages in thread

* [sup-devel]  [Heliotrope] search for cyrillic terms does not work
  2012-02-24  5:43 [sup-devel] [Heliotrope] search for cyrillic terms does not work Serge Z
@ 2012-02-25  6:42 ` William Morgan
  2012-02-29 10:44   ` Serge Z
  0 siblings, 1 reply; 4+ messages in thread
From: William Morgan @ 2012-02-25  6:42 UTC (permalink / raw)
  To: sup-devel

Excerpts from Serge Z's message of 2012-02-23 21:43:18 -0800:
> Can you please suppose why that could happen or offer a simple
> workaround?  This issue is the only one which stops me from migrating
> to Heliotrope/Turnsole.

I'll have to look into it. Super-ascii search was definitely working at
some point, so I'm not sure why there was a regression. You can help by
trying to see whether the problem is in whistlepig or in heliotrope,
e.g. by adding and querying Cyrillic documents in a whistlepig index of
your own construction.

-- 
William <wmorgan@masanjin.net>
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: [sup-devel] [Heliotrope] search for cyrillic terms does not work
  2012-02-25  6:42 ` William Morgan
@ 2012-02-29 10:44   ` Serge Z
  2012-03-05 22:57     ` William Morgan
  0 siblings, 1 reply; 4+ messages in thread
From: Serge Z @ 2012-02-29 10:44 UTC (permalink / raw)
  To: Sup developer discussion, William Morgan, sup-devel


Quoting William Morgan (2012-02-25 10:42:57)
>I'll have to look into it. Super-ascii search was definitely working at
>some point, so I'm not sure why there was a regression. You can help by
>trying to see whether the problem is in whistlepig or in heliotrope,
>e.g. by adding and querying Cyrillic documents in a whistlepig index of
>your own construction.

Does whistlepig have any tool for manual managing its indexes?
Or do I have to code in either ruby or C to do that?
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: [sup-devel] [Heliotrope] search for cyrillic terms does not work
  2012-02-29 10:44   ` Serge Z
@ 2012-03-05 22:57     ` William Morgan
  0 siblings, 0 replies; 4+ messages in thread
From: William Morgan @ 2012-03-05 22:57 UTC (permalink / raw)
  To: Sup developer discussion

Excerpts from Serge Z's message of 2012-02-29 02:44:13 -0800:
> Does whistlepig have any tool for manual managing its indexes?
> Or do I have to code in either ruby or C to do that?

Yeah, if you check it out separately and build it, you can run
something like:

  whistlepig$ make dump
  whistlepig$ ./dump <heliotrope store dir>/index/whistlepig|less

And then if you search for some Cyrillic text, that should at least
tell you the tokenization in the index.
-- 
William <wmorgan@masanjin.net>
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel


^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2012-03-05 22:59 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-02-24  5:43 [sup-devel] [Heliotrope] search for cyrillic terms does not work Serge Z
2012-02-25  6:42 ` William Morgan
2012-02-29 10:44   ` Serge Z
2012-03-05 22:57     ` William Morgan

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox