* [sup-devel] Heliotrope improving but still found some issues
@ 2011-07-05 1:52 Horacio Sanson
2011-07-05 14:01 ` Horacio Sanson
` (2 more replies)
0 siblings, 3 replies; 7+ messages in thread
From: Horacio Sanson @ 2011-07-05 1:52 UTC (permalink / raw)
To: sup-devel
[-- Attachment #1: Type: Text/Plain, Size: 5154 bytes --]
So I tried the latest heliotrope with the leveldb-ruby 0.6 gem, whistlepig 0.7
and MeCab hooks for Japanese text support and it works better than before.
Unfortunately got two issues:
First any attempt to search using japanese text fails with the dreaded
incompatible character encodings error:
#####################################################
[2011-07-05 10:22:17] INFO WEBrick 1.3.1
[2011-07-05 10:22:17] INFO ruby 1.9.2 (2010-08-18) [x86_64-linux]
[2011-07-05 10:22:17] INFO WEBrick::HTTPServer#start: pid=13523 port=8042
search(body:"手紙", 0, 20) took 2.1ms
Encoding::CompatibilityError - incompatible character encodings: ASCII-8BIT
and UTF-8:
bin/heliotrope-server:223:in `block in <class:HeliotropeServer>'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:1152:in `call'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:1152:in `block in
compile!'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:724:in
`instance_eval'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:724:in
`route_eval'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:708:in `block (2
levels) in route!'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:758:in `block in
process_route'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:755:in `catch'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:755:in
`process_route'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:707:in `block in
route!'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:706:in `each'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:706:in `route!'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:843:in `dispatch!'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:644:in `block in
call!'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in
`instance_eval'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in `block in
invoke'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in `catch'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in `invoke'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:644:in `call!'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:629:in `call'
/var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/head.rb:9:in `call'
/var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/showexceptions.rb:21:in
`call'
/var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/lint.rb:48:in `_call'
/var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/lint.rb:36:in `call'
/var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/showexceptions.rb:24:in `call'
/var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/commonlogger.rb:18:in `call'
/var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/content_length.rb:13:in `call'
/var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/handler/webrick.rb:52:in
`service'
/usr/lib/ruby/1.9.1/webrick/httpserver.rb:111:in `service'
/usr/lib/ruby/1.9.1/webrick/httpserver.rb:70:in `run'
/usr/lib/ruby/1.9.1/webrick/server.rb:183:in `block in start_thread'
127.0.0.1 - - [05/Jul/2011 10:22:20] "GET /search?q=%E6%89%8B%E7%B4%99
HTTP/1.1" 500 89118 0.0331
localhost - - [05/Jul/2011:10:22:20 JST] "GET /search?q=%E6%89%8B%E7%B4%99
HTTP/1.0" 500 89118
- -> /search?q=%E6%89%8B%E7%B4%99
[2011-07-05 10:22:20] ERROR Errno::ECONNRESET: Connection reset by peer
/usr/lib/ruby/1.9.1/webrick/httpserver.rb:56:in `eof?'
/usr/lib/ruby/1.9.1/webrick/httpserver.rb:56:in `run'
#######################################################
The problem seems to be the header method in the heliotrope-server that uses
multiline strings (e.g. <<- EOS). By forcing the resulting text to UTF-8
encoding the search works as expected with japanese and non japanese text (see
attached patch).
The second problem is actually not heliotrope problem. Is the artificial
limitations imposed by Gmail. After running heliotrope-add for some time it
would fail when the IMAP fetch returns nil. Just after it failed I tried to
use my current email reader (kmail) and got an interesting error saying:
"exceeded IMAP bandwidth limits". These indicates the nil is due to Gmail
limiting the maximum bandwidth I can consume downloading emails.
The latest heliotrope now catches this error and ignores it but after a while
ignoring it I started getting sys-write errors on the socket. I believe this
is also GMail abruptly breaking the socket connection to enforce it's
bandwidth limits.
Maybe limiting the rate of gmail-dumper so it reads mails at a lower pace
would eliminate these problems or simply stop reading emails for some time
when we get the first nil response.
Overall heliotrope is now usable for Japanese language users (at least for me
). Now I will start playing with turnsole to see if it can handle japanese.
--
regards,
Horacio Sanson
[-- Attachment #2: 0001-Fix-encoding-exception.patch --]
[-- Type: text/x-patch, Size: 679 bytes --]
From a056837d1ebe5054106e65ac7155b4e8e422a382 Mon Sep 17 00:00:00 2001
From: Horacio Sanson <hsanson@gmail.com>
Date: Tue, 5 Jul 2011 10:31:33 +0900
Subject: [PATCH] Fix encoding exception.
---
bin/heliotrope-server | 3 +++
1 files changed, 3 insertions(+), 0 deletions(-)
diff --git a/bin/heliotrope-server b/bin/heliotrope-server
index 15dc897..def9909 100644
--- a/bin/heliotrope-server
+++ b/bin/heliotrope-server
@@ -557,6 +557,9 @@ td {
<input type="submit" value="go"/>
</form></div>
EOS
+
+ title.force_encoding(Encoding::UTF_8) if title.respond_to?(:force_encoding) # sigh...
+ title
end
def footer
--
1.7.4.1
[-- Attachment #3: Type: text/plain, Size: 143 bytes --]
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-devel] Heliotrope improving but still found some issues
2011-07-05 1:52 [sup-devel] Heliotrope improving but still found some issues Horacio Sanson
@ 2011-07-05 14:01 ` Horacio Sanson
2011-07-07 6:33 ` William Morgan
2011-07-07 6:31 ` William Morgan
2011-07-09 22:22 ` William Morgan
2 siblings, 1 reply; 7+ messages in thread
From: Horacio Sanson @ 2011-07-05 14:01 UTC (permalink / raw)
To: sup-devel
[-- Attachment #1: Type: text/plain, Size: 6192 bytes --]
Speaked too fast... got a few more issues.
First the patch I sent was incomplete, please ignore and use the one
attached here if you would. The previous patch completely removed the
header section of the web page.
Second the GMail labels work great as long as they are in english.
This is because the labels are UTF-7 encoded and look like this in
japanese: "+&mlkwrtdrmkiwwzdxmlgw4zdrmpm-" and clicking on any of
these labels in the web interface result in systax error. Fixing this
is as simple as replacing line 207 of imap-dumper.rb with the
following code:
labels = (data.attr["X-GM-LABELS"] || []).map { |label|
Net::IMAP.decode_utf7(label.to_s).downcase }
I am pretty sure the utf7 decoding is language independent and can be
applied safely to all labels in any language but I cannot bet on it
since I only have tested Japanese. Not sure if this conversion would
require a separate hook or something like that.
regards,
Horacio
On Tue, Jul 5, 2011 at 10:52 AM, Horacio Sanson <hsanson@gmail.com> wrote:
>
> So I tried the latest heliotrope with the leveldb-ruby 0.6 gem, whistlepig 0.7
> and MeCab hooks for Japanese text support and it works better than before.
> Unfortunately got two issues:
>
> First any attempt to search using japanese text fails with the dreaded
> incompatible character encodings error:
>
> #####################################################
> [2011-07-05 10:22:17] INFO WEBrick 1.3.1
> [2011-07-05 10:22:17] INFO ruby 1.9.2 (2010-08-18) [x86_64-linux]
> [2011-07-05 10:22:17] INFO WEBrick::HTTPServer#start: pid=13523 port=8042
> search(body:"手紙", 0, 20) took 2.1ms
> Encoding::CompatibilityError - incompatible character encodings: ASCII-8BIT
> and UTF-8:
> bin/heliotrope-server:223:in `block in <class:HeliotropeServer>'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:1152:in `call'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:1152:in `block in
> compile!'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:724:in
> `instance_eval'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:724:in
> `route_eval'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:708:in `block (2
> levels) in route!'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:758:in `block in
> process_route'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:755:in `catch'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:755:in
> `process_route'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:707:in `block in
> route!'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:706:in `each'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:706:in `route!'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:843:in `dispatch!'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:644:in `block in
> call!'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in
> `instance_eval'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in `block in
> invoke'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in `catch'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:808:in `invoke'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:644:in `call!'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/base.rb:629:in `call'
> /var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/head.rb:9:in `call'
> /var/lib/gems/1.9.1/gems/sinatra-1.2.5/lib/sinatra/showexceptions.rb:21:in
> `call'
> /var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/lint.rb:48:in `_call'
> /var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/lint.rb:36:in `call'
> /var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/showexceptions.rb:24:in `call'
> /var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/commonlogger.rb:18:in `call'
> /var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/content_length.rb:13:in `call'
> /var/lib/gems/1.9.1/gems/rack-1.2.2/lib/rack/handler/webrick.rb:52:in
> `service'
> /usr/lib/ruby/1.9.1/webrick/httpserver.rb:111:in `service'
> /usr/lib/ruby/1.9.1/webrick/httpserver.rb:70:in `run'
> /usr/lib/ruby/1.9.1/webrick/server.rb:183:in `block in start_thread'
> 127.0.0.1 - - [05/Jul/2011 10:22:20] "GET /search?q=%E6%89%8B%E7%B4%99
> HTTP/1.1" 500 89118 0.0331
> localhost - - [05/Jul/2011:10:22:20 JST] "GET /search?q=%E6%89%8B%E7%B4%99
> HTTP/1.0" 500 89118
> - -> /search?q=%E6%89%8B%E7%B4%99
> [2011-07-05 10:22:20] ERROR Errno::ECONNRESET: Connection reset by peer
> /usr/lib/ruby/1.9.1/webrick/httpserver.rb:56:in `eof?'
> /usr/lib/ruby/1.9.1/webrick/httpserver.rb:56:in `run'
> #######################################################
>
> The problem seems to be the header method in the heliotrope-server that uses
> multiline strings (e.g. <<- EOS). By forcing the resulting text to UTF-8
> encoding the search works as expected with japanese and non japanese text (see
> attached patch).
>
>
> The second problem is actually not heliotrope problem. Is the artificial
> limitations imposed by Gmail. After running heliotrope-add for some time it
> would fail when the IMAP fetch returns nil. Just after it failed I tried to
> use my current email reader (kmail) and got an interesting error saying:
> "exceeded IMAP bandwidth limits". These indicates the nil is due to Gmail
> limiting the maximum bandwidth I can consume downloading emails.
>
> The latest heliotrope now catches this error and ignores it but after a while
> ignoring it I started getting sys-write errors on the socket. I believe this
> is also GMail abruptly breaking the socket connection to enforce it's
> bandwidth limits.
>
> Maybe limiting the rate of gmail-dumper so it reads mails at a lower pace
> would eliminate these problems or simply stop reading emails for some time
> when we get the first nil response.
>
> Overall heliotrope is now usable for Japanese language users (at least for me
> ). Now I will start playing with turnsole to see if it can handle japanese.
>
> --
> regards,
> Horacio Sanson
>
[-- Attachment #2: 0001-Fix-encoding-exception.patch --]
[-- Type: text/x-patch, Size: 987 bytes --]
From 90ef5390daf4fa7a05d62c3a61a1eee9b7e8061a Mon Sep 17 00:00:00 2001
From: Horacio Sanson <hsanson@gmail.com>
Date: Tue, 5 Jul 2011 10:31:33 +0900
Subject: [PATCH] Fix encoding exception.
---
bin/heliotrope-server | 5 ++++-
1 files changed, 4 insertions(+), 1 deletions(-)
diff --git a/bin/heliotrope-server b/bin/heliotrope-server
index 15dc897..26ae4c5 100644
--- a/bin/heliotrope-server
+++ b/bin/heliotrope-server
@@ -530,7 +530,7 @@ private
def header title, query=""
title = escape_html title
- <<-EOS
+ title = <<-EOS
<!DOCTYPE html><html><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><title>Heliotrope: #{title}</title>
<meta name="application-name" content="heliotrope">
<style type="text/css">
@@ -557,6 +557,9 @@ td {
<input type="submit" value="go"/>
</form></div>
EOS
+
+ title.force_encoding(Encoding::UTF_8) if title.respond_to?(:force_encoding) # sigh...
+ title
end
def footer
--
1.7.4.1
[-- Attachment #3: Type: text/plain, Size: 143 bytes --]
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-devel] Heliotrope improving but still found some issues
2011-07-05 1:52 [sup-devel] Heliotrope improving but still found some issues Horacio Sanson
2011-07-05 14:01 ` Horacio Sanson
@ 2011-07-07 6:31 ` William Morgan
2011-07-09 22:22 ` William Morgan
2 siblings, 0 replies; 7+ messages in thread
From: William Morgan @ 2011-07-07 6:31 UTC (permalink / raw)
To: sup-devel
Hi Horacio,
Thanks for all your help testing. I am committed to making Heliotrope and
Turnsole i18n-friendly, so it's great to have some stress applied to that
area.
Reformatted excerpts from Horacio Sanson's message of 2011-07-05:
> Encoding::CompatibilityError - incompatible character encodings: ASCII-8BIT
> and UTF-8:
> bin/heliotrope-server:223:in `block in <class:HeliotropeServer>'
Ok, I will check out your patch.
> The latest heliotrope now catches this error and ignores it but after
> a while ignoring it I started getting sys-write errors on the socket.
> I believe this is also GMail abruptly breaking the socket connection
> to enforce it's bandwidth limits.
I suspect you're right. I wonder if there is a way to detect the rate
limiting kicking on. If not, I can add a delay. You can also manually
delay with judicious use of the -n flag.
> Overall heliotrope is now usable for Japanese language users (at least
> for me ). Now I will start playing with turnsole to see if it can
> handle japanese.
Great! I look forward to your bug reports. If you could please file bugs
in the corresponding Github projects, that will help me keep track of
things.
--
William <wmorgan-sup@masanjin.net>
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-devel] Heliotrope improving but still found some issues
2011-07-05 14:01 ` Horacio Sanson
@ 2011-07-07 6:33 ` William Morgan
0 siblings, 0 replies; 7+ messages in thread
From: William Morgan @ 2011-07-07 6:33 UTC (permalink / raw)
To: sup-devel
Reformatted excerpts from Horacio Sanson's message of 2011-07-05:
> I am pretty sure the utf7 decoding is language independent and can be
> applied safely to all labels in any language but I cannot bet on it
I think you are right. It should be safe to utf7-decode all labels.
Good catch.
--
William <wmorgan-sup@masanjin.net>
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-devel] Heliotrope improving but still found some issues
2011-07-05 1:52 [sup-devel] Heliotrope improving but still found some issues Horacio Sanson
2011-07-05 14:01 ` Horacio Sanson
2011-07-07 6:31 ` William Morgan
@ 2011-07-09 22:22 ` William Morgan
2011-07-09 23:50 ` Horacio Sanson
2 siblings, 1 reply; 7+ messages in thread
From: William Morgan @ 2011-07-09 22:22 UTC (permalink / raw)
To: sup-devel
Hi Horacio,
Reformatted excerpts from Horacio Sanson's message of 2011-07-05:
> First any attempt to search using japanese text fails with the dreaded
> incompatible character encodings error:
I'm having trouble reproducing this, or even understanding why your fix would
help, since all string literals in the code should be UTF-8-encoded.
Could you please apply this patch and tell me what the output is when
you feed it a crashing search term? Thanks!
--- cut here ---
diff --git a/bin/heliotrope-server b/bin/heliotrope-server
index c9754d4..ca764c0 100644
--- a/bin/heliotrope-server
+++ b/bin/heliotrope-server
@@ -219,6 +219,19 @@ class HeliotropeServer < Sinatra::Base
end
nav += "</div>"
+ puts "start"
+ p query.original_query_s.encoding
+ p query.parsed_query_s.encoding
+ p header("Search: #{query.original_query_s}", query.original_query_s).enc
+ p "<div>Parsed query: #{escape_html query.parsed_query_s}</div>".encoding
+ p "<div>Search took #{sprintf '%.2f', info[:elapsed]}s and #{info[:contin
+ p "#{nav}<table>".encoding
+ p results.size
+ p results.map { |r| threadinfo_to_html r }.join.encoding
+ p "</table>#{nav}".encoding
+ p footer.encoding
+ puts "end"
+
header("Search: #{query.original_query_s}", query.original_query_s) +
"<div>Parsed query: #{escape_html query.parsed_query_s}</div>" +
"<div>Search took #{sprintf '%.2f', info[:elapsed]}s and #{info[:contin
--- cut here ---
--
William <wmorgan-sup@masanjin.net>
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-devel] Heliotrope improving but still found some issues
2011-07-09 22:22 ` William Morgan
@ 2011-07-09 23:50 ` Horacio Sanson
2011-07-15 4:07 ` William Morgan
0 siblings, 1 reply; 7+ messages in thread
From: Horacio Sanson @ 2011-07-09 23:50 UTC (permalink / raw)
To: Sup developer discussion
Hello,
On Sunday 10 July 2011 07:22:15 William Morgan wrote:
> Hi Horacio,
>
> Reformatted excerpts from Horacio Sanson's message of 2011-07-05:
> > First any attempt to search using japanese text fails with the dreaded
>
> > incompatible character encodings error:
> I'm having trouble reproducing this, or even understanding why your fix
> would help, since all string literals in the code should be UTF-8-encoded.
>
> Could you please apply this patch and tell me what the output is when
> you feed it a crashing search term? Thanks!
>
> --- cut here ---
> diff --git a/bin/heliotrope-server b/bin/heliotrope-server
> index c9754d4..ca764c0 100644
> --- a/bin/heliotrope-server
> +++ b/bin/heliotrope-server
> @@ -219,6 +219,19 @@ class HeliotropeServer < Sinatra::Base
> end
> nav += "</div>"
>
> + puts "start"
> + p query.original_query_s.encoding
> + p query.parsed_query_s.encoding
> + p header("Search: #{query.original_query_s}",
> query.original_query_s).enc + p "<div>Parsed query: #{escape_html
> query.parsed_query_s}</div>".encoding + p "<div>Search took #{sprintf
> '%.2f', info[:elapsed]}s and #{info[:contin + p
> "#{nav}<table>".encoding
> + p results.size
> + p results.map { |r| threadinfo_to_html r }.join.encoding
> + p "</table>#{nav}".encoding
> + p footer.encoding
> + puts "end"
> +
> header("Search: #{query.original_query_s}", query.original_query_s)
> + "<div>Parsed query: #{escape_html query.parsed_query_s}</div>" +
> "<div>Search took #{sprintf '%.2f', info[:elapsed]}s and #{info[:contin
> --- cut here ---
Seems the problem is not heliotrope. The problem are my hooks that use MeCab
to split Japanese words.
If I run a search for japanese using my query hook this is the output:
search(body:"飲み会", 0, 20) took 0.1ms
start
#<Encoding:ASCII-8BIT>
#<Encoding:UTF-8>
#<Encoding:ASCII-8BIT>
#<Encoding:UTF-8>
"<div>Search took 0.00s and was NOT continued</div>"
#<Encoding:UTF-8>
0
#<Encoding:ASCII-8BIT>
#<Encoding:UTF-8>
#<Encoding:UTF-8>
end
If I put a force_encoding at the end of the hook I get:
start
#<Encoding:UTF-8>
#<Encoding:UTF-8>
#<Encoding:UTF-8>
#<Encoding:UTF-8>
"<div>Search took 0.00s and was NOT continued</div>"
#<Encoding:UTF-8>
20
#<Encoding:UTF-8>
#<Encoding:UTF-8>
#<Encoding:UTF-8>
end
I need to re-index my emails with the new UTF-8 hooks and test the search
again.
--
regards,
Horacio Sanson
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-devel] Heliotrope improving but still found some issues
2011-07-09 23:50 ` Horacio Sanson
@ 2011-07-15 4:07 ` William Morgan
0 siblings, 0 replies; 7+ messages in thread
From: William Morgan @ 2011-07-15 4:07 UTC (permalink / raw)
To: sup-devel
Reformatted excerpts from Horacio Sanson's message of 2011-07-09:
> I need to re-index my emails with the new UTF-8 hooks and test the
> search again.
Can you try with the latest master? You may not need to reindex.
--
William <wmorgan-sup@masanjin.net>
_______________________________________________
Sup-devel mailing list
Sup-devel@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-devel
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2011-07-15 3:56 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2011-07-05 1:52 [sup-devel] Heliotrope improving but still found some issues Horacio Sanson
2011-07-05 14:01 ` Horacio Sanson
2011-07-07 6:33 ` William Morgan
2011-07-07 6:31 ` William Morgan
2011-07-09 22:22 ` William Morgan
2011-07-09 23:50 ` Horacio Sanson
2011-07-15 4:07 ` William Morgan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox