* [sup-talk] Recovering a busted ferret db?
@ 2009-10-30 17:17 Steven Walter
2009-10-30 21:48 ` William Morgan
0 siblings, 1 reply; 6+ messages in thread
From: Steven Walter @ 2009-10-30 17:17 UTC (permalink / raw)
To: sup-talk
I think my ferret db is corrupted. Whenever I do a tag search for a
specific tag, sup loads 2 messages and then hangs. Actually, it's
using 100% CPU, but I have to kill -9 it; ctrl-c doesn't work. Is
there any hope of fixing this without losing all my tag information?
--
-Steven Walter <stevenrwalter@gmail.com>
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [sup-talk] Recovering a busted ferret db?
2009-10-30 17:17 [sup-talk] Recovering a busted ferret db? Steven Walter
@ 2009-10-30 21:48 ` William Morgan
2009-10-30 22:14 ` Steven Walter
0 siblings, 1 reply; 6+ messages in thread
From: William Morgan @ 2009-10-30 21:48 UTC (permalink / raw)
To: sup-talk
Reformatted excerpts from Steven Walter's message of 2009-10-30:
> I think my ferret db is corrupted. Whenever I do a tag search for a
> specific tag, sup loads 2 messages and then hangs. Actually, it's
> using 100% CPU, but I have to kill -9 it; ctrl-c doesn't work. Is
> there any hope of fixing this without losing all my tag information?
You can certainly move to the Xapian index without losing all of your
tags. Sup-dump will output everything precious from your index.
Is it possible you have a very large thread with that label? E.g.
thousands of messages, all replying to each other, from some script?
--
William <wmorgan-sup@masanjin.net>
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [sup-talk] Recovering a busted ferret db?
2009-10-30 21:48 ` William Morgan
@ 2009-10-30 22:14 ` Steven Walter
2009-11-01 14:53 ` William Morgan
0 siblings, 1 reply; 6+ messages in thread
From: Steven Walter @ 2009-10-30 22:14 UTC (permalink / raw)
To: William Morgan; +Cc: sup-talk
On Fri, Oct 30, 2009 at 5:48 PM, William Morgan
<wmorgan-sup@masanjin.net> wrote:
> Reformatted excerpts from Steven Walter's message of 2009-10-30:
>> I think my ferret db is corrupted. Whenever I do a tag search for a
>> specific tag, sup loads 2 messages and then hangs. Actually, it's
>> using 100% CPU, but I have to kill -9 it; ctrl-c doesn't work. Is
>> there any hope of fixing this without losing all my tag information?
>
> You can certainly move to the Xapian index without losing all of your
> tags. Sup-dump will output everything precious from your index.
Looks like sup-dump hangs, too.
> Is it possible you have a very large thread with that label? E.g.
> thousands of messages, all replying to each other, from some script?
Not very likely. I could believe tens, up to a hundred; 200 at the most.
I am able to Ctrl-C sup-dump when it hangs. Here's the ruby backtrace:
/var/lib/gems/1.8/gems/sup-0.9/lib/sup/util.rb:206:in `split': Interrupt
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/util.rb:206:in
`split_on_commas'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/person.rb:108:in
`from_address_list'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/message.rb:104:in
`parse_header'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/ferret_index.rb:276:in
`build_message'
from /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/ferret_index.rb:256:in
`build_message'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/index.rb:150:in
`each_message'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/ferret_index.rb:319:in
`each_id'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/ferret_index.rb:319:in `map'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/ferret_index.rb:319:in
`each_id'
from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/index.rb:149:in
`each_message'
from /var/lib/gems/1.8/gems/sup-0.9/bin/sup-dump:28
--
-Steven Walter <stevenrwalter@gmail.com>
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: [sup-talk] Recovering a busted ferret db?
2009-10-30 22:14 ` Steven Walter
@ 2009-11-01 14:53 ` William Morgan
[not found] ` <e06498070911011203s66ece542mac80378442073369@mail.gmail.com>
0 siblings, 1 reply; 6+ messages in thread
From: William Morgan @ 2009-11-01 14:53 UTC (permalink / raw)
To: sup-talk
Reformatted excerpts from Steven Walter's message of 2009-10-30:
> I am able to Ctrl-C sup-dump when it hangs. Here's the ruby backtrace:
>
> /var/lib/gems/1.8/gems/sup-0.9/lib/sup/util.rb:206:in `split': Interrupt
> from /var/lib/gems/1.8/gems/sup-0.9/lib/sup/util.rb:206:in
> `split_on_commas'
It looks like you have some crazy long recipient email in some list
that's triggering worst-case behavior in a regexp. Can you try again
after applying this patch, please? (And I'd be curious how long the
address list was, if you find out what message is triggering this.)
diff --git a/lib/sup/person.rb b/lib/sup/person.rb
index 4b1c80b..dbedc79 100644
--- a/lib/sup/person.rb
+++ b/lib/sup/person.rb
@@ -105,6 +105,10 @@ class Person
def self.from_address_list ss
return [] if ss.nil?
+ ## #split_on_commas has some bad behavior for long strings. so here we do
+ ## something nasty and just truncate the string at the nearest comma <= 500
+ ## characters.
+ ss = ss[0, ss.rindex(",", 500)] if ss.length > 500
ss.split_on_commas.map { |s| self.from_address s }
end
--
William <wmorgan-sup@masanjin.net>
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2009-11-02 12:42 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2009-10-30 17:17 [sup-talk] Recovering a busted ferret db? Steven Walter
2009-10-30 21:48 ` William Morgan
2009-10-30 22:14 ` Steven Walter
2009-11-01 14:53 ` William Morgan
[not found] ` <e06498070911011203s66ece542mac80378442073369@mail.gmail.com>
2009-11-02 11:53 ` William Morgan
2009-11-02 12:35 ` William Morgan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox