* [sup-talk] Fwd: Re: [Ferret-trac] #279: IO Error - Error reading the segment infos
@ 2007-08-15 5:17 William Morgan
2007-08-18 12:18 ` [sup-talk] " jeff covey
0 siblings, 1 reply; 4+ messages in thread
From: William Morgan @ 2007-08-15 5:17 UTC (permalink / raw)
Fore those following the index.c:901 error, here's a potential reason
why Ferret might be doing this: too many open filehandles. If you can
reproduce this, try increasing the max open filehandle limit and see if
that helps things.
--- Begin forwarded message from Ferret ---
From: Ferret <trac at davebalmain.com>
Cc: dbalmain <dbalmain at gmail.com>
Date: Wed, 15 Aug 2007 05:52:27 -0000
Subject: Re: [Ferret-trac] #279: IO Error - Error reading the segment infos
#279: IO Error - Error reading the segment infos
--------------------------------------+-------------------------------------
Reporter: dennis at dennisschaaf.com | Owner: somebody
Type: defect | Status: reopened
Priority: major | Milestone:
Component: component1 | Version:
Resolution: | Keywords:
--------------------------------------+-------------------------------------
Comment (by dennis at dennisschaaf.com):
This guy mentions that there seems to be a limit with too many open files.
Could it be that ferret is not closing files properly? I don't know where
in the source i'd look but i'll try.
http://www.ruby-forum.com/topic/120609
--- End forwarded message ---
--
William <wmorgan-sup at masanjin.net>
^ permalink raw reply [flat|nested] 4+ messages in thread* [sup-talk] [Ferret-trac] #279: IO Error - Error reading the segment infos
2007-08-15 5:17 [sup-talk] Fwd: Re: [Ferret-trac] #279: IO Error - Error reading the segment infos William Morgan
@ 2007-08-18 12:18 ` jeff covey
2007-08-27 20:32 ` William Morgan
0 siblings, 1 reply; 4+ messages in thread
From: jeff covey @ 2007-08-18 12:18 UTC (permalink / raw)
on Tue, Aug 14, 2007 at 10:17:46PM -0700%, William Morgan said:
> Fore those following the index.c:901 error, here's a potential reason why
> Ferret might be doing this: too many open filehandles. If you can
> reproduce this, try increasing the max open filehandle limit and see if
> that helps things.
i tried this, setting it to 32768 as he recommended, then adding my archive
sources from the beginning of the year (i had been working with just
messages from the past month). it caused a lot of exceptions in sup and
some segmentation faults in ruby. i tried resetting the limit to 1024, and
got the exception below.
i think i'll have to assume sup/ferret can't handle many sources and change
my archiving system to accommodate.
[Sat Aug 18 08:07:54 -0400 2007] stopped cursing
[Sat Aug 18 08:07:54 -0400 2007] oh crap, an exception
[Sat Aug 18 08:07:54 -0400 2007] unlocking /home/jeff/.sup/lock...
----------------------------------------------------------------
I'm very sorry, but it seems that an error occurred in Sup.
Please accept my sincere apologies. If you don't mind, please
send the backtrace below and a brief report of the circumstances
to sup-talk at rubyforge dot orgs so that I might address this
problem. Thank you!
Sincerely,
William
----------------------------------------------------------------
The problem was: 'Too many open files - /home/jeff/mail/turbotax at mailca.custhelp.com-2007-02' (error type Errno::EMFILE)
A backtrace follows:
./lib/sup/mbox/loader.rb:20:in `initialize': Too many open files - /home/jeff/mail/turbotax at mailca.custhelp.com-2007-02 (Errno::EMFILE)
from ./lib/sup/mbox/loader.rb:20:in `open'
from ./lib/sup/mbox/loader.rb:20:in `initialize'
from ./lib/sup.rb:28:in `new'
from ./lib/sup.rb:28:in `yaml_properties'
from /usr/lib/ruby/1.8/yaml.rb:133:in `call'
from /usr/lib/ruby/1.8/yaml.rb:133:in `transfer'
from /usr/lib/ruby/1.8/yaml.rb:133:in `node_import'
from /usr/lib/ruby/1.8/yaml.rb:133:in `load'
... 6 levels...
from ./lib/sup/index.rb:101:in `load'
from ./lib/sup/util.rb:401:in `send'
from ./lib/sup/util.rb:401:in `method_missing'
from bin/sup:89
checking for messages to delete...
./lib/sup/util.rb:7: warning: method redefined; discarding old gen_lock_id
./lib/sup/util.rb:18: warning: method redefined; discarding old dump_lock_id
./lib/sup/mbox/loader.rb:20:in `initialize': Too many open files - /home/jeff/mail/turbotax at mailca.custhelp.com-2007-02 (Errno::EMFILE)
from ./lib/sup/mbox/loader.rb:20:in `open'
from ./lib/sup/mbox/loader.rb:20:in `initialize'
from ./lib/sup.rb:28:in `new'
from ./lib/sup.rb:28:in `yaml_properties'
from /usr/lib/ruby/1.8/yaml.rb:133:in `call'
from /usr/lib/ruby/1.8/yaml.rb:133:in `transfer'
from /usr/lib/ruby/1.8/yaml.rb:133:in `node_import'
from /usr/lib/ruby/1.8/yaml.rb:133:in `load'
from /usr/lib/ruby/1.8/yaml.rb:133:in `load'
from /usr/lib/ruby/1.8/yaml.rb:144:in `load_file'
from /usr/lib/ruby/1.8/yaml.rb:143:in `open'
from /usr/lib/ruby/1.8/yaml.rb:143:in `load_file'
from ./lib/sup.rb:99:in `load_yaml_obj'
from ./lib/sup/index.rb:348:in `load_sources'
from ./lib/sup/index.rb:101:in `load'
from bin/sup-dump:25
thanks,
--
jeff covey
http://jeffcovey.net/
^ permalink raw reply [flat|nested] 4+ messages in thread* [sup-talk] [Ferret-trac] #279: IO Error - Error reading the segment infos
2007-08-18 12:18 ` [sup-talk] " jeff covey
@ 2007-08-27 20:32 ` William Morgan
2007-08-28 21:48 ` jeff covey
0 siblings, 1 reply; 4+ messages in thread
From: William Morgan @ 2007-08-27 20:32 UTC (permalink / raw)
Excerpts from jeff.covey's message of Sat Aug 18 05:18:15 -0700 2007:
> i tried this, setting it to 32768 as he recommended, then adding my
> archive sources from the beginning of the year (i had been working
> with just messages from the past month). it caused a lot of
> exceptions in sup and some segmentation faults in ruby.
Sup does keep a filehandle open to every mbox source. Since sources
aren't read except when you open a thread-view-mode, it probably
wouldn't be too bad to just open them on demand. That might help.
--
William <wmorgan-sup at masanjin.net>
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2007-08-28 21:48 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2007-08-15 5:17 [sup-talk] Fwd: Re: [Ferret-trac] #279: IO Error - Error reading the segment infos William Morgan
2007-08-18 12:18 ` [sup-talk] " jeff covey
2007-08-27 20:32 ` William Morgan
2007-08-28 21:48 ` jeff covey
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox