* [sup-talk] message add speedup
@ 2009-04-27 0:07 William Morgan
0 siblings, 0 replies; only message in thread
From: William Morgan @ 2009-04-27 0:07 UTC (permalink / raw)
I've merged a branch 'scanning-speedup' into next that doubles the speed
of adding messages to the index. There was a lot of time wasted in
parsing the email headers, which I fixed, and I tweaked a couple other
things. Various other operations that load data from the message source,
like viewing a message thread, should now be slightly faster.
I'm able to index around 70 messages/s on my home computer, which is
still slow, but hey, twice as fast as 35. Time is split about 50/50
between scanning/parsing and Ferret index writing. Sadly, Ruby has a
GIL, so I don't think threading these two operations will buy very much.
(Though there might be complicated ways of getting around that.)
--
William <wmorgan-sup at masanjin.net>
^ permalink raw reply [flat|nested] only message in thread
only message in thread, other threads:[~2009-04-27 0:07 UTC | newest]
Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2009-04-27 0:07 [sup-talk] message add speedup William Morgan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox