community/pipermail-archives/sup-talk/2009-07.txt (248372B) - raw
1 From jim@gonzul.net Wed Jul 1 01:20:10 2009
2 From: jim@gonzul.net (Jim Cheetham)
3 Date: Wed, 1 Jul 2009 17:20:10 +1200
4 Subject: [sup-talk] Character encoding when displaying quoted-printable
5 messages
6 In-Reply-To: <f4cc59760906171439q1b8983adw2008843b1ec02990@mail.gmail.com>
7 References: <f4cc59760906171439q1b8983adw2008843b1ec02990@mail.gmail.com>
8 Message-ID: <f4cc59760906302220v1595b4a8xf600a96747d2c408@mail.gmail.com>
9
10 On Thu, Jun 18, 2009 at 9:39 AM, Jim Cheetham<jim at gonzul.net> wrote:
11 > However, I'm coming across some character decoding issues with
12 > quoted-printable that are making some messages hard to read. Any
13 > advice on how to improve things would be welcome ... In the example
14 > below, a NBSP entity is showing up as the characters "M-BM-"
15
16 Nicely fixed by using the hack ncursesw branch, by the way.
17 http://sup.rubyforge.org/wiki/wiki.pl?UTF8
18
19 -jim
20
21 From ingmar@exherbo.org Wed Jul 1 04:38:36 2009
22 From: ingmar@exherbo.org (Ingmar Vanhassel)
23 Date: Wed, 01 Jul 2009 10:38:36 +0200
24 Subject: [sup-talk] ncurses-ruby-1.2.3 + ncursesw hack breaks search
25 In-Reply-To: <f4cc59760906302220v1595b4a8xf600a96747d2c408@mail.gmail.com>
26 References: <f4cc59760906171439q1b8983adw2008843b1ec02990@mail.gmail.com>
27 <f4cc59760906302220v1595b4a8xf600a96747d2c408@mail.gmail.com>
28 Message-ID: <1246437271-sup-7636@cannonball>
29
30 Excerpts from Jim Cheetham's message of Wed Jul 01 07:20:10 +0200 2009:
31 > Nicely fixed by using the hack ncursesw branch, by the way.
32 > http://sup.rubyforge.org/wiki/wiki.pl?UTF8
33
34 Has anyone noticed that newer versions of ncurses-ruby plus that
35 ncursesw hack [1] (to link to ncurses with widechar support) breaks search?
36
37 When I search for 'foo', sup launches a search for a bunch of weird
38 characters, not for 'foo', which obviously returns nothing useful.
39
40 I can trigger this with ncurses-ruby 1.2.2, 1.2.3. Version 1.1 seems to
41 be unaffected.
42
43 [1] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=477366#52
44 --
45 Exherbo KDE, X.org maintainer
46
47 From helgedt@tihlde.org Wed Jul 1 05:20:05 2009
48 From: helgedt@tihlde.org (Helge Titlestad)
49 Date: Wed, 01 Jul 2009 11:20:05 +0200
50 Subject: [sup-talk] Sup crash when adding CC to forwarded message
51 Message-ID: <1246439829-sup-6907@colargol.tihlde.org>
52
53 Hi,
54 sup 0.8 just crashed on me. What I did was:
55 * From thread-view, hit "f" to forward.
56 * Enter address to forward to.
57 * Just hit "enter" when asked for CC.
58 * Save message (unedited).
59 * Hit "c" to edit CC
60 -> crash
61
62 This is reproducible (only tried on one message, though.)
63
64 bt:
65 --- NoMethodError from thread: main
66 undefined method `join' for "":String
67 /home/xhs/helgedt/gems/gems/sup-0.8/lib/sup/modes/edit-message-mode.rb:414:in `edit_field'
68 /home/xhs/helgedt/gems/gems/sup-0.8/lib/sup/modes/edit-message-mode.rb:119:in `edit_cc'
69 /home/xhs/helgedt/gems/gems/sup-0.8/lib/sup/mode.rb:50:in `send'
70 /home/xhs/helgedt/gems/gems/sup-0.8/lib/sup/mode.rb:50:in `handle_input'
71 /home/xhs/helgedt/gems/gems/sup-0.8/lib/sup/buffer.rb:249:in `handle_input'
72 /home/xhs/helgedt/gems/gems/sup-0.8/bin/sup:238
73 /home/xhs/helgedt/gems/bin/sup:19:in `load'
74 /home/xhs/helgedt/gems/bin/sup:19
75 --
76 alge
77
78 From jim@gonzul.net Wed Jul 1 05:48:30 2009
79 From: jim@gonzul.net (Jim Cheetham)
80 Date: Wed, 1 Jul 2009 21:48:30 +1200
81 Subject: [sup-talk] sent_source - singular or per-account?
82 Message-ID: <f4cc59760907010248r5598eb50sf29b3ae8f500e5f8@mail.gmail.com>
83
84 It looks like there is only one place that outbound mail can be stored
85 -- sent_source in config.yaml specifies it globally.
86
87 I'd like to be able to save outgoing email into the mailstore for the
88 matching account; can anyone suggest some way to do this? Hacking code
89 is an option, although I'd appreciate some pointers ...
90
91 From wmorgan-sup@masanjin.net Wed Jul 1 11:28:46 2009
92 From: wmorgan-sup@masanjin.net (William Morgan)
93 Date: Wed, 01 Jul 2009 08:28:46 -0700
94 Subject: [sup-talk] ncurses-ruby-1.2.3 + ncursesw hack breaks search
95 In-Reply-To: <1246437271-sup-7636@cannonball>
96 References: <f4cc59760906171439q1b8983adw2008843b1ec02990@mail.gmail.com>
97 <f4cc59760906302220v1595b4a8xf600a96747d2c408@mail.gmail.com>
98 <1246437271-sup-7636@cannonball>
99 Message-ID: <1246461233-sup-208@entry>
100
101 Reformatted excerpts from Ingmar Vanhassel's message of 2009-07-01:
102 > [1] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=477366#52
103
104 Interesting thread. I disagree with the conclusion that a separate
105 libncursesw-ruby package should be created. Maybe I'll respond.
106
107 The analysis of Sup is wrong. He says: "Looking at the source code of
108 the mailer I'd say that it is not really suited for UTF-8 encoded
109 strings yet, as it still assumes that the length of a string in bytes is
110 equal to the number of characters in the string." This is not really
111 true. What Sup assumes is that String#length gives the length of the
112 string in characters. This is obviously false in Ruby 1.8 (without
113 monkeypatching), but it is true in Ruby 1.9.
114
115 What *does* need to happen for Sup to really, actually, correctly
116 display non-ASCII characters, besides having a ncurses library that's
117 linked against ncursesw, is to be able to call the 'wcwidth' and
118 'wcswidth' functions. The current #display_length function is a hack
119 that's broken for e.g. Chinese characters.
120
121 One way to do this would be to use dl/import like we do for setlocale().
122 I've played around with this but haven't really gotten it to work. If
123 someone can get any further than the below, please let me know:
124
125 require 'dl/import'
126 module LibC
127 extend DL.const_defined?(:Importer) ? DL::Importer : DL::Importable
128 dlload "libc.so.6"
129 extern "void setlocale(int, const char *)"
130 extern "int wcwidth(int)"
131 extern "int wcswidth(const int*, int)"
132 end
133
134 That "works", as in doesn't throw any exceptions, but then calling
135 LibC.wcswidth doesn't return the right thing, presumably because the
136 Ruby string isn't being converted into an array of ints, or something. I
137 don't really know how this works.
138
139 > Has anyone noticed that newer versions of ncurses-ruby plus that
140 > ncursesw hack [1] (to link to ncurses with widechar support) breaks
141 > search?
142
143 I don't have these newer versions available on my system yet (Ubuntu).
144
145 > When I search for 'foo', sup launches a search for a bunch of weird
146 > characters, not for 'foo', which obviously returns nothing useful.
147
148 Disturbing.
149 --
150 William <wmorgan-sup at masanjin.net>
151
152 From bachjh@googlemail.com Wed Jul 1 11:42:04 2009
153 From: bachjh@googlemail.com (Jörg-Hendrik Bach)
154 Date: Wed, 01 Jul 2009 17:42:04 +0200
155 Subject: [sup-talk] ncurses-ruby-1.2.3 + ncursesw hack breaks search
156 In-Reply-To: <1246437271-sup-7636@cannonball>
157 References: <f4cc59760906171439q1b8983adw2008843b1ec02990@mail.gmail.com>
158 <f4cc59760906302220v1595b4a8xf600a96747d2c408@mail.gmail.com>
159 <1246437271-sup-7636@cannonball>
160 Message-ID: <1246462442-sup-1884@BlackMesa>
161
162 Ingmar Vanhassel, Wed Jul 01 10:38:36 +0200 2009:
163
164 > Has anyone noticed that newer versions of ncurses-ruby plus that
165 > ncursesw hack [1] (to link to ncurses with widechar support) breaks search?
166
167 I can confirm the behaviour.
168
169 > When I search for 'foo', sup launches a search for a bunch of weird
170 > characters, not for 'foo', which obviously returns nothing useful.
171
172 True. However, with the following workaround, you can get proper search results:
173 - search for foo -> garbled search, no proper results
174 - hit 'x' to destroy the result buffer
175 - hit '\' to search again.
176 - hit uparrow to go to previous search. backspace all the garbled characters there.
177 - repeat the uparrow + remove until it shows your last working search (or until there's no more previous search to go to)
178 - type foo again, hit enter: works.
179
180 Not that this is the type of thing you'd want to do for a simple search. Guess we'll have to wait for ruby 1.9?
181
182 cheers,
183 - J?rg-Hendrik
184
185
186 >
187 > I can trigger this with ncurses-ruby 1.2.2, 1.2.3. Version 1.1 seems to
188 > be unaffected.
189 >
190 > [1] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=477366#52
191
192 From ingmar@exherbo.org Wed Jul 1 11:29:22 2009
193 From: ingmar@exherbo.org (Ingmar Vanhassel)
194 Date: Wed, 01 Jul 2009 17:29:22 +0200
195 Subject: [sup-talk] Sup on Ruby-1.9
196 Message-ID: <1246461780-sup-5146@cannonball>
197
198 Has anyone been keeping a TODO list for running sup on ruby-1.9?
199
200 I haven't had the time to try it myself, but I'd like to have a rough
201 idea of what I'm looking at.
202
203 --
204 Exherbo KDE, X.org maintainer
205
206 From wmorgan-sup@masanjin.net Wed Jul 1 14:11:37 2009
207 From: wmorgan-sup@masanjin.net (William Morgan)
208 Date: Wed, 01 Jul 2009 11:11:37 -0700
209 Subject: [sup-talk] Sup on Ruby-1.9
210 In-Reply-To: <1246461780-sup-5146@cannonball>
211 References: <1246461780-sup-5146@cannonball>
212 Message-ID: <1246471261-sup-3755@entry>
213
214 Reformatted excerpts from Ingmar Vanhassel's message of 2009-07-01:
215 > Has anyone been keeping a TODO list for running sup on ruby-1.9?
216
217 The major blocker for a while was the Ferret gem. With the advent of the
218 Xapian branch, I have been toying around with getting Sup + Xapian to
219 work on 1.9.1. So far all the gem dependencies seem to compile except
220 ncurses, which needs some minor code tweaks.
221
222 The latest Xapian has Ruby 1.9.1-compatible bindings, but unfortunately
223 the API seems to have shifted since Rich's patches. I get:
224
225 lib/sup/xapian_index.rb:24:in `initialize': Wrong arguments for overloaded method 'WritableDatabase.new'. (ArgumentError)
226 Possible C/C++ prototypes are:
227 WritableDatabase.new()
228 WritableDatabase.new(std::string const &path, int action)
229 WritableDatabase.new(Xapian::WritableDatabase const &other)
230 from lib/sup/xapian_index.rb:24:in `new'
231 from lib/sup/xapian_index.rb:24:in `initialize'
232 from bin/sup:132:in `new'
233 from bin/sup:132:in `<module:Redwood>'
234 from bin/sup:62:in `<main>'
235
236 Moving to 1.9 is highly desirable. It would be a major win for non-ASCII
237 display issues and for speed in general. I would also like to try moving
238 some of the display code from threads to fibers, since there are still
239 weird threading bugs in there that occasionally crop up, and I think it
240 would simplify the implementation.
241 --
242 William <wmorgan-sup at masanjin.net>
243
244 From wmorgan-sup@masanjin.net Wed Jul 1 14:19:27 2009
245 From: wmorgan-sup@masanjin.net (William Morgan)
246 Date: Wed, 01 Jul 2009 11:19:27 -0700
247 Subject: [sup-talk] Sup crash when adding CC to forwarded message
248 In-Reply-To: <1246439829-sup-6907@colargol.tihlde.org>
249 References: <1246439829-sup-6907@colargol.tihlde.org>
250 Message-ID: <1246472248-sup-591@entry>
251
252 Hi Helge,
253
254 Reformatted excerpts from Helge Titlestad's message of 2009-07-01:
255 > sup 0.8 just crashed on me. What I did was:
256 > * From thread-view, hit "f" to forward.
257 > * Enter address to forward to.
258 > * Just hit "enter" when asked for CC.
259 > * Save message (unedited).
260 > * Hit "c" to edit CC
261 > -> crash
262 >
263 > This is reproducible (only tried on one message, though.)
264
265 I can't reproduce this. Does it happen on all messages, or just on that
266 one? Does it happen if you specify someting for the cc: header?
267
268 Thanks!
269 --
270 William <wmorgan-sup at masanjin.net>
271
272 From wmorgan-sup@masanjin.net Wed Jul 1 14:23:09 2009
273 From: wmorgan-sup@masanjin.net (William Morgan)
274 Date: Wed, 01 Jul 2009 11:23:09 -0700
275 Subject: [sup-talk] Delete single message in thread-view?
276 In-Reply-To: <1245415127-sup-2107@thinkpad-ubuntu>
277 References: <1245415127-sup-2107@thinkpad-ubuntu>
278 Message-ID: <1246472570-sup-6752@entry>
279
280 Reformatted excerpts from Christopher Bertels's message of 2009-06-19:
281 > Is it possible to delete a single message from a thread? I haven't
282 > found a way to do this, but maybe I'm just blind.
283
284 Not currently. Sorry! It's all or nothing for now.
285 --
286 William <wmorgan-sup at masanjin.net>
287
288 From helgedt@tihlde.org Wed Jul 1 14:54:20 2009
289 From: helgedt@tihlde.org (Helge Titlestad)
290 Date: Wed, 01 Jul 2009 20:54:20 +0200
291 Subject: [sup-talk] Sup crash when adding CC to forwarded message
292 In-Reply-To: <1246472248-sup-591@entry>
293 References: <1246439829-sup-6907@colargol.tihlde.org>
294 <1246472248-sup-591@entry>
295 Message-ID: <1246474215-sup-7272@colargol.tihlde.org>
296
297 Excerpts from William Morgan's message of Wed Jul 01 20:19:27 +0200 2009:
298 >> [Adding CC crash procedure]
299 >
300 > I can't reproduce this. Does it happen on all messages, or just on that
301 > one? Does it happen if you specify someting for the cc: header?
302
303 It's stopped being reproducible now. \:
304
305 For the record, there was one "?" in the subject field. Probably shouldn't
306 be related, but you never know with these utf-8 woes. (:
307 --
308 alge
309
310 From wmorgan-sup@masanjin.net Wed Jul 1 14:57:55 2009
311 From: wmorgan-sup@masanjin.net (William Morgan)
312 Date: Wed, 01 Jul 2009 11:57:55 -0700
313 Subject: [sup-talk] Sup crash when adding CC to forwarded message
314 In-Reply-To: <1246474215-sup-7272@colargol.tihlde.org>
315 References: <1246439829-sup-6907@colargol.tihlde.org>
316 <1246472248-sup-591@entry>
317 <1246474215-sup-7272@colargol.tihlde.org>
318 Message-ID: <1246474654-sup-137@entry>
319
320 Reformatted excerpts from Helge Titlestad's message of 2009-07-01:
321 > For the record, there was one "?" in the subject field. Probably
322 > shouldn't be related, but you never know with these utf-8 woes. (:
323
324 I'd be surprised... but yeah, who knows!
325 --
326 William <wmorgan-sup at masanjin.net>
327
328 From wmorgan-sup@masanjin.net Wed Jul 1 15:15:45 2009
329 From: wmorgan-sup@masanjin.net (William Morgan)
330 Date: Wed, 01 Jul 2009 12:15:45 -0700
331 Subject: [sup-talk] Sup on Ruby-1.9
332 In-Reply-To: <1246471261-sup-3755@entry>
333 References: <1246461780-sup-5146@cannonball> <1246471261-sup-3755@entry>
334 Message-ID: <1246475697-sup-7574@entry>
335
336 Reformatted excerpts from William Morgan's message of 2009-07-01:
337 > The latest Xapian has Ruby 1.9.1-compatible bindings, but unfortunately
338 > the API seems to have shifted since Rich's patches.
339
340 Hm, AFAIK that isn't an API change. Maybe I compiled my Xapian bindings
341 wrong somehow. Or something.
342 --
343 William <wmorgan-sup at masanjin.net>
344
345 From bwalton@artsci.utoronto.ca Wed Jul 1 15:39:57 2009
346 From: bwalton@artsci.utoronto.ca (Ben Walton)
347 Date: Wed, 01 Jul 2009 15:39:57 -0400
348 Subject: [sup-talk] sent_source - singular or per-account?
349 In-Reply-To: <f4cc59760907010248r5598eb50sf29b3ae8f500e5f8@mail.gmail.com>
350 References: <f4cc59760907010248r5598eb50sf29b3ae8f500e5f8@mail.gmail.com>
351 Message-ID: <1246476925-sup-5046@ntdws12.chass.utoronto.ca>
352
353 Excerpts from Jim Cheetham's message of Wed Jul 01 05:48:30 -0400 2009:
354 > I'd like to be able to save outgoing email into the mailstore for the
355 > matching account; can anyone suggest some way to do this? Hacking code
356 > is an option, although I'd appreciate some pointers ...
357
358 This is an interesting idea. I think the best way to do it might be
359 to implement a sent_source hook that can override the global default.
360 It would be wise to either a) not use mbox or b) have dedicated mboxes
361 for this purpose...until I finally get around to finishing the lock
362 manager to make shared access safe.
363
364 The other gotcha with a hook to pick the source for message storage is
365 that not all sources are capable of storing mail presently (mbox,
366 maildir and imap are the only supported types, which admittedly should
367 cover most people).
368
369 I think this would be quite simple to add.
370
371 I've also toyed around with the idea of 'patterned' sources so that
372 you could specify a source as maildir:///u/bwalton/Maildir/inbox-%Y%m
373 and have new sources picked up automatically as they're created
374 (possibly by procmail doing autofiling, or something).
375
376 -Ben
377 --
378 Ben Walton
379 Systems Programmer - CHASS
380 University of Toronto
381 C:416.407.5610 | W:416.978.4302
382
383 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
384 Contact me to arrange for a CAcert assurance meeting.
385 -------------- next part --------------
386 A non-text attachment was scrubbed...
387 Name: signature.asc
388 Type: application/pgp-signature
389 Size: 189 bytes
390 Desc: not available
391 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090701/64c4a100/attachment.bin>
392
393 From andrea.fazzi@alcacoop.it Wed Jul 1 16:07:22 2009
394 From: andrea.fazzi@alcacoop.it (Andrea Fazzi)
395 Date: Wed, 01 Jul 2009 22:07:22 +0200
396 Subject: [sup-talk] Reconnect command
397 Message-ID: <1246478645-sup-1505@ganimoide>
398
399 Hi all,
400
401 finally I found the mail client I was searching for :) So, thanks for this
402 great software.
403
404 Sometime, it happens that I lost my internet connection (e.g. after a
405 suspend/resume). Occasionally I noticed that, after the connection is
406 restored, sup can't polling for new messages anymore. At the moment, I
407 "fix" the issue restarting sup. In fact, it seems that doing a new login to
408 the imap server solves the problem and I can fetch the new messages. I know
409 I should investigate deeper and I'll do. But now I wonder if a "reconnect"
410 command can be an useful feature. Thoughts?
411
412 Cheers,
413 Andrea
414 --
415 Andrea Fazzi @ Alca Societ? Cooperativa
416 Follow me on http://twitter.com/remogatto
417
418 From jim@gonzul.net Wed Jul 1 22:30:25 2009
419 From: jim@gonzul.net (Jim Cheetham)
420 Date: Thu, 2 Jul 2009 14:30:25 +1200
421 Subject: [sup-talk] sent_source - singular or per-account?
422 In-Reply-To: <1246476925-sup-5046@ntdws12.chass.utoronto.ca>
423 References: <f4cc59760907010248r5598eb50sf29b3ae8f500e5f8@mail.gmail.com>
424 <1246476925-sup-5046@ntdws12.chass.utoronto.ca>
425 Message-ID: <f4cc59760907011930x4678e623j33a777ef03b7da55@mail.gmail.com>
426
427 On Thu, Jul 2, 2009 at 7:39 AM, Ben Walton<bwalton at artsci.utoronto.ca> wrote:
428 > Excerpts from Jim Cheetham's message of Wed Jul 01 05:48:30 -0400 2009:
429 >> I'd like to be able to save outgoing email into the mailstore for the
430 >> matching account; can anyone suggest some way to do this? Hacking code
431 >> is an option, although I'd appreciate some pointers ...
432 >
433 > This is an interesting idea. ?I think the best way to do it might be
434 > to implement a sent_source hook that can override the global default.
435
436 'best' or 'simplest'?
437
438 There already exists logic for determining which account a given
439 outgoing message belongs to, because that's how the :sendmail: target
440 is being used.
441
442 If you are arguing that having a different sent_source per (outgoing)
443 message is useful, then perhaps a hook makes sense; but the simpler
444 case probably doesn't need it.
445
446 > It would be wise to either a) not use mbox or b) have dedicated mboxes
447 > for this purpose...until I finally get around to finishing the lock
448 > manager to make shared access safe.
449
450 Certainly the sent_source mbox shouldn't be subject to something
451 inconvenient like delivery of new mail while we're updating it :-) but
452 I'm not sure that mbox people would be unhappy having sent mail in a
453 separate file ... ?
454
455 -jim
456
457 From bwalton@artsci.utoronto.ca Wed Jul 1 23:17:57 2009
458 From: bwalton@artsci.utoronto.ca (Ben Walton)
459 Date: Wed, 01 Jul 2009 23:17:57 -0400
460 Subject: [sup-talk] sent_source - singular or per-account?
461 In-Reply-To: <f4cc59760907011930x4678e623j33a777ef03b7da55@mail.gmail.com>
462 References: <f4cc59760907010248r5598eb50sf29b3ae8f500e5f8@mail.gmail.com>
463 <1246476925-sup-5046@ntdws12.chass.utoronto.ca>
464 <f4cc59760907011930x4678e623j33a777ef03b7da55@mail.gmail.com>
465 Message-ID: <1246502666-sup-1295@ntdws12.chass.utoronto.ca>
466
467 Excerpts from Jim Cheetham's message of Wed Jul 01 22:30:25 -0400 2009:
468 > On Thu, Jul 2, 2009 at 7:39 AM, Ben Walton<bwalton at artsci.utoronto.ca> wrote:
469 > > Excerpts from Jim Cheetham's message of Wed Jul 01 05:48:30 -0400 2009:
470 > >> I'd like to be able to save outgoing email into the mailstore for the
471 > >> matching account; can anyone suggest some way to do this? Hacking code
472 > >> is an option, although I'd appreciate some pointers ...
473 > >
474 > > This is an interesting idea. ?I think the best way to do it might be
475 > > to implement a sent_source hook that can override the global default.
476 >
477 > 'best' or 'simplest'?
478
479 Both?
480
481 > There already exists logic for determining which account a given
482 > outgoing message belongs to, because that's how the :sendmail:
483 > target is being used.
484 >
485 > If you are arguing that having a different sent_source per (outgoing)
486 > message is useful, then perhaps a hook makes sense; but the simpler
487 > case probably doesn't need it.
488
489 I'm not arguing anything, and perhaps using sent_source as the
490 (hypothetical) hook name was a bad choice...
491
492 If I'm understanding you correctly, you want to write to a different
493 source depending on which address is used in the From. You'd either
494 need to make a separate config entry in each account that gets setup
495 (similar to the sendmail that you note) or provide the ability for the
496 user to select the sent box in some other way.
497
498 In the 'simpler' case where the decision is made based on account
499 used, you've got a chunk of static code making the choice and
500 defaulting as it would now. The hook would simply take the place of
501 the static decision maker. The decision has to be made per message
502 regardless of how it's implemented, so doing it in a hook is a better
503 option, imo. The Hook route would be slightly slower, since there are
504 extra activation records on the stack for the function calls, but it
505 should be negligible.
506
507 The other advantage to a Hook is that the decision could be made based
508 on more than simply the From:. Maybe other users would prefer to
509 store mail based on who it was sent To...or a combo of From/To?
510
511 I'm interested in William's thoughts on this. It's not a feature I'd
512 use, but I do think it's a good feature to have.
513
514 I hope this explains my thinking more clearly.
515
516 -Ben
517 --
518 Ben Walton
519 Systems Programmer - CHASS
520 University of Toronto
521 C:416.407.5610 | W:416.978.4302
522
523 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
524 Contact me to arrange for a CAcert assurance meeting.
525 -------------- next part --------------
526 A non-text attachment was scrubbed...
527 Name: signature.asc
528 Type: application/pgp-signature
529 Size: 189 bytes
530 Desc: not available
531 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090701/eb941c06/attachment.bin>
532
533 From jim@gonzul.net Thu Jul 2 06:14:23 2009
534 From: jim@gonzul.net (Jim Cheetham)
535 Date: Thu, 2 Jul 2009 22:14:23 +1200
536 Subject: [sup-talk] sent_source - singular or per-account?
537 In-Reply-To: <1246502666-sup-1295@ntdws12.chass.utoronto.ca>
538 References: <f4cc59760907010248r5598eb50sf29b3ae8f500e5f8@mail.gmail.com>
539 <1246476925-sup-5046@ntdws12.chass.utoronto.ca>
540 <f4cc59760907011930x4678e623j33a777ef03b7da55@mail.gmail.com>
541 <1246502666-sup-1295@ntdws12.chass.utoronto.ca>
542 Message-ID: <f4cc59760907020314o60100e01r1a1f8af4d354030a@mail.gmail.com>
543
544 On Thu, Jul 2, 2009 at 3:17 PM, Ben Walton<bwalton at artsci.utoronto.ca> wrote:
545 > Excerpts from Jim Cheetham's message of Wed Jul 01 22:30:25 -0400 2009:
546 > If I'm understanding you correctly, you want to write to a different
547 > source depending on which address is used in the From.
548
549 Almost; what I (could have) said was that I wanted to write to a
550 different source depending on which account is in use for the current
551 message; I wasn't fixating on the From address itself, although with a
552 better understanding of the code you might declare that they are
553 effectively the same anyway :-)
554
555
556 > ?You'd either
557 > need to make a separate config entry in each account that gets setup
558 > (similar to the sendmail that you note) or provide the ability for the
559 > user to select the sent box in some other way.
560
561 Yes; and in either case I think we can't just override the current
562 global sent_source, because this is being used to read messages from,
563 in order to include them in the threads.
564
565 > In the 'simpler' case where the decision is made based on account
566 > used, you've got a chunk of static code making the choice and
567 > defaulting as it would now. ?The hook would simply take the place of
568 > the static decision maker. ?The decision has to be made per message
569 > regardless of how it's implemented, so doing it in a hook is a better
570 > option, imo. ?The Hook route would be slightly slower, since there are
571 > extra activation records on the stack for the function calls, but it
572 > should be negligible.
573
574 Mmm, I think the hook route would expose you to a lot of change,
575 because whenever a 'new' source (i.e. one not known about as load
576 time) is declared in the hook, you'll have to remember it so it can be
577 included in the index, and be available next time sup starts too.
578
579 Whereas requiring sent_sources to be declared at load time only means
580 they can be added as sources just like the current singular one is.
581
582 I've been browsing the source this evening, I don't have a very good
583 grasp of Ruby idiom but I do find it to be very readable in general
584 :-) However, I've come to a halt in SentManager.write_sent_message,
585 because I haven't figured out how @source.store_message relates to my
586 store URI, and therefore the relevant store_message function. I mean,
587 if :sent_store: is configured, how does @source get created from
588 @source_uri?
589
590 If we have multiple sent_sources, that contradicts the singleton
591 SentManager, unless @source becomes a hash keyed off from_email ... at
592 which point I'm pushing my Ruby skills too far for the evening.
593
594 Any comments or specific code pointers welcomed! I'd be happy to
595 attempt a patch for this, but I may need a little help ...
596
597 -jim
598
599 From bwalton@artsci.utoronto.ca Thu Jul 2 10:02:56 2009
600 From: bwalton@artsci.utoronto.ca (Ben Walton)
601 Date: Thu, 02 Jul 2009 10:02:56 -0400
602 Subject: [sup-talk] sent_source - singular or per-account?
603 In-Reply-To: <f4cc59760907020314o60100e01r1a1f8af4d354030a@mail.gmail.com>
604 References: <f4cc59760907010248r5598eb50sf29b3ae8f500e5f8@mail.gmail.com>
605 <1246476925-sup-5046@ntdws12.chass.utoronto.ca>
606 <f4cc59760907011930x4678e623j33a777ef03b7da55@mail.gmail.com>
607 <1246502666-sup-1295@ntdws12.chass.utoronto.ca>
608 <f4cc59760907020314o60100e01r1a1f8af4d354030a@mail.gmail.com>
609 Message-ID: <1246542975-sup-7239@ntdws12.chass.utoronto.ca>
610
611 Excerpts from Jim Cheetham's message of Thu Jul 02 06:14:23 -0400 2009:
612
613 > Almost; what I (could have) said was that I wanted to write to a
614 > different source depending on which account is in use for the
615 > current message; I wasn't fixating on the From address itself,
616 > although with a better understanding of the code you might declare
617 > that they are effectively the same anyway :-)
618
619 Ok. I _think_ that difference would come out in the wash, unless I'm
620 overlooking a subtlety. Thanks for clarifying your needs/wants
621 though.
622
623 > > ?You'd either need to make a separate config entry in each account
624 > > that gets setup (similar to the sendmail that you note) or provide
625 > > the ability for the user to select the sent box in some other way.
626 >
627 > Yes; and in either case I think we can't just override the current
628 > global sent_source, because this is being used to read messages from,
629 > in order to include them in the threads.
630
631 As long as sup is configured with all sources that might be returned
632 from the hook, including the default source, it should be ok. It'll
633 still poll all sources and thread messages appropriately.
634
635 > Mmm, I think the hook route would expose you to a lot of change,
636 > because whenever a 'new' source (i.e. one not known about as load
637 > time) is declared in the hook, you'll have to remember it so it can be
638 > included in the index, and be available next time sup starts too.
639
640 My take on this is that the hook would be constrained to return only
641 existing sources. On the other hand, aside from an initial import of
642 any existing mail in a new folder, I'm not sure that adding new
643 sources on the fly would be that bad.
644
645 > Whereas requiring sent_sources to be declared at load time only means
646 > they can be added as sources just like the current singular one is.
647
648 I was picturing the hook return value to be a uri suitable for passing
649 to Index.source_for. If that method call failed, the default would be
650 used. There are of course other (maybe better) ways to do this, but
651 that's what I was thinking last night. Using this technique, you're
652 limited to existing sources and you also have an easy way to back out
653 of a 'hook gone wild.'
654
655 > I've been browsing the source this evening, I don't have a very good
656 > grasp of Ruby idiom but I do find it to be very readable in general
657 > :-) However, I've come to a halt in SentManager.write_sent_message,
658
659 It is a beautiful, expressive language! :)
660
661 > because I haven't figured out how @source.store_message relates to my
662 > store URI, and therefore the relevant store_message function. I mean,
663 > if :sent_store: is configured, how does @source get created from
664 > @source_uri?
665
666 At startup, SentManager is initialized with a URI. This is either the
667 value of :sent_source: from config.yaml or the default (special) value
668 sup://sent. A little later on, after the Index has been initialized,
669 it is asked for the source that corresponds to the URI value passed to
670 SentManager. If this source is found in the Index, it is assigned to
671 the @source value. Otherwise, the SentManager.default_source method
672 is triggered.
673
674 So, when one of the message modes calls write_sent_message, it has
675 either a specific source or the default ready to go. Sources usable
676 by SentManager are constrained such that they must respond to
677 store_message. This excludes ssh+mbox URI's from being a valid sent
678 mail source.
679
680 > If we have multiple sent_sources, that contradicts the singleton
681 > SentManager, unless @source becomes a hash keyed off from_email ... at
682 > which point I'm pushing my Ruby skills too far for the evening.
683
684 I don't think it precludes it from being a singleton, but it would
685 require some heavy reworking of the initialization logic for it.
686
687 I just popped into sent.rb and was all set to knock out a patch to add
688 the hook and I discovered that my memory of this wasn't what I
689 thought. SentManager doesn't ever _see_ the message. It simply
690 facilitates calling the store_message method of whatever source is
691 configured and that source object in turn provides an object that acts
692 like an IO object to the edit-message-mode call site. This
693 complicates either approach discussed here since the determination of
694 which source to use can't be constrained to SentManager...presently,
695 it would end up in edit-message-mode, which wouldn't be the right spot
696 for the logic, I don't think.
697
698 More thinking required, I believe.
699
700 -Ben
701 --
702 Ben Walton
703 Systems Programmer - CHASS
704 University of Toronto
705 C:416.407.5610 | W:416.978.4302
706
707 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
708 Contact me to arrange for a CAcert assurance meeting.
709 -------------- next part --------------
710 A non-text attachment was scrubbed...
711 Name: signature.asc
712 Type: application/pgp-signature
713 Size: 189 bytes
714 Desc: not available
715 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090702/9f959f68/attachment.bin>
716
717 From ezyang@MIT.EDU Thu Jul 2 13:16:17 2009
718 From: ezyang@MIT.EDU (Edward Z. Yang)
719 Date: Thu, 02 Jul 2009 13:16:17 -0400
720 Subject: [sup-talk] Sup doesn't respect Reply-To header
721 Message-ID: <1246554940-sup-138@javelin>
722
723 It doesn't look like Sup respects Reply-To headers. Is this
724 intentional? It breaks some mailing list agents.
725
726 Cheers,
727 Edward
728
729 From bachjh@googlemail.com Fri Jul 3 12:05:23 2009
730 From: bachjh@googlemail.com (=?UTF-8?B?SsO2cmctSGVuZHJpayBCYWNo?=)
731 Date: Fri, 3 Jul 2009 18:05:23 +0200
732 Subject: [sup-talk] colour customisation
733 Message-ID: <91de50e10907030905l6673a7c3n380f6daeccfb14ab@mail.gmail.com>
734
735 Hello list,
736
737 is there any documentation on which parts of the display can be changed via the
738 .sup/colors.yaml? From the wiki entry[1] it is possible to figure out some of
739 the variables, but I haven't got all.
740
741 cheers,
742 - J?rg-Hendrik
743
744 [1] http://sup.rubyforge.org/wiki/wiki.pl?CustomizingColors
745
746 From garoth@gmail.com Fri Jul 3 13:13:29 2009
747 From: garoth@gmail.com (Andrei Thorp)
748 Date: Fri, 03 Jul 2009 13:13:29 -0400
749 Subject: [sup-talk] colour customisation
750 In-Reply-To: <91de50e10907030905l6673a7c3n380f6daeccfb14ab@mail.gmail.com>
751 References: <91de50e10907030905l6673a7c3n380f6daeccfb14ab@mail.gmail.com>
752 Message-ID: <1246641077-sup-9945@Longbow>
753
754 Excerpts from J?rg-Hendrik Bach's message of Fri Jul 03 12:05:23 -0400 2009:
755 > Hello list,
756 >
757 > is there any documentation on which parts of the display can be changed via the
758 > .sup/colors.yaml? From the wiki entry[1] it is possible to figure out some of
759 > the variables, but I haven't got all.
760
761 I don't really know, but from browsing the source briefly, I've
762 found (formatted as quote):
763
764 > DEFAULT_COLORS = {
765 > :status => { :fg => "white", :bg => "blue", :attrs => ["bold"] },
766 > :index_old => { :fg => "white", :bg => "default" },
767 > :index_new => { :fg => "white", :bg => "default", :attrs => ["bold"] },
768 > :index_starred => { :fg => "yellow", :bg => "default", :attrs => ["bold"] },
769 > :index_draft => { :fg => "red", :bg => "default", :attrs => ["bold"] },
770 > :labellist_old => { :fg => "white", :bg => "default" },
771 > :labellist_new => { :fg => "white", :bg => "default", :attrs => ["bold"] },
772 > :twiddle => { :fg => "blue", :bg => "default" },
773 > :label => { :fg => "yellow", :bg => "default" },
774 > :message_patina => { :fg => "black", :bg => "green" },
775 > :alternate_patina => { :fg => "black", :bg => "blue" },
776 > :missing_message => { :fg => "black", :bg => "red" },
777 > :attachment => { :fg => "cyan", :bg => "default" },
778 > :cryptosig_valid => { :fg => "yellow", :bg => "default", :attrs => ["bold"] },
779 > :cryptosig_unknown => { :fg => "cyan", :bg => "default" },
780 > :cryptosig_invalid => { :fg => "yellow", :bg => "red", :attrs => ["bold"] },
781 > :generic_notice_patina => { :fg => "cyan", :bg => "default" },
782 > :quote_patina => { :fg => "yellow", :bg => "default" },
783 > :sig_patina => { :fg => "yellow", :bg => "default" },
784 > :quote => { :fg => "yellow", :bg => "default" },
785 > :sig => { :fg => "yellow", :bg => "default" },
786 > :to_me => { :fg => "green", :bg => "default" },
787 > :starred => { :fg => "yellow", :bg => "default", :attrs => ["bold"] },
788 > :starred_patina => { :fg => "yellow", :bg => "green", :attrs => ["bold"] },
789 > :alternate_starred_patina => { :fg => "yellow", :bg => "blue", :attrs => ["bold"] },
790 > :snippet => { :fg => "cyan", :bg => "default" },
791 > :option => { :fg => "white", :bg => "default" },
792 > :tagged => { :fg => "yellow", :bg => "default", :attrs => ["bold"] },
793 > :draft_notification => { :fg => "red", :bg => "default", :attrs => ["bold"] },
794 > :completion_character => { :fg => "white", :bg => "default", :attrs => ["bold"] },
795 > :horizontal_selector_selected => { :fg => "yellow", :bg => "default", :attrs => ["bold"] },
796 > :horizontal_selector_unselected => { :fg => "cyan", :bg => "default" },
797 > :search_highlight => { :fg => "black", :bg => "yellow", :attrs => ["bold"] },
798 > :system_buf => { :fg => "blue", :bg => "default" },
799 > :regular_buf => { :fg => "white", :bg => "default" },
800 > :modified_buffer => { :fg => "yellow", :bg => "default", :attrs => ["bold"] },
801 > }
802
803 You can probably extrapolate how to do colouring based on this? If you
804 have the energy, please update the wiki to maybe mention this list, etc.
805 Last I saw, the page was fairly out of date.
806
807 Hope this helps,
808 --
809 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
810
811 From wmorgan-sup@masanjin.net Fri Jul 3 14:37:46 2009
812 From: wmorgan-sup@masanjin.net (William Morgan)
813 Date: Fri, 03 Jul 2009 11:37:46 -0700
814 Subject: [sup-talk] sup
815 In-Reply-To: <20090703173353.GA4117@gmx.de>
816 References: <20090703173353.GA4117@gmx.de>
817 Message-ID: <1246645330-sup-1433@entry>
818
819 [cc'ing sup-talk]
820
821 Hi Marc,
822
823 Reformatted excerpts from Marc Weber's message of 2009-07-03:
824 > I finally managed to package sup on nix. (nixos.org) and I'm ready to
825 > give sup a try.
826
827 Great!
828
829 > a) if ferret does save the whole messages you don't really need the
830 > original sources (maildir, mbox files), right?
831
832 That's basically correct, but:
833
834 a) Ferret doesn't store the entire message as represented in the
835 mailstore (e.g. it only keeps a subset of the headers).
836 b) Ferret has had corruption problems in the past, which I believe have
837 now been fixed, but I wouldn't bet my mailstore on it.
838 c) It's easy to turn that feature off, i.e., Ferret can index email for
839 search without directly storing the email. The only reason I have
840 Ferret store the email is because it makes changing the message
841 labels quicker. If the Ferret index is too large, you can disable
842 this feature at the expense of some speed.
843
844 > b) [redacted] on irc told me that ferret has been abandoned in favour of
845 > Xapian ? So are there any plans in replacing Ferret by Xapian as well?
846
847 It hasn't happened quite yet (the Xapian backend is very recent and
848 experimental), but that's the goal. I'm currently thinking about having
849 the next release of Sup use Xapian as the default index, but still
850 support Ferret, and the release after that not support Ferret at all.
851 But we shall see. I'm also working on a sup server, which will act as
852 yet another index type.
853
854 > c) I've got about 280MB of mails from the haskelcafe mailinglist or
855 > such. I missed telling sup to mark those old mails as read as well
856 > as adding a "haskell-cafe" tag. It's not a big problem because all
857 > mails contain [haskell-cafe] in the subject. However finding all
858 > threads (using !!) takes ages (more than 20min or so?) so I didn't
859 > wait until it finished. Opening the same maildir in mutt takes less
860 > than a minute.
861
862 The Xapian backend will speed this up dramatically, because the thread
863 structures are cached, and that's what's expensive in this case. But the
864 best solution is to use sup-tweak-labels, which is an offline tool built
865 for exactly this purpose.
866
867 > I've seen that ferret does save mails but displays threads.
868 > Would it make sense to index the threads instead of mails?
869 > Then displaying them and querying them could be even faster?
870
871 See above.
872
873 Welcome to Sup!
874 --
875 William <wmorgan-sup at masanjin.net>
876
877 From wmorgan-sup@masanjin.net Fri Jul 3 14:54:46 2009
878 From: wmorgan-sup@masanjin.net (William Morgan)
879 Date: Fri, 03 Jul 2009 11:54:46 -0700
880 Subject: [sup-talk] colour customisation
881 In-Reply-To: <1246641077-sup-9945@Longbow>
882 References: <91de50e10907030905l6673a7c3n380f6daeccfb14ab@mail.gmail.com>
883 <1246641077-sup-9945@Longbow>
884 Message-ID: <1246646592-sup-3461@entry>
885
886 Reformatted excerpts from Andrei Thorp's message of 2009-07-03:
887 > I don't really know, but from browsing the source briefly, I've
888 > found (formatted as quote):
889
890 This is correct. That is the list of parts of the display that can be
891 changed, and their default colors. The possible colors for both
892 foreground and background are the curses palette: black, red, green,
893 yellow, blue, magenta, cyan, white, and "default". The possible
894 attributes are the curses attributes: normal, standout, underline,
895 reverse, blink, dim, bold, protect, invis. (I have no idea what many
896 of those actually do.)
897
898 Any of those settings can be overwritten by making a ~/.sup/colors.yaml
899 file, which should be a YAML hash of the exact same format as
900 DEFAULT_COLORS.
901
902 A good way to get started it to do this:
903
904 ruby -rubygems -rsup -e 'print Redwood::Colormap::DEFAULT_COLORS.to_yaml' > ~/.sup/colors.yaml
905
906 and then edit the result.
907
908 A gold star to whoever updates the wiki.
909 --
910 William <wmorgan-sup at masanjin.net>
911
912 From j.bach@uni-oldenburg.de Sat Jul 4 08:01:25 2009
913 From: j.bach@uni-oldenburg.de (=?utf-8?q?J=C3=B6rg-Hendrik_Bach?=)
914 Date: Sat, 04 Jul 2009 14:01:25 +0200
915 Subject: [sup-talk] colour customisation
916 In-Reply-To: <1246646592-sup-3461@entry>
917 References: <91de50e10907030905l6673a7c3n380f6daeccfb14ab@mail.gmail.com>
918 <1246641077-sup-9945@Longbow> <1246646592-sup-3461@entry>
919 Message-ID: <1246708626-sup-8076@lambda>
920
921 I started updating the wiki page on customized colours,
922 http://sup.rubyforge.org/wiki/wiki.pl?CustomizingColors
923
924 I added explanations for the obvious entries, and a few that I found by
925 trial and error. However, a large part of the description is still
926 missing, I didn't have enough time to find all the colours; but at least
927 it's a start.
928
929 From garoth@gmail.com Mon Jul 6 09:47:42 2009
930 From: garoth@gmail.com (Andrei Thorp)
931 Date: Mon, 06 Jul 2009 09:47:42 -0400
932 Subject: [sup-talk] colour customisation
933 In-Reply-To: <1246708626-sup-8076@lambda>
934 References: <91de50e10907030905l6673a7c3n380f6daeccfb14ab@mail.gmail.com>
935 <1246641077-sup-9945@Longbow> <1246646592-sup-3461@entry>
936 <1246708626-sup-8076@lambda>
937 Message-ID: <1246887804-sup-6728@Longbow>
938
939 Excerpts from J?rg-Hendrik Bach's message of Sat Jul 04 08:01:25 -0400 2009:
940 > I started updating the wiki page on customized colours,
941 > http://sup.rubyforge.org/wiki/wiki.pl?CustomizingColors
942 >
943 > I added explanations for the obvious entries, and a few that I found by
944 > trial and error. However, a large part of the description is still
945 > missing, I didn't have enough time to find all the colours; but at least
946 > it's a start.
947
948 Daaamn. Fine work you've done there. I'm really impressed with the
949 graphics :)
950
951 Just from reading over the names of the list and not consulting the
952 source:
953 - index_draft is obviously what colour drafts in the inbox are
954 - cryptosig variables probably have to do with what colours the stuff
955 for signed messages are.
956 - search_highlight is probably the colour for when you search in a
957 buffer and some stuff is highlighted (yellow)
958
959 Anyway, thanks for all your work.
960 --
961 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
962
963 From jof@thejof.com Tue Jul 7 04:20:51 2009
964 From: jof@thejof.com (Jonathan Lassoff)
965 Date: Tue, 07 Jul 2009 01:20:51 -0700
966 Subject: [sup-talk] sup 0.8.1 crash
967 Message-ID: <1246954373-sup-4550@sfo.thejof.com>
968
969 Yikes! I found a way to crash my sup!
970
971 I'm running sup 0.8.1 (sourced from whatever's current on rubygems.org, not a git branch), and can get sup to crash on specific searches.
972
973 I took a little time to poke around in the sup source to try and get an idea what was going on. I'm led to believe this is because I added a source in the past that I later deleted -- but all of the mesages are still in the index. So, when certain searches turn up results that are in that deleted source, the sup index fails to reference the message source in Redwood::Index. Is there a way to delete a source without having to re-index everything?
974
975 So, I figured I might find a way to search the index for any documents whose source id is the same as the deleted one and remove them from the index, but am having a hard time finding a way to iterate over all documents in the index (no search query). Is there a simple way to iterate over all messages?
976
977 Here's some example crash output:
978
979 --- RuntimeError from thread: load threads for thread-index-mode
980 invalid source 1
981 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/index.rb:403:in `build_message'
982 /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
983 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/index.rb:399:in `build_message'
984 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/index.rb:297:in `each_id_by_date'
985 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/thread.rb:330:in `call'
986 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/thread.rb:330:in `load_n_threads'
987 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/index.rb:297:in `each_id_by_date'
988 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/index.rb:296:in `each'
989 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/index.rb:296:in `each_id_by_date'
990 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/thread.rb:326:in `load_n_threads'
991 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:620:in `__unprotected_load_n_threads'
992 (eval):12:in `load_n_threads'
993 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:604:in `load_n_threads_background'
994 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup.rb:71:in `reporting_thread'
995 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup.rb:69:in `initialize'
996 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup.rb:69:in `new'
997 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup.rb:69:in `reporting_thread'
998 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:603:in `load_n_threads_background'
999 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:673:in `__unprotected_load_threads'
1000 (eval):12:in `load_threads'
1001 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/lib/sup/modes/search-results-mode.rb:34:in `spawn_from_query'
1002 /usr/lib/ruby/gems/1.8/gems/sup-0.8.1/bin/sup:270
1003 /usr/bin/sup:19:in `load'
1004 /usr/bin/sup:19
1005
1006 Thanks,
1007 jonathan
1008
1009 From marco-oweber@gmx.de Tue Jul 7 09:08:44 2009
1010 From: marco-oweber@gmx.de (Marc Weber)
1011 Date: Tue, 7 Jul 2009 15:08:44 +0200
1012 Subject: [sup-talk] Backups ?
1013 Message-ID: <20090707130844.GA23073@gmx.de>
1014
1015 Hi, I'd like to setup an automatic backup system cause I don't want to
1016 tag my mails twice and I don't want to loose the information about
1017 archived mails etc.
1018
1019 What do you think about something like this?
1020 Is it enough to keep 4 dumps?
1021 What about moving this code into sup shutdown?
1022 I think everyone wants to have this feature?
1023
1024 run_sup(){
1025 # untested draft
1026 local dump_dir="/var"
1027 sup
1028 sup-dump | bzip2 > "$dump_dir/sup-dumps-`date`"
1029 ls -1t "$dump_dir"/sup-dumps-* | { read; read; read; read; cat } | xargs rm
1030 }
1031
1032 Marc Weber
1033
1034 From wagnerdm@seas.upenn.edu Tue Jul 7 11:26:35 2009
1035 From: wagnerdm@seas.upenn.edu (wagnerdm at seas.upenn.edu)
1036 Date: Tue, 07 Jul 2009 11:26:35 -0400
1037 Subject: [sup-talk] Backups ?
1038 In-Reply-To: <20090707130844.GA23073@gmx.de>
1039 References: <20090707130844.GA23073@gmx.de>
1040 Message-ID: <20090707112635.14736pk1mxi8r9k4@webmail.seas.upenn.edu>
1041
1042 Quoting Marc Weber <marco-oweber at gmx.de>:
1043
1044 > ls -1t "$dump_dir"/sup-dumps-* | { read; read; read; read; cat } | xargs rm
1045
1046 "{ read; read; read; read; cat }" could probably better be done as
1047 "tail +5"; makes it easier to adjust to people's choice of backup
1048 count, too. ;-)
1049 - Daniel "Bikeshedder" Wagner
1050
1051 From bwalton@artsci.utoronto.ca Tue Jul 7 12:10:42 2009
1052 From: bwalton@artsci.utoronto.ca (Ben Walton)
1053 Date: Tue, 07 Jul 2009 12:10:42 -0400
1054 Subject: [sup-talk] Backups ?
1055 In-Reply-To: <20090707112635.14736pk1mxi8r9k4@webmail.seas.upenn.edu>
1056 References: <20090707130844.GA23073@gmx.de>
1057 <20090707112635.14736pk1mxi8r9k4@webmail.seas.upenn.edu>
1058 Message-ID: <1246982848-sup-5820@ntdws12.chass.utoronto.ca>
1059
1060 Excerpts from wagnerdm's message of Tue Jul 07 11:26:35 -0400 2009:
1061 > > ls -1t "$dump_dir"/sup-dumps-* | { read; read; read; read; cat } | xargs rm
1062 >
1063 > "{ read; read; read; read; cat }" could probably better be done as
1064 > "tail +5"; makes it easier to adjust to people's choice of backup
1065
1066
1067 Or:
1068
1069 DAYS=5
1070 find $dump_dir -mtime +${DAYS} -name "*sup-dumps-*" -print0 | xargs -0 --no-run-if-empty rm
1071
1072 (adjust xargs options to suit your environment...I don't think
1073 --no-run-if-empty is all that portable.)
1074
1075 -Ben
1076 --
1077 Ben Walton
1078 Systems Programmer - CHASS
1079 University of Toronto
1080 C:416.407.5610 | W:416.978.4302
1081
1082 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
1083 Contact me to arrange for a CAcert assurance meeting.
1084 -------------- next part --------------
1085 A non-text attachment was scrubbed...
1086 Name: signature.asc
1087 Type: application/pgp-signature
1088 Size: 189 bytes
1089 Desc: not available
1090 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090707/e4d9cdb7/attachment.bin>
1091
1092 From ingmar@exherbo.org Tue Jul 7 12:19:14 2009
1093 From: ingmar@exherbo.org (Ingmar Vanhassel)
1094 Date: Tue, 07 Jul 2009 18:19:14 +0200
1095 Subject: [sup-talk] Backups ?
1096 In-Reply-To: <20090707112635.14736pk1mxi8r9k4@webmail.seas.upenn.edu>
1097 References: <20090707130844.GA23073@gmx.de>
1098 <20090707112635.14736pk1mxi8r9k4@webmail.seas.upenn.edu>
1099 Message-ID: <1246983494-sup-6924@cannonball>
1100
1101 Excerpts from wagnerdm's message of Tue Jul 07 17:26:35 +0200 2009:
1102 > Quoting Marc Weber <marco-oweber at gmx.de>:
1103 >
1104 > > ls -1t "$dump_dir"/sup-dumps-* | { read; read; read; read; cat } | xargs rm
1105 >
1106 > "{ read; read; read; read; cat }" could probably better be done as
1107 > "tail +5"; makes it easier to adjust to people's choice of backup
1108 > count, too. ;-)
1109 > - Daniel "Bikeshedder" Wagner
1110
1111 "tail -n+5", which is POSIX compatible
1112
1113 --
1114 Exherbo KDE, X.org maintainer
1115
1116 From rhomunuq+ml_sup@gmail.com Tue Jul 7 13:44:18 2009
1117 From: rhomunuq+ml_sup@gmail.com (Iain)
1118 Date: Tue, 07 Jul 2009 18:44:18 +0100
1119 Subject: [sup-talk] Exception Log
1120 Message-ID: <1246988396-sup-8372@leda>
1121
1122 I'm using Sup 0.8.1 on Ubuntu 8.10 -- from the .deb kindly put together
1123 by Decklin Foster, <http://apt.rupamsunyata.org/sup/>.
1124
1125 A few minutes ago, sup crashed on me. ~/.sup/exception-log.txt :
1126
1127 --- NoMethodError from thread: main
1128 undefined method `title' for nil:NilClass
1129 /usr/lib/ruby/1.8/sup/buffer.rb:747:in `get_status_and_title'
1130 /usr/lib/ruby/1.8/sup/buffer.rb:281:in `draw_screen'
1131 /usr/bin/sup-mail:306
1132
1133 The crash may have something to do with receiving a new message (from an
1134 automatic poll of a Maildir) at the same time as having just read and
1135 archived the prior first message in the inbox, using: ".a".
1136
1137 From dato@net.com.org.es Thu Jul 9 15:55:17 2009
1138 From: dato@net.com.org.es (=?utf-8?q?Adeodato=20Sim=C3=B3?=)
1139 Date: Thu, 9 Jul 2009 21:55:17 +0200
1140 Subject: [sup-talk] [PATCH] Use /etc/mailname if present to determine the
1141 hostname for Message-Id
1142 Message-ID: <e23a0f3ed1ae4e2007d0f8144207e0e2fe3d8c11.1247169308.git.dato@net.com.org.es>
1143
1144 Signed-off-by: Adeodato Sim? <dato at net.com.org.es>
1145 ---
1146 Hello,
1147
1148 on many systems (notably Debian-based systems), the /etc/mailname file
1149 can be created to specify the public mail name for a host. If that file
1150 exists, it'd be good to use its contents for generating the Message-Id
1151 header.
1152
1153 I'd be grateful if you'd consider applying this patch.
1154
1155 lib/sup/modes/edit-message-mode.rb | 9 ++++++++-
1156 1 files changed, 8 insertions(+), 1 deletions(-)
1157
1158 diff --git a/lib/sup/modes/edit-message-mode.rb b/lib/sup/modes/edit-message-mode.rb
1159 index f956d65..a48930a 100644
1160 --- a/lib/sup/modes/edit-message-mode.rb
1161 +++ b/lib/sup/modes/edit-message-mode.rb
1162 @@ -73,7 +73,14 @@ EOS
1163 @attachment_names = []
1164 end
1165
1166 - @message_id = "<#{Time.now.to_i}-sup-#{rand 10000}@#{Socket.gethostname}>"
1167 + begin
1168 + hostname = File.open("/etc/mailname", "r").gets.chomp
1169 + rescue
1170 + nil
1171 + end
1172 + hostname = Socket.gethostname if hostname.nil? or hostname.empty?
1173 +
1174 + @message_id = "<#{Time.now.to_i}-sup-#{rand 10000}@#{hostname}>"
1175 @edited = false
1176 @selectors = []
1177 @selector_label_width = 0
1178 --
1179 1.6.3.3
1180
1181
1182 From michael@stapelberg.de Thu Jul 9 20:34:21 2009
1183 From: michael@stapelberg.de (Michael Stapelberg)
1184 Date: Fri, 10 Jul 2009 02:34:21 +0200
1185 Subject: [sup-talk] sup opens multiple connections to the same imap-server
1186 Message-ID: <1247185833-sup-8539@x200>
1187
1188 Hi,
1189
1190 for some reason my cyrus-imapd does not handle multiple connections so well.
1191 There are 27 processes on my server which are all caused by sup. Probably sup
1192 opens one imap connection for each source I configured, which are 28. In my
1193 opinion, one connection to the server should be enough. Especially because
1194 sup hangs for ages until it manages to talk to my imap server correctly.
1195
1196 Is there an easy way to make sup use only one connection? If not, I?ll see
1197 if this problem still arises after I re-install my server (probably with
1198 dovecot instead of cyrus this time).
1199
1200 Best regards,
1201 Michael
1202
1203 From michael@stapelberg.de Thu Jul 9 20:38:25 2009
1204 From: michael@stapelberg.de (Michael Stapelberg)
1205 Date: Fri, 10 Jul 2009 02:38:25 +0200
1206 Subject: [sup-talk] Using sup on multiple computers?
1207 Message-ID: <1247186181-sup-1712@x200>
1208
1209 Hi,
1210
1211 I?d like to use sup on my notebook and on my workstation. Is there any
1212 simple/recommended way to synchronize the index? I figured using multiple
1213 clients in parallel is one of the big advantages of IMAP and I?d love to keep
1214 it that way while using sup.
1215
1216 Best regards,
1217 Michael
1218
1219 From ezyang@MIT.EDU Thu Jul 9 22:57:14 2009
1220 From: ezyang@MIT.EDU (Edward Z. Yang)
1221 Date: Thu, 09 Jul 2009 22:57:14 -0400
1222 Subject: [sup-talk] Using sup on multiple computers?
1223 In-Reply-To: <1247186181-sup-1712@x200>
1224 References: <1247186181-sup-1712@x200>
1225 Message-ID: <1247194599-sup-5843@javelin>
1226
1227 Excerpts from Michael Stapelberg's message of Thu Jul 09 20:38:25 -0400 2009:
1228 > I?d like to use sup on my notebook and on my workstation. Is there any
1229 > simple/recommended way to synchronize the index? I figured using multiple
1230 > clients in parallel is one of the big advantages of IMAP and I?d love to keep
1231 > it that way while using sup.
1232
1233 The easiest way is to not; since Sup is a command line application, it's trivial
1234 to spin it up on a server you have access to and simply SSH in to check your
1235 mail.
1236
1237 Cheers,
1238 Edward
1239
1240 From jof@thejof.com Thu Jul 9 23:03:22 2009
1241 From: jof@thejof.com (Jonathan Lassoff)
1242 Date: Thu, 09 Jul 2009 20:03:22 -0700
1243 Subject: [sup-talk] Using sup on multiple computers?
1244 In-Reply-To: <1247186181-sup-1712@x200>
1245 References: <1247186181-sup-1712@x200>
1246 Message-ID: <1247194844-sup-6153@sfo.thejof.com>
1247
1248 Excerpts from Michael Stapelberg's message of Thu Jul 09 17:38:25 -0700 2009:
1249 > Hi,
1250 >
1251 > I'd like to use sup on my notebook and on my workstation. Is there any
1252 > simple/recommended way to synchronize the index?
1253
1254 As far as I know, this isn't supported in sup yet.
1255
1256 One way I work around this to use sup on two machines is that I know my
1257 access is mutually exclusive i.e. I don't use more than one host at
1258 once.
1259
1260 So, when I switch from one host to another, I quit sup and rsync my ~/.sup to the
1261 machine I'm moving to and rysnc it back again when I return.
1262 Hacky, but functional enough.
1263
1264 Cheers,
1265 jonathan
1266
1267 From michael+sup@stapelberg.de Fri Jul 10 06:59:42 2009
1268 From: michael+sup@stapelberg.de (Michael Stapelberg)
1269 Date: Fri, 10 Jul 2009 12:59:42 +0200
1270 Subject: [sup-talk] Using sup on multiple computers?
1271 In-Reply-To: <1247194599-sup-5843@javelin>
1272 References: <1247186181-sup-1712@x200> <1247194599-sup-5843@javelin>
1273 Message-ID: <1247223427-sup-4016@x200>
1274
1275 Hi,
1276
1277 Excerpts from Edward Z. Yang's message of Fr Jul 10 04:57:14 +0200 2009:
1278 > The easiest way is to not; since Sup is a command line application, it's trivial
1279 > to spin it up on a server you have access to and simply SSH in to check your
1280 > mail.
1281 I?ve been using mutt like this for about a year or so but I generally
1282 don?t want to continue with this approach. It has the disadvantage of
1283 having the need to copy attachments to your computer before being able
1284 to display them (think of PDFs) and of not scaling well when on a slow
1285 internet connection (IMAP traffic is less than a whole user interface).
1286
1287 Best regards,
1288 Michael
1289
1290 From garoth@gmail.com Fri Jul 10 10:30:40 2009
1291 From: garoth@gmail.com (Andrei Thorp)
1292 Date: Fri, 10 Jul 2009 10:30:40 -0400
1293 Subject: [sup-talk] Using sup on multiple computers?
1294 In-Reply-To: <1247194844-sup-6153@sfo.thejof.com>
1295 References: <1247186181-sup-1712@x200> <1247194844-sup-6153@sfo.thejof.com>
1296 Message-ID: <1247236046-sup-9543@Longbow>
1297
1298 Excerpts from Jonathan Lassoff's message of Thu Jul 09 23:03:22 -0400 2009:
1299 > Excerpts from Michael Stapelberg's message of Thu Jul 09 17:38:25 -0700 2009:
1300 > > Hi,
1301 > >
1302 > > I'd like to use sup on my notebook and on my workstation. Is there any
1303 > > simple/recommended way to synchronize the index?
1304 >
1305 > As far as I know, this isn't supported in sup yet.
1306 >
1307 > One way I work around this to use sup on two machines is that I know my
1308 > access is mutually exclusive i.e. I don't use more than one host at
1309 > once.
1310
1311 The smarter way of doing this is to keep your .sup on a remote server as
1312 a share and mount it onto the right place in your home when you log in.
1313 This still has the disadvantage of only being able to use one sup at a
1314 time, but at least sup will lock the index using its lockfile, so you
1315 can't accidentally run two at once and screw something up.
1316
1317 It also prevents you from having to manually rsync stuff.
1318
1319 The nicest way to do this would to probably use sshfs. This way, the
1320 index is shared, you only need ssh (no NFS nastiness), it can mount
1321 automatically, and since sup is actually running on your local machine,
1322 it can save attachments just fine.
1323
1324 One note: You need to either have _identical_ imap folders on your
1325 computers in the identical filesystem paths, or you need to have your
1326 mail delivered to the server and share that too.
1327 --
1328 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
1329
1330 From dato@net.com.org.es Fri Jul 10 11:00:29 2009
1331 From: dato@net.com.org.es (=?utf-8?q?Adeodato=20Sim=C3=B3?=)
1332 Date: Fri, 10 Jul 2009 17:00:29 +0200
1333 Subject: [sup-talk] [PATCH] mime-decode hook: provide a "charset" variable
1334 with the attachment charset
1335 Message-ID: <6fc2e5dd8aa2b0b8547375d77b1776d779f85817.1247238014.git.dato@net.com.org.es>
1336
1337 This is useful, for example, for HTML attachments which are sent in a
1338 charset different from the default for the system (eg., ISO-8859-1 on an
1339 UTF-8 system), so that the converter program can be told what charset it
1340 should be converting from.
1341
1342 Signed-off-by: Adeodato Sim? <dato at net.com.org.es>
1343 ---
1344 lib/sup/message-chunks.rb | 4 +++-
1345 1 files changed, 3 insertions(+), 1 deletions(-)
1346
1347 diff --git a/lib/sup/message-chunks.rb b/lib/sup/message-chunks.rb
1348 index 0d742d9..ea04ed7 100644
1349 --- a/lib/sup/message-chunks.rb
1350 +++ b/lib/sup/message-chunks.rb
1351 @@ -50,7 +50,8 @@ directly in Sup. For attachments that you wish to use a separate program
1352 to view (e.g. images), you should use the mime-view hook instead.
1353
1354 Variables:
1355 - content_type: the content-type of the message
1356 + content_type: the content-type of the attachment
1357 + charset: the charset of the attachment, if applicable
1358 filename: the filename of the attachment as saved to disk
1359 sibling_types: if this attachment is part of a multipart MIME attachment,
1360 an array of content-types for all attachments. Otherwise,
1361 @@ -103,6 +104,7 @@ EOS
1362 else
1363 HookManager.run "mime-decode", :content_type => content_type,
1364 :filename => lambda { write_to_disk },
1365 + :charset => encoded_content.charset,
1366 :sibling_types => sibling_types
1367 end
1368
1369 --
1370 1.6.3.3
1371
1372
1373 From michael+sup@stapelberg.de Fri Jul 10 16:19:14 2009
1374 From: michael+sup@stapelberg.de (Michael Stapelberg)
1375 Date: Fri, 10 Jul 2009 22:19:14 +0200
1376 Subject: [sup-talk] Validating GPG keys in parallel and in background
1377 Message-ID: <1247256988-sup-2799@x200>
1378
1379 Hi,
1380
1381 it seems like sup is blocking during the validation of GPG signed/encrypted
1382 mails. While for encryption it makes some sense to block, for signed mails
1383 it would be better to just display the message and add the information about
1384 the signature status later. The same approach could be used for encrypted
1385 messages: Display "decrypting..." and update it when done.
1386
1387 This is especially important for big mailing lists (like debian-devel) which
1388 contain many signed mails.
1389
1390 Best regards,
1391 Michael
1392
1393 From dato@net.com.org.es Sat Jul 11 07:57:55 2009
1394 From: dato@net.com.org.es (=?utf-8?q?Adeodato=20Sim=C3=B3?=)
1395 Date: Sat, 11 Jul 2009 13:57:55 +0200
1396 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was referencing
1397 an nonexistent variable)
1398 Message-ID: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
1399
1400 Signed-off-by: Adeodato Sim? <dato at net.com.org.es>
1401 ---
1402 lib/sup/modes/thread-view-mode.rb | 2 +-
1403 1 files changed, 1 insertions(+), 1 deletions(-)
1404
1405 diff --git a/lib/sup/modes/thread-view-mode.rb b/lib/sup/modes/thread-view-mode.rb
1406 index 759191e..737f6f1 100644
1407 --- a/lib/sup/modes/thread-view-mode.rb
1408 +++ b/lib/sup/modes/thread-view-mode.rb
1409 @@ -204,7 +204,7 @@ EOS
1410 end
1411 end
1412
1413 - cmd = case HookManager.run "bounce-command", :from => m.from, :to => to
1414 + cmd = case (hookcmd = HookManager.run "bounce-command", :from => m.from, :to => to)
1415 when nil, /^$/ then defcmd
1416 else hookcmd
1417 end + ' ' + to.map { |t| t.email }.join(' ')
1418 --
1419 1.6.3.3
1420
1421
1422 From bwalton@artsci.utoronto.ca Sat Jul 11 10:12:17 2009
1423 From: bwalton@artsci.utoronto.ca (Ben Walton)
1424 Date: Sat, 11 Jul 2009 10:12:17 -0400
1425 Subject: [sup-talk] sup opens multiple connections to the same
1426 imap-server
1427 In-Reply-To: <1247185833-sup-8539@x200>
1428 References: <1247185833-sup-8539@x200>
1429 Message-ID: <1247321064-sup-4795@ntdws12.chass.utoronto.ca>
1430
1431 Excerpts from Michael Stapelberg's message of Thu Jul 09 20:34:21 -0400 2009:
1432 > Is there an easy way to make sup use only one connection? If not, I?ll see
1433 > if this problem still arises after I re-install my server (probably with
1434 > dovecot instead of cyrus this time).
1435
1436 I don't believe there is a way to do this currently. It would require
1437 some refactoring of the code.
1438
1439 Roughly:
1440
1441 The IMAP source would refer to an IMAPManager for a connection. The
1442 IMAP manager would handle creating new connections when required or
1443 passing a reference to an existing connection if it had already
1444 created. A tuple of (imap server, username, password) could be used
1445 to determine the uniqueness of the request.
1446
1447 The unsafe_connect method of the IMAP source could move to the
1448 IMAPManager and calls to unsafe_connect could be rerouted to
1449 IMAPManager.connection_for(server, user, password) or some such...
1450
1451 It shouldn't be a bad addition to add if you're interested.
1452
1453 -Ben
1454 --
1455 Ben Walton
1456 Systems Programmer - CHASS
1457 University of Toronto
1458 C:416.407.5610 | W:416.978.4302
1459
1460 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
1461 Contact me to arrange for a CAcert assurance meeting.
1462 -------------- next part --------------
1463 A non-text attachment was scrubbed...
1464 Name: signature.asc
1465 Type: application/pgp-signature
1466 Size: 189 bytes
1467 Desc: not available
1468 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090711/4edae96c/attachment.bin>
1469
1470 From bwalton@artsci.utoronto.ca Sat Jul 11 10:28:58 2009
1471 From: bwalton@artsci.utoronto.ca (Ben Walton)
1472 Date: Sat, 11 Jul 2009 10:28:58 -0400
1473 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was
1474 referencing an nonexistent variable)
1475 In-Reply-To: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
1476 References: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
1477 Message-ID: <1247322405-sup-1564@ntdws12.chass.utoronto.ca>
1478
1479 Excerpts from Adeodato Sim?'s message of Sat Jul 11 07:57:55 -0400 2009:
1480
1481 > Signed-off-by: Adeodato Sim? <dato at net.com.org.es>
1482 > ---
1483 > lib/sup/modes/thread-view-mode.rb | 2 +-
1484 > 1 files changed, 1 insertions(+), 1 deletions(-)
1485
1486 +1 for this. Not sure how I managed to submit the original patch like
1487 this, since I did test various forms of results returned from the
1488 bounce-command hook...anyway, I've applied this and verified it.
1489
1490 -Ben
1491 --
1492 Ben Walton
1493 Systems Programmer - CHASS
1494 University of Toronto
1495 C:416.407.5610 | W:416.978.4302
1496
1497 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
1498 Contact me to arrange for a CAcert assurance meeting.
1499 -------------- next part --------------
1500 A non-text attachment was scrubbed...
1501 Name: signature.asc
1502 Type: application/pgp-signature
1503 Size: 189 bytes
1504 Desc: not available
1505 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090711/3b5d572f/attachment.bin>
1506
1507 From michael+sup@stapelberg.de Sat Jul 11 11:36:23 2009
1508 From: michael+sup@stapelberg.de (Michael Stapelberg)
1509 Date: Sat, 11 Jul 2009 17:36:23 +0200
1510 Subject: [sup-talk] sup opens multiple connections to the same
1511 imap-server
1512 In-Reply-To: <1247321064-sup-4795@ntdws12.chass.utoronto.ca>
1513 References: <1247185833-sup-8539@x200>
1514 <1247321064-sup-4795@ntdws12.chass.utoronto.ca>
1515 Message-ID: <1247326506-sup-1002@x200>
1516
1517 Hi Ben,
1518
1519 Excerpts from Ben Walton's message of Sa Jul 11 16:12:17 +0200 2009:
1520 > It shouldn't be a bad addition to add if you're interested.
1521 Thanks for pointing out how it could be done. Unfortunately, I?ve never
1522 done any ruby code. I?ll have a look at sup?s source in a few weeks and
1523 I can try to implement it. Don?t count on it, though (meaning: if you
1524 can do it better/faster, go for it).
1525
1526 Best regards,
1527 Michael
1528
1529 From michael+sup@stapelberg.de Sat Jul 11 12:53:35 2009
1530 From: michael+sup@stapelberg.de (Michael Stapelberg)
1531 Date: Sat, 11 Jul 2009 18:53:35 +0200
1532 Subject: [sup-talk] Adding/saving multiple attachments?
1533 Message-ID: <1247331130-sup-4923@x200>
1534
1535 Hi,
1536
1537 I?ve had the same problem with mutt: Isn?t there a way to add or save
1538 multiple attachments? Why can?t I add ~/work/foo/* when pressing 'a'?
1539 Why doesn?t the file browser save the last directory I?ve been in?
1540 Can we please get a binding to save all attachments of a message into
1541 a folder?
1542
1543 Best regards,
1544 Michael
1545
1546 From nico-sup@schottelius.org Mon Jul 13 05:01:10 2009
1547 From: nico-sup@schottelius.org (Nico Schottelius)
1548 Date: Mon, 13 Jul 2009 11:01:10 +0200
1549 Subject: [sup-talk] Invalid character on import
1550 Message-ID: <20090713090110.GA20996@ikn.schottelius.org>
1551
1552 Hello!
1553
1554 I'm trying to import my current maildir into sup, but
1555 it fails with the following error:
1556
1557 --------------------------------------------------------------------------------
1558 [Mon Jul 13 09:33:17 +0200 2009] scanning maildir /home/spieler/Maildir/INBOX...
1559 [Mon Jul 13 09:33:17 +0200 2009] no poll on cur. mtime on indicates no new messages.
1560 [Mon Jul 13 09:33:17 +0200 2009] no poll on new. mtime on indicates no new messages.
1561 [Mon Jul 13 09:33:18 +0200 2009] done scanning maildir
1562 ## read 13228m (about 84%) @ 6.1m/s. 0:36:04 elapsed, about 0:06:49 remaining
1563 ## read 13306m (about 84%) @ 6.1m/s. 0:36:19 elapsed, about 0:06:48 remaining
1564 [Mon Jul 13 09:33:34 +0200 2009] unlocking /home/spieler/.sup/lock...
1565 /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/util.rb:647:in `iconv': " " (Iconv::InvalidCharacter)
1566 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/util.rb:647:in `easy_decode'
1567 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/message.rb:430:in `message_to_chunks'
1568 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/message.rb:209:in `load_from_source!'
1569 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/poll.rb:151:in `add_messages_from'
1570 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/maildir.rb:130:in `each'
1571 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/maildir.rb:127:in `upto'
1572 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/maildir.rb:127:in `each'
1573 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/util.rb:552:in `send'
1574 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/util.rb:552:in `__pass'
1575 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/util.rb:539:in `method_missing'
1576 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/poll.rb:141:in `add_messages_from'
1577 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/util.rb:513:in `send'
1578 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/lib/sup/util.rb:513:in `method_missing'
1579 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/bin/sup-sync:140
1580 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/bin/sup-sync:135:in `each'
1581 from /home/spieler/.gem/ruby/1.8/gems/sup-0.8.1/bin/sup-sync:135
1582 from /home/spieler/.gem/ruby/1.8/bin/sup-sync:19:in `load'
1583 from /home/spieler/.gem/ruby/1.8/bin/sup-sync:19
1584 --------------------------------------------------------------------------------
1585
1586 Any idea what's wrong here? sup's installed via gem install.
1587
1588 Nico
1589
1590 From nico-sup@schottelius.org Mon Jul 13 05:15:16 2009
1591 From: nico-sup@schottelius.org (Nico Schottelius)
1592 Date: Mon, 13 Jul 2009 11:15:16 +0200
1593 Subject: [sup-talk] Slow import of messages
1594 Message-ID: <20090713091516.GA21214@ikn.schottelius.org>
1595
1596 Hello!
1597
1598 I'm looking at sup as a replacement for mutt.
1599 Following the idea of sup, I took a snapshot of
1600 my Mails from 2008-2009 (~56k mails) and run
1601
1602 sup-sync --all-sources
1603
1604 Now the problem is that sup gets about 3 mails per
1605 second into its index. That means it takes about
1606
1607 56k/3 ~= 15k; 15000/60 = 250 minutes
1608
1609 That import is already from a local Maildir (synced with
1610 offlineimap).
1611
1612 For me, this is incredibly slow. Using mutt it's way faster,
1613 not even comparing the fact the speed improvement you get
1614 when dividing into folders.
1615
1616 What's your impression? Am I totally wrong or is sup just
1617 the wrong tool for handling a lot of messages?
1618
1619 Sincerly,
1620
1621 Nico
1622
1623 From michael+sup@stapelberg.de Mon Jul 13 05:26:14 2009
1624 From: michael+sup@stapelberg.de (Michael Stapelberg)
1625 Date: Mon, 13 Jul 2009 11:26:14 +0200
1626 Subject: [sup-talk] Slow import of messages
1627 In-Reply-To: <20090713091516.GA21214@ikn.schottelius.org>
1628 References: <20090713091516.GA21214@ikn.schottelius.org>
1629 Message-ID: <1247477044-sup-6433@midna>
1630
1631 Hi Nico,
1632
1633 Excerpts from Nico Schottelius's message of Mo Jul 13 11:15:16 +0200 2009:
1634 > I'm looking at sup as a replacement for mutt.
1635 > Following the idea of sup, I took a snapshot of
1636 > my Mails from 2008-2009 (~56k mails) and run
1637 I have about 33k emails on my IMAP server in my LAN.
1638
1639 > Now the problem is that sup gets about 3 mails per
1640 > second into its index. That means it takes about
1641 I got around 10 MB/s performance using sup-sync. Maybe
1642 your mails are all very large, I don?t know. Maybe maildir is
1643 just a lot slower than IMAP in sup-sync.
1644
1645 > What's your impression? Am I totally wrong or is sup just
1646 > the wrong tool for handling a lot of messages?
1647 My impression is that sup-sync can definitely be improved regarding
1648 its speed. I?m not sure if it is actually doable or if it is some ruby
1649 library (Ferret?) which is the limiting factor here. However, it was
1650 not as bad for me as it is for you ;-).
1651
1652 Best regards,
1653 Michael
1654
1655 From nicolas.pouillard@gmail.com Mon Jul 13 16:17:26 2009
1656 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
1657 Date: Mon, 13 Jul 2009 22:17:26 +0200
1658 Subject: [sup-talk] Invalid character on import
1659 In-Reply-To: <20090713090110.GA20996@ikn.schottelius.org>
1660 References: <20090713090110.GA20996@ikn.schottelius.org>
1661 Message-ID: <1247516120-sup-3116@ausone.local>
1662
1663 Excerpts from Nico Schottelius's message of Mon Jul 13 11:01:10 +0200 2009:
1664 > Hello!
1665 Hello,
1666
1667 > I'm trying to import my current maildir into sup, but
1668 > it fails with the following error:
1669
1670 The fix is trivial, I've submitted a merge request for exactly this:
1671
1672 http://gitorious.org/~ertai/sup/clone-by-ertai
1673
1674 --
1675 Nicolas Pouillard
1676 http://nicolaspouillard.fr
1677
1678 From jim@gonzul.net Mon Jul 13 17:22:04 2009
1679 From: jim@gonzul.net (Jim Cheetham)
1680 Date: Tue, 14 Jul 2009 09:22:04 +1200
1681 Subject: [sup-talk] Slow import of messages
1682 In-Reply-To: <20090713091516.GA21214@ikn.schottelius.org>
1683 References: <20090713091516.GA21214@ikn.schottelius.org>
1684 Message-ID: <f4cc59760907131422p3dd1d429ka9d334e509b992d7@mail.gmail.com>
1685
1686 On Mon, Jul 13, 2009 at 9:15 PM, Nico
1687 Schottelius<nico-sup at schottelius.org> wrote:
1688 > What's your impression? Am I totally wrong or is sup just
1689 > the wrong tool for handling a lot of messages?
1690
1691 No, it's just slow to index for the first time. Unless you receive
1692 1000s of messages per hour, you should be OK ...
1693
1694 -jim
1695
1696 From lcanas@libresoft.es Mon Jul 13 17:20:22 2009
1697 From: lcanas@libresoft.es (Luis =?ISO-8859-1?Q?Ca=F1as_D=EDaz?=)
1698 Date: Mon, 13 Jul 2009 23:20:22 +0200
1699 Subject: [sup-talk] problems with Maildir and IMAP offline
1700 Message-ID: <20090713232022.fe1d4839.lcanas@libresoft.es>
1701
1702 Hi guys,
1703 first things first. Your mail client looks promising, I've been testing many of them (most of them from the kde/gnome world) and yours seems to be perfect to be running in my dear mac mini ;)
1704
1705 This afternoon I've been trying to set up a gmail account with offlineimap and I'm having the same problem reported by this guy[1]. I run offlineimap and it creates a Maildir directory with 4hundred read mails and 2hundred unread mails (yes, I should pay more attention to my gmail account;). The problem is that sup sees all of the messages as unread which is not true according to the Maildir structure:
1706
1707 [luis at gongbu INBOX]$ ls new/|wc -l;ls cur/|wc -l
1708 210
1709 412
1710
1711 After applying changes with sup, the state is the same. When using sup I "delete" messages and mark them as read.
1712
1713 The sup version is:
1714
1715 [luis at gongbu ~]$ sup -v
1716 [Mon Jul 13 23:14:25 +0200 2009] using character set encoding "UTF-8"
1717 sup v0.8.1
1718
1719 Last thing, I haven't seen it written by I guess it's a good idea having the files locally to use the search engine. Am I right?
1720
1721 Thanks for your help! :)
1722
1723 [1] http://osdir.com/ml/mail.sup.general/2008-08/msg00029.html
1724
1725 --
1726 Luis Ca?as D?az | GSyC/LibreSoft Research Lab
1727 http://libresoft.es | Grupo de Sistemas y Comunicaciones
1728 Tel: (+34) 91 488 85 23 | Universidad Rey Juan Carlos
1729
1730 From garoth@gmail.com Tue Jul 14 09:24:32 2009
1731 From: garoth@gmail.com (Andrei Thorp)
1732 Date: Tue, 14 Jul 2009 09:24:32 -0400
1733 Subject: [sup-talk] problems with Maildir and IMAP offline
1734 In-Reply-To: <20090713232022.fe1d4839.lcanas@libresoft.es>
1735 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
1736 Message-ID: <1247577490-sup-7098@Longbow>
1737
1738 Excerpts from Luis Ca?as D?az's message of Mon Jul 13 17:20:22 -0400 2009:
1739 > After applying changes with sup, the state is the same. When using sup I
1740 > "delete" messages and mark them as read.
1741 I'm somewhat unhappy about this too. It seems to me that sup just plain
1742 does not support the read features of maildirs.
1743 a) It doesn't import them as read
1744 b) sup-sync-back does not mark them as read.
1745
1746 The best I could find is manually marking things as read and deleting
1747 them, and then using sup-sync-back with the deleted options which it
1748 does understand.
1749
1750 On the other hand, sup provides hooks to make calling offlineimap and
1751 sup-sync-back completely transparent and well-timed. You can call
1752 sup-sync-back followed by offlineimap on each sup poll, so that's pretty
1753 sweet.
1754 --
1755 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
1756
1757 From garoth@gmail.com Tue Jul 14 10:02:11 2009
1758 From: garoth@gmail.com (Andrei Thorp)
1759 Date: Tue, 14 Jul 2009 10:02:11 -0400
1760 Subject: [sup-talk] problems with Maildir and IMAP offline
1761 In-Reply-To: <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
1762 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
1763 <1247577490-sup-7098@Longbow>
1764 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
1765 Message-ID: <1247580020-sup-9946@Longbow>
1766
1767 Excerpts from Tim Gray's message of Tue Jul 14 09:45:44 -0400 2009:
1768 > On Tue 14, Jul'09 at 9:24 AM -0400, Andrei Thorp wrote:
1769 >
1770 > > a) It doesn't import them as read
1771 > > b) sup-sync-back does not mark them as read.
1772
1773 I'm forwarding a summary of your message with my replies to the mailing
1774 list. It seems like you replied to me only by accident?
1775
1776 > From my playing around with sup and from what I've read, sup just doesn't
1777 > play nicely with other mail clients. Sup will read from your sources, but
1778 > the sources never get modified.
1779
1780 Again, see sup-sync-back -- it does indeed have _some_ ability to write
1781 its state back to the source.
1782
1783 > I know sup is slowly moving in the direction of a more locked in design. I
1784 > just wish sup added automatic sync back capabilities.
1785
1786 Put this in a hook and it's automatic. That's the beauty of the
1787 hook/multiple binary design.
1788
1789 > As far as OfflineIMAP goes, I didn't think I would do this, but I've been
1790 > running it in it's full curses mode with an auto refresh set.
1791
1792 I'm not entirely sure why you want this. If you're worried about
1793 failures, do they really happen? If you want to see the log, aren't you
1794 already piping it? If you want notifications, you could hook them up to
1795 happen in your sup hook (the one I described before) rather trivially
1796 via notify-send.
1797 --
1798 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
1799
1800 From lists+sup@protozoic.com Tue Jul 14 11:00:34 2009
1801 From: lists+sup@protozoic.com (Tim Gray)
1802 Date: Tue, 14 Jul 2009 11:00:34 -0400
1803 Subject: [sup-talk] problems with Maildir and IMAP offline
1804 In-Reply-To: <1247580020-sup-9946@Longbow>
1805 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
1806 <1247577490-sup-7098@Longbow>
1807 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
1808 <1247580020-sup-9946@Longbow>
1809 Message-ID: <20090714150034.GA393@d228.scdc1.swarthmore.edu>
1810
1811 On Tue 14, Jul'09 at 10:02 AM -0400, Andrei Thorp wrote:
1812
1813 > I'm forwarding a summary of your message with my replies to the mailing
1814 > list. It seems like you replied to me only by accident?
1815
1816 Whoops. I didn't realize this list didn't have reply-to set. Thanks.
1817
1818 > Again, see sup-sync-back -- it does indeed have _some_ ability to write
1819 > its state back to the source.
1820
1821 To me, this is a vital feature of any mail client. I'll look into it, but I
1822 would really like this to be fully integrated into my mail client. And from
1823 I've read, this isn't something that's going to happen.
1824
1825 Sometimes I need to use mutt/pine. Sometimes webmail. Most importantly, I
1826 want all my mail in a form that is easy to backup, human readable, and can
1827 be manipulated with standard utilities. Maildir fits the bill.
1828
1829 I think it'd be fantastic if there was a mail client that allowed you to
1830 sort by folders, but also provided a sup-like view that laid on top if/when
1831 you needed.
1832
1833 > Put this in a hook and it's automatic. That's the beauty of the
1834 > hook/multiple binary design.
1835
1836 Honestly, if it's that easy, shouldn't it be configured like that out of the
1837 box?
1838
1839 > I'm not entirely sure why you want this. If you're worried about
1840 > failures, do they really happen? If you want to see the log, aren't you
1841 > already piping it? If you want notifications, you could hook them up to
1842 > happen in your sup hook (the one I described before) rather trivially
1843 > via notify-send.
1844
1845 For use with other mail clients for one. It's kind of nice having my IMAP
1846 syncing separate from the mail client. I'm sure I could run it
1847 automatically via cron, but then you'd have to give up the quick refresh
1848 capability (minor) and the IDLE mode. Sure, I could pipe the output
1849 somewhere else, but wouldn't that accomplish the same thing as just looking
1850 at the output already provided, either curses or one of the other ones?
1851 Again, it's running in screen so I don't even have it open on any windows.
1852
1853 Of course, that doesn't mean this is the best route to go, but it's been
1854 working for me for so far - I am new to it though. It's a nice pretty
1855 colored interface too :)
1856
1857 Tim
1858
1859 From bwalton@artsci.utoronto.ca Tue Jul 14 11:07:46 2009
1860 From: bwalton@artsci.utoronto.ca (Ben Walton)
1861 Date: Tue, 14 Jul 2009 11:07:46 -0400
1862 Subject: [sup-talk] problems with Maildir and IMAP offline
1863 In-Reply-To: <20090714150034.GA393@d228.scdc1.swarthmore.edu>
1864 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
1865 <1247577490-sup-7098@Longbow>
1866 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
1867 <1247580020-sup-9946@Longbow>
1868 <20090714150034.GA393@d228.scdc1.swarthmore.edu>
1869 Message-ID: <1247584002-sup-504@ntdws12.chass.utoronto.ca>
1870
1871 Excerpts from Tim Gray's message of Tue Jul 14 11:00:34 -0400 2009:
1872 > > Again, see sup-sync-back -- it does indeed have _some_ ability to write
1873 > > its state back to the source.
1874 >
1875 > To me, this is a vital feature of any mail client. I'll look into it, but I
1876 > would really like this to be fully integrated into my mail client. And from
1877 > I've read, this isn't something that's going to happen.
1878
1879 There was some talk a while back about modifying the behaviour of
1880 Maildir sources. The issue was that there is an odd scanning bug with
1881 Maildir that sometimes sees messages get skipped. A proposed solution
1882 was to have sup start 'playing nice' with Maildir so that when new
1883 messages were found in new/, they'd be indexed and recorded with a
1884 filename in cur/, presumably with the S (seen) flag appended properly.
1885
1886 I _think_ William was looking at that, but I'm not sure. It's
1887 something I'd like too (not to play nice with other clients, but
1888 because it's "just better"). I haven't had much time lately, but if
1889 William confirms he's not working on it, I'd be interested in
1890 implementing it.
1891
1892 Thanks
1893 -Ben
1894 --
1895 Ben Walton
1896 Systems Programmer - CHASS
1897 University of Toronto
1898 C:416.407.5610 | W:416.978.4302
1899
1900 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
1901 Contact me to arrange for a CAcert assurance meeting.
1902 -------------- next part --------------
1903 A non-text attachment was scrubbed...
1904 Name: signature.asc
1905 Type: application/pgp-signature
1906 Size: 189 bytes
1907 Desc: not available
1908 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090714/e30a5b14/attachment.bin>
1909
1910 From garoth@gmail.com Tue Jul 14 11:14:50 2009
1911 From: garoth@gmail.com (Andrei Thorp)
1912 Date: Tue, 14 Jul 2009 11:14:50 -0400
1913 Subject: [sup-talk] problems with Maildir and IMAP offline
1914 In-Reply-To: <20090714150034.GA393@d228.scdc1.swarthmore.edu>
1915 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
1916 <1247577490-sup-7098@Longbow>
1917 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
1918 <1247580020-sup-9946@Longbow>
1919 <20090714150034.GA393@d228.scdc1.swarthmore.edu>
1920 Message-ID: <1247584404-sup-7126@Longbow>
1921
1922 Excerpts from Tim Gray's message of Tue Jul 14 11:00:34 -0400 2009:
1923 > On Tue 14, Jul'09 at 10:02 AM -0400, Andrei Thorp wrote:
1924 > > Put this in a hook and it's automatic. That's the beauty of the
1925 > > hook/multiple binary design.
1926 >
1927 > Honestly, if it's that easy, shouldn't it be configured like that out of the
1928 > box?
1929
1930 People perhaps don't want this. It's slower, and a lot of folks probably
1931 do no syncing back since all they use is sup anyway.
1932
1933 > > I'm not entirely sure why you want this. If you're worried about
1934 > > failures, do they really happen? If you want to see the log, aren't you
1935 > > already piping it? If you want notifications, you could hook them up to
1936 > > happen in your sup hook (the one I described before) rather trivially
1937 > > via notify-send.
1938 >
1939 > For use with other mail clients for one.
1940
1941 Understood. Makes sense in your use case. I don't really understand why
1942 you'd want to use pine/mutt when you've already got sup though ;)
1943 --
1944 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
1945
1946 From lists+sup@protozoic.com Tue Jul 14 11:28:06 2009
1947 From: lists+sup@protozoic.com (Tim Gray)
1948 Date: Tue, 14 Jul 2009 11:28:06 -0400
1949 Subject: [sup-talk] problems with Maildir and IMAP offline
1950 In-Reply-To: <1247584002-sup-504@ntdws12.chass.utoronto.ca>
1951 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
1952 <1247577490-sup-7098@Longbow>
1953 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
1954 <1247580020-sup-9946@Longbow>
1955 <20090714150034.GA393@d228.scdc1.swarthmore.edu>
1956 <1247584002-sup-504@ntdws12.chass.utoronto.ca>
1957 Message-ID: <20090714152806.GC393@d228.scdc1.swarthmore.edu>
1958
1959 On Tue 14, Jul'09 at 11:07 AM -0400, Ben Walton wrote:
1960 > It's something I'd like too (not to play nice with other clients, but
1961 > because it's "just better").
1962
1963 This sound like a good thing. In my experience, 'just better' usually
1964 equals 'playing nice', since 'playing nice' usually equals following the
1965 standards. That's how Maildirs are supposed to work - if everybody followed
1966 the spec, we'd be set.
1967
1968 Though I don't program for a living, nor do I know any Ruby, it seems like a
1969 doable thing. Is there something fundamental blocking per-message sync-back
1970 of status as you read/delete/otherwise modify your mail? I would assume
1971 there a reference to the original message location in a message's database
1972 entry. If a message gets read, write an S at the end of the filename and
1973 move it to /cur. If it gets deleted, delete it. Operations on a message
1974 should affect the database and the mail store at the same time. Why is
1975 something like sup-sync-back even necessary?
1976
1977 Anyway, these are just the musings of someone who doesn't have the tools to
1978 write something like sup, so I'll be quiet now before I embarrass myself any
1979 further.
1980
1981 From garoth@gmail.com Tue Jul 14 11:39:09 2009
1982 From: garoth@gmail.com (Andrei Thorp)
1983 Date: Tue, 14 Jul 2009 11:39:09 -0400
1984 Subject: [sup-talk] problems with Maildir and IMAP offline
1985 In-Reply-To: <20090714152806.GC393@d228.scdc1.swarthmore.edu>
1986 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
1987 <1247577490-sup-7098@Longbow>
1988 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
1989 <1247580020-sup-9946@Longbow>
1990 <20090714150034.GA393@d228.scdc1.swarthmore.edu>
1991 <1247584002-sup-504@ntdws12.chass.utoronto.ca>
1992 <20090714152806.GC393@d228.scdc1.swarthmore.edu>
1993 Message-ID: <1247585761-sup-5167@Longbow>
1994
1995 Excerpts from Tim Gray's message of Tue Jul 14 11:28:06 -0400 2009:
1996 > On Tue 14, Jul'09 at 11:07 AM -0400, Ben Walton wrote:
1997 > > It's something I'd like too (not to play nice with other clients, but
1998 > > because it's "just better").
1999 >
2000 > This sound like a good thing. In my experience, 'just better' usually
2001 > equals 'playing nice', since 'playing nice' usually equals following the
2002 > standards. That's how Maildirs are supposed to work - if everybody followed
2003 > the spec, we'd be set.
2004
2005 I'd just like to mention that the reason we tend not to sync back in
2006 general isn't because we hate standards and want people to get hurt :)
2007
2008 It's roughly because of the extra features in sup:
2009 - It keeps a database so it can search for stuff quickly
2010 - It implements its own tagging regardless of source (unlike stuff like
2011 mutt that just rely on "physical" folders)
2012 - It merges sources
2013
2014 So while it's possible to do some merging back, it's sometimes awkward
2015 because sup's tags do not have to map 1:1 to IMAP folders or anything
2016 else. It's otherwise also a bit awkward because we might have mail from
2017 many sources in one place, so writing back isn't as simple as just
2018 editing files. You also have to _not_ edit files.
2019
2020 Anyway, that all said, it's clearly possible and would be very nice to
2021 have.
2022 --
2023 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
2024
2025 From lists+sup@protozoic.com Tue Jul 14 11:45:07 2009
2026 From: lists+sup@protozoic.com (Tim Gray)
2027 Date: Tue, 14 Jul 2009 11:45:07 -0400
2028 Subject: [sup-talk] problems with Maildir and IMAP offline
2029 In-Reply-To: <1247584404-sup-7126@Longbow>
2030 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
2031 <1247577490-sup-7098@Longbow>
2032 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
2033 <1247580020-sup-9946@Longbow>
2034 <20090714150034.GA393@d228.scdc1.swarthmore.edu>
2035 <1247584404-sup-7126@Longbow>
2036 Message-ID: <20090714154507.GD393@d228.scdc1.swarthmore.edu>
2037
2038 On Tue 14, Jul'09 at 11:14 AM -0400, Andrei Thorp wrote:
2039 > People perhaps don't want this. It's slower, and a lot of folks probably
2040 > do no syncing back since all they use is sup anyway.
2041
2042 I would hope in this day in age we can change a database entry and move a
2043 file at the same time without too much of a performance hit. I would think
2044 it only gets unbearable when you don't update as you go and you have to do a
2045 large batch of messages. But you are right, maybe people don't want that.
2046
2047 Personally, and this is a side note, if I was involved in the project, I'd
2048 push for canning the built in IMAP capabilities all together. Just run
2049 offlineimap or one of the other IMAP syncing utilities. Add to that beefing
2050 up the Maildir handling. Just worry about better and more transparent
2051 sync-back-to-Maildir capabilities and let offlineimap worry about the server
2052 side of the equation.
2053
2054 > Understood. Makes sense in your use case. I don't really understand why
2055 > you'd want to use pine/mutt when you've already got sup though ;)
2056
2057 As you can tell, I'm not quite sold on sup yet. I've switched mail clients
2058 enough over the past few years that switching in and of itself is a giant
2059 pain. I've settled on Maildir as my 'client' for now. I can serve it via
2060 IMAP if I need, I can read it with a couple mail clients, and I can easily
2061 convert it to mbox however I want to with some simple Python code.
2062
2063 If I switch to sup full time, I would be comforted by the fact that if I
2064 choose to change in 2 years, all of my mail is marked read, deleted mail is
2065 actually deleted, and even though I was using sup labels for my
2066 organization, things are still organized in some fashion by appropriate
2067 folders on the file system. The last part could be achievable by some
2068 combination of offlineimap + gmail/sieve filtering and fetchmail/getmail +
2069 procmail. It'd still be nice to be able to move physical messages around in
2070 sup though. Maybe I'm just nuts though.
2071
2072 From lists+sup@protozoic.com Tue Jul 14 11:59:16 2009
2073 From: lists+sup@protozoic.com (Tim Gray)
2074 Date: Tue, 14 Jul 2009 11:59:16 -0400
2075 Subject: [sup-talk] problems with Maildir and IMAP offline
2076 In-Reply-To: <1247585761-sup-5167@Longbow>
2077 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
2078 <1247577490-sup-7098@Longbow>
2079 <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
2080 <1247580020-sup-9946@Longbow>
2081 <20090714150034.GA393@d228.scdc1.swarthmore.edu>
2082 <1247584002-sup-504@ntdws12.chass.utoronto.ca>
2083 <20090714152806.GC393@d228.scdc1.swarthmore.edu>
2084 <1247585761-sup-5167@Longbow>
2085 Message-ID: <20090714155916.GE393@d228.scdc1.swarthmore.edu>
2086
2087 On Tue 14, Jul'09 at 11:39 AM -0400, Andrei Thorp wrote:
2088 > I'd just like to mention that the reason we tend not to sync back in
2089 > general isn't because we hate standards and want people to get hurt :)
2090
2091 Haha. Of course.
2092
2093 > It's roughly because of the extra features in sup:
2094
2095 I got you. Still, I envisage a mail client that has an underlying structure
2096 built on folders. On top of that a database/virtual folder interface is
2097 built. Of course, you'd have the ability to access the folder based
2098 structure when needed. So you could move a message or a conversation to a
2099 given folder if you want.
2100
2101 For example, I have work emails for a certain project with a given label.
2102 It's wonderful that in sup, those currently in my physical inbox and those
2103 currently in an archive folder somewhere show up under the same label in
2104 sup. But there's no mechanism to moving those in my physical inbox to the
2105 archive folder. Some might say who cares, but I can't leave all my email in
2106 my physical inbox forever, which is synced by offlineimap, because people
2107 associated with this project have a nasty habit of sending 10-20 mb
2108 attachments and I don't want to clutter up my IMAP boxes with hundreds of
2109 megs of attachments forever. Heck, I can't do that unless I have an IMAP
2110 service with 25 gigs of storage.* Sometimes they just need to be collected
2111 in a totally offline box, but somewhere that is still accessible by
2112 searching if I need access to it.
2113
2114 Sup is pretty close to this already, minus the access to the underlying
2115 structure.
2116
2117 ---
2118
2119 [*] Obviously for those of you using Gmail, this isn't an issue. Who cares
2120 about deleting messages?
2121
2122 From isra@herraiz.org Tue Jul 14 12:21:45 2009
2123 From: isra@herraiz.org (Israel Herraiz)
2124 Date: Tue, 14 Jul 2009 18:21:45 +0200
2125 Subject: [sup-talk] problems with Maildir and IMAP offline
2126 In-Reply-To: <20090713232022.fe1d4839.lcanas@libresoft.es>
2127 References: <20090713232022.fe1d4839.lcanas@libresoft.es>
2128 Message-ID: <1247587742-sup-5619@elly>
2129
2130 Excerpts from Luis's message on Jul 13, 2009 about 11 PM:
2131 > This afternoon I've been trying to set up a gmail account with offlineimap and
2132 > I'm having the same problem reported by this guy[1]. I run offlineimap and it
2133 > creates a Maildir directory with 4hundred read mails and 2hundred unread mails
2134 > (yes, I should pay more attention to my gmail account;).
2135
2136 I have not used IMAP with Sup, but AFAIK, Sup does not touch the
2137 original sources of email. For instance, it does not read nor modify
2138 messages using IMAP, it just read them using that protocol (or maildir
2139 or whatever).
2140
2141 Therefore, the only way to get those messages marked as read is using
2142 sup-sync with the --read option. That will mark the messages as read
2143 in Sup.
2144
2145 However there are two problems. If all the messages (unread or read)
2146 are in the same source, there is no way to indicate which messages are
2147 going to be marked as read and which are not.
2148
2149 Moreover, if you read a message in Sup, it still will appear in Gmail
2150 as unread.
2151
2152 I also use Gmail with Sup, but using POP. I use the web interface of
2153 Gmail when I cannnot access my laptop. I use IMAP from my mobile
2154 phone. And I download all my email to my laptop using POP.
2155
2156 If I get a message in my laptop, it is marked as archived and read in
2157 GMail, so it does not appear as unread in the web nor in my phone.
2158
2159 However, if I read the message in the phone or the web, it will appear
2160 as unread in Sup.
2161
2162 Still it is a good solution if you have a "central" node where you
2163 store your mail, and do your main work (my laptop), and a couple of
2164 "external" agents (phone, web) to be able of reading your email if you
2165 do not have your laptop at hand.
2166
2167 Another advantage is that you keep a copy of your mail in your
2168 laptop. GMail is not going to last forever (of course, it still has a
2169 long live) and with this you ensure that you will not loose your
2170 old-email in GMail is closed some day, and it is also very handy to
2171 make backups of all your email (just copy the mbox file to another
2172 location).
2173
2174 To get the email I use getmail [1], and msmtp [2] with these scripts
2175 [3] (see last section) as a lightweight replacement for sendmail. I
2176 can provide you my config scripts if you want.
2177
2178 It is not a good solution though if you read your email from several
2179 different computers.
2180
2181 Cheers,
2182 Israel
2183
2184 [1] http://pyropus.ca/software/getmail/
2185 [2] http://msmtp.sourceforge.net/
2186 [3] http://wiki.archlinux.org/index.php/Msmtp
2187
2188 From johnbent@lanl.gov Tue Jul 14 11:43:01 2009
2189 From: johnbent@lanl.gov (John Bent)
2190 Date: Tue, 14 Jul 2009 09:43:01 -0600
2191 Subject: [sup-talk] Using sup on multiple computers?
2192 In-Reply-To: <1247186181-sup-1712@x200>
2193 References: <1247186181-sup-1712@x200>
2194 Message-ID: <1247585908-sup-4190@tangerine.lanl.gov>
2195
2196 Excerpts from Michael Stapelberg's message of Thu Jul 09 18:38:25 -0600
2197 2009:
2198 > Hi,
2199 >
2200 > I?d like to use sup on my notebook and on my workstation. Is there any
2201 > simple/recommended way to synchronize the index? I figured using
2202 > multiple clients in parallel is one of the big advantages of IMAP and
2203 > I?d love to keep it that way while using sup.
2204 >
2205 This won't really answer your exact question but I also use sup on a
2206 workstation and a notebook. What I do is run sup in a screen session on
2207 the workstation and then connect to it from the laptop. The window size
2208 is different on the workstation and the laptop so whenever I switch, I
2209 have to do:
2210
2211 <ctr-a>F : to get screen to resize
2212 @ : to get sup to redraw itself
2213
2214 Hope that helps,
2215
2216 John
2217 > Best regards,
2218 > Michael
2219
2220 From bwalton@artsci.utoronto.ca Tue Jul 14 15:33:36 2009
2221 From: bwalton@artsci.utoronto.ca (Ben Walton)
2222 Date: Tue, 14 Jul 2009 15:33:36 -0400
2223 Subject: [sup-talk] Using sup on multiple computers?
2224 In-Reply-To: <1247585908-sup-4190@tangerine.lanl.gov>
2225 References: <1247186181-sup-1712@x200> <1247585908-sup-4190@tangerine.lanl.gov>
2226 Message-ID: <1247599899-sup-811@ntdws12.chass.utoronto.ca>
2227
2228 Excerpts from John Bent's message of Tue Jul 14 11:43:01 -0400 2009:
2229 > @ : to get sup to redraw itself
2230
2231 Try Ctrl+L for the redraw. Saves having sup do any work at all. This
2232 is also good for when the display gets corrupted in screen. It's a
2233 pretty standard sequence too, so you may find it applicable elsewhere
2234 (eg: it'll clear your terminal for you, redraw and centre a buffer in
2235 emacs, etc).
2236
2237 HTH.
2238 -Ben
2239 --
2240 Ben Walton
2241 Systems Programmer - CHASS
2242 University of Toronto
2243 C:416.407.5610 | W:416.978.4302
2244
2245 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
2246 Contact me to arrange for a CAcert assurance meeting.
2247 -------------- next part --------------
2248 A non-text attachment was scrubbed...
2249 Name: signature.asc
2250 Type: application/pgp-signature
2251 Size: 189 bytes
2252 Desc: not available
2253 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090714/143b6aca/attachment.bin>
2254
2255 From michael+sup@stapelberg.de Tue Jul 14 15:35:12 2009
2256 From: michael+sup@stapelberg.de (Michael Stapelberg)
2257 Date: Tue, 14 Jul 2009 21:35:12 +0200
2258 Subject: [sup-talk] Using sup on multiple computers?
2259 In-Reply-To: <1247585908-sup-4190@tangerine.lanl.gov>
2260 References: <1247186181-sup-1712@x200> <1247585908-sup-4190@tangerine.lanl.gov>
2261 Message-ID: <1247600011-sup-635@midna>
2262
2263 Hi John,
2264
2265 Excerpts from John Bent's message of Di Jul 14 17:43:01 +0200 2009:
2266 > <ctr-a>F : to get screen to resize
2267 > @ : to get sup to redraw itself
2268 > Hope that helps,
2269 Thanks, that?s at least a good start to get where I was with mutt. However,
2270 it does not solve the other problems (GUI traffic/latency vs. IMAP,
2271 opening/adding attachments).
2272
2273 Best regards,
2274 Michael
2275
2276 From rgh@roughage.com.au Fri Jul 17 19:42:07 2009
2277 From: rgh@roughage.com.au (Richard Heycock)
2278 Date: Sat, 18 Jul 2009 09:42:07 +1000
2279 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
2280 In-Reply-To: <1246022094-sup-3336@entry>
2281 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
2282 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
2283 <loom.20090625T222159-861@post.gmane.org>
2284 <1246022094-sup-3336@entry>
2285 Message-ID: <1247873980-sup-8574@wrasse>
2286
2287 Excerpts from William Morgan's message of Fri Jun 26 23:49:40 +1000 2009:
2288 > Reformatted excerpts from Olly Betts's message of 2009-06-25:
2289 > > I'll make sure this fix makes it into the next Xapian release (which
2290 > > will be 1.0.14).
2291 >
2292 > Awesome, thanks!
2293 >
2294 > Though even with SWIG fixed there will still be some tweaking necessary
2295 > in Sup because the logistic function used for generating Xapian docids
2296 > still has trouble with extreme dates.
2297 >
2298 > BTW, more kudos to Rich for somehow finding a way to use a logistic
2299 > function in an email client.
2300
2301 I've been meaning to respond to this the day this was posted. Rich Lane
2302 thank you, thank you. Ferret was one of by biggest gripes of using sup.
2303 I've used it elsewhere and it's a shocker; I eventually migrated it all
2304 to Xapian which has worked flawlessly since. I used to rebuild by ferret
2305 index almost on a weekly basis (I'm running debian unstable, which at
2306 the moment is really living up to it's name) at one stage something I
2307 haven't had to do once since migrating to Xapian.
2308
2309 I got it work with 1.9 once but there are some problems that I just
2310 haven't had the time to look into but I will do and post any problems to
2311 the list.
2312
2313 rgh
2314
2315 From lee@yun.yagibdah.de Sat Jul 18 03:41:51 2009
2316 From: lee@yun.yagibdah.de (lee)
2317 Date: Sat, 18 Jul 2009 01:41:51 -0600
2318 Subject: [sup-talk] trying out sup ...
2319 Message-ID: <20090718074151.GF30748@cat.rubenette.is-a-geek.com>
2320
2321 Hi,
2322
2323 I've started trying out sup on Debian Testing amd64. Searching didn't
2324 work, so I installed a replacement library[1] after finding a bug
2325 report[2].
2326
2327 Now the search would work, but when I'm trying to enter something to
2328 search for or only press enter to see a list of labels I used, no
2329 matches are found, and the status line shows some garbage characters
2330 as string that has been searched for. This happens when sup is running
2331 in an xterm or in rxvt; it doesn't happen when I switch to the console
2332 and run sup there.
2333
2334 So I had sup running on the console and tried out to search for
2335 something while sup was looking for new messages in a maildir. But
2336 then it crashed and told me I should send a bug report[3].
2337
2338 Maybe I have created some incompatibilities by installing the
2339 replacement library. But is it currently possible to run sup on Debian
2340 Testing without too much difficulty? If so, what do I need to do?
2341
2342
2343 [1]:
2344 http://apt.rupamsunyata.org/sup/libncurses-ruby1.8_1.2.3-0.2_amd64.deb
2345 [2]:
2346 http://groups.google.com/group/linux.debian.bugs.dist/browse_thread/thread/d79896cacc28e0e8/7a76dece1e5ef6a3?lnk=raot
2347 [3]: ~/.sup/exception-log.txt:
2348
2349 --- NoMethodError from thread: poll after loading inbox
2350 undefined method `content_width' for nil:NilClass
2351 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:747:in `from_width'
2352 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:672:in `text_for_thread_at'
2353 /usr/lib/ruby/1.8/sup/hook.rb:134:in `each_with_index'
2354 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:671:in `each'
2355 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:671:in `each_with_index'
2356 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:671:in `text_for_thread_at'
2357 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:632:in `regen_text'
2358 /usr/lib/ruby/1.8/sup/util.rb:344:in `map_with_index'
2359 /usr/lib/ruby/1.8/sup/hook.rb:134:in `each_with_index'
2360 /usr/lib/ruby/1.8/sup/util.rb:344:in `each'
2361 /usr/lib/ruby/1.8/sup/util.rb:344:in `each_with_index'
2362 /usr/lib/ruby/1.8/sup/util.rb:344:in `map_with_index'
2363 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:632:in `regen_text'
2364 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:219:in `update'
2365 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:576:in `add_or_unhide'
2366 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:181:in `handle_added_update'
2367 /usr/lib/ruby/1.8/sup/update.rb:27:in `send'
2368 /usr/lib/ruby/1.8/sup/update.rb:27:in `relay'
2369 /usr/lib/ruby/1.8/sup/update.rb:27:in `each'
2370 /usr/lib/ruby/1.8/sup/update.rb:27:in `relay'
2371 /usr/lib/ruby/1.8/sup/util.rb:499:in `send'
2372 /usr/lib/ruby/1.8/sup/util.rb:499:in `method_missing'
2373 /usr/lib/ruby/1.8/sup/poll.rb:161:in `add_messages_from'
2374 /usr/lib/ruby/1.8/sup/maildir.rb:130:in `each'
2375 /usr/lib/ruby/1.8/sup/maildir.rb:127:in `upto'
2376 /usr/lib/ruby/1.8/sup/maildir.rb:127:in `each'
2377 /usr/lib/ruby/1.8/sup/util.rb:538:in `send'
2378 /usr/lib/ruby/1.8/sup/util.rb:538:in `__pass'
2379 /usr/lib/ruby/1.8/sup/util.rb:525:in `method_missing'
2380 /usr/lib/ruby/1.8/sup/poll.rb:141:in `add_messages_from'
2381 /usr/lib/ruby/1.8/sup/poll.rb:98:in `do_poll'
2382 /usr/lib/ruby/1.8/sup/poll.rb:86:in `each'
2383 /usr/lib/ruby/1.8/sup/poll.rb:86:in `do_poll'
2384 /usr/lib/ruby/1.8/sup/poll.rb:85:in `synchronize'
2385 /usr/lib/ruby/1.8/sup/poll.rb:85:in `do_poll'
2386 /usr/lib/ruby/1.8/sup/util.rb:499:in `send'
2387 /usr/lib/ruby/1.8/sup/util.rb:499:in `method_missing'
2388 /usr/lib/ruby/1.8/sup/modes/poll-mode.rb:17:in `poll'
2389 /usr/lib/ruby/1.8/sup/poll.rb:53:in `poll'
2390 /usr/lib/ruby/1.8/sup/util.rb:499:in `send'
2391 /usr/lib/ruby/1.8/sup/util.rb:499:in `method_missing'
2392 /usr/bin/sup-mail:173
2393 /usr/lib/ruby/1.8/sup.rb:84:in `reporting_thread'
2394 /usr/lib/ruby/1.8/sup.rb:82:in `initialize'
2395 /usr/lib/ruby/1.8/sup.rb:82:in `new'
2396 /usr/lib/ruby/1.8/sup.rb:82:in `reporting_thread'
2397 /usr/bin/sup-mail:173
2398 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:543:in `call'
2399 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:543:in `__unprotected_load_threads'
2400 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:485:in `call'
2401 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:485:in `load_n_threads_background'
2402 /usr/lib/ruby/1.8/sup.rb:84:in `reporting_thread'
2403 /usr/lib/ruby/1.8/sup.rb:82:in `initialize'
2404 /usr/lib/ruby/1.8/sup.rb:82:in `new'
2405 /usr/lib/ruby/1.8/sup.rb:82:in `reporting_thread'
2406 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:483:in `load_n_threads_background'
2407 /usr/lib/ruby/1.8/sup/modes/thread-index-mode.rb:553:in `__unprotected_load_threads'
2408 (eval):12:in `load_threads'
2409 /usr/bin/sup-mail:173
2410
2411 From michael+sup@stapelberg.de Mon Jul 20 08:34:56 2009
2412 From: michael+sup@stapelberg.de (Michael Stapelberg)
2413 Date: Mon, 20 Jul 2009 14:34:56 +0200
2414 Subject: [sup-talk] [PATCH] GSSAPI support for net/imap.rb and sup
2415 Message-ID: <1248092732-sup-9960@midna>
2416
2417 Hi,
2418
2419 since I installed my new mailserver with Kerberos auth only, I needed to
2420 implement GSSAPI support for Net::IMAP and sup.
2421
2422 I found the C bindings called ruby-gss at:
2423 http://devel.it.su.se/pub/jsp/polopoly.jsp?d=1047&a=3790
2424
2425 Using them (and adding the wrap/unwrap methods for a context, see
2426 03-ruby-gss.patch), it was relatively easy to implement GSSAPIAuthenticator
2427 (see 02-net_imap-gssapi.patch). The addition of the authenticator to sup is
2428 trivial (see 01-sup_gssapi.patch).
2429
2430 Here comes the catch:
2431 As I?m not very much involved in the ruby community (in fact, this is my first
2432 piece of ruby code), I need someone to help me get things upstream (for
2433 Net::IMAP in the first place, but someone maintaining ruby-gss would be great).
2434 As for the sup patch, I think this already is the right place to post it ;-).
2435
2436 Short installation instructions for those not so familiar with ruby:
2437 $ cd ruby-gss
2438 $ ruby extconf.rb
2439 $ make
2440 $ sudo make install
2441 # patch /usr/lib/ruby/1.8/net/imap.rb
2442 # patch /usr/lib/ruby/1.8/sup/imap.rb
2443
2444 Best regards,
2445 Michael
2446 -------------- next part --------------
2447 A non-text attachment was scrubbed...
2448 Name: 01-sup_gssapi.patch
2449 Type: application/octet-stream
2450 Size: 1936 bytes
2451 Desc: not available
2452 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090720/9d9a88ec/attachment.obj>
2453 -------------- next part --------------
2454 A non-text attachment was scrubbed...
2455 Name: 02-net_imap_gssapi.patch
2456 Type: application/octet-stream
2457 Size: 2373 bytes
2458 Desc: not available
2459 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090720/9d9a88ec/attachment-0001.obj>
2460 -------------- next part --------------
2461 A non-text attachment was scrubbed...
2462 Name: 03-ruby-gss.patch
2463 Type: application/octet-stream
2464 Size: 2891 bytes
2465 Desc: not available
2466 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090720/9d9a88ec/attachment-0002.obj>
2467
2468 From sgoldman@tower-research.com Wed Jul 22 21:10:41 2009
2469 From: sgoldman@tower-research.com (Steve Goldman)
2470 Date: Wed, 22 Jul 2009 21:10:41 -0400
2471 Subject: [sup-talk] Choose "From:" address based on message content?
2472 Message-ID: <1248311332-sup-1053@sgoldmanlinux.tower-research.com>
2473
2474
2475 Here's what I want:
2476
2477 After I compose an email (new or a reply), I want sup to grep the
2478 entire message (recipients, subject, body, etc.) for a single word and
2479 choose address A if that word is there and address B otherwise.
2480
2481 Can sup do it?
2482
2483 Thanks.
2484
2485 --
2486
2487 Steve Goldman
2488 sgoldman at tower-research.com
2489
2490 T: 212.219.6014
2491 F: 212.219.6007
2492
2493 Tower Research Capital, LLC
2494 377 Broadway, 11th Fl.
2495 New York, NY 10013
2496
2497 From sgoldman@tower-research.com Wed Jul 22 22:51:54 2009
2498 From: sgoldman@tower-research.com (Steve Goldman)
2499 Date: Wed, 22 Jul 2009 22:51:54 -0400
2500 Subject: [sup-talk] Choose "From:" address based on message content?
2501 In-Reply-To: <1248311332-sup-1053@sgoldmanlinux.tower-research.com>
2502 References: <1248311332-sup-1053@sgoldmanlinux.tower-research.com>
2503 Message-ID: <1248317360-sup-4094@sgoldmanlinux.tower-research.com>
2504
2505 Excerpts from Steve Goldman's message of Wed Jul 22 21:10:41 -0400 2009:
2506 >
2507 > Here's what I want:
2508 >
2509 > After I compose an email (new or a reply), I want sup to grep the
2510 > entire message (recipients, subject, body, etc.) for a single word and
2511 > choose address A if that word is there and address B otherwise.
2512 >
2513 > Can sup do it?
2514 >
2515 > Thanks.
2516 >
2517
2518 I think I answered my own question.
2519
2520 I added an "after-edit" hook call in edit-message-mode.rb and wrote a
2521 hook that looks like this:
2522
2523
2524 require 'eregex'
2525
2526 r = Regexp.new('word', Regexp::IGNORECASE);
2527 if header.to_s.grep(r).size > 0 or body.to_s.grep(r).size > 0
2528 header["From"] = "Steve Goldman <sgoldman at other-address.com>"
2529 end
2530 --
2531
2532 Steve Goldman
2533 sgoldman at tower-research.com
2534
2535 T: 212.219.6014
2536 F: 212.219.6007
2537
2538 Tower Research Capital, LLC
2539 377 Broadway, 11th Fl.
2540 New York, NY 10013
2541
2542 From dato@net.com.org.es Thu Jul 23 05:35:43 2009
2543 From: dato@net.com.org.es (Adeodato =?utf-8?B?U2ltw7M=?=)
2544 Date: Thu, 23 Jul 2009 11:35:43 +0200
2545 Subject: [sup-talk] [PATCH] mime-decode hook: provide a "charset"
2546 variable with the attachment charset
2547 In-Reply-To: <6fc2e5dd8aa2b0b8547375d77b1776d779f85817.1247238014.git.dato@net.com.org.es>
2548 References: <6fc2e5dd8aa2b0b8547375d77b1776d779f85817.1247238014.git.dato@net.com.org.es>
2549 Message-ID: <20090723093543.GA2265@chistera.yi.org>
2550
2551 + Adeodato Sim? (Fri, 10 Jul 2009 17:00:29 +0200):
2552
2553 > + :charset => encoded_content.charset,
2554
2555 Hm, so apparently encoded_content doesn't always have a charset
2556 member...
2557
2558 --
2559 - Are you sure we're good?
2560 - Always.
2561 -- Rory and Lorelai
2562
2563
2564 From dato@net.com.org.es Thu Jul 23 06:23:25 2009
2565 From: dato@net.com.org.es (Adeodato =?utf-8?B?U2ltw7M=?=)
2566 Date: Thu, 23 Jul 2009 12:23:25 +0200
2567 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
2568 In-Reply-To: <1247873980-sup-8574@wrasse>
2569 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
2570 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
2571 <loom.20090625T222159-861@post.gmane.org>
2572 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
2573 Message-ID: <20090723102325.GA4291@chistera.yi.org>
2574
2575 + Richard Heycock (Sat, 18 Jul 2009 09:42:07 +1000):
2576
2577 > I've been meaning to respond to this the day this was posted. Rich Lane
2578 > thank you, thank you. Ferret was one of by biggest gripes of using sup.
2579 > I've used it elsewhere and it's a shocker; I eventually migrated it all
2580 > to Xapian which has worked flawlessly since. I used to rebuild by ferret
2581 > index almost on a weekly basis (I'm running debian unstable, which at
2582 > the moment is really living up to it's name) at one stage something I
2583 > haven't had to do once since migrating to Xapian.
2584
2585 Yeah, thanks Rich! However, there seems to be something wrong with the
2586 parsing of contacts. After reindexing with Xapian, my contact list has
2587 entries like:
2588
2589 <dato <dato at net.com.org.esadeodato
2590 <other <other at foo.ua.esfoo
2591 dato at net.com.org.esAdeodato Simo other2 at domain.netother2 surname2
2592
2593 Plus, nor '!label:inbox' or '-label:inbox' work for me. From an
2594 inspection of the code, it doesn't look to me as random negated labels
2595 are being parsed.
2596
2597 Any hints?
2598
2599 --
2600 - Are you sure we're good?
2601 - Always.
2602 -- Rory and Lorelai
2603
2604
2605 From dato@net.com.org.es Thu Jul 23 13:12:58 2009
2606 From: dato@net.com.org.es (=?utf-8?q?Adeodato=20Sim=C3=B3?=)
2607 Date: Thu, 23 Jul 2009 19:12:58 +0200
2608 Subject: [sup-talk] [RFC] Fix parsing of encrypted messages that contain
2609 further multipart elements
2610 Message-ID: <ff7df0405d003a8f4e88f0dd191d8bf4875f73f3.1248368899.git.dato@net.com.org.es>
2611
2612 ---
2613 Hello,
2614
2615 this is just a RFC, because I can't think of any elegant way to address
2616 the issue, given the shortcomings of the RMail API. Please read the
2617 lengthy comment in the patch, and let me know if anybody has any ideas
2618 about this issue.
2619
2620 P.S.: I've created a "sup-dato" repository in Gitorious, in case that's
2621 helpful. Should I be creating merge requests?
2622
2623 lib/sup/crypto.rb | 19 ++++++++++++++++++-
2624 1 files changed, 18 insertions(+), 1 deletions(-)
2625
2626 diff --git a/lib/sup/crypto.rb b/lib/sup/crypto.rb
2627 index 8ec277b..6ef0c0e 100644
2628 --- a/lib/sup/crypto.rb
2629 +++ b/lib/sup/crypto.rb
2630 @@ -132,8 +132,25 @@ class CryptoManager
2631 end
2632 end
2633
2634 + # This is gross. The decrypted payload could very well be a multipart
2635 + # element itself, as opposed to a simple payload; for example, a
2636 + # multipart/signed element, like Mutt does when encrypting and signing a
2637 + # message (instead of clearsigning it). Supposedly, decrypted_payload
2638 + # being a multipart element ought to work out nicely because in
2639 + # Message::multipart_encrypted_to_chunks() the decrypted message is run
2640 + # though message_to_chunks() again to get any children. However, it does
2641 + # not work as intended because this inner payload need not carry a
2642 + # MIME-Version header, yet they are fed to RMail as a top-level message,
2643 + # for which the MIME-Version header is required, which causes for the
2644 + # part not to be detected as multipart. If we detect this is happening,
2645 + # force the payload to be interpreted as MIME.
2646 + msg = RMail::Parser.read(decrypted_payload)
2647 + if msg.header.content_type =~ %r{^multipart/} and not msg.multipart?
2648 + decrypted_payload = "MIME-Version: 1.0\n" + decrypted_payload
2649 + msg = RMail::Parser.read(decrypted_payload)
2650 + end
2651 notice = Chunk::CryptoNotice.new :valid, "This message has been decrypted for display"
2652 - [RMail::Parser.read(decrypted_payload), sig, notice]
2653 + [msg, sig, notice]
2654 else
2655 notice = Chunk::CryptoNotice.new :invalid, "This message could not be decrypted", output.split("\n")
2656 [nil, nil, notice]
2657 --
2658 1.6.3.3
2659
2660
2661 From dato@net.com.org.es Thu Jul 23 13:19:51 2009
2662 From: dato@net.com.org.es (=?utf-8?q?Adeodato=20Sim=C3=B3?=)
2663 Date: Thu, 23 Jul 2009 19:19:51 +0200
2664 Subject: [sup-talk] [PATCH] Fix parsing of encrypted messages that contain
2665 further multipart elements
2666 In-Reply-To: <ff7df0405d003a8f4e88f0dd191d8bf4875f73f3.1248368899.git.dato@net.com.org.es>
2667 References: <ff7df0405d003a8f4e88f0dd191d8bf4875f73f3.1248368899.git.dato@net.com.org.es>
2668 Message-ID: <6fd87965a2e243b190678edb6c4b9cefbde9ae66.1248369563.git.dato@net.com.org.es>
2669
2670 ---
2671 Amended patch follows, with a better wording that I had seemingly not
2672 committed. Sorry for the noise.
2673
2674 lib/sup/crypto.rb | 20 +++++++++++++++++++-
2675 1 files changed, 19 insertions(+), 1 deletions(-)
2676
2677 diff --git a/lib/sup/crypto.rb b/lib/sup/crypto.rb
2678 index 8ec277b..acbc1d8 100644
2679 --- a/lib/sup/crypto.rb
2680 +++ b/lib/sup/crypto.rb
2681 @@ -132,8 +132,26 @@ class CryptoManager
2682 end
2683 end
2684
2685 + # This is gross. This decrypted payload could very well be a multipart
2686 + # element itself, as opposed to a simple payload. For example, a
2687 + # multipart/signed element, like those generated by Mutt when encrypting
2688 + # and signing a message (instead of just clearsigning the body).
2689 + # Supposedly, decrypted_payload being a multipart element ought to work
2690 + # out nicely because Message::multipart_encrypted_to_chunks() runs the
2691 + # decrypted message through message_to_chunks() again to get any
2692 + # children. However, it does not work as intended because these inner
2693 + # payloads need not carry a MIME-Version header, yet they are fed to
2694 + # RMail as a top-level message, for which the MIME-Version header is
2695 + # required. This causes for the part not to be detected as multipart,
2696 + # hence being shown as an attachment. If we detect this is happening,
2697 + # we force the decrypted payload to be interpreted as MIME.
2698 + msg = RMail::Parser.read(decrypted_payload)
2699 + if msg.header.content_type =~ %r{^multipart/} and not msg.multipart?
2700 + decrypted_payload = "MIME-Version: 1.0\n" + decrypted_payload
2701 + msg = RMail::Parser.read(decrypted_payload)
2702 + end
2703 notice = Chunk::CryptoNotice.new :valid, "This message has been decrypted for display"
2704 - [RMail::Parser.read(decrypted_payload), sig, notice]
2705 + [msg, sig, notice]
2706 else
2707 notice = Chunk::CryptoNotice.new :invalid, "This message could not be decrypted", output.split("\n")
2708 [nil, nil, notice]
2709 --
2710 1.6.3.3
2711
2712
2713 From marco-oweber@gmx.de Fri Jul 24 12:35:15 2009
2714 From: marco-oweber@gmx.de (Marc Weber)
2715 Date: Fri, 24 Jul 2009 18:35:15 +0200
2716 Subject: [sup-talk] Exception
2717 Message-ID: <1248453259-sup-3604@nixos>
2718
2719 Hi, when either running sup-sync or sup (without -n) I get this
2720 exception:
2721
2722 --- NoMethodError from thread: poll after loading inbox
2723 undefined method `to_indexable_s' for nil:NilClass
2724 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/index.rb:244:in `sync_message'
2725 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `send'
2726 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `method_missing'
2727 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:161:in `add_messages_from'
2728 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/source.rb:100:in `each'
2729 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:552:in `send'
2730 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:552:in `__pass'
2731 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:539:in `method_missing'
2732 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:141:in `add_messages_from'
2733 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:98:in `do_poll'
2734 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:86:in `each'
2735 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:86:in `do_poll'
2736 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:85:in `synchronize'
2737 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:85:in `do_poll'
2738 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `send'
2739 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `method_missing'
2740 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/modes/poll-mode.rb:17:in `poll'
2741 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:53:in `poll'
2742 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `send'
2743 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `method_missing'
2744 /home/marc/.nix-profile/gems/sup-0.8.1/bin/sup:206
2745 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:71:in `reporting_thread'
2746 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:69:in `initialize'
2747 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:69:in `new'
2748 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:69:in `reporting_thread'
2749 /home/marc/.nix-profile/gems/sup-0.8.1/bin/sup:206
2750 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:663:in `call'
2751 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:663:in `__unprotected_load_threads'
2752 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:605:in `call'
2753 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:605:in `load_n_threads_background'
2754 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:71:in `reporting_thread'
2755 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:69:in `initialize'
2756 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:69:in `new'
2757 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup.rb:69:in `reporting_thread'
2758 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:603:in `load_n_threads_background'
2759 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/modes/thread-index-mode.rb:673:in `__unprotected_load_threads'
2760 (eval):12:in `load_threads'
2761 /home/marc/.nix-profile/gems/sup-0.8.1/bin/sup:206
2762 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/bin/.sup-wrapped:19:in `load'
2763 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/bin/.sup-wrapped:19
2764
2765 Do you see what's happening here or shall I start debugging?
2766
2767 The sup-sync exception trace looks like this:
2768
2769 /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/index.rb:244:in `sync_message': undefined method `to_indexable_s' for nil:NilClass (NoMethodError)
2770 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `send'
2771 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `method_missing'
2772 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:161:in `add_messages_from'
2773 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/source.rb:100:in `each'
2774 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:552:in `send'
2775 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:552:in `__pass'
2776 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:539:in `method_missing'
2777 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/poll.rb:141:in `add_messages_from'
2778 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `send'
2779 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/gems/sup-0.8.1/lib/sup/util.rb:513:in `method_missing'
2780 from /home/marc/.nix-profile/gems/sup-0.8.1/bin/sup-sync:140
2781 from /home/marc/.nix-profile/gems/sup-0.8.1/bin/sup-sync:135:in `each'
2782 from /home/marc/.nix-profile/gems/sup-0.8.1/bin/sup-sync:135
2783 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/bin/.sup-sync-wrapped:19:in `load'
2784 from /nix/store/cg3g3wyz2bibk8zc5ykhdyr2a166x87l-sup-0.8.1/bin/.sup-sync-wrapped:19
2785
2786
2787
2788 Marc Weber
2789
2790 From rlane@club.cc.cmu.edu Fri Jul 24 22:50:54 2009
2791 From: rlane@club.cc.cmu.edu (Rich Lane)
2792 Date: Fri, 24 Jul 2009 19:50:54 -0700
2793 Subject: [sup-talk] [PATCH] xapian: initialize sources in sup-dump
2794 Message-ID: <1248490254-31895-1-git-send-email-rlane@club.cc.cmu.edu>
2795
2796 ---
2797 bin/sup-dump | 1 +
2798 1 files changed, 1 insertions(+), 0 deletions(-)
2799
2800 diff --git a/bin/sup-dump b/bin/sup-dump
2801 index 9b0892e..c18a767 100755
2802 --- a/bin/sup-dump
2803 +++ b/bin/sup-dump
2804 @@ -22,6 +22,7 @@ EOS
2805 end
2806
2807 index = Redwood::Index.new
2808 +Redwood::SourceManager.new
2809 index.load
2810
2811 index.each_message do |m|
2812 --
2813 1.6.0.4
2814
2815
2816 From rlane@club.cc.cmu.edu Fri Jul 24 23:25:09 2009
2817 From: rlane@club.cc.cmu.edu (Rich Lane)
2818 Date: Fri, 24 Jul 2009 20:25:09 -0700
2819 Subject: [sup-talk] [PATCH] xapian: fix mk_addrs args in build_message
2820 Message-ID: <1248492309-1980-1-git-send-email-rlane@club.cc.cmu.edu>
2821
2822 ---
2823 lib/sup/xapian_index.rb | 6 +++---
2824 1 files changed, 3 insertions(+), 3 deletions(-)
2825
2826 diff --git a/lib/sup/xapian_index.rb b/lib/sup/xapian_index.rb
2827 index d064ffc..23af431 100644
2828 --- a/lib/sup/xapian_index.rb
2829 +++ b/lib/sup/xapian_index.rb
2830 @@ -68,9 +68,9 @@ class XapianIndex < BaseIndex
2831 'date' => Time.at(entry[:date]),
2832 'subject' => entry[:subject],
2833 'from' => mk_addrs[[entry[:from]]],
2834 - 'to' => mk_addrs[[entry[:to]]],
2835 - 'cc' => mk_addrs[[entry[:cc]]],
2836 - 'bcc' => mk_addrs[[entry[:bcc]]],
2837 + 'to' => mk_addrs[entry[:to]],
2838 + 'cc' => mk_addrs[entry[:cc]],
2839 + 'bcc' => mk_addrs[entry[:bcc]],
2840 'reply-tos' => mk_refs[entry[:replytos]],
2841 'references' => mk_refs[entry[:refs]],
2842 }
2843 --
2844 1.6.0.4
2845
2846
2847 From rlane@club.cc.cmu.edu Sat Jul 25 00:53:07 2009
2848 From: rlane@club.cc.cmu.edu (Rich Lane)
2849 Date: Sat, 25 Jul 2009 00:53:07 -0400
2850 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
2851 In-Reply-To: <20090723102325.GA4291@chistera.yi.org>
2852 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
2853 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
2854 <loom.20090625T222159-861@post.gmane.org>
2855 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
2856 <20090723102325.GA4291@chistera.yi.org>
2857 Message-ID: <1248497184-sup-939@pion.club.cc.cmu.edu>
2858
2859 > Yeah, thanks Rich! However, there seems to be something wrong with the
2860 > parsing of contacts. After reindexing with Xapian, my contact list has
2861 > entries like:
2862 >
2863 > <dato <dato at net.com.org.esadeodato
2864 > <other <other at foo.ua.esfoo
2865 > dato at net.com.org.esAdeodato Simo other2 at domain.netother2 surname2
2866
2867 Thanks for the bug report, I've posted a patch (fix-mk_addrs-args) to
2868 fix this. You shouldn't need to reindex after applying the patch.
2869
2870 > Plus, nor '!label:inbox' or '-label:inbox' work for me. From an
2871 > inspection of the code, it doesn't look to me as random negated labels
2872 > are being parsed.
2873 >
2874 > Any hints?
2875
2876 You need to specify a non-negated term in the query.
2877 "type:mail -label:inbox" should work.
2878
2879 From dato@net.com.org.es Sat Jul 25 05:21:16 2009
2880 From: dato@net.com.org.es (=?utf-8?q?Adeodato_Sim=C3=B3?=)
2881 Date: Sat, 25 Jul 2009 11:21:16 +0200
2882 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
2883 In-Reply-To: <1248497184-sup-939@pion.club.cc.cmu.edu>
2884 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
2885 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
2886 <loom.20090625T222159-861@post.gmane.org>
2887 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
2888 <20090723102325.GA4291@chistera.yi.org>
2889 <1248497184-sup-939@pion.club.cc.cmu.edu>
2890 Message-ID: <1248513425-sup-2484@chistera.yi.org>
2891
2892 + Rich Lane (Sat, 25 Jul 2009 06:53:07 +0200):
2893
2894 > Thanks for the bug report, I've posted a patch (fix-mk_addrs-args) to
2895 > fix this. You shouldn't need to reindex after applying the patch.
2896
2897 Great, thanks. The patch indeed fixes the issue.
2898
2899 > > Plus, nor '!label:inbox' or '-label:inbox' work for me. From an
2900 > > inspection of the code, it doesn't look to me as random negated labels
2901 > > are being parsed.
2902
2903 > > Any hints?
2904
2905 > You need to specify a non-negated term in the query.
2906 > "type:mail -label:inbox" should work.
2907
2908 Oh, I see. Yes, that works, thanks.
2909
2910 One extra issue I just noticed: after dumping with ferret, reloading
2911 into Xapian, and doing a dump again (with Xapian this time), all the
2912 messages tagged "deleted" or "spam" do not appear in the dump at all.
2913 Any ideas?
2914
2915 --
2916 - Are you sure we're good?
2917 - Always.
2918 -- Rory and Lorelai
2919
2920
2921 From ezyang@MIT.EDU Sat Jul 25 14:10:54 2009
2922 From: ezyang@MIT.EDU (Edward Z. Yang)
2923 Date: Sat, 25 Jul 2009 14:10:54 -0400
2924 Subject: [sup-talk] Reply calculation
2925 Message-ID: <1248545266-sup-6886@javelin>
2926
2927 I think sup's "To" address calculation algorithm is wrong, and
2928 messes up in some important edge-cases. The two edge
2929 cases I have in mind are:
2930
2931 * When a mailing list sends an unsubscribe/subscribe notification
2932
2933 * When someone posts to a mailing list with an explicit Reply-to
2934 header.
2935
2936 In both of these cases, the mail will commonly have an explicit
2937 Reply-to header. However, Sup will by default disregard this
2938 header in favor for List-id, which is *wrong*.
2939
2940 You can guess, this has bitten me several times.
2941
2942 I think the correct behavior is to only use List-id when Reply-to
2943 is not explicitly set, since List-id is "magical" whereas Reply-to
2944 is commonly explicit.
2945
2946 Cheers,
2947 Edward
2948
2949 From ezyang@MIT.EDU Sat Jul 25 14:24:15 2009
2950 From: ezyang@MIT.EDU (Edward Z. Yang)
2951 Date: Sat, 25 Jul 2009 14:24:15 -0400
2952 Subject: [sup-talk] Reply calculation
2953 In-Reply-To: <1248545266-sup-6886@javelin>
2954 References: <1248545266-sup-6886@javelin>
2955 Message-ID: <1248546228-sup-9505@javelin>
2956
2957 Here is a patch that changes the behavior:
2958
2959 >From 58a8d325286703f9057dd5d07094d0c6a061377c Mon Sep 17 00:00:00 2001
2960 From: Edward Z. Yang <ezyang at mit.edu>
2961 Date: Sat, 25 Jul 2009 14:17:08 -0400
2962 Subject: [PATCH] Use Reply-to if it is explicitly set.
2963
2964 Previously, Sup would ignore an explicit Reply-to
2965 in favor of List-id. This is the wrong behavior for
2966 the following cases:
2967
2968 * List subscribe and unsubscribe messages will commonly
2969 have List-id set, but set Reply-to for their own
2970 nefarious purposes (the "you should be able to reply
2971 to this email and have it work")
2972
2973 * People will sometimes send mail to a list with an
2974 explicit Reply-to header to get responses offlist.
2975
2976 This brings Sup's behavior more inline with traditional
2977 mail clients. Since most lists already set Reply-to
2978 (and most mail clients don't respect List-id), there will
2979 probably be no breakage.
2980
2981 Signed-off-by: Edward Z. Yang <ezyang at mit.edu>
2982 ---
2983 lib/sup/modes/reply-mode.rb | 8 +++-----
2984 1 files changed, 3 insertions(+), 5 deletions(-)
2985
2986 diff --git a/lib/sup/modes/reply-mode.rb b/lib/sup/modes/reply-mode.rb
2987 index c79c5db..ca423c1 100644
2988 --- a/lib/sup/modes/reply-mode.rb
2989 +++ b/lib/sup/modes/reply-mode.rb
2990 @@ -81,10 +81,8 @@ EOS
2991 AccountManager.default_account
2992 end
2993
2994 - ## now, determine to: and cc: addressess. we ignore reply-to for list
2995 - ## messages because it's typically set to the list address, which we
2996 - ## explicitly treat with reply type :list
2997 - to = @m.is_list_message? ? @m.from : (@m.replyto || @m.from)
2998 + ## if someone overrode reply-to, it was for a good reason
2999 + to = (@m.replyto || @m.from)
3000
3001 ## next, cc:
3002 cc = (@m.to + @m.cc - [from, to]).uniq
3003 @@ -115,7 +113,7 @@ EOS
3004 } unless not_me_ccs.empty?
3005
3006 @headers[:list] = {
3007 - "To" => [@m.list_address.full_address],
3008 + "To" => [@m.replyto.full_address || @m.list_address.full_address],
3009 } if @m.is_list_message?
3010
3011 refs = gen_references
3012 --
3013 1.6.3.3
3014
3015 From ezyang@MIT.EDU Sat Jul 25 15:03:31 2009
3016 From: ezyang@MIT.EDU (Edward Z. Yang)
3017 Date: Sat, 25 Jul 2009 15:03:31 -0400
3018 Subject: [sup-talk] Reply calculation
3019 In-Reply-To: <1248546228-sup-9505@javelin>
3020 References: <1248545266-sup-6886@javelin> <1248546228-sup-9505@javelin>
3021 Message-ID: <1248548497-sup-1158@javelin>
3022
3023 Excerpts from Edward Z. Yang's message of Sat Jul 25 14:24:15 -0400 2009:
3024 > Here is a patch that changes the behavior:
3025
3026 Actually, the patch is not quite correct. Let me think about this
3027 some more.
3028
3029 Cheers,
3030 Edward
3031
3032 From ezyang@MIT.EDU Sat Jul 25 15:15:59 2009
3033 From: ezyang@MIT.EDU (Edward Z. Yang)
3034 Date: Sat, 25 Jul 2009 15:15:59 -0400
3035 Subject: [sup-talk] Reply calculation
3036 In-Reply-To: <1248548497-sup-1158@javelin>
3037 References: <1248545266-sup-6886@javelin> <1248546228-sup-9505@javelin>
3038 <1248548497-sup-1158@javelin>
3039 Message-ID: <1248549271-sup-3371@javelin>
3040
3041 After thinking about this some, I think that the only way
3042 to reasonably handle all corner cases is to explicitly ask
3043 the user for a choice in corner cases. Having the default
3044 subtly change based on some non-obvious attributes of an
3045 email is a great way to break muscle memory.
3046
3047 Myself, I have :user in my reply-to.rb hook for now.
3048
3049 Cheers,
3050 Edward
3051
3052 From rlane@club.cc.cmu.edu Sat Jul 25 15:27:08 2009
3053 From: rlane@club.cc.cmu.edu (Rich Lane)
3054 Date: Sat, 25 Jul 2009 12:27:08 -0700
3055 Subject: [sup-talk] [PATCH] xapian: dont exclude spam/etc in some internal
3056 searches
3057 Message-ID: <1248550028-9703-1-git-send-email-rlane@club.cc.cmu.edu>
3058
3059 ---
3060 bin/sup-dump | 2 +-
3061 bin/sup-sync | 2 +-
3062 bin/sup-sync-back | 2 +-
3063 bin/sup-tweak-labels | 1 +
3064 4 files changed, 4 insertions(+), 3 deletions(-)
3065
3066 diff --git a/bin/sup-dump b/bin/sup-dump
3067 index c18a767..ba36b21 100755
3068 --- a/bin/sup-dump
3069 +++ b/bin/sup-dump
3070 @@ -25,6 +25,6 @@ index = Redwood::Index.new
3071 Redwood::SourceManager.new
3072 index.load
3073
3074 -index.each_message do |m|
3075 +index.each_message :load_spam => true, :load_deleted => true, :load_killed => true do |m|
3076 puts "#{m.id} (#{m.labels * ' '})"
3077 end
3078 diff --git a/bin/sup-sync b/bin/sup-sync
3079 index 270524a..8e37c74 100755
3080 --- a/bin/sup-sync
3081 +++ b/bin/sup-sync
3082 @@ -213,7 +213,7 @@ begin
3083 num_del, num_scanned = 0, 0
3084 sources.each do |source|
3085 raise "no source id for #{source}" unless source.id
3086 - index.each_message :source_id => source.id do |m|
3087 + index.each_message :source_id => source.id, :load_spam => true, :load_deleted => true, :load_killed => true do |m|
3088 num_scanned += 1
3089 unless seen[m.id]
3090 next unless m.source_info >= opts[:start_at] if opts[:start_at]
3091 diff --git a/bin/sup-sync-back b/bin/sup-sync-back
3092 index da94bbd..56ac4eb 100755
3093 --- a/bin/sup-sync-back
3094 +++ b/bin/sup-sync-back
3095 @@ -16,7 +16,7 @@ def die msg
3096 exit(-1)
3097 end
3098 def has_any_from_source_with_label? index, source, label
3099 - query = { :source_id => source.id, :label => label, :limit => 1 }
3100 + query = { :source_id => source.id, :label => label, :limit => 1, :load_spam => true, :load_deleted => true, :load_killed => true }
3101 not Enumerable::Enumerator.new(index, :each_id, query).map.empty?
3102 end
3103
3104 diff --git a/bin/sup-tweak-labels b/bin/sup-tweak-labels
3105 index a8115ea..8ae5c26 100755
3106 --- a/bin/sup-tweak-labels
3107 +++ b/bin/sup-tweak-labels
3108 @@ -83,6 +83,7 @@ begin
3109 query += ' ' + opts[:query] if opts[:query]
3110
3111 parsed_query = index.parse_query query
3112 + parsed_query.merge! :load_spam => true, :load_deleted => true, :load_killed => true
3113 ids = Enumerable::Enumerator.new(index, :each_id, parsed_query).map
3114 num_total = ids.size
3115
3116 --
3117 1.6.0.4
3118
3119
3120 From rlane@club.cc.cmu.edu Sat Jul 25 15:59:19 2009
3121 From: rlane@club.cc.cmu.edu (Rich Lane)
3122 Date: Sat, 25 Jul 2009 15:59:19 -0400
3123 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
3124 In-Reply-To: <1248513425-sup-2484@chistera.yi.org>
3125 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
3126 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
3127 <loom.20090625T222159-861@post.gmane.org>
3128 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
3129 <20090723102325.GA4291@chistera.yi.org>
3130 <1248497184-sup-939@pion.club.cc.cmu.edu>
3131 <1248513425-sup-2484@chistera.yi.org>
3132 Message-ID: <1248550384-sup-74@pion.club.cc.cmu.edu>
3133
3134 Excerpts from Adeodato Sim?'s message of Sat Jul 25 05:21:16 -0400 2009:
3135 > One extra issue I just noticed: after dumping with ferret, reloading
3136 > into Xapian, and doing a dump again (with Xapian this time), all the
3137 > messages tagged "deleted" or "spam" do not appear in the dump at all.
3138 > Any ideas?
3139
3140 The patch "xapian: dont exclude spam..." should fix this.
3141
3142 One issue I've noticed is that removing labels from messages doesn't
3143 always immediately work. For example, label-list-mode shows a label as
3144 having some unread messages even though all of them are actually read.
3145 This tends to happen only after sup's been running for a while and
3146 restarting sup fixes it.
3147
3148 From ingmar@exherbo.org Sat Jul 25 19:28:16 2009
3149 From: ingmar@exherbo.org (Ingmar Vanhassel)
3150 Date: Sun, 26 Jul 2009 01:28:16 +0200
3151 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
3152 In-Reply-To: <1248550384-sup-74@pion.club.cc.cmu.edu>
3153 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
3154 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
3155 <loom.20090625T222159-861@post.gmane.org>
3156 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
3157 <20090723102325.GA4291@chistera.yi.org>
3158 <1248497184-sup-939@pion.club.cc.cmu.edu>
3159 <1248513425-sup-2484@chistera.yi.org>
3160 <1248550384-sup-74@pion.club.cc.cmu.edu>
3161 Message-ID: <1248564412-sup-7548@cannonball>
3162
3163 Excerpts from Rich Lane's message of Sat Jul 25 21:59:19 +0200 2009:
3164 > One issue I've noticed is that removing labels from messages doesn't
3165 > always immediately work. For example, label-list-mode shows a label as
3166 > having some unread messages even though all of them are actually read.
3167 > This tends to happen only after sup's been running for a while and
3168 > restarting sup fixes it.
3169
3170 I was just about to report that. :)
3171 Besides that, the Xapian index works very nicely. So I'd be happy to see
3172 it in next when that last regression (as far as my testing showed them) is fixed!
3173
3174 --
3175 Exherbo KDE, X.org maintainer
3176
3177 From wmorgan-sup@masanjin.net Mon Jul 27 11:46:21 2009
3178 From: wmorgan-sup@masanjin.net (William Morgan)
3179 Date: Mon, 27 Jul 2009 08:46:21 -0700
3180 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
3181 In-Reply-To: <1248497184-sup-939@pion.club.cc.cmu.edu>
3182 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
3183 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
3184 <loom.20090625T222159-861@post.gmane.org>
3185 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
3186 <20090723102325.GA4291@chistera.yi.org>
3187 <1248497184-sup-939@pion.club.cc.cmu.edu>
3188 Message-ID: <1248709366-sup-5856@entry>
3189
3190 Reformatted excerpts from Rich Lane's message of 2009-07-24:
3191 > > Plus, nor '!label:inbox' or '-label:inbox' work for me. From an
3192 > > inspection of the code, it doesn't look to me as random negated
3193 > > labels are being parsed.
3194 > >
3195 > > Any hints?
3196 >
3197 > You need to specify a non-negated term in the query. "type:mail
3198 > -label:inbox" should work.
3199
3200 This is a typical restriction for inverted index-based search engines.
3201 You need to have at least one positive term or the computation is too
3202 expensive (it would have to iterate over every term ever seen.) It's
3203 true of Ferret, Google, etc.
3204 --
3205 William <wmorgan-sup at masanjin.net>
3206
3207 From wmorgan-sup@masanjin.net Mon Jul 27 11:48:38 2009
3208 From: wmorgan-sup@masanjin.net (William Morgan)
3209 Date: Mon, 27 Jul 2009 08:48:38 -0700
3210 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
3211 In-Reply-To: <1248550384-sup-74@pion.club.cc.cmu.edu>
3212 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
3213 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
3214 <loom.20090625T222159-861@post.gmane.org>
3215 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
3216 <20090723102325.GA4291@chistera.yi.org>
3217 <1248497184-sup-939@pion.club.cc.cmu.edu>
3218 <1248513425-sup-2484@chistera.yi.org>
3219 <1248550384-sup-74@pion.club.cc.cmu.edu>
3220 Message-ID: <1248709681-sup-4141@entry>
3221
3222 Reformatted excerpts from Rich Lane's message of 2009-07-25:
3223 > One issue I've noticed is that removing labels from messages doesn't
3224 > always immediately work.
3225
3226 Is this true even after you sync changes to the index? What about if you
3227 reload the label list buffer? ('@')
3228 --
3229 William <wmorgan-sup at masanjin.net>
3230
3231 From wmorgan-sup@masanjin.net Mon Jul 27 12:13:16 2009
3232 From: wmorgan-sup@masanjin.net (William Morgan)
3233 Date: Mon, 27 Jul 2009 09:13:16 -0700
3234 Subject: [sup-talk] xapian merged into next
3235 Message-ID: <1248711109-sup-7061@entry>
3236
3237 I've merged the xapian branch into next. Users of next need not worry;
3238 xapian only enabled when you set the environment variable
3239 SUP_INDEX=xapian. (And you'll have to regenerate your index; see my
3240 message of a few weeks ago for how.)
3241 --
3242 William <wmorgan-sup at masanjin.net>
3243
3244 From wmorgan-sup@masanjin.net Mon Jul 27 12:16:43 2009
3245 From: wmorgan-sup@masanjin.net (William Morgan)
3246 Date: Mon, 27 Jul 2009 09:16:43 -0700
3247 Subject: [sup-talk] [PATCH] xapian: dont exclude spam/etc in some
3248 internal searches
3249 In-Reply-To: <1248550028-9703-1-git-send-email-rlane@club.cc.cmu.edu>
3250 References: <1248550028-9703-1-git-send-email-rlane@club.cc.cmu.edu>
3251 Message-ID: <1248711395-sup-5867@entry>
3252
3253 Applied, thanks.
3254 --
3255 William <wmorgan-sup at masanjin.net>
3256
3257 From wmorgan-sup@masanjin.net Mon Jul 27 12:17:00 2009
3258 From: wmorgan-sup@masanjin.net (William Morgan)
3259 Date: Mon, 27 Jul 2009 09:17:00 -0700
3260 Subject: [sup-talk] [PATCH] xapian: fix mk_addrs args in build_message
3261 In-Reply-To: <1248492309-1980-1-git-send-email-rlane@club.cc.cmu.edu>
3262 References: <1248492309-1980-1-git-send-email-rlane@club.cc.cmu.edu>
3263 Message-ID: <1248711412-sup-674@entry>
3264
3265 Applied, thanks!
3266 --
3267 William <wmorgan-sup at masanjin.net>
3268
3269 From wmorgan-sup@masanjin.net Mon Jul 27 12:17:14 2009
3270 From: wmorgan-sup@masanjin.net (William Morgan)
3271 Date: Mon, 27 Jul 2009 09:17:14 -0700
3272 Subject: [sup-talk] [PATCH] xapian: initialize sources in sup-dump
3273 In-Reply-To: <1248490254-31895-1-git-send-email-rlane@club.cc.cmu.edu>
3274 References: <1248490254-31895-1-git-send-email-rlane@club.cc.cmu.edu>
3275 Message-ID: <1248711426-sup-1184@entry>
3276
3277 Aaaand applied. Thanks!
3278 --
3279 William <wmorgan-sup at masanjin.net>
3280
3281 From wmorgan-sup@masanjin.net Mon Jul 27 12:22:48 2009
3282 From: wmorgan-sup@masanjin.net (William Morgan)
3283 Date: Mon, 27 Jul 2009 09:22:48 -0700
3284 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was
3285 referencing an nonexistent variable)
3286 In-Reply-To: <1247322405-sup-1564@ntdws12.chass.utoronto.ca>
3287 References: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
3288 <1247322405-sup-1564@ntdws12.chass.utoronto.ca>
3289 Message-ID: <1248711741-sup-3733@entry>
3290
3291 Reformatted excerpts from Ben Walton's message of 2009-07-11:
3292 > +1 for this. Not sure how I managed to submit the original patch like
3293 > this, since I did test various forms of results returned from the
3294 > bounce-command hook...anyway, I've applied this and verified it.
3295
3296 I don't see this in your bw/bounce_message branch. I'd like to remerge
3297 that.
3298 --
3299 William <wmorgan-sup at masanjin.net>
3300
3301 From guillaume.quintard@gmail.com Mon Jul 27 12:16:50 2009
3302 From: guillaume.quintard@gmail.com (Guillaume Quintard)
3303 Date: Mon, 27 Jul 2009 18:16:50 +0200
3304 Subject: [sup-talk] xapian merged into next
3305 In-Reply-To: <1248711109-sup-7061@entry>
3306 References: <1248711109-sup-7061@entry>
3307 Message-ID: <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3308
3309 On Mon, Jul 27, 2009 at 6:13 PM, William Morgan<wmorgan-sup at masanjin.net> wrote:
3310 > I've merged the xapian branch into next. Users of next need not worry;
3311 > xapian only enabled when you set the environment variable
3312 > SUP_INDEX=xapian. (And you'll have to regenerate your index; see my
3313 > message of a few weeks ago for how.)
3314
3315 The big question is: is it interesting, as a user, to switch? :-)
3316
3317 --
3318 Guillaume
3319
3320 From bwalton@artsci.utoronto.ca Mon Jul 27 12:25:52 2009
3321 From: bwalton@artsci.utoronto.ca (Ben Walton)
3322 Date: Mon, 27 Jul 2009 12:25:52 -0400
3323 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was
3324 referencing an nonexistent variable)
3325 In-Reply-To: <1248711741-sup-3733@entry>
3326 References: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
3327 <1247322405-sup-1564@ntdws12.chass.utoronto.ca>
3328 <1248711741-sup-3733@entry>
3329 Message-ID: <1248711899-sup-4693@ntdws12.chass.utoronto.ca>
3330
3331 Excerpts from William Morgan's message of Mon Jul 27 12:22:48 -0400 2009:
3332
3333 > I don't see this in your bw/bounce_message branch. I'd like to remerge
3334 > that.
3335
3336 Sorry. I didn't publish the change, I thought it would be `git am`'d
3337 from the original mail. I applied it to my local running copy of next
3338 though, which is what I was referring to. I'll try to remember to
3339 push things like this in the future.
3340
3341 -Ben
3342 --
3343 Ben Walton
3344 Systems Programmer - CHASS
3345 University of Toronto
3346 C:416.407.5610 | W:416.978.4302
3347
3348 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
3349 Contact me to arrange for a CAcert assurance meeting.
3350 -------------- next part --------------
3351 A non-text attachment was scrubbed...
3352 Name: signature.asc
3353 Type: application/pgp-signature
3354 Size: 189 bytes
3355 Desc: not available
3356 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090727/85a7f7a7/attachment.bin>
3357
3358 From wmorgan-sup@masanjin.net Mon Jul 27 12:27:42 2009
3359 From: wmorgan-sup@masanjin.net (William Morgan)
3360 Date: Mon, 27 Jul 2009 09:27:42 -0700
3361 Subject: [sup-talk] xapian merged into next
3362 In-Reply-To: <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3363 References: <1248711109-sup-7061@entry>
3364 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3365 Message-ID: <1248711777-sup-9329@entry>
3366
3367 Reformatted excerpts from Guillaume Quintard's message of 2009-07-27:
3368 > The big question is: is it interesting, as a user, to switch? :-)
3369
3370 Yes. It's noticeably faster than Ferret, especially for loading large
3371 threads in thread-index-mode. (Which isn't Xapian per se, but other
3372 improvements Rich has made).
3373
3374 It's also much larger on disk, though there might be a way to trim that
3375 down.
3376
3377 At some point I want to deprecate Ferret, since it's unmaintained, so
3378 you'll be forced to switch. No timeline on that though.
3379 --
3380 William <wmorgan-sup at masanjin.net>
3381
3382 From wmorgan-sup@masanjin.net Mon Jul 27 12:29:20 2009
3383 From: wmorgan-sup@masanjin.net (William Morgan)
3384 Date: Mon, 27 Jul 2009 09:29:20 -0700
3385 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was
3386 referencing an nonexistent variable)
3387 In-Reply-To: <1248711899-sup-4693@ntdws12.chass.utoronto.ca>
3388 References: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
3389 <1247322405-sup-1564@ntdws12.chass.utoronto.ca>
3390 <1248711741-sup-3733@entry>
3391 <1248711899-sup-4693@ntdws12.chass.utoronto.ca>
3392 Message-ID: <1248712076-sup-7189@entry>
3393
3394 Reformatted excerpts from Ben Walton's message of 2009-07-27:
3395 > Sorry. I didn't publish the change, I thought it would be `git am`'d
3396 > from the original mail.
3397
3398 No problem. We can do it either way. I'll apply this patch directly.
3399 --
3400 William <wmorgan-sup at masanjin.net>
3401
3402 From bwalton@artsci.utoronto.ca Mon Jul 27 12:30:20 2009
3403 From: bwalton@artsci.utoronto.ca (Ben Walton)
3404 Date: Mon, 27 Jul 2009 12:30:20 -0400
3405 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was
3406 referencing an nonexistent variable)
3407 In-Reply-To: <1248711899-sup-4693@ntdws12.chass.utoronto.ca>
3408 References: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
3409 <1247322405-sup-1564@ntdws12.chass.utoronto.ca>
3410 <1248711741-sup-3733@entry>
3411 <1248711899-sup-4693@ntdws12.chass.utoronto.ca>
3412 Message-ID: <1248712092-sup-5843@ntdws12.chass.utoronto.ca>
3413
3414 Excerpts from Ben Walton's message of Mon Jul 27 12:25:52 -0400 2009:
3415 > Sorry. I didn't publish the change, I thought it would be `git am`'d
3416 > from the original mail. I applied it to my local running copy of next
3417 > though, which is what I was referring to. I'll try to remember to
3418 > push things like this in the future.
3419
3420 I've now `git am`'d and pushed on my development copy to
3421 git://code.chass.utoronto.ca/bwalton-sup.git. You should be able to
3422 remerge the bw/bounce_message branch and get Adeodato's fix.
3423
3424 Thanks
3425 -Ben
3426
3427 --
3428 Ben Walton
3429 Systems Programmer - CHASS
3430 University of Toronto
3431 C:416.407.5610 | W:416.978.4302
3432
3433 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
3434 Contact me to arrange for a CAcert assurance meeting.
3435 -------------- next part --------------
3436 A non-text attachment was scrubbed...
3437 Name: signature.asc
3438 Type: application/pgp-signature
3439 Size: 189 bytes
3440 Desc: not available
3441 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090727/eb249faf/attachment.bin>
3442
3443 From wmorgan-sup@masanjin.net Mon Jul 27 12:30:50 2009
3444 From: wmorgan-sup@masanjin.net (William Morgan)
3445 Date: Mon, 27 Jul 2009 09:30:50 -0700
3446 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was
3447 referencing an nonexistent variable)
3448 In-Reply-To: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
3449 References: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
3450 Message-ID: <1248712242-sup-2953@entry>
3451
3452 Applied, thanks!
3453 --
3454 William <wmorgan-sup at masanjin.net>
3455
3456 From guillaume.quintard@gmail.com Mon Jul 27 12:31:46 2009
3457 From: guillaume.quintard@gmail.com (Guillaume Quintard)
3458 Date: Mon, 27 Jul 2009 18:31:46 +0200
3459 Subject: [sup-talk] xapian merged into next
3460 In-Reply-To: <1248711777-sup-9329@entry>
3461 References: <1248711109-sup-7061@entry>
3462 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3463 <1248711777-sup-9329@entry>
3464 Message-ID: <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
3465
3466 On Mon, Jul 27, 2009 at 6:27 PM, William Morgan<wmorgan-sup at masanjin.net> wrote:
3467 > Yes. It's noticeably faster than Ferret, especially for loading large
3468 > threads in thread-index-mode. (Which isn't Xapian per se, but other
3469 > improvements Rich has made).
3470 Yummy!
3471 > It's also much larger on disk, though there might be a way to trim that
3472 > down.
3473 Less yummy!
3474
3475 So, we just export SUP_INDEX=xapian and that's it? We start with an
3476 empty sup and we just have to reimport the mbox/maildir/whatever?
3477 Means losing the red states and tags, I guess.
3478
3479 --
3480 Guillaume
3481
3482 From wmorgan-sup@masanjin.net Mon Jul 27 12:41:05 2009
3483 From: wmorgan-sup@masanjin.net (William Morgan)
3484 Date: Mon, 27 Jul 2009 09:41:05 -0700
3485 Subject: [sup-talk] Exception
3486 In-Reply-To: <1248453259-sup-3604@nixos>
3487 References: <1248453259-sup-3604@nixos>
3488 Message-ID: <1248712764-sup-736@entry>
3489
3490 Reformatted excerpts from Marc Weber's message of 2009-07-24:
3491 > Hi, when either running sup-sync or sup (without -n) I get this
3492 > exception:
3493 >
3494 > --- NoMethodError from thread: poll after loading inbox
3495 > undefined method `to_indexable_s' for nil:NilClass
3496
3497 Weird. It looks like a date parsing issue, but I'm having a hard time
3498 seeing where the logic fails such that no date field is set.
3499
3500 Can you try applying the following patch, and then running sup-sync with
3501 -v? I'm hoping that the debugging output prefixed with XX will provide a
3502 clue.
3503
3504 Thanks!
3505
3506 --- a/lib/sup/message.rb
3507 +++ b/lib/sup/message.rb
3508 @@ -92,11 +92,14 @@ class Message
3509 begin
3510 Time.parse date
3511 rescue ArgumentError => e
3512 - #Redwood::log "faking mangled date header for #{@id} (orig #{header['da
3513 + Redwood::log "faking mangled date header for #{@id} (orig #{header['dat
3514 Time.now
3515 end
3516 - else
3517 - #Redwood::log "faking non-existent date header for #{@id}"
3518 + end
3519 +
3520 + @date ||= begin
3521 + Redwood::log "XX original header was #{header["date"].inspect}"
3522 + Redwood::log "XX faking non-existent date header for #{@id}"
3523 Time.now
3524 end
3525
3526 --
3527 William <wmorgan-sup at masanjin.net>
3528
3529 From wmorgan-sup@masanjin.net Mon Jul 27 12:44:54 2009
3530 From: wmorgan-sup@masanjin.net (William Morgan)
3531 Date: Mon, 27 Jul 2009 09:44:54 -0700
3532 Subject: [sup-talk] xapian merged into next
3533 In-Reply-To: <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
3534 References: <1248711109-sup-7061@entry>
3535 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3536 <1248711777-sup-9329@entry>
3537 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
3538 Message-ID: <1248712876-sup-1446@entry>
3539
3540 Reformatted excerpts from Guillaume Quintard's message of 2009-07-27:
3541 > So, we just export SUP_INDEX=xapian and that's it? We start with an
3542 > empty sup and we just have to reimport the mbox/maildir/whatever?
3543 > Means losing the red states and tags, I guess.
3544
3545 Current instructions:
3546
3547 1. install the ruby xapian library and the ruby gdbm library, if you
3548 don't have them. These are packaged by your distro, and are not gems.
3549 2. git checkout next
3550 3. git pull
3551 4. cp ~/.sup/sources.yaml /tmp # just in case
3552 5. ruby -Ilib bin/sup-dump > dumpfile
3553 6. SUP_INDEX=xapian ruby -Ilib bin/sup-sync --all --all-sources --restore dumpfile
3554 7. SUP_INDEX=xapian ruby -Ilib bin/sup -o
3555 8. Oooh, fast.
3556
3557 This should not disturb your Ferret index, so you can switch back and forth
3558 between the two. (Message state, of course, is not shared.) However, adding new
3559 messages to one index will prevent it from being automatically added to the
3560 other, so I recommend running in Xapian mode with -o and not pressing 'P'.
3561 Unless, of of course, you're ready to switch permanently, in which case rm -rf
3562 ~/.sup/ferret. :)
3563 --
3564 William <wmorgan-sup at masanjin.net>
3565
3566 From wmorgan-sup@masanjin.net Mon Jul 27 12:45:17 2009
3567 From: wmorgan-sup@masanjin.net (William Morgan)
3568 Date: Mon, 27 Jul 2009 09:45:17 -0700
3569 Subject: [sup-talk] [PATCH] Unbreak "bounce-command" hook (was
3570 referencing an nonexistent variable)
3571 In-Reply-To: <1248712092-sup-5843@ntdws12.chass.utoronto.ca>
3572 References: <ef3825cbc25db1005616823980a339827c9db65e.1247313450.git.dato@net.com.org.es>
3573 <1247322405-sup-1564@ntdws12.chass.utoronto.ca>
3574 <1248711741-sup-3733@entry>
3575 <1248711899-sup-4693@ntdws12.chass.utoronto.ca>
3576 <1248712092-sup-5843@ntdws12.chass.utoronto.ca>
3577 Message-ID: <1248713108-sup-884@entry>
3578
3579 Reformatted excerpts from Ben Walton's message of 2009-07-27:
3580 > I've now `git am`'d and pushed on my development copy to
3581 > git://code.chass.utoronto.ca/bwalton-sup.git. You should be able to
3582 > remerge the bw/bounce_message branch and get Adeodato's fix.
3583
3584 Heh. :)
3585 --
3586 William <wmorgan-sup at masanjin.net>
3587
3588 From guillaume.quintard@gmail.com Mon Jul 27 12:47:13 2009
3589 From: guillaume.quintard@gmail.com (Guillaume Quintard)
3590 Date: Mon, 27 Jul 2009 18:47:13 +0200
3591 Subject: [sup-talk] xapian merged into next
3592 In-Reply-To: <1248712876-sup-1446@entry>
3593 References: <1248711109-sup-7061@entry>
3594 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3595 <1248711777-sup-9329@entry>
3596 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
3597 <1248712876-sup-1446@entry>
3598 Message-ID: <1e5fdab70907270947n1866decdoc8a568cc9a2733ae@mail.gmail.com>
3599
3600 On Mon, Jul 27, 2009 at 6:44 PM, William Morgan<wmorgan-sup at masanjin.net> wrote:
3601 > Unless, of of course, you're ready to switch permanently, in which case rm -rf
3602 > ~/.sup/ferret. :)
3603
3604 There's no reason not to, right?
3605 /me is following blinding the given instructions :-)
3606
3607 --
3608 Guillaume
3609
3610 From wmorgan-sup@masanjin.net Mon Jul 27 12:49:11 2009
3611 From: wmorgan-sup@masanjin.net (William Morgan)
3612 Date: Mon, 27 Jul 2009 09:49:11 -0700
3613 Subject: [sup-talk] Reply calculation
3614 In-Reply-To: <1248549271-sup-3371@javelin>
3615 References: <1248545266-sup-6886@javelin> <1248546228-sup-9505@javelin>
3616 <1248548497-sup-1158@javelin> <1248549271-sup-3371@javelin>
3617 Message-ID: <1248713182-sup-172@entry>
3618
3619 Reformatted excerpts from Edward Z. Yang's message of 2009-07-25:
3620 > After thinking about this some, I think that the only way to
3621 > reasonably handle all corner cases is to explicitly ask the user for a
3622 > choice in corner cases.
3623
3624 What was the breakage when favoring reply-to over list-id? I was buying
3625 your arguments...
3626
3627 Is it possible to identify these corner cases? Is it always when there's
3628 a reply-to and a list-id both set?
3629 --
3630 William <wmorgan-sup at masanjin.net>
3631
3632 From wmorgan-sup@masanjin.net Mon Jul 27 12:50:12 2009
3633 From: wmorgan-sup@masanjin.net (William Morgan)
3634 Date: Mon, 27 Jul 2009 09:50:12 -0700
3635 Subject: [sup-talk] xapian merged into next
3636 In-Reply-To: <1e5fdab70907270947n1866decdoc8a568cc9a2733ae@mail.gmail.com>
3637 References: <1248711109-sup-7061@entry>
3638 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3639 <1248711777-sup-9329@entry>
3640 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
3641 <1248712876-sup-1446@entry>
3642 <1e5fdab70907270947n1866decdoc8a568cc9a2733ae@mail.gmail.com>
3643 Message-ID: <1248713360-sup-5448@entry>
3644
3645 Reformatted excerpts from Guillaume Quintard's message of 2009-07-27:
3646 > There's no reason not to, right?
3647
3648 Well, the code isn't quite as well tested...
3649 --
3650 William <wmorgan-sup at masanjin.net>
3651
3652 From wmorgan-sup@masanjin.net Mon Jul 27 12:51:17 2009
3653 From: wmorgan-sup@masanjin.net (William Morgan)
3654 Date: Mon, 27 Jul 2009 09:51:17 -0700
3655 Subject: [sup-talk] [PATCH] mime-decode hook: provide a "charset"
3656 variable with the attachment charset
3657 In-Reply-To: <20090723093543.GA2265@chistera.yi.org>
3658 References: <6fc2e5dd8aa2b0b8547375d77b1776d779f85817.1247238014.git.dato@net.com.org.es>
3659 <20090723093543.GA2265@chistera.yi.org>
3660 Message-ID: <1248713434-sup-4961@entry>
3661
3662 Reformatted excerpts from Adeodato Sim?'s message of 2009-07-23:
3663 > + Adeodato Sim? (Fri, 10 Jul 2009 17:00:29 +0200):
3664 >
3665 > > + :charset => encoded_content.charset,
3666 >
3667 > Hm, so apparently encoded_content doesn't always have a charset
3668 > member...
3669 >
3670
3671 In which case that value of that variable is nil, right? Is that a
3672 problem? The patch still seems useful.
3673 --
3674 William <wmorgan-sup at masanjin.net>
3675
3676 From wmorgan-sup@masanjin.net Mon Jul 27 12:52:02 2009
3677 From: wmorgan-sup@masanjin.net (William Morgan)
3678 Date: Mon, 27 Jul 2009 09:52:02 -0700
3679 Subject: [sup-talk] Choose "From:" address based on message content?
3680 In-Reply-To: <1248311332-sup-1053@sgoldmanlinux.tower-research.com>
3681 References: <1248311332-sup-1053@sgoldmanlinux.tower-research.com>
3682 Message-ID: <1248713502-sup-312@entry>
3683
3684 Reformatted excerpts from Steve Goldman's message of 2009-07-22:
3685 > Can sup do it?
3686
3687 Shit yes. These insane requests are exactly why I am favoring hooks over
3688 configuration.
3689 --
3690 William <wmorgan-sup at masanjin.net>
3691
3692 From wmorgan-sup@masanjin.net Mon Jul 27 12:53:58 2009
3693 From: wmorgan-sup@masanjin.net (William Morgan)
3694 Date: Mon, 27 Jul 2009 09:53:58 -0700
3695 Subject: [sup-talk] Choose "From:" address based on message content?
3696 In-Reply-To: <1248317360-sup-4094@sgoldmanlinux.tower-research.com>
3697 References: <1248311332-sup-1053@sgoldmanlinux.tower-research.com>
3698 <1248317360-sup-4094@sgoldmanlinux.tower-research.com>
3699 Message-ID: <1248713574-sup-6167@entry>
3700
3701 Reformatted excerpts from Steve Goldman's message of 2009-07-22:
3702 > require 'eregex'
3703 >
3704 > r = Regexp.new('word', Regexp::IGNORECASE);
3705 > if header.to_s.grep(r).size > 0 or body.to_s.grep(r).size > 0
3706
3707 You can just use body.to_s =~ /word/i || header.join =~ /i/. No need for
3708 all the fancy libraries and method calls.
3709 --
3710 William <wmorgan-sup at masanjin.net>
3711
3712 From marco-oweber@gmx.de Mon Jul 27 12:55:46 2009
3713 From: marco-oweber@gmx.de (Marc Weber)
3714 Date: Mon, 27 Jul 2009 18:55:46 +0200
3715 Subject: [sup-talk] Exception
3716 In-Reply-To: <1248712764-sup-736@entry>
3717 References: <1248453259-sup-3604@nixos> <1248712764-sup-736@entry>
3718 Message-ID: <1248713299-sup-9062@nixos>
3719
3720 You're right. I fixed it today by running sup-sync. (I was still reading
3721 my mails that's why I didn't respond earlier).
3722 I used p m at that location to get a message output saying something
3723 about offset is out of sync. Then I tried sup-sync -c.
3724
3725 The strange thing is that I didn't open the mbox file using another
3726 program such as mutt. Maybe a locking issue or such ? I'm using
3727 procmail.
3728
3729 I was surprised how easy it was to find the cause after starting looking
3730 into it.
3731
3732 Thanks for taking the time sending this patch!
3733
3734 Marc Weber
3735
3736 Excerpts from William Morgan's message of Mon Jul 27 18:41:05 +0200 2009:
3737 > Reformatted excerpts from Marc Weber's message of 2009-07-24:
3738 > > Hi, when either running sup-sync or sup (without -n) I get this
3739 > > exception:
3740 > >
3741 > > --- NoMethodError from thread: poll after loading inbox
3742 > > undefined method `to_indexable_s' for nil:NilClass
3743 >
3744 > Weird. It looks like a date parsing issue, but I'm having a hard time
3745 > seeing where the logic fails such that no date field is set.
3746 >
3747 > Can you try applying the following patch, and then running sup-sync with
3748 > -v? I'm hoping that the debugging output prefixed with XX will provide a
3749 > clue.
3750 >
3751 > Thanks!
3752 >
3753 > --- a/lib/sup/message.rb
3754 > +++ b/lib/sup/message.rb
3755 > @@ -92,11 +92,14 @@ class Message
3756 > begin
3757 > Time.parse date
3758 > rescue ArgumentError => e
3759 > - #Redwood::log "faking mangled date header for #{@id} (orig #{header['da
3760 > + Redwood::log "faking mangled date header for #{@id} (orig #{header['dat
3761 > Time.now
3762 > end
3763 > - else
3764 > - #Redwood::log "faking non-existent date header for #{@id}"
3765 > + end
3766 > +
3767 > + @date ||= begin
3768 > + Redwood::log "XX original header was #{header["date"].inspect}"
3769 > + Redwood::log "XX faking non-existent date header for #{@id}"
3770 > Time.now
3771 > end
3772 >
3773
3774 From ingmar@exherbo.org Mon Jul 27 12:56:28 2009
3775 From: ingmar@exherbo.org (Ingmar Vanhassel)
3776 Date: Mon, 27 Jul 2009 18:56:28 +0200
3777 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
3778 In-Reply-To: <1248709681-sup-4141@entry>
3779 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
3780 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
3781 <loom.20090625T222159-861@post.gmane.org>
3782 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
3783 <20090723102325.GA4291@chistera.yi.org>
3784 <1248497184-sup-939@pion.club.cc.cmu.edu>
3785 <1248513425-sup-2484@chistera.yi.org>
3786 <1248550384-sup-74@pion.club.cc.cmu.edu>
3787 <1248709681-sup-4141@entry>
3788 Message-ID: <1248713376-sup-5163@cannonball>
3789
3790 Excerpts from William Morgan's message of Mon Jul 27 17:48:38 +0200 2009:
3791 > Reformatted excerpts from Rich Lane's message of 2009-07-25:
3792 > > One issue I've noticed is that removing labels from messages doesn't
3793 > > always immediately work.
3794 >
3795 > Is this true even after you sync changes to the index? What about if you
3796 > reload the label list buffer? ('@')
3797
3798 It's true in both cases. Even after a sync, 'U' still produces read
3799 messages (among unread), and a search for label:foo has threads without
3800 that label. If you quit sup & restart it things work as expected for a
3801 while.
3802
3803 I've also noticed that sup takes a long time to quit with the xapian
3804 index. This delay happens after this message:
3805 [Mon Jul 27 16:56:01 +0000 2009] unlocking /home/ingmar/.sup/lock...
3806
3807 --
3808 Exherbo KDE, X.org maintainer
3809
3810 From rlane@club.cc.cmu.edu Mon Jul 27 13:06:34 2009
3811 From: rlane@club.cc.cmu.edu (Rich Lane)
3812 Date: Mon, 27 Jul 2009 13:06:34 -0400
3813 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
3814 In-Reply-To: <1248709681-sup-4141@entry>
3815 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
3816 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
3817 <loom.20090625T222159-861@post.gmane.org>
3818 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
3819 <20090723102325.GA4291@chistera.yi.org>
3820 <1248497184-sup-939@pion.club.cc.cmu.edu>
3821 <1248513425-sup-2484@chistera.yi.org>
3822 <1248550384-sup-74@pion.club.cc.cmu.edu>
3823 <1248709681-sup-4141@entry>
3824 Message-ID: <1248710432-sup-1734@pion.club.cc.cmu.edu>
3825
3826 Excerpts from William Morgan's message of Mon Jul 27 11:48:38 -0400 2009:
3827 > Reformatted excerpts from Rich Lane's message of 2009-07-25:
3828 > > One issue I've noticed is that removing labels from messages doesn't
3829 > > always immediately work.
3830 >
3831 > Is this true even after you sync changes to the index? What about if you
3832 > reload the label list buffer? ('@')
3833
3834 Yes. This is looking like a Xapian bug - I've reproduced it without any
3835 Sup code. I'm working on a fix.
3836
3837 From ezyang@MIT.EDU Mon Jul 27 13:09:13 2009
3838 From: ezyang@MIT.EDU (Edward Z. Yang)
3839 Date: Mon, 27 Jul 2009 13:09:13 -0400
3840 Subject: [sup-talk] Reply calculation
3841 In-Reply-To: <1248713182-sup-172@entry>
3842 References: <1248545266-sup-6886@javelin> <1248546228-sup-9505@javelin>
3843 <1248548497-sup-1158@javelin> <1248549271-sup-3371@javelin>
3844 <1248713182-sup-172@entry>
3845 Message-ID: <1248713591-sup-8324@javelin>
3846
3847 Excerpts from William Morgan's message of Mon Jul 27 12:49:11 -0400 2009:
3848 > What was the breakage when favoring reply-to over list-id? I was buying
3849 > your arguments...
3850
3851 First and foremost, s/list-id/list-post/ in my previous posts; I was quoting
3852 the wrong field and double checked message.rb just now.
3853
3854 I received mail from a mailing list as a call for applications that should
3855 not be sent back to the list. The mail was constructed with headers like:
3856
3857 From: correct@example.com
3858 To: correct at example.com
3859 Reply-To: correct at example.com
3860 List-Post: mailto:incorrect at example.com
3861
3862 Sup detects List-Post, categorizes the message as a list message, and then
3863 sets the default reply mode as list, which results in List-Post being used
3864 as the to address.
3865
3866 > Is it possible to identify these corner cases? Is it always when there's
3867 > a reply-to and a list-id both set?
3868
3869 Unfortunately, mailing list administrating is notoriously broken. I'm not
3870 sure at all what the right solution is. Take for example this other case:
3871
3872 From: person@example.com
3873 To: list at example.com
3874 Reply-To: person at example.com
3875 List-Post: mailto:list at example.com
3876
3877 Reply-To, in this case, was set by the mailing list server. This makes
3878 having Reply-To be the end-all be-all kind of spurious. If we try
3879 to make Sup do the Right Thing (TM), you probably want to send mail to
3880 the list as a whole, which means you do want to either "reply all" semantics
3881 or "list post" magic. ("reply all" semantics are what you see in traditional
3882 mail clients when you hit the "reply all" button.)
3883
3884 However, consider the next case:
3885
3886 From: persona@example.com
3887 To: list at example.com
3888 Cc: me at example.com
3889
3890 Which is when someone else hit "Reply all" and you got CC'ed. This means
3891 that the mail never passed through the mailing list agent, the List-Post/Reply-To
3892 headers never got set, and the only way to tell that you should reply to the
3893 whole list is to explicitly ask for "Reply all" semantics (Sup defaults to
3894 "Reply" semantics, which is damn confusing if you're not paying attention).
3895
3896 The core problem is that subtle changes in state should not require the user
3897 to do things differently; it breaks muscle memory and makes mistakes easy.
3898 We could try to make it so that Sup requires /no/ user intervention, but
3899 this is seems to be an AI-hard problem. Then, the logical other direction,
3900 is to make the interface as consistent as possible.
3901
3902 Cheers,
3903 Edward
3904
3905 PS. Djb wrote an article along these lines:
3906 http://cr.yp.to/proto/replyto.html
3907 I've skimmed it but I'm kind of skeptical about client support and not sure
3908 if it actually gives useful recommendations.
3909
3910 From guillaume.quintard@gmail.com Mon Jul 27 13:09:19 2009
3911 From: guillaume.quintard@gmail.com (Guillaume Quintard)
3912 Date: Mon, 27 Jul 2009 19:09:19 +0200
3913 Subject: [sup-talk] xapian merged into next
3914 In-Reply-To: <1248713360-sup-5448@entry>
3915 References: <1248711109-sup-7061@entry>
3916 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
3917 <1248711777-sup-9329@entry>
3918 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
3919 <1248712876-sup-1446@entry>
3920 <1e5fdab70907270947n1866decdoc8a568cc9a2733ae@mail.gmail.com>
3921 <1248713360-sup-5448@entry>
3922 Message-ID: <1e5fdab70907271009v46639384w4bb3461ccaccf0cc@mail.gmail.com>
3923
3924 On Mon, Jul 27, 2009 at 6:50 PM, William Morgan<wmorgan-sup at masanjin.net> wrote:
3925 > Well, the code isn't quite as well tested...
3926
3927 Someone has to do it, plus I still have my mbox archive...
3928 ...and I was getting tired of this mostly bugless mail experience.
3929
3930 --
3931 Guillaume
3932
3933 From ezyang@MIT.EDU Mon Jul 27 13:13:01 2009
3934 From: ezyang@MIT.EDU (Edward Z. Yang)
3935 Date: Mon, 27 Jul 2009 13:13:01 -0400
3936 Subject: [sup-talk] Odd key bug
3937 Message-ID: <1248714653-sup-6926@javelin>
3938
3939 After I finish editing a message and exit out of my editor (vim),
3940 if I try to press up arrow in order to move my focus to the
3941 reply mode field to toggle it, I get the errors:
3942
3943 unknown keypress '^[' for compose-mode
3944 unknown keypress 'A' for compose-mode
3945
3946 It then works properly. A guess is something is messing with the
3947 terminal? This is 100% reproduceable.
3948
3949 Cheers,
3950 Edward
3951
3952 From wmorgan-sup@masanjin.net Mon Jul 27 13:16:02 2009
3953 From: wmorgan-sup@masanjin.net (William Morgan)
3954 Date: Mon, 27 Jul 2009 10:16:02 -0700
3955 Subject: [sup-talk] sup 0.8.1 crash
3956 In-Reply-To: <1246954373-sup-4550@sfo.thejof.com>
3957 References: <1246954373-sup-4550@sfo.thejof.com>
3958 Message-ID: <1248714912-sup-9402@entry>
3959
3960 Reformatted excerpts from Jonathan Lassoff's message of 2009-07-07:
3961 > I took a little time to poke around in the sup source to try and get
3962 > an idea what was going on. I'm led to believe this is because I added
3963 > a source in the past that I later deleted -- but all of the mesages
3964 > are still in the index.
3965
3966 That would do it!
3967
3968 > So, when certain searches turn up results that are in that deleted
3969 > source, the sup index fails to reference the message source in
3970 > Redwood::Index. Is there a way to delete a source without having to
3971 > re-index everything?
3972
3973 Yes, using devel/console.sh. Are you running master or next? (Or a
3974 release?) Details differ depending.
3975 --
3976 William <wmorgan-sup at masanjin.net>
3977
3978 From wmorgan-sup@masanjin.net Mon Jul 27 13:19:14 2009
3979 From: wmorgan-sup@masanjin.net (William Morgan)
3980 Date: Mon, 27 Jul 2009 10:19:14 -0700
3981 Subject: [sup-talk] [PATCH] Use /etc/mailname if present to determine
3982 the hostname for Message-Id
3983 In-Reply-To: <e23a0f3ed1ae4e2007d0f8144207e0e2fe3d8c11.1247169308.git.dato@net.com.org.es>
3984 References: <e23a0f3ed1ae4e2007d0f8144207e0e2fe3d8c11.1247169308.git.dato@net.com.org.es>
3985 Message-ID: <1248715131-sup-8076@entry>
3986
3987 Reformatted excerpts from Adeodato Sim?'s message of 2009-07-09:
3988 > on many systems (notably Debian-based systems), the /etc/mailname file
3989 > can be created to specify the public mail name for a host. If that
3990 > file exists, it'd be good to use its contents for generating the
3991 > Message-Id header.
3992
3993 Excellent idea. Applied directly to master. Thanks!
3994 --
3995 William <wmorgan-sup at masanjin.net>
3996
3997 From wmorgan-sup@masanjin.net Mon Jul 27 13:24:09 2009
3998 From: wmorgan-sup@masanjin.net (William Morgan)
3999 Date: Mon, 27 Jul 2009 10:24:09 -0700
4000 Subject: [sup-talk] Validating GPG keys in parallel and in background
4001 In-Reply-To: <1247256988-sup-2799@x200>
4002 References: <1247256988-sup-2799@x200>
4003 Message-ID: <1248715421-sup-9481@masanjin.net>
4004
4005 Reformatted excerpts from Michael Stapelberg's message of 2009-07-10:
4006 > it seems like sup is blocking during the validation of GPG
4007 > signed/encrypted mails. While for encryption it makes some sense to
4008 > block, for signed mails it would be better to just display the message
4009 > and add the information about the signature status later. The same
4010 > approach could be used for encrypted messages: Display "decrypting..."
4011 > and update it when done.
4012
4013 I agree. This would be great.
4014 --
4015 William <wmorgan-sup at masanjin.net>
4016
4017 From wmorgan-sup@masanjin.net Mon Jul 27 13:25:36 2009
4018 From: wmorgan-sup@masanjin.net (William Morgan)
4019 Date: Mon, 27 Jul 2009 10:25:36 -0700
4020 Subject: [sup-talk] Adding/saving multiple attachments?
4021 In-Reply-To: <1247331130-sup-4923@x200>
4022 References: <1247331130-sup-4923@x200>
4023 Message-ID: <1248715516-sup-4466@masanjin.net>
4024
4025 Reformatted excerpts from Michael Stapelberg's message of 2009-07-11:
4026 > I?ve had the same problem with mutt: Isn?t there a way to add or save
4027 > multiple attachments? Why can?t I add ~/work/foo/* when pressing 'a'?
4028 > Why doesn?t the file browser save the last directory I?ve been in?
4029 > Can we please get a binding to save all attachments of a message into
4030 > a folder?
4031
4032 All excellent ideas. I too am annoyed when I have more than one
4033 attachment to save.
4034 --
4035 William <wmorgan-sup at masanjin.net>
4036
4037 From wmorgan-sup@masanjin.net Mon Jul 27 13:26:06 2009
4038 From: wmorgan-sup@masanjin.net (William Morgan)
4039 Date: Mon, 27 Jul 2009 10:26:06 -0700
4040 Subject: [sup-talk] Invalid character on import
4041 In-Reply-To: <1247516120-sup-3116@ausone.local>
4042 References: <20090713090110.GA20996@ikn.schottelius.org>
4043 <1247516120-sup-3116@ausone.local>
4044 Message-ID: <1248715552-sup-271@masanjin.net>
4045
4046 Reformatted excerpts from Nicolas Pouillard's message of 2009-07-13:
4047 > The fix is trivial, I've submitted a merge request for exactly this:
4048 >
4049 > http://gitorious.org/~ertai/sup/clone-by-ertai
4050
4051 This has been applied to master. Thanks!
4052 --
4053 William <wmorgan-sup at masanjin.net>
4054
4055 From wmorgan-sup@masanjin.net Mon Jul 27 13:31:09 2009
4056 From: wmorgan-sup@masanjin.net (William Morgan)
4057 Date: Mon, 27 Jul 2009 10:31:09 -0700
4058 Subject: [sup-talk] [PATCH] GSSAPI support for net/imap.rb and sup
4059 In-Reply-To: <1248092732-sup-9960@midna>
4060 References: <1248092732-sup-9960@midna>
4061 Message-ID: <1248715761-sup-5112@masanjin.net>
4062
4063 Reformatted excerpts from Michael Stapelberg's message of 2009-07-20:
4064 > As I?m not very much involved in the ruby community (in fact, this is
4065 > my first piece of ruby code), I need someone to help me get things
4066 > upstream (for Net::IMAP in the first place, but someone maintaining
4067 > ruby-gss would be great).
4068
4069 I don't have much advice for you other than find the guy who maintains
4070 Net::IMAP, beating him on the head a few times for me, and send him the
4071 patch. I believe net/imap is part of core ruby, which means you can
4072 probably just take this to the ruby-core mailing list.
4073 --
4074 William <wmorgan-sup at masanjin.net>
4075
4076 From wmorgan-sup@masanjin.net Mon Jul 27 13:33:57 2009
4077 From: wmorgan-sup@masanjin.net (William Morgan)
4078 Date: Mon, 27 Jul 2009 10:33:57 -0700
4079 Subject: [sup-talk] Odd key bug
4080 In-Reply-To: <1248714653-sup-6926@javelin>
4081 References: <1248714653-sup-6926@javelin>
4082 Message-ID: <1248715911-sup-4656@masanjin.net>
4083
4084 Reformatted excerpts from Edward Z. Yang's message of 2009-07-27:
4085 > It then works properly. A guess is something is messing with the
4086 > terminal? This is 100% reproduceable.
4087
4088 This happens to me too. Maybe there's some more curses weirdness that
4089 needs to happen when shelling out---you can see the current magic spell
4090 at buffer.rb circa line 724, in BufferManager#shell_out. I've just
4091 suffered through it for the past three years.
4092 --
4093 William <wmorgan-sup at masanjin.net>
4094
4095 From wmorgan-sup@masanjin.net Mon Jul 27 13:34:59 2009
4096 From: wmorgan-sup@masanjin.net (William Morgan)
4097 Date: Mon, 27 Jul 2009 10:34:59 -0700
4098 Subject: [sup-talk] xapian merged into next
4099 In-Reply-To: <1e5fdab70907271009v46639384w4bb3461ccaccf0cc@mail.gmail.com>
4100 References: <1248711109-sup-7061@entry>
4101 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
4102 <1248711777-sup-9329@entry>
4103 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
4104 <1248712876-sup-1446@entry>
4105 <1e5fdab70907270947n1866decdoc8a568cc9a2733ae@mail.gmail.com>
4106 <1248713360-sup-5448@entry>
4107 <1e5fdab70907271009v46639384w4bb3461ccaccf0cc@mail.gmail.com>
4108 Message-ID: <1248716073-sup-7443@masanjin.net>
4109
4110 Reformatted excerpts from Guillaume Quintard's message of 2009-07-27:
4111 > Someone has to do it, plus I still have my mbox archive...
4112 > ...and I was getting tired of this mostly bugless mail experience.
4113
4114 Ok, you're the official guinea pig then. :)
4115 --
4116 William <wmorgan-sup at masanjin.net>
4117
4118 From ezyang@MIT.EDU Mon Jul 27 13:36:10 2009
4119 From: ezyang@MIT.EDU (Edward Z. Yang)
4120 Date: Mon, 27 Jul 2009 13:36:10 -0400
4121 Subject: [sup-talk] Odd bug with lazy-loaded messages
4122 Message-ID: <1248716007-sup-5156@javelin>
4123
4124 I've been experiencing an odd bug with the following patch
4125 for lazy loading messages:
4126
4127 --- a/lib/sup/modes/thread-index-mode.rb
4128 +++ b/lib/sup/modes/thread-index-mode.rb
4129 @@ -103,7 +103,6 @@ EOS
4130 t.each_with_index do |(m, *o), i|
4131 next unless m
4132 BufferManager.say "#{message} (#{i}/#{num})", sid if t.size > 1
4133 - m.load_from_source!
4134 end
4135 end
4136
4137 Specifically, the "default" opened message when I open a thread
4138 gets a weird misrendering of the headers that looks like:
4139
4140 To: foo
4141 foo <foo at example.com>
4142 foo
4143
4144 And so forth, for all lines in To and Cc.
4145
4146 Any ideas what could be causing this? I checked load_from_source! in message.rb
4147 but didn't see anything obvious that would prevent this behavior.
4148
4149 Cheers,
4150 Edward
4151
4152 From ezyang@MIT.EDU Mon Jul 27 13:39:27 2009
4153 From: ezyang@MIT.EDU (Edward Z. Yang)
4154 Date: Mon, 27 Jul 2009 13:39:27 -0400
4155 Subject: [sup-talk] [PATCH] Make logging less chatty
4156 Message-ID: <1248716313-sup-1608@javelin>
4157
4158 Sup currently generates a lot of logging spew during initial startup
4159 when it is threading. This makes it difficult to see other log
4160 messages that are more interesting. I propose we turn these messages
4161 off.
4162
4163 >From 1fc4107013a991f24a62dad54509913bb1270d5d Mon Sep 17 00:00:00 2001
4164 From: Edward Z. Yang <ezyang at mit.edu>
4165 Date: Sat, 25 Jul 2009 14:16:40 -0400
4166 Subject: [PATCH] Make logging less chatty.
4167
4168 Signed-off-by: Edward Z. Yang <ezyang at mit.edu>
4169 ---
4170 lib/sup/index.rb | 4 ++--
4171 1 files changed, 2 insertions(+), 2 deletions(-)
4172
4173 diff --git a/lib/sup/index.rb b/lib/sup/index.rb
4174 index 9c985d9..fa33baa 100644
4175 --- a/lib/sup/index.rb
4176 +++ b/lib/sup/index.rb
4177 @@ -394,10 +394,10 @@ EOS
4178 end
4179
4180 if killed
4181 - Redwood::log "thread for #{m.id} is killed, ignoring"
4182 + #Redwood::log "thread for #{m.id} is killed, ignoring"
4183 false
4184 else
4185 - Redwood::log "ran #{num_queries} queries to build thread of #{messages.size} messages for #{m.id}: #{m.subj}" if num_queries > 0
4186 + #Redwood::log "ran #{num_queries} queries to build thread of #{messages.size} messages for #{m.id}: #{m.subj}" if num_queries > 0
4187 messages.each { |mid, builder| yield mid, builder }
4188 true
4189 end
4190 --
4191 1.6.3.3
4192
4193 From ezyang@MIT.EDU Mon Jul 27 13:40:48 2009
4194 From: ezyang@MIT.EDU (Edward Z. Yang)
4195 Date: Mon, 27 Jul 2009 13:40:48 -0400
4196 Subject: [sup-talk] [PATCH] before-search hook
4197 In-Reply-To: <1246035946-sup-7069@javelin>
4198 References: <1244612627-sup-982@javelin> <1245087294-sup-6276@entry>
4199 <1246035946-sup-7069@javelin>
4200 Message-ID: <1248716405-sup-6097@javelin>
4201
4202 Excerpts from Edward Z. Yang's message of Fri Jun 26 13:10:01 -0400 2009:
4203 > Done.
4204
4205 What's the status on getting this patch into the tree?
4206
4207 Cheers,
4208 Edward
4209
4210 From alex@chmrr.net Mon Jul 27 13:27:33 2009
4211 From: alex@chmrr.net (Alex Vandiver)
4212 Date: Mon, 27 Jul 2009 13:27:33 -0400
4213 Subject: [sup-talk] Odd key bug
4214 In-Reply-To: <1248714653-sup-6926@javelin>
4215 References: <1248714653-sup-6926@javelin>
4216 Message-ID: <1248715577-sup-4766@utwig>
4217
4218 At Mon Jul 27 13:13:01 -0400 2009, Edward Z. Yang wrote:
4219 > After I finish editing a message and exit out of my editor (vim),
4220 > if I try to press up arrow in order to move my focus to the
4221 > reply mode field to toggle it, I get the errors:
4222 >
4223 > unknown keypress '^[' for compose-mode
4224 > unknown keypress 'A' for compose-mode
4225 >
4226 > It then works properly. A guess is something is messing with the
4227 > terminal? This is 100% reproduceable.
4228
4229 As another data point, I also see this, with emacs as my editor.
4230 - Alex
4231 --
4232 Networking -- only one letter away from not working
4233
4234 From wmorgan-sup@masanjin.net Mon Jul 27 13:45:32 2009
4235 From: wmorgan-sup@masanjin.net (William Morgan)
4236 Date: Mon, 27 Jul 2009 10:45:32 -0700
4237 Subject: [sup-talk] xapian question
4238 Message-ID: <1248716325-sup-7534@masanjin.net>
4239
4240 Hey, I finally get to ask a question!
4241
4242 One of the mildly irritating things about Ferret was that it was
4243 impossible to update the labels of a message without updating the entire
4244 entry, i.e. including the body. So updating the labels of a message and
4245 saving that to disk required either re-loading the body from the source,
4246 or keeping the body explicitly in the index so that it could be loaded
4247 without going back to the source.
4248
4249 The latter approach is used by the current Ferret index implementation,
4250 since it's significantly faster (especially for slow sources like IMAP
4251 servers), but at the cost of a lot of disk space.
4252
4253 My understanding of Xapian is that this is also the case, since fields
4254 are essentially represented as prefixed terms, and so you're basically
4255 updating a big blog, but I wanted to confirm this. I ask because the
4256 entries.db file is very big. :)
4257 --
4258 William <wmorgan-sup at masanjin.net>
4259
4260 From bwalton@artsci.utoronto.ca Mon Jul 27 13:48:05 2009
4261 From: bwalton@artsci.utoronto.ca (Ben Walton)
4262 Date: Mon, 27 Jul 2009 13:48:05 -0400
4263 Subject: [sup-talk] [PATCH] Make logging less chatty
4264 In-Reply-To: <1248716313-sup-1608@javelin>
4265 References: <1248716313-sup-1608@javelin>
4266 Message-ID: <1248716783-sup-6509@ntdws12.chass.utoronto.ca>
4267
4268 Excerpts from Edward Z. Yang's message of Mon Jul 27 13:39:27 -0400 2009:
4269 > Sup currently generates a lot of logging spew during initial startup
4270 > when it is threading. This makes it difficult to see other log
4271 > messages that are more interesting. I propose we turn these messages
4272 > off.
4273
4274 +1 for the idea, but wouldn't a command line verbosity toggle be a
4275 better way to do this? Maybe an arg that accepts a numeric value and
4276 then debug statements of type foo if $val > bar?
4277
4278 Makes debugging this stuff easier, but the output is still optional
4279 and presumably below the default threshold.
4280
4281 Just a thought.
4282
4283 -Ben
4284 --
4285 Ben Walton
4286 Systems Programmer - CHASS
4287 University of Toronto
4288 C:416.407.5610 | W:416.978.4302
4289
4290 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
4291 Contact me to arrange for a CAcert assurance meeting.
4292 -------------- next part --------------
4293 A non-text attachment was scrubbed...
4294 Name: signature.asc
4295 Type: application/pgp-signature
4296 Size: 189 bytes
4297 Desc: not available
4298 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090727/60963ec8/attachment.bin>
4299
4300 From bwalton@artsci.utoronto.ca Mon Jul 27 13:52:02 2009
4301 From: bwalton@artsci.utoronto.ca (Ben Walton)
4302 Date: Mon, 27 Jul 2009 13:52:02 -0400
4303 Subject: [sup-talk] Odd key bug
4304 In-Reply-To: <1248715577-sup-4766@utwig>
4305 References: <1248714653-sup-6926@javelin> <1248715577-sup-4766@utwig>
4306 Message-ID: <1248717027-sup-9556@ntdws12.chass.utoronto.ca>
4307
4308 Excerpts from Alex Vandiver's message of Mon Jul 27 13:27:33 -0400 2009:
4309 > As another data point, I also see this, with emacs as my editor.
4310
4311 And I saw it with vim until I switched to emacs a few months back. I
4312 wonder if this is anything to do with how these curses apps interact
4313 with the 'alternate' screen buffer or something? For the record, I've
4314 always run sup inside of screen...
4315
4316 I've just been suffering through it too. Edward, you've given voice
4317 to this insidious little annoyance! :)
4318
4319 -Ben
4320 --
4321 Ben Walton
4322 Systems Programmer - CHASS
4323 University of Toronto
4324 C:416.407.5610 | W:416.978.4302
4325
4326 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
4327 Contact me to arrange for a CAcert assurance meeting.
4328 -------------- next part --------------
4329 A non-text attachment was scrubbed...
4330 Name: signature.asc
4331 Type: application/pgp-signature
4332 Size: 189 bytes
4333 Desc: not available
4334 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090727/580ec624/attachment.bin>
4335
4336 From ezyang@MIT.EDU Mon Jul 27 14:13:12 2009
4337 From: ezyang@MIT.EDU (Edward Z. Yang)
4338 Date: Mon, 27 Jul 2009 14:13:12 -0400
4339 Subject: [sup-talk] Odd key bug
4340 In-Reply-To: <1248715911-sup-4656@masanjin.net>
4341 References: <1248714653-sup-6926@javelin> <1248715911-sup-4656@masanjin.net>
4342 Message-ID: <1248718344-sup-1931@javelin>
4343
4344 Excerpts from William Morgan's message of Mon Jul 27 13:33:57 -0400 2009:
4345 > This happens to me too. Maybe there's some more curses weirdness that
4346 > needs to happen when shelling out---you can see the current magic spell
4347 > at buffer.rb circa line 724, in BufferManager#shell_out. I've just
4348 > suffered through it for the past three years.
4349
4350 I tried cargo culting a few extra function calls from the web, to no
4351 avail. Man, where's an ncurses expert when you need them...
4352
4353 Cheers,
4354 Edward
4355
4356 From ezyang@MIT.EDU Mon Jul 27 14:30:46 2009
4357 From: ezyang@MIT.EDU (Edward Z. Yang)
4358 Date: Mon, 27 Jul 2009 14:30:46 -0400
4359 Subject: [sup-talk] Odd key bug
4360 In-Reply-To: <1248718344-sup-1931@javelin>
4361 References: <1248714653-sup-6926@javelin> <1248715911-sup-4656@masanjin.net>
4362 <1248718344-sup-1931@javelin>
4363 Message-ID: <1248719342-sup-9126@javelin>
4364
4365 I currently suspect that if I send a null character to the stdscr
4366 (which would require bin/sup to be rewritten a little to make stdscr
4367 globally available) it would serve as a decent workaround. I don't
4368 actually know how global variables work in Ruby.
4369
4370 (Basically, add stdscr.keypad(0) when we return from the external shell.)
4371
4372 Cheers,
4373 Edward
4374
4375 From tarko@lanparty.ee Mon Jul 27 14:47:00 2009
4376 From: tarko@lanparty.ee (Tarko Tikan)
4377 Date: Mon, 27 Jul 2009 21:47:00 +0300
4378 Subject: [sup-talk] Odd key bug
4379 In-Reply-To: <1248714653-sup-6926@javelin>
4380 References: <1248714653-sup-6926@javelin>
4381 Message-ID: <1248720085-sup-7444@valgus>
4382
4383 hey,
4384
4385 > After I finish editing a message and exit out of my editor (vim),
4386 > if I try to press up arrow in order to move my focus to the
4387 > reply mode field to toggle it, I get the errors:
4388
4389 Running sup in screen and seeing it aswell.
4390
4391 As the discussion goes around external editor (and problems switching to and back), I want to throw up an question/idea.
4392
4393 Currently, as the external editor is run, there is no way to switch between sup and external editor (for obvious reasons). Is anyone aware of any better idea how to integrate vim (even better, any editor) into sup and still have the excellent buffer system. Currently, going between received emails, and the one being composed, is a real pain.
4394
4395 Inventing own editor is ofc one solution but it sounds silly to do it from scratch.
4396
4397 --
4398 tarko
4399
4400 From ezyang@MIT.EDU Mon Jul 27 15:15:27 2009
4401 From: ezyang@MIT.EDU (Edward Z. Yang)
4402 Date: Mon, 27 Jul 2009 15:15:27 -0400
4403 Subject: [sup-talk] Odd key bug
4404 In-Reply-To: <1248719342-sup-9126@javelin>
4405 References: <1248714653-sup-6926@javelin> <1248715911-sup-4656@masanjin.net>
4406 <1248718344-sup-1931@javelin> <1248719342-sup-9126@javelin>
4407 Message-ID: <1248721402-sup-3517@javelin>
4408
4409 Alex Vandiver points out that stdscr is a member variable of Ncurses.
4410 As such, this patch appears to fix the issue.
4411
4412 However, my rationale in my previous message was completely bogus (I
4413 checked the manpage and keypad does NOT send a null key); thus,
4414 I have no fucking clue why this works. Perhaps forcibly setting this
4415 setting clears some internal buffer. Either 1 or 0 works, we probably
4416 want 1 since that's what bin/sup sets.
4417
4418 Yay cargo culting! Whoo!
4419
4420 >From 61696b6a097a949545db52b4a537d74f8256d807 Mon Sep 17 00:00:00 2001
4421 From: Edward Z. Yang <ezyang at mit.edu>
4422 Date: Mon, 27 Jul 2009 15:03:58 -0400
4423 Subject: [PATCH] Fix broken arrow keypresses after shelling out.
4424
4425 Signed-off-by: Edward Z. Yang <ezyang at mit.edu>
4426 ---
4427 lib/sup/buffer.rb | 1 +
4428 1 files changed, 1 insertions(+), 0 deletions(-)
4429
4430 diff --git a/lib/sup/buffer.rb b/lib/sup/buffer.rb
4431 index 8eedf96..5f52d1d 100644
4432 --- a/lib/sup/buffer.rb
4433 +++ b/lib/sup/buffer.rb
4434 @@ -723,6 +723,7 @@ EOS
4435 Ncurses.sync do
4436 Ncurses.endwin
4437 system command
4438 + Ncurses.stdscr.keypad 1
4439 Ncurses.refresh
4440 Ncurses.curs_set 0
4441 end
4442 --
4443 1.6.3.3
4444
4445 From wmorgan-sup@masanjin.net Mon Jul 27 15:40:05 2009
4446 From: wmorgan-sup@masanjin.net (William Morgan)
4447 Date: Mon, 27 Jul 2009 12:40:05 -0700
4448 Subject: [sup-talk] [PATCH] before-search hook
4449 In-Reply-To: <1248716405-sup-6097@javelin>
4450 References: <1244612627-sup-982@javelin> <1245087294-sup-6276@entry>
4451 <1246035946-sup-7069@javelin> <1248716405-sup-6097@javelin>
4452 Message-ID: <1248717965-sup-1834@masanjin.net>
4453
4454 Reformatted excerpts from Edward Z. Yang's message of 2009-07-27:
4455 > What's the status on getting this patch into the tree?
4456
4457 Thanks for the ping. I've put this on branch custom-search-hook and
4458 merged into next. Note that it only applies to Ferret for now. Now that
4459 we've split into two indexes, we need to plan out how this hook is going
4460 to work going forward, since different indexes have different query
4461 languages. Probably the best option is to have the index type be passed
4462 as an argument, and let the user special-case on that.
4463 --
4464 William <wmorgan-sup at masanjin.net>
4465
4466 From guillaume.quintard@gmail.com Mon Jul 27 16:04:58 2009
4467 From: guillaume.quintard@gmail.com (Guillaume Quintard)
4468 Date: Mon, 27 Jul 2009 22:04:58 +0200
4469 Subject: [sup-talk] xapian merged into next
4470 In-Reply-To: <1248712876-sup-1446@entry>
4471 References: <1248711109-sup-7061@entry>
4472 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
4473 <1248711777-sup-9329@entry>
4474 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
4475 <1248712876-sup-1446@entry>
4476 Message-ID: <1e5fdab70907271304xcc52d55pb745cb85d258fdc4@mail.gmail.com>
4477
4478 On Mon, Jul 27, 2009 at 6:44 PM, William Morgan<wmorgan-sup at masanjin.net> wrote:
4479 all went well until:
4480 > 5. ruby -Ilib bin/sup-dump > dumpfile
4481 -> produces a empty file (not sure it's normal)
4482
4483 > 6. SUP_INDEX=xapian ruby -Ilib bin/sup-sync --all --all-sources --restore dumpfile
4484 -> error
4485 [Mon Jul 27 22:01:35 +0200 2009] using character set encoding "UTF-8"
4486 ./lib/sup/xapian_index.rb:17:in `at': bignum too big to convert into
4487 `long' (RangeError)
4488 from ./lib/sup/xapian_index.rb:17
4489 from /usr/lib/ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require'
4490 from /usr/lib/ruby/1.8/rubygems/custom_require.rb:31:in `require'
4491 from ./lib/sup/index.rb:217
4492 from /usr/lib/ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require'
4493 from /usr/lib/ruby/1.8/rubygems/custom_require.rb:31:in `require'
4494 from ./lib/sup.rb:269
4495 from /usr/lib/ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require'
4496 from /usr/lib/ruby/1.8/rubygems/custom_require.rb:31:in `require'
4497 from bin/sup-sync:6
4498
4499 l17 of xapian_index.rb is MAX_DATE = Time.at(2**31)
4500
4501 --
4502 Guillaume
4503
4504 From andrew@pimlott.net Mon Jul 27 16:11:53 2009
4505 From: andrew@pimlott.net (Andrew Pimlott)
4506 Date: Mon, 27 Jul 2009 13:11:53 -0700
4507 Subject: [sup-talk] Odd key bug
4508 In-Reply-To: <1248720085-sup-7444@valgus>
4509 References: <1248714653-sup-6926@javelin> <1248720085-sup-7444@valgus>
4510 Message-ID: <20090727201153.GI14010@pimlott.net>
4511
4512 On Mon, Jul 27, 2009 at 09:47:00PM +0300, Tarko Tikan wrote:
4513 > Currently, as the external editor is run, there is no way to switch between sup and external editor (for obvious reasons). Is anyone aware of any better idea how to integrate vim (even better, any editor) into sup and still have the excellent buffer system.
4514
4515 My idea is to make sup act like a shell and implement job control, so
4516 when you ctrl-z out of your editor, you're back in sup. You can have
4517 multiple editors stopped in the background, and resume any of them at
4518 any point.
4519
4520 Andrew
4521
4522 From rgh@roughage.com.au Mon Jul 27 20:33:16 2009
4523 From: rgh@roughage.com.au (Richard Heycock)
4524 Date: Tue, 28 Jul 2009 10:33:16 +1000
4525 Subject: [sup-talk] xapian merged into next
4526 In-Reply-To: <1248711777-sup-9329@entry>
4527 References: <1248711109-sup-7061@entry>
4528 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
4529 <1248711777-sup-9329@entry>
4530 Message-ID: <1248740968-sup-759@wrasse>
4531
4532 Excerpts from William Morgan's message of Tue Jul 28 02:27:42 +1000 2009:
4533 > Reformatted excerpts from Guillaume Quintard's message of 2009-07-27:
4534 > > The big question is: is it interesting, as a user, to switch? :-)
4535 >
4536 > Yes. It's noticeably faster than Ferret, especially for loading large
4537 > threads in thread-index-mode. (Which isn't Xapian per se, but other
4538 > improvements Rich has made).
4539 >
4540 > It's also much larger on disk, though there might be a way to trim that
4541 > down.
4542 >
4543 > At some point I want to deprecate Ferret, since it's unmaintained, so
4544 > you'll be forced to switch. No timeline on that though.
4545
4546 Just to add to Williams answer not only is it faster it's also
4547 *significantly* more robust. I'm running Debian unstable which, at the
4548 moment is really living up to it's name, consequently my machine is
4549 dying a lot more times than it should and I haven't had to rebuild the
4550 index once. Compare that to ferret where I pretty much has to rebuild
4551 the index every time; I even wrote myself a one line script to do it.
4552
4553 William there is work being done on the next xapian "engine" which aims
4554 to reduce the disc size.
4555
4556 rgh
4557
4558 From rlane@club.cc.cmu.edu Mon Jul 27 23:19:29 2009
4559 From: rlane@club.cc.cmu.edu (Rich Lane)
4560 Date: Mon, 27 Jul 2009 20:19:29 -0700
4561 Subject: [sup-talk] [PATCH 1/2] xapian: fix MAX_DATE
4562 Message-ID: <1248751170-4102-1-git-send-email-rlane@club.cc.cmu.edu>
4563
4564 ---
4565 lib/sup/xapian_index.rb | 2 +-
4566 1 files changed, 1 insertions(+), 1 deletions(-)
4567
4568 diff --git a/lib/sup/xapian_index.rb b/lib/sup/xapian_index.rb
4569 index 303b4d0..6358a20 100644
4570 --- a/lib/sup/xapian_index.rb
4571 +++ b/lib/sup/xapian_index.rb
4572 @@ -14,7 +14,7 @@ class XapianIndex < BaseIndex
4573 ## so we must ensure they're reasonably valid. this typically only affect
4574 ## spam.
4575 MIN_DATE = Time.at 0
4576 - MAX_DATE = Time.at(2**31)
4577 + MAX_DATE = Time.at(2**31-1)
4578
4579 def initialize dir=BASE_DIR
4580 super
4581 --
4582 1.6.0.4
4583
4584
4585 From rlane@club.cc.cmu.edu Mon Jul 27 23:19:30 2009
4586 From: rlane@club.cc.cmu.edu (Rich Lane)
4587 Date: Mon, 27 Jul 2009 20:19:30 -0700
4588 Subject: [sup-talk] [PATCH 2/2] xapian: fix issue with empty ferret query
4589 In-Reply-To: <1248751170-4102-1-git-send-email-rlane@club.cc.cmu.edu>
4590 References: <1248751170-4102-1-git-send-email-rlane@club.cc.cmu.edu>
4591 Message-ID: <1248751170-4102-2-git-send-email-rlane@club.cc.cmu.edu>
4592
4593 ---
4594 lib/sup/ferret_index.rb | 1 +
4595 1 files changed, 1 insertions(+), 0 deletions(-)
4596
4597 diff --git a/lib/sup/ferret_index.rb b/lib/sup/ferret_index.rb
4598 index f2bb2a0..5473814 100644
4599 --- a/lib/sup/ferret_index.rb
4600 +++ b/lib/sup/ferret_index.rb
4601 @@ -442,6 +442,7 @@ private
4602
4603 def build_ferret_query query
4604 q = Ferret::Search::BooleanQuery.new
4605 + q.add_query Ferret::Search::MatchAllQuery.new, :must
4606 q.add_query query[:qobj], :must if query[:qobj]
4607 labels = ([query[:label]] + (query[:labels] || [])).compact
4608 labels.each { |t| q.add_query Ferret::Search::TermQuery.new("label", t.to_s), :must }
4609 --
4610 1.6.0.4
4611
4612
4613 From rlane@club.cc.cmu.edu Mon Jul 27 23:33:16 2009
4614 From: rlane@club.cc.cmu.edu (Rich Lane)
4615 Date: Mon, 27 Jul 2009 23:33:16 -0400
4616 Subject: [sup-talk] xapian merged into next
4617 In-Reply-To: <1e5fdab70907271304xcc52d55pb745cb85d258fdc4@mail.gmail.com>
4618 References: <1248711109-sup-7061@entry>
4619 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
4620 <1248711777-sup-9329@entry>
4621 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
4622 <1248712876-sup-1446@entry>
4623 <1e5fdab70907271304xcc52d55pb745cb85d258fdc4@mail.gmail.com>
4624 Message-ID: <1248751256-sup-4491@pion.club.cc.cmu.edu>
4625
4626 Excerpts from Guillaume Quintard's message of Mon Jul 27 16:04:58 -0400 2009:
4627 > > 5. ruby -Ilib bin/sup-dump > dumpfile
4628 > -> produces a empty file (not sure it's normal)
4629 >
4630 > ./lib/sup/xapian_index.rb:17:in `at': bignum too big to convert into
4631
4632 Oops, breaking sup-dump would make switching to Xapian a little
4633 difficult. I've posted patches for both these issues. We really should
4634 have more tests to catch this sort of thing...
4635
4636 From rlane@club.cc.cmu.edu Tue Jul 28 01:02:29 2009
4637 From: rlane@club.cc.cmu.edu (Rich Lane)
4638 Date: Mon, 27 Jul 2009 22:02:29 -0700
4639 Subject: [sup-talk] [PATCH] explicitly load messages in testcase
4640 Message-ID: <1248757349-11301-1-git-send-email-rlane@club.cc.cmu.edu>
4641
4642 ---
4643 test/test_message.rb | 6 ++++++
4644 1 files changed, 6 insertions(+), 0 deletions(-)
4645
4646 diff --git a/test/test_message.rb b/test/test_message.rb
4647 index 0a7db45..675b81d 100644
4648 --- a/test/test_message.rb
4649 +++ b/test/test_message.rb
4650 @@ -73,6 +73,7 @@ EOS
4651 source_info = 0
4652
4653 sup_message = Message.new( {:source => source, :source_info => source_info } )
4654 + sup_message.load_from_source!
4655
4656 # see how well parsing the header went
4657
4658 @@ -222,6 +223,7 @@ EOS
4659 source_info = 0
4660
4661 sup_message = Message.new( {:source => source, :source_info => source_info } )
4662 + sup_message.load_from_source!
4663
4664 # read the message body chunks
4665
4666 @@ -271,6 +273,7 @@ EOS
4667 source_info = 0
4668
4669 sup_message = Message.new( {:source => source, :source_info => source_info } )
4670 + sup_message.load_from_source!
4671
4672 to = sup_message.to
4673
4674 @@ -316,6 +319,7 @@ EOS
4675 source_info = 0
4676
4677 sup_message = Message.new( {:source => source, :source_info => source_info } )
4678 + sup_message.load_from_source!
4679
4680 # read the message body chunks: no errors should reach this level
4681
4682 @@ -414,6 +418,7 @@ EOS
4683 source_info = 0
4684
4685 sup_message = Message.new( {:source => source, :source_info => source_info } )
4686 + sup_message.load_from_source!
4687
4688 # read the message body chunks
4689
4690 @@ -504,6 +509,7 @@ EOS
4691 source_info = 0
4692
4693 sup_message = Message.new( {:source => source, :source_info => source_info } )
4694 + sup_message.load_from_source!
4695
4696 # See how well parsing the message ID went.
4697 id = sup_message.id
4698 --
4699 1.6.0.4
4700
4701
4702 From olly@survex.com Tue Jul 28 09:47:07 2009
4703 From: olly@survex.com (Olly Betts)
4704 Date: Tue, 28 Jul 2009 13:47:07 +0000 (UTC)
4705 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
4706 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
4707 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
4708 <loom.20090625T222159-861@post.gmane.org>
4709 <1246022094-sup-3336@entry>
4710 Message-ID: <loom.20090728T134034-967@post.gmane.org>
4711
4712 William Morgan <wmorgan-sup at masanjin.net> writes:
4713 > Reformatted excerpts from Olly Betts's message of 2009-06-25:
4714 > > I'll make sure this fix makes it into the next Xapian release (which
4715 > > will be 1.0.14).
4716 >
4717 > Awesome, thanks!
4718
4719 Just to update, Xapian 1.0.14 was released last week with this fix.
4720
4721 I tested with a distilled micro-testcase rather than sup and these patches,
4722 so if you still see problems please open a ticket on http://trac.xapian.org/
4723
4724 Cheers,
4725 Olly
4726
4727
4728 From wmorgan-sup@masanjin.net Tue Jul 28 11:06:34 2009
4729 From: wmorgan-sup@masanjin.net (William Morgan)
4730 Date: Tue, 28 Jul 2009 08:06:34 -0700
4731 Subject: [sup-talk] trying out sup ...
4732 In-Reply-To: <20090718074151.GF30748@cat.rubenette.is-a-geek.com>
4733 References: <20090718074151.GF30748@cat.rubenette.is-a-geek.com>
4734 Message-ID: <1248793474-sup-9541@masanjin.net>
4735
4736 Hi Lee,
4737
4738 Reformatted excerpts from lee's message of 2009-07-18:
4739 > So I had sup running on the console and tried out to search for
4740 > something while sup was looking for new messages in a maildir. But
4741 > then it crashed and told me I should send a bug report[3].
4742 >
4743 > Maybe I have created some incompatibilities by installing the
4744 > replacement library. But is it currently possible to run sup on Debian
4745 > Testing without too much difficulty? If so, what do I need to do?
4746
4747 That particular crash is a transient thing, I think---there is some
4748 race condition with the display logic that occasionally manifests itself
4749 as such. I would just retry. I have tentative plans to rewrite a lot of
4750 the display stuff without threads once we're Ruby 1.9 ready.
4751
4752 I don't know why display is corrupt in rxvt. Do other ncurses apps
4753 display ok?
4754 --
4755 William <wmorgan-sup at masanjin.net>
4756
4757 From wmorgan-sup@masanjin.net Tue Jul 28 11:07:11 2009
4758 From: wmorgan-sup@masanjin.net (William Morgan)
4759 Date: Tue, 28 Jul 2009 08:07:11 -0700
4760 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
4761 In-Reply-To: <loom.20090728T134034-967@post.gmane.org>
4762 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
4763 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
4764 <loom.20090625T222159-861@post.gmane.org>
4765 <1246022094-sup-3336@entry>
4766 <loom.20090728T134034-967@post.gmane.org>
4767 Message-ID: <1248793614-sup-5597@masanjin.net>
4768
4769 Reformatted excerpts from Olly Betts's message of 2009-07-28:
4770 > Just to update, Xapian 1.0.14 was released last week with this fix.
4771 >
4772 > I tested with a distilled micro-testcase rather than sup and these patches,
4773 > so if you still see problems please open a ticket on http://trac.xapian.org/
4774
4775 Excellent. Thank you.
4776 --
4777 William <wmorgan-sup at masanjin.net>
4778
4779 From wmorgan-sup@masanjin.net Tue Jul 28 11:12:51 2009
4780 From: wmorgan-sup@masanjin.net (William Morgan)
4781 Date: Tue, 28 Jul 2009 08:12:51 -0700
4782 Subject: [sup-talk] [PATCH] explicitly load messages in testcase
4783 In-Reply-To: <1248757349-11301-1-git-send-email-rlane@club.cc.cmu.edu>
4784 References: <1248757349-11301-1-git-send-email-rlane@club.cc.cmu.edu>
4785 Message-ID: <1248793905-sup-2227@masanjin.net>
4786
4787 Hi Rich,
4788
4789 Not to be a pain, but can you give a little more context for this patch
4790 (and the other two you sent recently)? I'm just trying to understand
4791 what this fixes.
4792 --
4793 William <wmorgan-sup at masanjin.net>
4794
4795 From wmorgan-sup@masanjin.net Tue Jul 28 11:13:52 2009
4796 From: wmorgan-sup@masanjin.net (William Morgan)
4797 Date: Tue, 28 Jul 2009 08:13:52 -0700
4798 Subject: [sup-talk] xapian merged into next
4799 In-Reply-To: <1248751256-sup-4491@pion.club.cc.cmu.edu>
4800 References: <1248711109-sup-7061@entry>
4801 <1e5fdab70907270916o2f8e1768vbe7e3bcc1c807e39@mail.gmail.com>
4802 <1248711777-sup-9329@entry>
4803 <1e5fdab70907270931t7dfbe285h67197a7355b611d6@mail.gmail.com>
4804 <1248712876-sup-1446@entry>
4805 <1e5fdab70907271304xcc52d55pb745cb85d258fdc4@mail.gmail.com>
4806 <1248751256-sup-4491@pion.club.cc.cmu.edu>
4807 Message-ID: <1248793998-sup-5987@masanjin.net>
4808
4809 Reformatted excerpts from Rich Lane's message of 2009-07-27:
4810 > We really should have more tests to catch this sort of thing...
4811
4812 Agreed. Mostly my fault, I'm afraid.
4813 --
4814 William <wmorgan-sup at masanjin.net>
4815
4816 From wmorgan-sup@masanjin.net Tue Jul 28 11:17:52 2009
4817 From: wmorgan-sup@masanjin.net (William Morgan)
4818 Date: Tue, 28 Jul 2009 08:17:52 -0700
4819 Subject: [sup-talk] Odd key bug
4820 In-Reply-To: <1248721402-sup-3517@javelin>
4821 References: <1248714653-sup-6926@javelin> <1248715911-sup-4656@masanjin.net>
4822 <1248718344-sup-1931@javelin> <1248719342-sup-9126@javelin>
4823 <1248721402-sup-3517@javelin>
4824 Message-ID: <1248794177-sup-3810@masanjin.net>
4825
4826 Reformatted excerpts from Edward Z. Yang's message of 2009-07-27:
4827 > Alex Vandiver points out that stdscr is a member variable of Ncurses.
4828 > As such, this patch appears to fix the issue.
4829
4830 Applied with great relish direct to master. Thanks!
4831
4832 > I have no fucking clue why this works. Perhaps forcibly setting this
4833 > setting clears some internal buffer. Either 1 or 0 works, we probably
4834 > want 1 since that's what bin/sup sets.
4835
4836 Welcome to ncurses programming. Much like fortran, everyone who once
4837 knew what this stuff meant has since died.
4838 --
4839 William <wmorgan-sup at masanjin.net>
4840
4841 From wmorgan-sup@masanjin.net Tue Jul 28 11:25:23 2009
4842 From: wmorgan-sup@masanjin.net (William Morgan)
4843 Date: Tue, 28 Jul 2009 08:25:23 -0700
4844 Subject: [sup-talk] [PATCH] Make logging less chatty
4845 In-Reply-To: <1248716783-sup-6509@ntdws12.chass.utoronto.ca>
4846 References: <1248716313-sup-1608@javelin>
4847 <1248716783-sup-6509@ntdws12.chass.utoronto.ca>
4848 Message-ID: <1248794676-sup-7855@masanjin.net>
4849
4850 Reformatted excerpts from Ben Walton's message of 2009-07-27:
4851 > +1 for the idea, but wouldn't a command line verbosity toggle be a
4852 > better way to do this?
4853
4854 I've applied the patch, but yes, the whole Redwood::log thing is crufty
4855 and needs to be replaced with a logger that's aware of levels.
4856 --
4857 William <wmorgan-sup at masanjin.net>
4858
4859 From bwalton@artsci.utoronto.ca Tue Jul 28 11:31:24 2009
4860 From: bwalton@artsci.utoronto.ca (Ben Walton)
4861 Date: Tue, 28 Jul 2009 11:31:24 -0400
4862 Subject: [sup-talk] Odd key bug
4863 In-Reply-To: <1248794177-sup-3810@masanjin.net>
4864 References: <1248714653-sup-6926@javelin> <1248715911-sup-4656@masanjin.net>
4865 <1248718344-sup-1931@javelin> <1248719342-sup-9126@javelin>
4866 <1248721402-sup-3517@javelin> <1248794177-sup-3810@masanjin.net>
4867 Message-ID: <1248795045-sup-4556@ntdws12.chass.utoronto.ca>
4868
4869 Excerpts from William Morgan's message of Tue Jul 28 11:17:52 -0400 2009:
4870
4871 > Welcome to ncurses programming. Much like fortran, everyone who once
4872 > knew what this stuff meant has since died.
4873
4874 ...or is making a 'mint' maintaining crap^H^H^H^Hcode from the 80's?
4875 <grin>
4876
4877 -Ben
4878 --
4879 Ben Walton
4880 Systems Programmer - CHASS
4881 University of Toronto
4882 C:416.407.5610 | W:416.978.4302
4883
4884 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
4885 Contact me to arrange for a CAcert assurance meeting.
4886 -------------- next part --------------
4887 A non-text attachment was scrubbed...
4888 Name: signature.asc
4889 Type: application/pgp-signature
4890 Size: 189 bytes
4891 Desc: not available
4892 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090728/7f69db3f/attachment.bin>
4893
4894 From rlane@club.cc.cmu.edu Tue Jul 28 11:39:16 2009
4895 From: rlane@club.cc.cmu.edu (Rich Lane)
4896 Date: Tue, 28 Jul 2009 11:39:16 -0400
4897 Subject: [sup-talk] [PATCH] explicitly load messages in testcase
4898 In-Reply-To: <1248793905-sup-2227@masanjin.net>
4899 References: <1248757349-11301-1-git-send-email-rlane@club.cc.cmu.edu>
4900 <1248793905-sup-2227@masanjin.net>
4901 Message-ID: <1248794785-sup-1840@pion.club.cc.cmu.edu>
4902
4903 Excerpts from William Morgan's message of Tue Jul 28 11:12:51 -0400 2009:
4904 > Hi Rich,
4905 >
4906 > Not to be a pain, but can you give a little more context for this patch
4907 > (and the other two you sent recently)? I'm just trying to understand
4908 > what this fixes.
4909
4910 Sure. The commit "don't automatically parse header on Message#new" broke
4911 test_message because the message id/etc fields are nil until
4912 load_from_source! is called. This patch just calls load_from_source!
4913 whenever we create a message in the testcase.
4914
4915 The other two are fixes for problems reported by Guillaume Quintard.
4916 Ferret sup-dump was failing because the query passed to each_id didn't
4917 have any positive terms. The date-ceiling code was broken on 32 bit
4918 machines because the maximum signed long is 2**31-1, not 2**31.
4919
4920 From wmorgan-sup@masanjin.net Tue Jul 28 11:48:48 2009
4921 From: wmorgan-sup@masanjin.net (William Morgan)
4922 Date: Tue, 28 Jul 2009 08:48:48 -0700
4923 Subject: [sup-talk] Reply calculation
4924 In-Reply-To: <1248713591-sup-8324@javelin>
4925 References: <1248545266-sup-6886@javelin> <1248546228-sup-9505@javelin>
4926 <1248548497-sup-1158@javelin> <1248549271-sup-3371@javelin>
4927 <1248713182-sup-172@entry> <1248713591-sup-8324@javelin>
4928 Message-ID: <1248794955-sup-3347@masanjin.net>
4929
4930 Reformatted excerpts from Edward Z. Yang's message of 2009-07-27:
4931 > From: correct at example.com
4932 > To: correct at example.com
4933 > Reply-To: correct at example.com
4934 > List-Post: mailto:incorrect at example.com
4935 >
4936 > Sup detects List-Post, categorizes the message as a list message, and then
4937 > sets the default reply mode as list, which results in List-Post being used
4938 > as the to address.
4939
4940 So in this case, following reply-to is correct.
4941
4942 > Unfortunately, mailing list administrating is notoriously broken. I'm not
4943 > sure at all what the right solution is. Take for example this other case:
4944 >
4945 > From: person at example.com
4946 > To: list at example.com
4947 > Reply-To: person at example.com
4948 > List-Post: mailto:list at example.com
4949 >
4950 > Reply-To, in this case, was set by the mailing list server.
4951
4952 In this case, I'd argue that this means the list administrator wants the
4953 default reply behavior to be to the individual and not the list. So I'd
4954 again prefer Sup default to the reply-to address rather than the list
4955 address. (With the caveat that this is overrideable by hooks on a
4956 per-list basis, so if it's a matter of an incompetent list
4957 administrator, or simply disagreeing with them, one can override this
4958 behavior for this list.)
4959
4960 > However, consider the next case:
4961 >
4962 > From: persona at example.com
4963 > To: list at example.com
4964 > Cc: me at example.com
4965 >
4966 > Which is when someone else hit "Reply all" and you got CC'ed. This means
4967 > that the mail never passed through the mailing list agent, the
4968 > List-Post/Reply-To
4969 > headers never got set, and the only way to tell that you should reply to the
4970 > whole list is to explicitly ask for "Reply all" semantics (Sup defaults to
4971 > "Reply" semantics, which is damn confusing if you're not paying attention).
4972
4973 There's not much to be done in this case, EXCEPT that if you receive
4974 more than one copy of the message, you should keep the list header
4975 around. Then the only time you're in a funny situation is when you've
4976 received the first but not the other.
4977
4978 This is presumably why Mutt had you register your mailing list addresses
4979 explicitly, which I always found a little irritating.
4980
4981 (Or to have Sup keep around email addresses known to belong to lists,
4982 and match those in the To: field against that, which seems significantly
4983 more complicated.)
4984
4985 > The core problem is that subtle changes in state should not require the user
4986 > to do things differently; it breaks muscle memory and makes mistakes easy.
4987
4988 I agree with this in principle, but I see addressing a message as a
4989 fundamental part of composing it. You can remove the notion of a smart
4990 default reply-to address from your Sup, if you like, by using the
4991 reply-to hook.
4992
4993 And as for the default, I think I'm of the opinion that setting the
4994 default reply address so as to obey the reply-to is correcter than
4995 anything else (including whatever Sup does currently).
4996
4997 --
4998 William <wmorgan-sup at masanjin.net>
4999
5000 From rlane@club.cc.cmu.edu Tue Jul 28 11:57:56 2009
5001 From: rlane@club.cc.cmu.edu (Rich Lane)
5002 Date: Tue, 28 Jul 2009 11:57:56 -0400
5003 Subject: [sup-talk] xapian question
5004 In-Reply-To: <1248716325-sup-7534@masanjin.net>
5005 References: <1248716325-sup-7534@masanjin.net>
5006 Message-ID: <1248795865-sup-6634@pion.club.cc.cmu.edu>
5007
5008 Excerpts from William Morgan's message of Mon Jul 27 13:45:32 -0400 2009:
5009 > Hey, I finally get to ask a question!
5010 >
5011 > One of the mildly irritating things about Ferret was that it was
5012 > impossible to update the labels of a message without updating the entire
5013 > entry, i.e. including the body. So updating the labels of a message and
5014 > saving that to disk required either re-loading the body from the source,
5015 > or keeping the body explicitly in the index so that it could be loaded
5016 > without going back to the source.
5017 >
5018 > The latter approach is used by the current Ferret index implementation,
5019 > since it's significantly faster (especially for slow sources like IMAP
5020 > servers), but at the cost of a lot of disk space.
5021 >
5022 > My understanding of Xapian is that this is also the case, since fields
5023 > are essentially represented as prefixed terms, and so you're basically
5024 > updating a big blog, but I wanted to confirm this. I ask because the
5025 > entries.db file is very big. :)
5026
5027 Xapian actually provides add_term and remove_term for documents. I'd
5028 definitely like to use these for label updates, but we need a way to
5029 tell if only the labels have changed in sync_message. Or, we update the
5030 index in Message#add_label/etc and get rid of the need to save buffers.
5031 That might not be an option for the Ferret index, though.
5032
5033 We don't store the body in entries.db, just enough info for
5034 thread-index-mode. It's only about 800 bytes/message for me, but I don't
5035 have snippets enabled so yours would be larger.
5036
5037 From wmorgan-sup@masanjin.net Tue Jul 28 12:04:20 2009
5038 From: wmorgan-sup@masanjin.net (William Morgan)
5039 Date: Tue, 28 Jul 2009 09:04:20 -0700
5040 Subject: [sup-talk] [PATCH] explicitly load messages in testcase
5041 In-Reply-To: <1248794785-sup-1840@pion.club.cc.cmu.edu>
5042 References: <1248757349-11301-1-git-send-email-rlane@club.cc.cmu.edu>
5043 <1248793905-sup-2227@masanjin.net>
5044 <1248794785-sup-1840@pion.club.cc.cmu.edu>
5045 Message-ID: <1248796949-sup-4949@masanjin.net>
5046
5047 Reformatted excerpts from Rich Lane's message of 2009-07-28:
5048 > Sure. The commit "don't automatically parse header on Message#new" broke
5049 > test_message because the message id/etc fields are nil until
5050 > load_from_source! is called. This patch just calls load_from_source!
5051 > whenever we create a message in the testcase.
5052
5053 Got it. Applied, thanks!
5054
5055 > The other two are fixes for problems reported by Guillaume Quintard.
5056 > Ferret sup-dump was failing because the query passed to each_id didn't
5057 > have any positive terms.
5058
5059 Hah.
5060
5061 > The date-ceiling code was broken on 32 bit machines because the
5062 > maximum signed long is 2**31-1, not 2**31.
5063
5064 Ok, both applied. Thanks!
5065 --
5066 William <wmorgan-sup at masanjin.net>
5067
5068 From olly@survex.com Tue Jul 28 12:53:46 2009
5069 From: olly@survex.com (Olly Betts)
5070 Date: Tue, 28 Jul 2009 16:53:46 +0000 (UTC)
5071 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
5072 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
5073 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
5074 <loom.20090625T222159-861@post.gmane.org>
5075 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
5076 <20090723102325.GA4291@chistera.yi.org>
5077 <1248497184-sup-939@pion.club.cc.cmu.edu>
5078 <1248709366-sup-5856@entry>
5079 Message-ID: <loom.20090728T134845-816@post.gmane.org>
5080
5081 William Morgan <wmorgan-sup at masanjin.net> writes:
5082 > Reformatted excerpts from Rich Lane's message of 2009-07-24:
5083 > > You need to specify a non-negated term in the query. "type:mail
5084 > > -label:inbox" should work.
5085 >
5086 > This is a typical restriction for inverted index-based search engines.
5087 > You need to have at least one positive term or the computation is too
5088 > expensive (it would have to iterate over every term ever seen.) It's
5089 > true of Ferret, Google, etc.
5090
5091 Actually, Xapian supports this - Xapian.Query.new("") is a "magic" query
5092 which matches all documents.
5093
5094 It doesn't need to iterate over every term, just all documents. But if you
5095 want the top ten documents without a particular filter, there's no relevance
5096 ranking, so it can stop after it has found ten matches, which should be
5097 pretty quick.
5098
5099 This isn't currently supported by the QueryParser when using "-" on terms
5100 (the reasoning was that it was too easy to accidentally invoke when pasting
5101 text), but 'NOT label:inbox' will work if you enable it using
5102 QueryParser.FLAG_PURE_NOT.
5103
5104 Cheers,
5105 Olly
5106
5107
5108
5109 From wmorgan-sup@masanjin.net Tue Jul 28 13:01:43 2009
5110 From: wmorgan-sup@masanjin.net (William Morgan)
5111 Date: Tue, 28 Jul 2009 10:01:43 -0700
5112 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
5113 In-Reply-To: <loom.20090728T134845-816@post.gmane.org>
5114 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
5115 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
5116 <loom.20090625T222159-861@post.gmane.org>
5117 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
5118 <20090723102325.GA4291@chistera.yi.org>
5119 <1248497184-sup-939@pion.club.cc.cmu.edu>
5120 <1248709366-sup-5856@entry>
5121 <loom.20090728T134845-816@post.gmane.org>
5122 Message-ID: <1248800452-sup-1121@masanjin.net>
5123
5124 Reformatted excerpts from Olly Betts's message of 2009-07-28:
5125 > Actually, Xapian supports this - Xapian.Query.new("") is a "magic"
5126 > query which matches all documents.
5127
5128 Yeah, I think Rich Lane just taught me how Ferret supports this too.
5129 --
5130 William <wmorgan-sup at masanjin.net>
5131
5132 From marka@pobox.com Tue Jul 28 12:57:57 2009
5133 From: marka@pobox.com (Mark Alexander)
5134 Date: Tue, 28 Jul 2009 12:57:57 -0400
5135 Subject: [sup-talk] [PATCH] Make logging less chatty
5136 In-Reply-To: <1248794676-sup-7855@masanjin.net>
5137 References: <1248716313-sup-1608@javelin>
5138 <1248716783-sup-6509@ntdws12.chass.utoronto.ca>
5139 <1248794676-sup-7855@masanjin.net>
5140 Message-ID: <a412e2a70907280957y73c1f562mc2dc51eb2d738ae0@mail.gmail.com>
5141
5142 On 7/28/09, William Morgan <wmorgan-sup at masanjin.net> wrote:
5143 > ... but yes, the whole Redwood::log thing is crufty
5144 > and needs to be replaced with a logger that's aware of levels.
5145
5146 Or maybe something combining types and levels that you
5147 could configure like this in config.yaml:
5148
5149 :logging:
5150 :mbox: 2
5151 :maildir: 3
5152 :ferret: 0
5153 ...etc...
5154
5155 From ezyang@MIT.EDU Tue Jul 28 14:34:46 2009
5156 From: ezyang@MIT.EDU (Edward Z. Yang)
5157 Date: Tue, 28 Jul 2009 14:34:46 -0400
5158 Subject: [sup-talk] Reply calculation
5159 In-Reply-To: <1248794955-sup-3347@masanjin.net>
5160 References: <1248545266-sup-6886@javelin> <1248546228-sup-9505@javelin>
5161 <1248548497-sup-1158@javelin> <1248549271-sup-3371@javelin>
5162 <1248713182-sup-172@entry> <1248713591-sup-8324@javelin>
5163 <1248794955-sup-3347@masanjin.net>
5164 Message-ID: <1248805830-sup-2383@javelin>
5165
5166 Excerpts from William Morgan's message of Tue Jul 28 11:48:48 -0400 2009:
5167 > > Unfortunately, mailing list administrating is notoriously broken. I'm not
5168 > > sure at all what the right solution is. Take for example this other case:
5169 > >
5170 > > From: person at example.com
5171 > > To: list at example.com
5172 > > Reply-To: person at example.com
5173 > > List-Post: mailto:list at example.com
5174 > >
5175 > > Reply-To, in this case, was set by the mailing list server.
5176 >
5177 > In this case, I'd argue that this means the list administrator wants the
5178 > default reply behavior to be to the individual and not the list. So I'd
5179 > again prefer Sup default to the reply-to address rather than the list
5180 > address. (With the caveat that this is overrideable by hooks on a
5181 > per-list basis, so if it's a matter of an incompetent list
5182 > administrator, or simply disagreeing with them, one can override this
5183 > behavior for this list.)
5184
5185 Nods.
5186
5187 > > However, consider the next case:
5188 > >
5189 > > From: persona at example.com
5190 > > To: list at example.com
5191 > > Cc: me at example.com
5192 > >
5193 > > Which is when someone else hit "Reply all" and you got CC'ed. This means
5194 > > that the mail never passed through the mailing list agent, the
5195 > > List-Post/Reply-To
5196 > > headers never got set, and the only way to tell that you should reply to the
5197 > > whole list is to explicitly ask for "Reply all" semantics (Sup defaults to
5198 > > "Reply" semantics, which is damn confusing if you're not paying attention).
5199 >
5200 > There's not much to be done in this case, EXCEPT that if you receive
5201 > more than one copy of the message, you should keep the list header
5202 > around. Then the only time you're in a funny situation is when you've
5203 > received the first but not the other.
5204
5205 This situation is not that uncommon; many mailing list software will notice
5206 that someone is on a CC list and will purposely omit them.
5207
5208 > I agree with this in principle, but I see addressing a message as a
5209 > fundamental part of composing it. You can remove the notion of a smart
5210 > default reply-to address from your Sup, if you like, by using the
5211 > reply-to hook.
5212
5213 This is true. However, when you compose a non-reply message, Sup prompts
5214 you for To, Cc and Subject, because they are such fundamental components
5215 of all messages you would write (well, maybe not so much Cc) and the
5216 user always has to make a judgment call there.
5217
5218 > And as for the default, I think I'm of the opinion that setting the
5219 > default reply address so as to obey the reply-to is correcter than
5220 > anything else (including whatever Sup does currently).
5221
5222 Fair enough. You may get some complaints because this /will/ break muscle
5223 memory, and still presents the possibility for messages to have different
5224 behavior in subtle ways, as detailed in the Cc versus mailing list example
5225 from above.
5226
5227 Cheers,
5228 Edward
5229
5230 From kkourt@cslab.ece.ntua.gr Tue Jul 28 12:58:23 2009
5231 From: kkourt@cslab.ece.ntua.gr (Kornilios Kourtis)
5232 Date: Tue, 28 Jul 2009 19:58:23 +0300
5233 Subject: [sup-talk] [PATCH] handle malformed multiplart messages
5234 Message-ID: <20090728165823.GA29533@solar.cslab.ece.ntua.gr>
5235
5236 Hi,
5237
5238 I've tried to use sup-mail, but sup-sync blows up due to some malformed
5239 messages I keep in my mailbox. Below is a quick patch that seems to fix the
5240 above issue for me.
5241
5242 Thanks,
5243
5244 --
5245 Kornilios Kourtis
5246
5247 diff --git a/lib/sup/message.rb b/lib/sup/message.rb
5248 index ded577a..c6e6baf 100644
5249 --- a/lib/sup/message.rb
5250 +++ b/lib/sup/message.rb
5251 @@ -385,11 +385,15 @@ private
5252
5253 chunks
5254 elsif m.header.content_type == "message/rfc822"
5255 - payload = RMail::Parser.read(m.body)
5256 - from = payload.header.from.first
5257 - from_person = from ? Person.from_address(from.format) : nil
5258 - [Chunk::EnclosedMessage.new(from_person, payload.to_s)] +
5259 - message_to_chunks(payload, encrypted)
5260 + if m.body
5261 + payload = RMail::Parser.read(m.body)
5262 + from = payload.header.from.first
5263 + from_person = from ? Person.from_address(from.format) : nil
5264 + [Chunk::EnclosedMessage.new(from_person, payload.to_s)] +
5265 + message_to_chunks(payload, encrypted)
5266 + else
5267 + [Chunk::EnclosedMessage.new(nil, "")]
5268 + end
5269 else
5270 filename =
5271 ## first, paw through the headers looking for a filename
5272
5273
5274 From wmorgan-sup@masanjin.net Tue Jul 28 14:55:50 2009
5275 From: wmorgan-sup@masanjin.net (William Morgan)
5276 Date: Tue, 28 Jul 2009 11:55:50 -0700
5277 Subject: [sup-talk] error with Sup while sending mails
5278 In-Reply-To: <956dbab30907210305s1127ace3s315c8505c9c38141@mail.gmail.com>
5279 References: <956dbab30907210305s1127ace3s315c8505c9c38141@mail.gmail.com>
5280 Message-ID: <1248807059-sup-8075@masanjin.net>
5281
5282 Hi Flo,
5283
5284 Reformatted excerpts from paro 462's message of 2009-07-21:
5285 > --- NoMethodError from thread: poll after loading inbox
5286 > undefined method `to_indexable_s' for nil:NilClass
5287 > ./lib/sup/index.rb:243:in `sync_message'
5288
5289 Interesting. You're the second person who's reported this. It has
5290 something to do with parsing a particular date. I'm not sure if it's
5291 locale-related... maybe.
5292
5293 Can you try applying the following patch? I'm hoping that the debugging
5294 output prefixed with XX will provide a clue.
5295
5296 --- a/lib/sup/message.rb
5297 +++ b/lib/sup/message.rb
5298 @@ -92,11 +92,14 @@ class Message
5299 begin
5300 Time.parse date
5301 rescue ArgumentError => e
5302 - #Redwood::log "faking mangled date header for #{@id} (orig #{header['date'].inspect} gave error: #{e.message})"
5303 + Redwood::log "faking mangled date header for #{@id} (orig #{header['date'].inspect} gave error: #{e.message})"
5304 Time.now
5305 end
5306 - else
5307 - #Redwood::log "faking non-existent date header for #{@id}"
5308 + end
5309 +
5310 + @date ||= begin
5311 + Redwood::log "XX original header was #{header["date"].inspect}"
5312 + Redwood::log "XX faking non-existent date header for #{@id}"
5313 Time.now
5314 end
5315 --
5316 William <wmorgan-sup at masanjin.net>
5317
5318 From wmorgan-sup@masanjin.net Tue Jul 28 15:05:39 2009
5319 From: wmorgan-sup@masanjin.net (William Morgan)
5320 Date: Tue, 28 Jul 2009 12:05:39 -0700
5321 Subject: [sup-talk] xapian question
5322 In-Reply-To: <1248795865-sup-6634@pion.club.cc.cmu.edu>
5323 References: <1248716325-sup-7534@masanjin.net>
5324 <1248795865-sup-6634@pion.club.cc.cmu.edu>
5325 Message-ID: <1248807365-sup-4965@masanjin.net>
5326
5327 Reformatted excerpts from Rich Lane's message of 2009-07-28:
5328 > Xapian actually provides add_term and remove_term for documents.
5329
5330 Excellent.
5331
5332 > I'd definitely like to use these for label updates, but we need a way
5333 > to tell if only the labels have changed in sync_message.
5334
5335 I've been running into this same issue with my sup-server experiments,
5336 so I think we should split the API into, say, three separate calls:
5337 something like add_new_message, update_labels, and update_body. (AFAIK
5338 the only client of update_body is in some of the draft editing stuff.)
5339 WDYT?
5340
5341 > Or, we update the index in Message#add_label/etc and get rid of the
5342 > need to save buffers. That might not be an option for the Ferret
5343 > index, though.
5344
5345 I think that would actually be fine for Ferret, and it's a direction
5346 that's often been discussed. (Especially now that we have undo.) If we
5347 do the above, we can certainly do this as a later step.
5348
5349 > We don't store the body in entries.db, just enough info for
5350 > thread-index-mode. It's only about 800 bytes/message for me, but I
5351 > don't have snippets enabled so yours would be larger.
5352
5353 On second glance, it's a little smaller than I remembered. For my sample
5354 212m mbox, it's about 20m with snippets enabled.
5355
5356 The total index size under Xapian (the xapian/ dir and all gdbm files)
5357 is larger than the original mbox file, which seems a little insane. But
5358 hey, disk space is cheap.
5359 --
5360 William <wmorgan-sup at masanjin.net>
5361
5362 From wmorgan-sup@masanjin.net Tue Jul 28 15:10:57 2009
5363 From: wmorgan-sup@masanjin.net (William Morgan)
5364 Date: Tue, 28 Jul 2009 12:10:57 -0700
5365 Subject: [sup-talk] Slow import of messages
5366 In-Reply-To: <20090713091516.GA21214@ikn.schottelius.org>
5367 References: <20090713091516.GA21214@ikn.schottelius.org>
5368 Message-ID: <1248808053-sup-5358@masanjin.net>
5369
5370 Hi Nico,
5371
5372 Reformatted excerpts from Nico Schottelius's message of 2009-07-13:
5373 > Now the problem is that sup gets about 3 mails per second into its
5374 > index.
5375
5376 As others have pointed out, messages only have to be indexed once, so
5377 this isn't ultimately that big of a deal. But 3m/s seems very slow for a
5378 Maildir source.
5379
5380 With my mbox on my reasonably-fast laptop, I start with around 50m/s
5381 using Ferret, and at 80m/s using Xapian. (These numbers degrade slightly
5382 as the index gets fuller.) I would expect similar numbers from Maildir.
5383
5384 So something weird is happening for you. Do you have a notion of whether
5385 it's disk or CPU that's the bottleneck?
5386 --
5387 William <wmorgan-sup at masanjin.net>
5388
5389 From iny+dev@iki.fi Wed Jul 29 02:09:42 2009
5390 From: iny+dev@iki.fi (Ilpo =?iso-8859-1?Q?Nyyss=F6nen?=)
5391 Date: Wed, 29 Jul 2009 09:09:42 +0300
5392 Subject: [sup-talk] Handling big mailing lists
5393 Message-ID: <m3zlaovx3t.fsf@iny.iki.fi>
5394
5395
5396 I'm searching alternatives for my Gnus email + news setup. I don't
5397 expect Sup to be able to do everything Gnus can yet, but maybe in
5398 future? :) Note that I have never used Gmail.
5399
5400 I tried to test Sup, but I wasn't able to get any emails because Sup
5401 failed to login to my IMAP server. This happened because the server
5402 requires client certificates and it looks like Sup doesn't support
5403 those.
5404
5405 The bigger question is about handling big amount of mailing list mail.
5406 I'm reading many small mailing lists and some big ones. Biggest is
5407 linux-kernel. I can split this to two: daily reading routine and
5408 expiration.
5409
5410 How would my daily reading routine work with Sup? I want to read
5411 things in priority order:
5412
5413 1. Personal email
5414 2. Emails related to my programming hobby
5415 3. Emails related to some associations like user groups
5416 4. Mailing lists, also in priority order
5417
5418 The order is such that if I need to stop reading, I have read the most
5419 important ones already. The order is not static, I want to be able to
5420 change it.
5421
5422 I have understood that labels are way to get this kind of grouping.
5423 Can I get a view where the labels are sorted like this? And can I
5424 continue reading the next label in that order after I have finished
5425 the one before?
5426
5427 Then about the expiration. The linux-kernel mailing list gets so much
5428 email that some kind of expiration is a must. Can Sup do such
5429 automatic deleting of old emails? Can Sup handle some other process
5430 doing such automatic deletion? (I would actually prefer some other
5431 process do it.)
5432
5433 I'm mostly reading just only few authors from linux-kernel and skipping
5434 rest, but I do like to see the rest in the thread view as sometimes some
5435 subject is interesting and sometimes some thread gets big and is
5436 interesting because of that. How would this work?
5437
5438 I would actually recommend reading linux-kernel to test Sup. :)
5439
5440 --
5441 Ilpo Nyyss?nen # biny # /* :-) */
5442
5443
5444 From marco-oweber@gmx.de Wed Jul 29 06:27:06 2009
5445 From: marco-oweber@gmx.de (Marc Weber)
5446 Date: Wed, 29 Jul 2009 12:27:06 +0200
5447 Subject: [sup-talk] error with Sup while sending mails
5448 In-Reply-To: <956dbab30907210305s1127ace3s315c8505c9c38141@mail.gmail.com>
5449 References: <956dbab30907210305s1127ace3s315c8505c9c38141@mail.gmail.com>
5450 Message-ID: <1248863105-sup-6533@nixos>
5451
5452 > undefined method `to_indexable_s' for nil:NilClass
5453 > ./lib/sup/index.rb:243:in `sync_message'
5454 > ./lib/sup/util.rb:519:in `send'
5455
5456 sup-sync -c did it for me. I don't know what was wrong at all though.
5457 This will take some time.
5458
5459 If you open index.rb:243 you may want to add a
5460 p m where m is the message object? Maybe the output will give you more
5461 insight as well.
5462
5463 I hope sync helps you as well.
5464
5465 Marc Weber
5466
5467 From marco-oweber@gmx.de Wed Jul 29 08:54:11 2009
5468 From: marco-oweber@gmx.de (Marc Weber)
5469 Date: Wed, 29 Jul 2009 14:54:11 +0200
5470 Subject: [sup-talk] Handling big mailing lists
5471 In-Reply-To: <m3zlaovx3t.fsf@iny.iki.fi>
5472 References: <m3zlaovx3t.fsf@iny.iki.fi>
5473 Message-ID: <1248871866-sup-9988@nixos>
5474
5475 You can use hooks to add labels:
5476
5477 my "~/.sup/hooks/before-add-message.rb":
5478
5479 def matchR(email)
5480 not message.recipients.find{ |to| /^#{email}$/i =~ to.email}.nil?
5481 end
5482
5483 def matchRAddLabel(email, label, inbox = 0)
5484 if matchR email then
5485 message.add_label label
5486 message.remove_label :inbox unless inbox
5487 end
5488 end
5489
5490 def importantFrom(email)
5491 message.add_label :Starred if message.from.email == email
5492 end
5493
5494 importantFrom "info at webkos.de"
5495
5496
5497 matchRAddLabel("mod_python at modpython.org","mod-python", 1)
5498 matchRAddLabel("mod_python at modpython.org","mod-python", 0)
5499
5500 if message.subj =~ /^Project Notification$/ && message.from.email == "info at guru.com" then
5501 message.add_label "GURU_PROJECT_NOTIFICATION"
5502 message.add_label "delete_after_one_month"
5503 end
5504
5505 if message.subj =~ /^WEBKOS_/ then
5506 message.remove_label :inbox
5507 message.add_label "WEBKOS_"
5508 end
5509
5510
5511 So adding labels onle if a contsraint is met is easy.
5512 About deleting mails: There is sup-sync-back. So there must be a way to delete
5513 "old" / whatever mails. I haven't used it yet.
5514
5515 I'm new to sup myself.
5516
5517 Yours
5518 Marc Weber
5519
5520 From wmorgan-sup@masanjin.net Wed Jul 29 09:46:19 2009
5521 From: wmorgan-sup@masanjin.net (William Morgan)
5522 Date: Wed, 29 Jul 2009 06:46:19 -0700
5523 Subject: [sup-talk] Handling big mailing lists
5524 In-Reply-To: <m3zlaovx3t.fsf@iny.iki.fi>
5525 References: <m3zlaovx3t.fsf@iny.iki.fi>
5526 Message-ID: <1248874122-sup-3830@masanjin.net>
5527
5528 Hi,
5529
5530 Excellent set of questions. Handling large volumes of mail is one of my
5531 main goals with Sup.
5532
5533 Reformatted excerpts from iny+dev's message of 2009-07-28:
5534 > I tried to test Sup, but I wasn't able to get any emails because Sup
5535 > failed to login to my IMAP server. This happened because the server
5536 > requires client certificates and it looks like Sup doesn't support
5537 > those.
5538
5539 As far as IMAP goes, Sup supports whatever authentication the Ruby IMAP
5540 libraries supports, which is probably not much.
5541
5542 Any serious use of Sup with IMAP is best done via an intermediate like
5543 offlineimap, which syncs an IMAP folder to a local Maildir folder. The
5544 Ruby IMAP libraries, and possibly IMAP itself, is a little too slow for
5545 how Sup likes to work.
5546
5547 > How would my daily reading routine work with Sup? I want to read
5548 > things in priority order:
5549 >
5550 > 1. Personal email
5551 > 2. Emails related to my programming hobby
5552 > 3. Emails related to some associations like user groups
5553 > 4. Mailing lists, also in priority order
5554
5555 Sup gives you two tools: search and labels. Sup will present a list of
5556 threads that match any search query. So, each of those steps is
5557 possible, to the extent that you can compose a search query that
5558 reflects it.
5559
5560 You can automatically add labels via arbitrary code, so you have a fair
5561 amount of flexibility here.
5562
5563 > The order is such that if I need to stop reading, I have read the most
5564 > important ones already. The order is not static, I want to be able to
5565 > change it. I have understood that labels are way to get this kind of
5566 > grouping. Can I get a view where the labels are sorted like this?
5567
5568 Sup currently only orders chronologically. It would not be difficult to
5569 add a second level of user-defined sorting *on top* of the chronological
5570 one, but it would be difficult, if not impossible, to order all email in
5571 the index by an arbitrary function.
5572
5573 (To be pedantic, if you can come up with a single number for each email,
5574 which never changes, and which is known at add time, you can order by
5575 that, with some work. But it doesn't sound like that's what you want.)
5576
5577 > And can I continue reading the next label in that order after I have
5578 > finished the one before?
5579
5580 Certainly, but not automatically. You can view one label, and then pick
5581 another label to view, etc.
5582
5583 I suppose if the above second-round of ordering were implemented, you
5584 could view both labels at once and make an ordering function that placed
5585 one above the other.
5586
5587 > Then about the expiration. The linux-kernel mailing list gets so much
5588 > email that some kind of expiration is a must.
5589
5590 You don't want to just buy a bigger hard drive?
5591
5592 > Can Sup do such automatic deleting of old emails? Can Sup handle some
5593 > other process doing such automatic deletion? (I would actually prefer
5594 > some other process do it.)
5595
5596 That's best left to another process. You'll then have to tell Sup which
5597 messages were deleted so that it can remove them from the index. Let me
5598 know when you're at this point and I can help you---it will require a
5599 brief Ruby script.
5600
5601 > I would actually recommend reading linux-kernel to test Sup. :)
5602
5603 I read ruby-talk, which is probably not too far off.
5604
5605 One last comment: large threads are irritatingly slow to create in
5606 thread-view-mode with the Ferret index, but there's a new Xapian index
5607 which is fast for this. It's still slightly experimental.
5608 --
5609 William <wmorgan-sup at masanjin.net>
5610
5611 From iny+dev@iki.fi Wed Jul 29 13:24:43 2009
5612 From: iny+dev@iki.fi (Ilpo =?iso-8859-1?Q?Nyyss=F6nen?=)
5613 Date: Wed, 29 Jul 2009 20:24:43 +0300
5614 Subject: [sup-talk] Handling big mailing lists
5615 References: <m3zlaovx3t.fsf@iny.iki.fi> <1248874122-sup-3830@masanjin.net>
5616 Message-ID: <m3prbjwgf8.fsf@iny.iki.fi>
5617
5618 William Morgan <wmorgan-sup at masanjin.net> writes:
5619
5620 > Sup currently only orders chronologically. It would not be difficult to
5621 > add a second level of user-defined sorting *on top* of the chronological
5622 > one, but it would be difficult, if not impossible, to order all email in
5623 > the index by an arbitrary function.
5624
5625 I'm not talking about ordering of emails, I'm talking about ordering of
5626 the labels.
5627
5628 When I start my daily routine, I want to see a list of labels with
5629 numbers telling how many unread emails each has. Labels containing
5630 nothing new must be hidden. And this list must be sorted to priority
5631 order. Then I want to read those labels through in that order.
5632
5633 How many labels would I have? At least tens, probably over hundred.
5634
5635 >> And can I continue reading the next label in that order after I have
5636 >> finished the one before?
5637 >
5638 > Certainly, but not automatically. You can view one label, and then pick
5639 > another label to view, etc.
5640
5641 Picking one from alphabetically sorted list or writing it is not usable.
5642 I don't remember the order, I just want to get the next one.
5643
5644 >> Then about the expiration. The linux-kernel mailing list gets so much
5645 >> email that some kind of expiration is a must.
5646 >
5647 > You don't want to just buy a bigger hard drive?
5648
5649 It's not a disk space problem. The problem is that many things would get
5650 slow (or I would need to configure exceptions) and I just do not have
5651 any need for them. They are all in searchable mailing list archives
5652 anyway.
5653
5654 And another point is that I actually prefer not to order mailing lists.
5655 It is much easier to just get them with nntp from news.gmane.org. How? I
5656 have a nntp to imap gateway and I use it to read also from other nntp
5657 servers. The thing here is that nntp servers usually do expire messages
5658 and so to be able to use that with Sup, it would need to tolerate the
5659 expiration.
5660
5661 > That's best left to another process. You'll then have to tell Sup which
5662 > messages were deleted so that it can remove them from the index.
5663
5664 So, I don't do the expiration. I guess it should be possible to find out
5665 the ones that went away when checking for new ones.
5666
5667 > Let me know when you're at this point and I can help you---it will
5668 > require a brief Ruby script.
5669
5670 Well, it is looking like in current state I won't even start trying.
5671
5672 >> I would actually recommend reading linux-kernel to test Sup. :)
5673 >
5674 > I read ruby-talk, which is probably not too far off.
5675
5676 Hmm,
5677
5678 http://dir.gmane.org/gmane.comp.lang.ruby.general
5679 http://dir.gmane.org/gmane.linux.kernel
5680
5681 I guess so. How long it takes to index few months of ruby-talk?
5682
5683 Could Sup use IMAP search features?
5684
5685 --
5686 Ilpo Nyyss?nen # biny # /* :-) */
5687
5688
5689 From dato@net.com.org.es Thu Jul 30 11:56:56 2009
5690 From: dato@net.com.org.es (Adeodato =?utf-8?B?U2ltw7M=?=)
5691 Date: Thu, 30 Jul 2009 17:56:56 +0200
5692 Subject: [sup-talk] [PATCH] mime-decode hook: provide a
5693 "charset" variable with the attachment charset
5694 In-Reply-To: <1248713434-sup-4961@entry>
5695 References: <6fc2e5dd8aa2b0b8547375d77b1776d779f85817.1247238014.git.dato@net.com.org.es>
5696 <20090723093543.GA2265@chistera.yi.org> <1248713434-sup-4961@entry>
5697 Message-ID: <20090730155656.GA20442@chistera.yi.org>
5698
5699 + William Morgan (Mon, 27 Jul 2009 09:51:17 -0700):
5700
5701 > Reformatted excerpts from Adeodato Sim?'s message of 2009-07-23:
5702 > > + Adeodato Sim? (Fri, 10 Jul 2009 17:00:29 +0200):
5703 > > > + :charset => encoded_content.charset,
5704
5705 > > Hm, so apparently encoded_content doesn't always have a charset
5706 > > member...
5707
5708 > In which case that value of that variable is nil, right? Is that a
5709 > problem? The patch still seems useful.
5710
5711 Yes, I took a closer look and you're right the result of
5712 encoded_content.charset is nil in that case. I also saw (I think) where
5713 the traceback I was seeing is coming from: apparently it's not possible
5714 to pass to HookContext a local that is nil, since then "super" will get
5715 called in HookContext::method_missing() as far as I can see.
5716
5717 So, perhaps, to fix this patch, one could do:
5718
5719 :charset => encoded_content.charset || ''
5720
5721 But then, I think it would be better to fix HookContext to allow for
5722 @__locals to contain nil. I'm not very familiar with that class, but it
5723 seems easy enough to fix, see upcoming patch (also found in
5724 ~dato/sup/sup-dato:fixes at Gitorious, if you prefer that). With it,
5725 this improvement to mime-decode seems to work without any further
5726 trouble.
5727
5728 Cheers,
5729
5730 --
5731 - Are you sure we're good?
5732 - Always. -- Rory and Lorelai
5733
5734
5735 From dato@net.com.org.es Thu Jul 30 11:57:16 2009
5736 From: dato@net.com.org.es (=?utf-8?q?Adeodato=20Sim=C3=B3?=)
5737 Date: Thu, 30 Jul 2009 17:57:16 +0200
5738 Subject: [sup-talk] [PATCH] HookContext::method_missing(): allow locals to
5739 be nil
5740 In-Reply-To: <20090730155656.GA20442@chistera.yi.org>
5741 References: <20090730155656.GA20442@chistera.yi.org>
5742 Message-ID: <b6ff832e5f1872bda03e7846260165e8571c6dae.1248969435.git.dato@net.com.org.es>
5743
5744 With the previous implementation of method_missing() in HookContext, it
5745 was not possible to set the value of a local to nil, since that would be
5746 assumed to mean "that local does not exist" and super would get called.
5747
5748 Now we use has_key? to check whether the local exists or not, and nil
5749 will be returned normally from method_missing if that's the value of the
5750 @__locals[name].
5751
5752 Signed-off-by: Adeodato Sim? <dato at net.com.org.es>
5753 ---
5754 lib/sup/hook.rb | 12 +++++++-----
5755 1 files changed, 7 insertions(+), 5 deletions(-)
5756
5757 diff --git a/lib/sup/hook.rb b/lib/sup/hook.rb
5758 index 0a0a2f6..8a52a96 100644
5759 --- a/lib/sup/hook.rb
5760 +++ b/lib/sup/hook.rb
5761 @@ -20,13 +20,15 @@ class HookManager
5762 attr_writer :__locals
5763
5764 def method_missing m, *a
5765 - case @__locals[m]
5766 - when Proc
5767 - @__locals[m] = @__locals[m].call(*a) # only call the proc once
5768 - when nil
5769 + if not @__locals.has_key? m
5770 super
5771 else
5772 - @__locals[m]
5773 + case @__locals[m]
5774 + when Proc
5775 + @__locals[m] = @__locals[m].call(*a) # only call the proc once
5776 + else
5777 + @__locals[m]
5778 + end
5779 end
5780 end
5781
5782 --
5783 1.6.3.3
5784
5785
5786 From tom@dbservice.com Thu Jul 30 14:31:12 2009
5787 From: tom@dbservice.com (Tomas Carnecky)
5788 Date: Thu, 30 Jul 2009 20:31:12 +0200
5789 Subject: [sup-talk] sup on opensolaris
5790 Message-ID: <C1361ACC-8CF6-4AD9-955C-0B812197AF19@dbservice.com>
5791
5792 Kids, don't try this at home, it kills kittens! Well, not directly,
5793 but trying to get sup running will drive you so mad you will try to
5794 kill everything that moves. In other words: it doesn't work and the
5795 fact that I'm trying this on opensolaris doesn't make it any easier.
5796
5797 The biggest issue is that the ruby binary from the package manager is
5798 linked against the ancient solaris curses.so but ruby-ncurses needs
5799 ncurses.so (which, to make the issue even more complicated, is in /usr/
5800 gnu/lib). When both libraries are liked into one application, they
5801 don't play along well (=segfaults). I had to compile ruby from source
5802 and make sure it's not liked with curses.so, and also patch ruby-
5803 ncurses slightly. I then managed to get sup to start up and read my
5804 mails. However, there is one issue left that I'm not able to fix:
5805 Ncurses.field.field_buffer() is returning garbage, and that makes is
5806 impossible to write mails, search and set tags etc. The problem is
5807 somewhere inside sup, as the ruby-ncurses example form2.rb is working
5808 just fine (maybe it has something to do with encoding/locale?).
5809
5810 I have an ugly patch for lib/sup/textfield.rb that uses its own string
5811 buffer instead of relying on field_buffer(). It's not perfect, but it
5812 at least allows me to write emails and assign tags.
5813
5814 Other issues:
5815 - strftime("%P") is a GNU extension, I work around this by using
5816 strftime("%p").downcase.
5817 - Iconv.iconv(target + "//IGNORE", charset, text + " ") <- the "//
5818 IGNORE" is causing an InvalidEncoding exception, removing it didn't
5819 seem to cause any regressions
5820
5821 tom
5822
5823
5824 From garoth@gmail.com Fri Jul 31 11:17:28 2009
5825 From: garoth@gmail.com (Andrei Thorp)
5826 Date: Fri, 31 Jul 2009 11:17:28 -0400
5827 Subject: [sup-talk] Smooth Paging
5828 Message-ID: <1249053249-sup-9884@Longbow>
5829
5830 Hello,
5831
5832 One thing's that I've found a bit suboptimal in Sup has been the paging
5833 ie. scrolling of e-mails. When you reach the bottom, it scrolls the
5834 whole page up, rather than scrolling smoothly as might be the default
5835 behaviour of Vim for example.
5836
5837 I find this really awkward at times, since I can't see what I just read
5838 while reading the next line. It's also just kind of jumpy. One main use
5839 case that his damages is when I'm doing patch review on mailing lists
5840 and stuff.
5841
5842 I'll open a long e-mail with diffs in it, and I will be scrolling to see
5843 the patch. Then, as I reach the bottom, it jumps and hides what I just
5844 read, making understanding code logic painful at times. So then I have
5845 to jump up and down some more to figure it out, but that sucks because I
5846 have to look between the top and bottom of the screen.
5847
5848 What do you guys think?
5849 --
5850 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
5851
5852 From garoth@gmail.com Fri Jul 31 11:23:07 2009
5853 From: garoth@gmail.com (Andrei Thorp)
5854 Date: Fri, 31 Jul 2009 11:23:07 -0400
5855 Subject: [sup-talk] Sup Resource Usage
5856 Message-ID: <1249053483-sup-9050@Longbow>
5857
5858 This isn't a serious complaint, but I'd just like to bring a couple
5859 things with respect to Sup resource usage to the light.
5860
5861 According to top, Sup uses a fair bit of ram: about 30 MB at any point.
5862 For comparison, pidgin uses about that much, and firefox uses 4x more.
5863 That's generally acceptable, but more than I'd expect from a CLI app.
5864 This is probably unavoidable.
5865
5866 What I find a bit more curious is Sup's wakeups. According to powertop,
5867 sup is actually one of the top power munchers on my computers. I don't
5868 understand why it has to wake up as often as it does: it's responsible
5869 for 20% of all wakeups, with a rating of ~115. By comparison, firefox
5870 does almost exactly the same amount of wakeups, and sup is the third
5871 thing on my list, way above my window manager/de which does considerably
5872 more.
5873
5874 I wonder what could be up here. Anyway, I'm fine with it if it's
5875 un-investigated. Cheers.
5876 --
5877 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
5878
5879 From ezyang@MIT.EDU Fri Jul 31 11:38:00 2009
5880 From: ezyang@MIT.EDU (Edward Z. Yang)
5881 Date: Fri, 31 Jul 2009 11:38:00 -0400
5882 Subject: [sup-talk] Smooth Paging
5883 In-Reply-To: <1249053249-sup-9884@Longbow>
5884 References: <1249053249-sup-9884@Longbow>
5885 Message-ID: <1249054651-sup-1510@javelin>
5886
5887 Excerpts from Andrei Thorp's message of Fri Jul 31 11:17:28 -0400 2009:
5888 > One thing's that I've found a bit suboptimal in Sup has been the paging
5889 > ie. scrolling of e-mails. When you reach the bottom, it scrolls the
5890 > whole page up, rather than scrolling smoothly as might be the default
5891 > behaviour of Vim for example.
5892
5893 I agree with this assessment and think smoother scrolling would be a
5894 nice extra touch.
5895
5896 Cheers,
5897 Edward
5898
5899 From wmorgan-sup@masanjin.net Fri Jul 31 11:43:26 2009
5900 From: wmorgan-sup@masanjin.net (William Morgan)
5901 Date: Fri, 31 Jul 2009 08:43:26 -0700
5902 Subject: [sup-talk] Sup Resource Usage
5903 In-Reply-To: <1249053483-sup-9050@Longbow>
5904 References: <1249053483-sup-9050@Longbow>
5905 Message-ID: <1249054758-sup-9479@masanjin.net>
5906
5907 Reformatted excerpts from Andrei Thorp's message of 2009-07-31:
5908 > What I find a bit more curious is Sup's wakeups. According to
5909 > powertop, sup is actually one of the top power munchers on my
5910 > computers. I don't understand why it has to wake up as often as it
5911 > does: it's responsible for 20% of all wakeups, with a rating of ~115.
5912
5913 What's the wakeup behavior of "ruby -esleep"?
5914
5915 What's the behavior of this Ruby program:
5916
5917 require 'rubygems'
5918 require 'ncurses'
5919
5920 Ncurses.initscr
5921 c = Ncurses.getch
5922 Ncurses.endwin
5923
5924 puts c
5925
5926 I'd also be curious if things change under Ruby 1.9.1, since I'd like to
5927 move to that as soon as feasible.
5928 --
5929 William <wmorgan-sup at masanjin.net>
5930
5931 From wmorgan-sup@masanjin.net Fri Jul 31 11:44:25 2009
5932 From: wmorgan-sup@masanjin.net (William Morgan)
5933 Date: Fri, 31 Jul 2009 08:44:25 -0700
5934 Subject: [sup-talk] Smooth Paging
5935 In-Reply-To: <1249053249-sup-9884@Longbow>
5936 References: <1249053249-sup-9884@Longbow>
5937 Message-ID: <1249055039-sup-8105@masanjin.net>
5938
5939 Reformatted excerpts from Andrei Thorp's message of 2009-07-31:
5940 > What do you guys think?
5941
5942 Have you tried J and K vs j and k to scroll?
5943 --
5944 William <wmorgan-sup at masanjin.net>
5945
5946 From ezyang@MIT.EDU Fri Jul 31 11:46:40 2009
5947 From: ezyang@MIT.EDU (Edward Z. Yang)
5948 Date: Fri, 31 Jul 2009 11:46:40 -0400
5949 Subject: [sup-talk] Smooth Paging
5950 In-Reply-To: <1249055039-sup-8105@masanjin.net>
5951 References: <1249053249-sup-9884@Longbow> <1249055039-sup-8105@masanjin.net>
5952 Message-ID: <1249055175-sup-4619@javelin>
5953
5954 Excerpts from William Morgan's message of Fri Jul 31 11:44:25 -0400 2009:
5955 > Have you tried J and K vs j and k to scroll?
5956
5957 In general, I use PgUp and PgDn to scroll. I didn't realize those keybindings
5958 existed. :-)
5959
5960 Cheers,
5961 Edward
5962
5963 From wmorgan-sup@masanjin.net Fri Jul 31 11:56:52 2009
5964 From: wmorgan-sup@masanjin.net (William Morgan)
5965 Date: Fri, 31 Jul 2009 08:56:52 -0700
5966 Subject: [sup-talk] sup on opensolaris
5967 In-Reply-To: <C1361ACC-8CF6-4AD9-955C-0B812197AF19@dbservice.com>
5968 References: <C1361ACC-8CF6-4AD9-955C-0B812197AF19@dbservice.com>
5969 Message-ID: <1249055178-sup-7149@masanjin.net>
5970
5971 Hi Tom,
5972
5973 Thanks for the report! It's nice to have another system "supported", at
5974 least technically.
5975
5976 Reformatted excerpts from Tomas Carnecky's message of 2009-07-30:
5977 > However, there is one issue left that I'm not able to fix:
5978 > Ncurses.field.field_buffer() is returning garbage, and that makes is
5979 > impossible to write mails, search and set tags etc. The problem is
5980 > somewhere inside sup, as the ruby-ncurses example form2.rb is working
5981 > just fine (maybe it has something to do with encoding/locale?).
5982
5983 The ncurses field stuff is some hellish bullshit that I hate with all my
5984 heart. It may very well be a locale problem... I really don't want to
5985 debug it.
5986
5987 > I have an ugly patch for lib/sup/textfield.rb that uses its own string
5988 > buffer instead of relying on field_buffer(). It's not perfect, but it
5989 > at least allows me to write emails and assign tags.
5990
5991 If it's not too much work to clean up, I'd be interested in this patch.
5992 The field buffer stuff is broken in weird ways anyways (the history
5993 never seems to be quite right), and anything that reduces the reliance
5994 on ncurses is always the right approach.
5995
5996
5997 > - strftime("%P") is a GNU extension, I work around this by using
5998 > strftime("%p").downcase.
5999
6000 Submit a patch! I'm fine with this.
6001
6002 > - Iconv.iconv(target + "//IGNORE", charset, text + " ") <- the "//
6003 > IGNORE" is causing an InvalidEncoding exception, removing it didn't
6004 > seem to cause any regressions
6005
6006 Hm, this is a trickier one. Allegedly the //IGNORE reduces the
6007 exceptions thrown by Iconv, but since we're catching them all anyways,
6008 we might be able to get away with removing this. Or we could
6009 special-case it to your arch.
6010 --
6011 William <wmorgan-sup at masanjin.net>
6012
6013 From wmorgan-sup@masanjin.net Fri Jul 31 11:57:43 2009
6014 From: wmorgan-sup@masanjin.net (William Morgan)
6015 Date: Fri, 31 Jul 2009 08:57:43 -0700
6016 Subject: [sup-talk] Smooth Paging
6017 In-Reply-To: <1249055175-sup-4619@javelin>
6018 References: <1249053249-sup-9884@Longbow> <1249055039-sup-8105@masanjin.net>
6019 <1249055175-sup-4619@javelin>
6020 Message-ID: <1249055837-sup-9394@masanjin.net>
6021
6022 Reformatted excerpts from Edward Z. Yang's message of 2009-07-31:
6023 > In general, I use PgUp and PgDn to scroll. I didn't realize those
6024 > keybindings existed. :-)
6025
6026 Ctrl-e and ctrl-y work as well, if you're a vi addict.
6027 --
6028 William <wmorgan-sup at masanjin.net>
6029
6030 From garoth@gmail.com Fri Jul 31 12:00:00 2009
6031 From: garoth@gmail.com (Andrei Thorp)
6032 Date: Fri, 31 Jul 2009 12:00:00 -0400
6033 Subject: [sup-talk] Sup Resource Usage
6034 In-Reply-To: <1249054758-sup-9479@masanjin.net>
6035 References: <1249053483-sup-9050@Longbow> <1249054758-sup-9479@masanjin.net>
6036 Message-ID: <1249055796-sup-2690@Longbow>
6037
6038 Excerpts from William Morgan's message of Fri Jul 31 11:43:26 -0400 2009:
6039 > What's the wakeup behavior of "ruby -esleep"?
6040
6041 Well, you can easily test this yourself with powertop, but just running
6042 this command does not cause a lot of wakeups. (It's not in the top
6043 causes list.)
6044
6045 > What's the behavior of this Ruby program:
6046 >
6047 > require 'rubygems'
6048 > require 'ncurses'
6049 >
6050 > Ncurses.initscr
6051 > c = Ncurses.getch
6052 > Ncurses.endwin
6053 >
6054 > puts c
6055
6056 This program exits right away, so I don't really know how to test it.
6057 --
6058 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
6059
6060 From garoth@gmail.com Fri Jul 31 12:01:08 2009
6061 From: garoth@gmail.com (Andrei Thorp)
6062 Date: Fri, 31 Jul 2009 12:01:08 -0400
6063 Subject: [sup-talk] Smooth Paging
6064 In-Reply-To: <1249055039-sup-8105@masanjin.net>
6065 References: <1249053249-sup-9884@Longbow> <1249055039-sup-8105@masanjin.net>
6066 Message-ID: <1249056026-sup-1964@Longbow>
6067
6068 Excerpts from William Morgan's message of Fri Jul 31 11:44:25 -0400 2009:
6069 > Reformatted excerpts from Andrei Thorp's message of 2009-07-31:
6070 > > What do you guys think?
6071 >
6072 > Have you tried J and K vs j and k to scroll?
6073
6074 No I haven't, but I'm glad to know they exist :)
6075
6076 Thanks.
6077 --
6078 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
6079
6080 From garoth@gmail.com Fri Jul 31 12:11:29 2009
6081 From: garoth@gmail.com (Andrei Thorp)
6082 Date: Fri, 31 Jul 2009 12:11:29 -0400
6083 Subject: [sup-talk] Smooth Paging
6084 In-Reply-To: <1249055837-sup-9394@masanjin.net>
6085 References: <1249053249-sup-9884@Longbow> <1249055039-sup-8105@masanjin.net>
6086 <1249055175-sup-4619@javelin> <1249055837-sup-9394@masanjin.net>
6087 Message-ID: <1249056674-sup-2428@Longbow>
6088
6089 Excerpts from William Morgan's message of Fri Jul 31 11:57:43 -0400 2009:
6090 > Reformatted excerpts from Edward Z. Yang's message of 2009-07-31:
6091 > > In general, I use PgUp and PgDn to scroll. I didn't realize those
6092 > > keybindings existed. :-)
6093 >
6094 > Ctrl-e and ctrl-y work as well, if you're a vi addict.
6095
6096 I didn't even know that one o_0. (in vim)
6097 --
6098 Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
6099
6100 From rlane@club.cc.cmu.edu Fri Jul 31 12:20:41 2009
6101 From: rlane@club.cc.cmu.edu (Rich Lane)
6102 Date: Fri, 31 Jul 2009 12:20:41 -0400
6103 Subject: [sup-talk] [PATCH 0/18] Xapian-based index
6104 In-Reply-To: <1248710432-sup-1734@pion.club.cc.cmu.edu>
6105 References: <1245531017-9907-1-git-send-email-rlane@club.cc.cmu.edu>
6106 <1245854803-sup-4481@entry> <1245864733-sup-1216@entry>
6107 <loom.20090625T222159-861@post.gmane.org>
6108 <1246022094-sup-3336@entry> <1247873980-sup-8574@wrasse>
6109 <20090723102325.GA4291@chistera.yi.org>
6110 <1248497184-sup-939@pion.club.cc.cmu.edu>
6111 <1248513425-sup-2484@chistera.yi.org>
6112 <1248550384-sup-74@pion.club.cc.cmu.edu>
6113 <1248709681-sup-4141@entry>
6114 <1248710432-sup-1734@pion.club.cc.cmu.edu>
6115 Message-ID: <1249056691-sup-9011@pion.club.cc.cmu.edu>
6116
6117 Excerpts from Rich Lane's message of Mon Jul 27 13:06:34 -0400 2009:
6118 > Excerpts from William Morgan's message of Mon Jul 27 11:48:38 -0400 2009:
6119 > > Reformatted excerpts from Rich Lane's message of 2009-07-25:
6120 > > > One issue I've noticed is that removing labels from messages doesn't
6121 > > > always immediately work.
6122 > >
6123 > > Is this true even after you sync changes to the index? What about if you
6124 > > reload the label list buffer? ('@')
6125 >
6126 > Yes. This is looking like a Xapian bug - I've reproduced it without any
6127 > Sup code. I'm working on a fix.
6128
6129 I've fixed this, it should be released in Xapian 1.0.15. Or, grab Xapian
6130 SVN and you can try out the Chert backend too (XAPIAN_PREFER_CHERT=1).
6131
6132 From bwalton@artsci.utoronto.ca Fri Jul 31 12:59:16 2009
6133 From: bwalton@artsci.utoronto.ca (Ben Walton)
6134 Date: Fri, 31 Jul 2009 12:59:16 -0400
6135 Subject: [sup-talk] sup on opensolaris
6136 In-Reply-To: <1249055178-sup-7149@masanjin.net>
6137 References: <C1361ACC-8CF6-4AD9-955C-0B812197AF19@dbservice.com>
6138 <1249055178-sup-7149@masanjin.net>
6139 Message-ID: <1249059493-sup-7953@ntdws12.chass.utoronto.ca>
6140
6141 Excerpts from William Morgan's message of Fri Jul 31 11:56:52 -0400 2009:
6142 > Thanks for the report! It's nice to have another system "supported", at
6143 > least technically.
6144
6145 I'm the ruby maintainer for OpenCSW, which provides binary packages
6146 for solaris 8+ linked against a modern curses. Everything lives in
6147 /opt/csw/, so it's self contained except where linking to system
6148 stuff.
6149
6150 I _think_ this should all work on opensolaris (but I don't use it) if
6151 you're interested in trying it. That won't help things like %P (%z is
6152 another common offender I come across), but it may make part of your
6153 life easier.
6154
6155 You'll get a modern libiconv too, although the version in opensolaris
6156 shouldn't be that old?
6157
6158 http://www.opencsw.org/
6159
6160 HTH
6161 -Ben
6162 --
6163 Ben Walton
6164 Systems Programmer - CHASS
6165 University of Toronto
6166 C:416.407.5610 | W:416.978.4302
6167
6168 GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
6169 Contact me to arrange for a CAcert assurance meeting.
6170 -------------- next part --------------
6171 A non-text attachment was scrubbed...
6172 Name: signature.asc
6173 Type: application/pgp-signature
6174 Size: 189 bytes
6175 Desc: not available
6176 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090731/84805c4a/attachment.bin>
6177