community/pipermail-archives/sup-talk/2009-04.txt (142808B) - raw
1 From david.guibert@cdcsp.univ-lyon1.fr Wed Apr 1 04:41:00 2009
2 From: david.guibert@cdcsp.univ-lyon1.fr (David Guibert)
3 Date: Wed, 01 Apr 2009 10:41:00 +0200
4 Subject: [sup-talk] Config in VCS
5 In-Reply-To: <1238234052-sup-2032@ausone.home>
6 References: <49CD0B3E.9010002@cs.rpi.edu> <1238234052-sup-2032@ausone.home>
7 Message-ID: <1238574341-sup-4744@orsine>
8
9 Hi,
10
11 >From Nicolas Pouillard:
12 > Excerpts from Ethan Glasser-Camp's message of Fri Mar 27 18:22:06 +0100 2009:
13 > > Hi, long time reader, first time caller.
14 > >
15 > > Many years ago I used fetchmail+Mutt to handle my mail, but all my
16 > > configuration was lost in a hard drive crash and I didn't have the
17 > > energy to recreate it. So as I look at sup, I am judging how difficult
18 > > it is to keep its configuration in a git repo (for easier replication
19 > > and backup).
20 >
21 > About backups, I recommend sup users to make regular sup-dump's, not only
22 > because sup still have bugs but also because it's the only (meta)data
23 > needed to reconstruct your index.
24
25 For backup, I keep my configuration files into a git repository.
26 I create the following pre-commit hook to create automatically sup-dump's on
27 each commit.
28 $ cat > .git/hooks/pre-commit <<EOF
29 #/bin/sh
30 sup-dump > sup.dump
31 git add -f sup.dump
32 EOF
33
34 For replication, you can also define the post-update hook as
35 $ cat > .git/hooks/post-update <<EOF
36 #!/bin/sh
37 sup-sync --restored --restore sup.dump
38 EOF
39 which reconstruct your index when you pull new commits.
40 --
41 David
42
43 From nicolas.pouillard@gmail.com Tue Apr 7 14:26:58 2009
44 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
45 Date: Tue, 07 Apr 2009 20:26:58 +0200
46 Subject: [sup-talk] Read only mode for sup
47 Message-ID: <1239128578-sup-6684@ausone.local>
48
49 Hi all,
50
51 What about adding such a read only mode to sup?
52
53 I see to important usages:
54
55 * Running sup in an environment that we don't want
56 to change, like a backup or synchronized index.
57
58 * Running a second instance of sup to make searches
59 while we are editing a mail.
60
61 Best regards,
62
63 --
64 Nicolas Pouillard
65
66 From ismith@MIT.EDU Tue Apr 7 19:29:04 2009
67 From: ismith@MIT.EDU (Ian Smith)
68 Date: Tue, 07 Apr 2009 19:29:04 -0400
69 Subject: [sup-talk] Read only mode for sup
70 In-Reply-To: <1239128578-sup-6684@ausone.local>
71 References: <1239128578-sup-6684@ausone.local>
72 Message-ID: <1239146860-sup-6624@baad>
73
74 Excerpts from Nicolas Pouillard's message of Tue Apr 07 14:26:58 -0400 2009:
75 > What about adding such a read only mode to sup?
76 > * Running a second instance of sup to make searches
77 > while we are editing a mail.
78
79 This use case already works using buffers - you can switch between them
80 fairly easily. I need to rewrite my reflexes still, but I run sup in
81 screen, so it can't be that hard.
82
83 Ian
84 --
85 Ian Smith
86 ismith at mit.edu
87 ismith at bostonaccess.org
88
89 From nicolas.pouillard@gmail.com Wed Apr 8 04:36:23 2009
90 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
91 Date: Wed, 08 Apr 2009 10:36:23 +0200
92 Subject: [sup-talk] Read only mode for sup
93 In-Reply-To: <1239146860-sup-6624@baad>
94 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
95 Message-ID: <1239179745-sup-912@ausone.inria.fr>
96
97 Excerpts from Ian Smith's message of Wed Apr 08 01:29:04 +0200 2009:
98 > Excerpts from Nicolas Pouillard's message of Tue Apr 07 14:26:58 -0400 2009:
99 > > What about adding such a read only mode to sup?
100 > > * Running a second instance of sup to make searches
101 > > while we are editing a mail.
102 >
103 > This use case already works using buffers - you can switch between them
104 > fairly easily. I need to rewrite my reflexes still, but I run sup in
105 > screen, so it can't be that hard.
106
107 Even when you are editing a mail?
108
109 --
110 Nicolas Pouillard
111
112 From ismith@MIT.EDU Wed Apr 8 08:30:05 2009
113 From: ismith@MIT.EDU (Ian Smith)
114 Date: Wed, 08 Apr 2009 08:30:05 -0400
115 Subject: [sup-talk] Read only mode for sup
116 In-Reply-To: <1239179745-sup-912@ausone.inria.fr>
117 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
118 <1239179745-sup-912@ausone.inria.fr>
119 Message-ID: <1239193758-sup-8985@baad>
120
121 Excerpts from Nicolas Pouillard's message of Wed Apr 08 04:36:23 -0400 2009:
122 > Excerpts from Ian Smith's message of Wed Apr 08 01:29:04 +0200 2009:
123 > > Excerpts from Nicolas Pouillard's message of Tue Apr 07 14:26:58 -0400 2009:
124 > > > What about adding such a read only mode to sup?
125 > > > * Running a second instance of sup to make searches
126 > > > while we are editing a mail.
127 > >
128 > > This use case already works using buffers - you can switch between them
129 > > fairly easily. I need to rewrite my reflexes still, but I run sup in
130 > > screen, so it can't be that hard.
131 >
132 > Even when you are editing a mail?
133
134 Oh, you're right - you have to switch into reply-mode, out of the
135 editor. Hmm.
136 --
137 Ian Smith
138 ismith at mit.edu
139 ismith at bostonaccess.org
140
141 From andrew@pimlott.net Wed Apr 8 13:01:08 2009
142 From: andrew@pimlott.net (Andrew Pimlott)
143 Date: Wed, 8 Apr 2009 10:01:08 -0700
144 Subject: [sup-talk] Read only mode for sup
145 In-Reply-To: <1239193758-sup-8985@baad>
146 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
147 <1239179745-sup-912@ausone.inria.fr> <1239193758-sup-8985@baad>
148 Message-ID: <20090408170108.GW11701@pimlott.net>
149
150 On Wed, Apr 08, 2009 at 08:30:05AM -0400, Ian Smith wrote:
151 > Excerpts from Nicolas Pouillard's message of Wed Apr 08 04:36:23 -0400 2009:
152 > > Excerpts from Ian Smith's message of Wed Apr 08 01:29:04 +0200 2009:
153 > > > This use case already works using buffers - you can switch between them
154 > > > fairly easily. I need to rewrite my reflexes still, but I run sup in
155 > > > screen, so it can't be that hard.
156 > >
157 > > Even when you are editing a mail?
158 >
159 > Oh, you're right - you have to switch into reply-mode, out of the
160 > editor. Hmm.
161
162 I've always wondered, could a mailer use job control, like a shell, to
163 allow it to have multiple sub-processes and switch among them? Then,
164 you could suspend your editor and get back to sup, and later resume your
165 editor.
166
167 Andrew
168
169 From marka@pobox.com Wed Apr 8 13:32:29 2009
170 From: marka@pobox.com (Mark Alexander)
171 Date: Wed, 8 Apr 2009 10:32:29 -0700
172 Subject: [sup-talk] More about those lost messages
173 Message-ID: <a412e2a70904081032x3438abedw3a23d87973f56d35@mail.gmail.com>
174
175 I've been using sup (next branch) for a week or so, and no crashes so
176 far. But I'm still having problems with occasional lost messages.
177 Messages that were definitely in the index in the evening are gone
178 when I start sup again the next morning. I've recovered them by doing
179 a sup-sync --all, but I'm still puzzled by what's going on.
180
181 This has happened twice that I've noticed, and in both cases the
182 message that got lost was part of a thread in which I was
183 participating, and was in the inbox. It could be that other messages
184 got lost in other threads that I was ignoring, but I didn't notice it
185 because I was ignoring those threads :-) .
186
187 When I first noticed this a couple of weeks ago, I thought it might
188 have something to do with fetchmail running in the background. I
189 changed things around so that fetchmail is only running in the
190 background when sup is not running. When sup is running, it invokes
191 fetchmail via the poll hook. But this doesn't seem to have had any
192 effect on the lost message problem.
193
194 This is just idle, uninformed speculation, but maybe some records that
195 were in the in-memory index didn't get written to disk when sup
196 exited? Would neglecting to use the '$' command do this?
197
198 From wirtwolff@gmail.com Wed Apr 8 15:03:07 2009
199 From: wirtwolff@gmail.com (Wirt Wolff)
200 Date: Wed, 08 Apr 2009 13:03:07 -0600
201 Subject: [sup-talk] Read only mode for sup
202 In-Reply-To: <1239146860-sup-6624@baad>
203 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
204 Message-ID: <1239217190-sup-5981@chigamba>
205
206 Excerpts from Ian Smith's message of Tue Apr 07 17:29:04 -0600 2009:
207 > Excerpts from Nicolas Pouillard's message of Tue Apr 07 14:26:58 -0400 2009:
208 > > What about adding such a read only mode to sup?
209 > > * Running a second instance of sup to make searches
210 > > while we are editing a mail.
211 >
212 > This use case already works using buffers - you can switch between them
213 > fairly easily. I need to rewrite my reflexes still, but I run sup in
214 > screen, so it can't be that hard.
215
216 In my situation buffers aren't enough sometimes. Aside from having to
217 exit the editor, unless I'm mistaken there's no way to view more than
218 one buffer at once. Mostly I've appreciated relaxing into that way of
219 working, and even found it helpful to concentration and productivity.
220
221 However, when for example, composing reviews of unapplied patches, each
222 with one or more discussion threads, I often find myself wishing I could
223 toggle back and forth between a couple of search buffers and their thread
224 views in one frame, while composing in another.
225
226 There are surely other solutions, hopefully simpler ones, but I've not
227 gotten motivated enough to work them out yet. A read-only second sup
228 would get daily usage here. It would be great to not have to switch to
229 and from "sup mode" while completing tasks referencing multiple threads.
230
231 --
232 regards,
233 wmw
234
235 From bm@bjornmichelsen.com Wed Apr 8 16:44:34 2009
236 From: bm@bjornmichelsen.com (=?UNKNOWN?Q?Bj=C3=B8rn?= Michelsen)
237 Date: Wed, 08 Apr 2009 22:44:34 +0200
238 Subject: [sup-talk] Saving status of merged threads with '#' on next branch
239 Message-ID: <1239177702-sup-8165@snowstorm>
240
241 Hi all,
242
243 For some reason, the '#' command isn't saving the status of tagged
244 threads being forced to merge. I get a visual feedback that the threads
245 have been put into the same one, but when I come back to the view after
246 killing the buffer, they're separated again.
247
248 I'm currently running sup from the next branch. But, I also checked the
249 command on the 0.7 gem version without any luck.
250
251 I'm a bit lost as to where I should begin troubleshooting, so I'm
252 wondering if someone else have had the same problem?
253
254 Maybe I have misinterpreted the command?
255 --
256 Mvh.
257 Bj?rn Michelsen
258 MOB: +47 934 55 474
259
260 From wmorgan-sup@masanjin.net Wed Apr 8 17:49:47 2009
261 From: wmorgan-sup@masanjin.net (William Morgan)
262 Date: Wed, 08 Apr 2009 14:49:47 -0700
263 Subject: [sup-talk] Read only mode for sup
264 In-Reply-To: <1239217190-sup-5981@chigamba>
265 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
266 <1239217190-sup-5981@chigamba>
267 Message-ID: <1239226676-sup-7216@entry>
268
269 Reformatted excerpts from Wirt Wolff's message of 2009-04-08:
270 > However, when for example, composing reviews of unapplied patches,
271 > each with one or more discussion threads, I often find myself wishing
272 > I could toggle back and forth between a couple of search buffers and
273 > their thread views in one frame, while composing in another.
274
275 The curses code was designed to support splitting the screen into
276 multiple buffers/frames/windows. I, too, found the initial
277 implementation of one buffer at a time to be surprisingly useful, so I
278 never took it the rest of the way. I'm certainly open to someone
279 fighting curses and making this possible.
280
281 As possibly an easier step, I, too, too, find the current buffer-
282 switching to be pretty onerous, and would love to hear suggestions on
283 how to improve it.
284
285 One easy thing to comes to mind would be to have buffer-list-mode (which
286 is what you get when you hit B) sort the buffer list by last access.
287 Remap that to something like ";" and you have one-handed buffer-
288 switching with minimal keystrokes.
289
290 > A read-only second sup would get daily usage here. It would be great
291 > to not have to switch to and from "sup mode" while completing tasks
292 > referencing multiple threads.
293
294 I think this would be fine and not too hard to implement.
295
296 In fact, I think it might not be too much harder to have multiple
297 simultaneous read/write Sups, by locking ~/.sup on a per-operation
298 rather than per-process basis. Of course you'd have to be cognizant of
299 the fact that they wouldn't be sharing any state except via $ and @.
300 It would be like editing a wiki page across multiple tabs. There's no
301 merge, there's only overwrite.
302 --
303 William <wmorgan-sup at masanjin.net>
304
305 From wmorgan-sup@masanjin.net Wed Apr 8 18:18:14 2009
306 From: wmorgan-sup@masanjin.net (William Morgan)
307 Date: Wed, 08 Apr 2009 15:18:14 -0700
308 Subject: [sup-talk] Read only mode for sup
309 In-Reply-To: <20090408170108.GW11701@pimlott.net>
310 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
311 <1239179745-sup-912@ausone.inria.fr> <1239193758-sup-8985@baad>
312 <20090408170108.GW11701@pimlott.net>
313 Message-ID: <1239227396-sup-782@entry>
314
315 Reformatted excerpts from Andrew Pimlott's message of 2009-04-08:
316 > I've always wondered, could a mailer use job control, like a shell, to
317 > allow it to have multiple sub-processes and switch among them? Then,
318 > you could suspend your editor and get back to sup, and later resume
319 > your editor.
320
321 The problem is that when the editor is in the foreground, it has
322 control. So I don't think Sup would be able to suspend it. But it might
323 be possible to do something like catch SIGTSTP signals when the editor
324 is running, and file those process ids away for later resumption. You'd
325 have to suspend from within the editor, but the rest of the behavior
326 might be close to what you want. Interesting idea.
327 --
328 William <wmorgan-sup at masanjin.net>
329
330 From wmorgan-sup@masanjin.net Wed Apr 8 18:34:06 2009
331 From: wmorgan-sup@masanjin.net (William Morgan)
332 Date: Wed, 08 Apr 2009 15:34:06 -0700
333 Subject: [sup-talk] More about those lost messages
334 In-Reply-To: <a412e2a70904081032x3438abedw3a23d87973f56d35@mail.gmail.com>
335 References: <a412e2a70904081032x3438abedw3a23d87973f56d35@mail.gmail.com>
336 Message-ID: <1239229590-sup-7235@entry>
337
338 Reformatted excerpts from Mark Alexander's message of 2009-04-08:
339 > This has happened twice that I've noticed, and in both cases the
340 > message that got lost was part of a thread in which I was
341 > participating, and was in the inbox.
342
343 Just to confirm: you saw the message in Sup, you quit Sup, and when you
344 started Sup again, the message wasn't there?
345
346 The next time this happens, would you mind trying this? Before running
347 sup-sync --all, find the message id of the missing message (i.e. from
348 the mbox file), and run:
349
350 devel/console.sh # start the debug console
351 Index.index.search("message_id:XXX").total_hits # from within the console
352
353 where XXX is the message id, without the angle brackets. E.g.
354
355 Index.index.search("message_id:a412e2a70904081032x3438abedw3a23d87973f56d35 at mail.gmail.com")
356
357 This will tell us whether it's in the index or not, without anything
358 of Sup's curses interface getting in the way.
359
360 If it is in the index (the total_hits is > 0), then try finding the
361 labels:
362
363 docid = Index.index.search("message_id:XXX").hits.first.doc
364 Index.build_message(docid).labels
365
366 > This is just idle, uninformed speculation, but maybe some records that
367 > were in the in-memory index didn't get written to disk when sup
368 > exited? Would neglecting to use the '$' command do this?
369
370 Sup saves all state when you quit. That's why I'm wondering whether the
371 messages actually are in the index, or somehow are just hidden from the
372 curses interface.
373 --
374 William <wmorgan-sup at masanjin.net>
375
376 From nicolas.pouillard@gmail.com Thu Apr 9 07:55:56 2009
377 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
378 Date: Thu, 09 Apr 2009 13:55:56 +0200
379 Subject: [sup-talk] Read only mode for sup
380 In-Reply-To: <1239226676-sup-7216@entry>
381 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
382 <1239217190-sup-5981@chigamba> <1239226676-sup-7216@entry>
383 Message-ID: <1239278036-sup-7327@ausone.inria.fr>
384
385 Excerpts from William Morgan's message of Wed Apr 08 23:49:47 +0200 2009:
386 > Reformatted excerpts from Wirt Wolff's message of 2009-04-08:
387 > > However, when for example, composing reviews of unapplied patches,
388 > > each with one or more discussion threads, I often find myself wishing
389 > > I could toggle back and forth between a couple of search buffers and
390 > > their thread views in one frame, while composing in another.
391 >
392 > The curses code was designed to support splitting the screen into
393 > multiple buffers/frames/windows. I, too, found the initial
394 > implementation of one buffer at a time to be surprisingly useful, so I
395 > never took it the rest of the way. I'm certainly open to someone
396 > fighting curses and making this possible.
397 >
398 > As possibly an easier step, I, too, too, find the current buffer-
399 > switching to be pretty onerous, and would love to hear suggestions on
400 > how to improve it.
401 >
402 > One easy thing to comes to mind would be to have buffer-list-mode (which
403 > is what you get when you hit B) sort the buffer list by last access.
404 > Remap that to something like ";" and you have one-handed buffer-
405 > switching with minimal keystrokes.
406
407 Or some kind of historic like with "cd -42".
408 It could be "b1" for the last one, "b2" for the previous... I actually
409 use these bindings in my window manager.
410
411 > > A read-only second sup would get daily usage here. It would be great
412 > > to not have to switch to and from "sup mode" while completing tasks
413 > > referencing multiple threads.
414 >
415 > I think this would be fine and not too hard to implement.
416 >
417 > In fact, I think it might not be too much harder to have multiple
418 > simultaneous read/write Sups, by locking ~/.sup on a per-operation
419 > rather than per-process basis. Of course you'd have to be cognizant of
420 > the fact that they wouldn't be sharing any state except via $ and @.
421 > It would be like editing a wiki page across multiple tabs. There's no
422 > merge, there's only overwrite.
423
424 Simultaneous read/write Sups would be great too!
425
426 --
427 Nicolas Pouillard
428
429 From marka@pobox.com Thu Apr 9 11:36:54 2009
430 From: marka@pobox.com (Mark Alexander)
431 Date: Thu, 9 Apr 2009 08:36:54 -0700
432 Subject: [sup-talk] More about those lost messages
433 In-Reply-To: <1239229590-sup-7235@entry>
434 References: <a412e2a70904081032x3438abedw3a23d87973f56d35@mail.gmail.com>
435 <1239229590-sup-7235@entry>
436 Message-ID: <a412e2a70904090836u2139ae8apf03ddc479f5aa393@mail.gmail.com>
437
438 I'm starting to think it may be a user error on my part. It looks as if
439 I might have used the 'd' (delete) command on some messages,
440 perhaps accidentally or carelessly in some cases, and that
441 prevented them from showing up in threads later. I'll continue
442 studying this.
443
444 From marka@pobox.com Thu Apr 9 11:39:39 2009
445 From: marka@pobox.com (Mark Alexander)
446 Date: Thu, 9 Apr 2009 08:39:39 -0700
447 Subject: [sup-talk] Saving status of merged threads with '#' on next
448 branch
449 In-Reply-To: <1239177702-sup-8165@snowstorm>
450 References: <1239177702-sup-8165@snowstorm>
451 Message-ID: <a412e2a70904090839k2b63f3f3v1d63c080902bb7ac@mail.gmail.com>
452
453 2009/4/8 Bj?rn Michelsen <bm at bjornmichelsen.com>:
454 > For some reason, the '#' command isn't saving the status of tagged
455 > threads being forced to merge. I get a visual feedback that the threads
456 > have been put into the same one, but when I come back to the view after
457 > killing the buffer, they're separated again.
458
459 I've noticed this as well. I figured it was a feature, not a bug :-) .
460
461 From wmorgan-sup@masanjin.net Thu Apr 9 13:30:09 2009
462 From: wmorgan-sup@masanjin.net (William Morgan)
463 Date: Thu, 09 Apr 2009 10:30:09 -0700
464 Subject: [sup-talk] Read only mode for sup
465 In-Reply-To: <1239226676-sup-7216@entry>
466 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
467 <1239217190-sup-5981@chigamba> <1239226676-sup-7216@entry>
468 Message-ID: <1239297831-sup-5831@entry>
469
470 Reformatted excerpts from William Morgan's message of 2009-04-08:
471 > One easy thing to comes to mind would be to have buffer-list-mode
472 > (which is what you get when you hit B) sort the buffer list by last
473 > access. Remap that to something like ";" and you have one-handed
474 > buffer- switching with minimal keystrokes.
475
476 Ok, I've done this on branch 'better-buffer-list', which I've merged
477 into next. Pull and see how you guys like it. Summary:
478
479 1. 'b' rolls the buffer forward as usual.
480 2. 'B' now rolls the buffer backwards like in the olden days.
481 3. ';' pulls up the buffer list, which is now sorted by access time,
482 colorized to show "system" vs non-"system" buffers, and has little
483 stars for buffers with unsaved content.
484 4. '+' is now the apply-to-tagged command.
485
486 Sorry for changing so many keymappings, but I really wanted ';' so that,
487 with 'j' and 'k', you can swap buffers really quickly with just one
488 hand. Since that freed up B, I figured I'd reenable the old behavior,
489 and '+' kinda makes sense for apply-to-tagged anyways.
490
491 Nicolas, I had to revert your "Buffer switching, 'bn' for the next one
492 and 'bp' for the previous" change in next. I hope you're not offended! :)
493 --
494 William <wmorgan-sup at masanjin.net>
495
496 From vikrambkumar@gmail.com Thu Apr 9 13:34:23 2009
497 From: vikrambkumar@gmail.com (Vikram Kumar)
498 Date: Thu, 9 Apr 2009 13:34:23 -0400
499 Subject: [sup-talk] Sup and Cygwin
500 Message-ID: <89041090904091034i420d33e1k6c53440229019039@mail.gmail.com>
501
502 Has anybody tried it before?
503
504 $ sup
505 /usr/lib/ruby/1.8/dl/import.rb:29:in `initialize': No such file or directory
506 (RuntimeError)
507 from /usr/lib/ruby/1.8/dl/import.rb:29:in `dlopen'
508 from /usr/lib/ruby/1.8/dl/import.rb:29:in `dlload'
509 from /usr/lib/ruby/1.8/dl/import.rb:27:in `each'
510 from /usr/lib/ruby/1.8/dl/import.rb:27:in `dlload'
511 from /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup.rb:17
512 from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
513 `gem_original_require'
514 from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
515 `require'
516 from /usr/lib/ruby/gems/1.8/gems/sup-0.7/bin/sup:9
517 from /usr/bin/sup:19:in `load'
518 from /usr/bin/sup:19
519
520 I do have all the requirements available in cygwin ruby + gems.
521
522 *** LOCAL GEMS ***
523 ferret (0.11.6)
524 ncurses (0.9.1)
525 rmail (1.0.0)
526 highline (1.5.0, 1.4.0)
527 net-ssh (2.0.11, 1.1.2)
528 net-ssh-gateway (1.0.1)
529 trollop (1.13)
530 lockfile (1.4.3)
531 mime-types (1.16, 1.15)
532
533 Vikram
534
535 P.S - I couldn't find a way to search the message list archives.
536 -------------- next part --------------
537 An HTML attachment was scrubbed...
538 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090409/6eb7d14a/attachment.html>
539
540 From wmorgan-sup@masanjin.net Thu Apr 9 13:53:32 2009
541 From: wmorgan-sup@masanjin.net (William Morgan)
542 Date: Thu, 09 Apr 2009 10:53:32 -0700
543 Subject: [sup-talk] brief master update
544 Message-ID: <1239299514-sup-1793@entry>
545
546 I've merged these branches into master:
547 - dont-canonicalize-email-addresses
548 - multi-remove-labels
549 - merge-labels
550 - encoding-misspellings
551 - background-save
552
553 I'd like to do a little more work on undo, and fix the From problem, and
554 then we can start thinking about an 0.8 release!
555 --
556 William <wmorgan-sup at masanjin.net>
557
558 From wmorgan-sup@masanjin.net Thu Apr 9 14:02:08 2009
559 From: wmorgan-sup@masanjin.net (William Morgan)
560 Date: Thu, 09 Apr 2009 11:02:08 -0700
561 Subject: [sup-talk] Saving status of merged threads with '#' on next
562 branch
563 In-Reply-To: <1239177702-sup-8165@snowstorm>
564 References: <1239177702-sup-8165@snowstorm>
565 Message-ID: <1239299963-sup-5933@entry>
566
567 Reformatted excerpts from =?UNKNOWN?Q?Bj=C3=B8rn?= Michelsen's message of 2009-04-08:
568 > I'm a bit lost as to where I should begin troubleshooting, so I'm
569 > wondering if someone else have had the same problem?
570
571 It's a known problem. I'm not sure why it isn't saved. If you want to
572 start investigating, ThreadSet#join_threads in lib/sup/threads.rb is the
573 joining code. Maybe the call to Message#add_ref is wrong somehow.
574
575 I'm also curious about your From: line, which is RFC2047-encoded but
576 with the "UNKNOWN" charset. What produces that? Surely not Sup!
577 --
578 William <wmorgan-sup at masanjin.net>
579
580 From marka@pobox.com Thu Apr 9 14:37:40 2009
581 From: marka@pobox.com (Mark Alexander)
582 Date: Thu, 9 Apr 2009 11:37:40 -0700
583 Subject: [sup-talk] Sup and Cygwin
584 In-Reply-To: <89041090904091034i420d33e1k6c53440229019039@mail.gmail.com>
585 References: <89041090904091034i420d33e1k6c53440229019039@mail.gmail.com>
586 Message-ID: <a412e2a70904091137x3e62dedcn3a498d22a7ac887d@mail.gmail.com>
587
588 On Thu, Apr 9, 2009 at 10:34 AM, Vikram Kumar <vikrambkumar at gmail.com> wrote:
589
590 > P.S - I couldn't find a way to search the message list archives.
591
592 Try the archive here:
593
594 http://www.nabble.com/SUP-Talk-f27890.html
595
596 From wmorgan-sup@masanjin.net Thu Apr 9 15:11:33 2009
597 From: wmorgan-sup@masanjin.net (William Morgan)
598 Date: Thu, 09 Apr 2009 12:11:33 -0700
599 Subject: [sup-talk] Sup and Cygwin
600 In-Reply-To: <89041090904091034i420d33e1k6c53440229019039@mail.gmail.com>
601 References: <89041090904091034i420d33e1k6c53440229019039@mail.gmail.com>
602 Message-ID: <1239304198-sup-9672@entry>
603
604 Reformatted excerpts from Vikram Kumar's message of 2009-04-09:
605 > Has anybody tried it before?
606 >
607 > $ sup
608 > /usr/lib/ruby/1.8/dl/import.rb:29:in `initialize': No such file or directory
609 > (RuntimeError)
610
611 Oh, that's a bug. I think you should be able to get around it by
612 changing the 'libc.so.6' on this line:
613 > from /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup.rb:17
614 to 'cygwin1.dll'.
615
616 I'd be interested to know if that works. If so I'll fix it in git.
617 --
618 William <wmorgan-sup at masanjin.net>
619
620 From nicolas.pouillard@gmail.com Fri Apr 10 04:36:16 2009
621 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
622 Date: Fri, 10 Apr 2009 10:36:16 +0200
623 Subject: [sup-talk] Read only mode for sup
624 In-Reply-To: <1239297831-sup-5831@entry>
625 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
626 <1239217190-sup-5981@chigamba> <1239226676-sup-7216@entry>
627 <1239297831-sup-5831@entry>
628 Message-ID: <1239352575-sup-724@ausone.inria.fr>
629
630 Excerpts from William Morgan's message of Thu Apr 09 19:30:09 +0200 2009:
631 > Reformatted excerpts from William Morgan's message of 2009-04-08:
632 > > One easy thing to comes to mind would be to have buffer-list-mode
633 > > (which is what you get when you hit B) sort the buffer list by last
634 > > access. Remap that to something like ";" and you have one-handed
635 > > buffer- switching with minimal keystrokes.
636 >
637 > Ok, I've done this on branch 'better-buffer-list', which I've merged
638 > into next. Pull and see how you guys like it. Summary:
639 >
640 > 1. 'b' rolls the buffer forward as usual.
641 > 2. 'B' now rolls the buffer backwards like in the olden days.
642 > 3. ';' pulls up the buffer list, which is now sorted by access time,
643 > colorized to show "system" vs non-"system" buffers, and has little
644 > stars for buffers with unsaved content.
645 > 4. '+' is now the apply-to-tagged command.
646 >
647 > Sorry for changing so many keymappings, but I really wanted ';' so that,
648 > with 'j' and 'k', you can swap buffers really quickly with just one
649 > hand. Since that freed up B, I figured I'd reenable the old behavior,
650 > and '+' kinda makes sense for apply-to-tagged anyways.
651 >
652 > Nicolas, I had to revert your "Buffer switching, 'bn' for the next one
653 > and 'bp' for the previous" change in next. I hope you're not offended! :)
654
655 I'm not offended, I just wanted to tend to more scalable bindings, where
656 a meaningful letter is kept to be the leading one for more advanced bindings
657 on a particular topic.
658
659 Moreover optimizing bindings for QUERTY keymap does not make sense for other
660 people... Personally I use and prefer DVORAK.
661
662 --
663 Nicolas Pouillard
664
665 From nicolas.pouillard@gmail.com Fri Apr 10 04:40:00 2009
666 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
667 Date: Fri, 10 Apr 2009 10:40:00 +0200
668 Subject: [sup-talk] brief master update
669 In-Reply-To: <1239299514-sup-1793@entry>
670 References: <1239299514-sup-1793@entry>
671 Message-ID: <1239352712-sup-3931@ausone.inria.fr>
672
673 Excerpts from William Morgan's message of Thu Apr 09 19:53:32 +0200 2009:
674 > I've merged these branches into master:
675 > - dont-canonicalize-email-addresses
676 > - multi-remove-labels
677 > - merge-labels
678 > - encoding-misspellings
679 > - background-save
680 >
681 > I'd like to do a little more work on undo, and fix the From problem, and
682 > then we can start thinking about an 0.8 release!
683
684 Great!
685
686 Just a small administrative question... Do we consider branches merged into
687 master as dead. That is making a new one if we want to improve again on this
688 topic?
689
690 --
691 Nicolas Pouillard
692
693 From wmorgan-sup@masanjin.net Fri Apr 10 08:23:02 2009
694 From: wmorgan-sup@masanjin.net (William Morgan)
695 Date: Fri, 10 Apr 2009 05:23:02 -0700
696 Subject: [sup-talk] brief master update
697 In-Reply-To: <1239352712-sup-3931@ausone.inria.fr>
698 References: <1239299514-sup-1793@entry> <1239352712-sup-3931@ausone.inria.fr>
699 Message-ID: <1239365949-sup-627@entry>
700
701 Reformatted excerpts from Nicolas Pouillard's message of 2009-04-10:
702 > Just a small administrative question... Do we consider branches merged
703 > into master as dead. That is making a new one if we want to improve
704 > again on this topic?
705
706 Yes... I don't see a real point in adding more commits to the branch and
707 remerging once it's in master. I'm happy to apply trivial changes
708 directly to master, and anything non-trivial I prefer to test out in
709 next first.
710 --
711 William <wmorgan-sup at masanjin.net>
712
713 From wmorgan-sup@masanjin.net Fri Apr 10 08:24:15 2009
714 From: wmorgan-sup@masanjin.net (William Morgan)
715 Date: Fri, 10 Apr 2009 05:24:15 -0700
716 Subject: [sup-talk] Read only mode for sup
717 In-Reply-To: <1239352575-sup-724@ausone.inria.fr>
718 References: <1239128578-sup-6684@ausone.local> <1239146860-sup-6624@baad>
719 <1239217190-sup-5981@chigamba> <1239226676-sup-7216@entry>
720 <1239297831-sup-5831@entry> <1239352575-sup-724@ausone.inria.fr>
721 Message-ID: <1239366212-sup-2213@entry>
722
723 Reformatted excerpts from Nicolas Pouillard's message of 2009-04-10:
724 > Moreover optimizing bindings for QUERTY keymap does not make sense for
725 > other people... Personally I use and prefer DVORAK.
726
727 Uh oh. Well, time to get working on that configurable keymap patch...
728 --
729 William <wmorgan-sup at masanjin.net>
730
731 From lee@writequit.org Fri Apr 10 15:04:58 2009
732 From: lee@writequit.org (Lee Hinman)
733 Date: Fri, 10 Apr 2009 13:04:58 -0600
734 Subject: [sup-talk] Display size of message or attachments?
735 Message-ID: <1239390142-sup-9102@black>
736
737 Hey Sup'ers
738 Is there a way to display the total size of the message in your inbox?
739 (Including attachments). I wasn't able to find a way (other than saving
740 everything and doing it manually).
741
742 On the same note, is there a way I can see how big an attachment is on an
743 email? I know it shows up when sending email, but not on a retrieved email.
744
745 Thanks,
746 Lee
747
748 From wmorgan-sup@masanjin.net Mon Apr 13 10:56:08 2009
749 From: wmorgan-sup@masanjin.net (William Morgan)
750 Date: Mon, 13 Apr 2009 07:56:08 -0700
751 Subject: [sup-talk] Display size of message or attachments?
752 In-Reply-To: <1239390142-sup-9102@black>
753 References: <1239390142-sup-9102@black>
754 Message-ID: <1239634495-sup-2172@entry>
755
756 Reformatted excerpts from Lee Hinman's message of 2009-04-10:
757 > Is there a way to display the total size of the message in your inbox?
758 > (Including attachments). I wasn't able to find a way (other than
759 > saving everything and doing it manually).
760
761 This wouldn't be too hard but I'm not sure what the right UI would be.
762 Suggestions, anyone?
763
764 > On the same note, is there a way I can see how big an attachment is on
765 > an email? I know it shows up when sending email, but not on a
766 > retrieved email.
767
768 I've added this in git.
769 --
770 William <wmorgan-sup at masanjin.net>
771
772 From lee@writequit.org Mon Apr 13 11:23:23 2009
773 From: lee@writequit.org (Lee Hinman)
774 Date: Mon, 13 Apr 2009 09:23:23 -0600
775 Subject: [sup-talk] Display size of message or attachments?
776 In-Reply-To: <1239634495-sup-2172@entry>
777 References: <1239390142-sup-9102@black> <1239634495-sup-2172@entry>
778 Message-ID: <1239636103-sup-6606@black>
779
780 Excerpts from William Morgan's message of Mon Apr 13 08:56:08 -0600 2009:
781 > Reformatted excerpts from Lee Hinman's message of 2009-04-10:
782 > > Is there a way to display the total size of the message in your inbox?
783 > > (Including attachments). I wasn't able to find a way (other than
784 > > saving everything and doing it manually).
785 >
786 > This wouldn't be too hard but I'm not sure what the right UI would be.
787 > Suggestions, anyone?
788
789 How about this?:
790 8:56am [213k] me,William (2) >[sup-talk] Display size of message or attachments? +list +sup This wouldn't b...
791
792 > > On the same note, is there a way I can see how big an attachment is on
793 > > an email? I know it shows up when sending email, but not on a
794 > > retrieved email.
795 >
796 > I've added this in git.
797
798 Thanks!
799
800 - Lee
801
802 From lee@writequit.org Mon Apr 13 12:00:56 2009
803 From: lee@writequit.org (Lee Hinman)
804 Date: Mon, 13 Apr 2009 10:00:56 -0600
805 Subject: [sup-talk] Suggestion for '.' keybinding
806 Message-ID: <1239638279-sup-6990@black>
807
808 Sup,
809 Since Sup already emulates vi-bindings, I was wondering if it'd be possible to
810 have '.' bound to "do-it-again". So if I added a label to a mail, then wanted
811 to apply it to a different mail, I could go to the mail and use '.' to apply
812 whatever the last change was. (I know I could tag all the messages ahead of
813 time and label them all at once, but sometimes I want to do it a different
814 way).
815
816 Is this possible with Sup right now? Does it store what the last action was?
817 (it might for the undo patch, I haven't looked at it)
818
819 - Lee
820
821 From wmorgan-sup@masanjin.net Mon Apr 13 19:19:34 2009
822 From: wmorgan-sup@masanjin.net (William Morgan)
823 Date: Mon, 13 Apr 2009 16:19:34 -0700
824 Subject: [sup-talk] Display size of message or attachments?
825 In-Reply-To: <1239636103-sup-6606@black>
826 References: <1239390142-sup-9102@black> <1239634495-sup-2172@entry>
827 <1239636103-sup-6606@black>
828 Message-ID: <1239664684-sup-2594@entry>
829
830 Reformatted excerpts from Lee Hinman's message of 2009-04-13:
831 > 8:56am [213k] me,William (2) >[sup-talk] Display size of message or
832 > attachments? +list +sup This wouldn't b...
833
834 What does the 213k refer to? The first message in this thread? The
835 newest message? All messages together? If you want per-message sizes,
836 it's going to have to go somewhere in thread-view-mode, methinks...
837
838 --
839 William <wmorgan-sup at masanjin.net>
840
841 From rhomunuq+ml_sup@gmail.com Tue Apr 14 19:52:13 2009
842 From: rhomunuq+ml_sup@gmail.com (Iain)
843 Date: Wed, 15 Apr 2009 00:52:13 +0100
844 Subject: [sup-talk] Display size of message or attachments?
845 In-Reply-To: <1239664684-sup-2594@entry>
846 References: <1239390142-sup-9102@black>
847 <1239634495-sup-2172@entry> <1239636103-sup-6606@black>
848 <1239664684-sup-2594@entry>
849 Message-ID: <49E521AD.9070507@gmail.com>
850
851 Long time reader; first time poster. Massive thanks to everyone who's
852 worked on sup (in particular to William). I'm dabbling in sup again now
853 with the release of 0.7, which hasn't crashed on me at all so far, hooray!
854
855 > What does the 213k refer to? The first message in this thread? The
856 > newest message? All messages together? If you want per-message sizes,
857 > it's going to have to go somewhere in thread-view-mode, methinks...
858
859 Sounds like a potentially neat feature. I'd suggest:
860
861 - When viewing lists of threads (inbox-mode, search-results-mode,
862 etc), the combined size of all messages together in the thread.
863
864 - When viewing a particular thread (thread-view-mode), showing
865 individually for each message.
866
867 Alternatively (or in addition?), perhaps even better would be the
868 ability to do searches like size:>200k, which would show all messages
869 (or all threads?) over 200k in size.
870
871 This would be useful for people like me who prune excessively large
872 attachments from disk occasionally. (Which at present is a little
873 fiddly, involving messing with the Maildir-stored messages then
874 sup-sync'ing, but that's another story...)
875
876 Cheers,
877 ~Iain
878
879 From bm@bjornmichelsen.com Wed Apr 15 11:58:03 2009
880 From: bm@bjornmichelsen.com (Bjorn Michelsen)
881 Date: Wed, 15 Apr 2009 17:58:03 +0200
882 Subject: [sup-talk] Saving status of merged threads with '#' on next
883 branch
884 In-Reply-To: <1239299963-sup-5933@entry>
885 References: <1239177702-sup-8165@snowstorm> <1239299963-sup-5933@entry>
886 Message-ID: <1239810733-sup-5572@snowstorm>
887
888 Excerpts from William Morgan's message of to. april 09 20:02:08 +0200 2009:
889
890 > > I'm a bit lost as to where I should begin troubleshooting, so I'm
891 > > wondering if someone else have had the same problem?
892 >
893 > It's a known problem. I'm not sure why it isn't saved. If you want to
894 > start investigating, ThreadSet#join_threads in lib/sup/threads.rb is the
895 > joining code. Maybe the call to Message#add_ref is wrong somehow.
896
897 Thanks for clearing that up, as well as the additional information
898 regarding where to start looking.
899
900 > I'm also curious about your From: line, which is RFC2047-encoded but
901 > with the "UNKNOWN" charset. What produces that? Surely not Sup!
902
903 I haven't replied earlier because I've been trying to figure out what
904 causes the strange From: address.
905
906 locale outputs the following:
907
908 LANG=nb_NO.UTF-8
909 LC_CTYPE=nb_NO.UTF-8
910 LC_NUMERIC="nb_NO.UTF-8"
911 LC_TIME="nb_NO.UTF-8"
912 LC_COLLATE="nb_NO.UTF-8"
913 LC_MONETARY="nb_NO.UTF-8"
914 LC_MESSAGES=en_US.UTF-8
915 LC_PAPER="nb_NO.UTF-8"
916 LC_NAME="nb_NO.UTF-8"
917 LC_ADDRESS="nb_NO.UTF-8"
918 LC_TELEPHONE="nb_NO.UTF-8"
919 LC_MEASUREMENT="nb_NO.UTF-8"
920 LC_IDENTIFICATION="nb_NO.UTF-8"
921 LC_ALL=
922
923 And Vim is saying that all files related to sup is encoded as utf8.
924
925 So, at the moment I don't know why this is happening. Maybe someone
926 using special characters can let me in on their secret?
927 --
928 Mvh.
929 Bj?rn Michelsen
930 MOB: +47 934 55 474
931
932 From rhomunuq+ml_sup@gmail.com Wed Apr 15 13:29:15 2009
933 From: rhomunuq+ml_sup@gmail.com (Iain)
934 Date: Wed, 15 Apr 2009 18:29:15 +0100
935 Subject: [sup-talk] Lost Maildir Messages
936 In-Reply-To: <a412e2a70903191341o744efb9bw3a02ebb1585a9b8b@mail.gmail.com>
937 References: <1237224356-sup-1941@entry> <a412e2a70903171129v22fe7bc0o6174ad3be6af73@mail.gmail.com> <1237383823-sup-8242@entry> <a412e2a70903191218x209c1cb1p6f46e718b2f90395@mail.gmail.com> <1237490703-sup-4095@entry>
938 <a412e2a70903191341o744efb9bw3a02ebb1585a9b8b@mail.gmail.com>
939 Message-ID: <49E6196B.504@gmail.com>
940
941 > Hm, that would be bad. The right way to debug this is to wait for it to
942 > happen again (!) and examine the contents of the poll-mode and log-mode
943 > buffers, which should describe what Sup thinks it was doing at the time.
944
945 I've noticed what seems to be the same problem.
946
947 I've been using getmail (no procmail or fetchmail), to grab messages
948 into Maildir folders. Occasionally, messages don't show up in Sup. They
949 appear only when I do a manual sup-sync --changed.
950
951 I discovered by accident (by impatiently trying to read an email that I
952 knew was being delivered by getmail into Sup) that I can reliably
953 replicate the problem, or at least a similar problem. It seems to occur
954 when Sup polls the Maildir at the same time as getmail is retrieving the
955 message.
956
957 I can replicate the problem by pressing P repeatedly in Sup to manually
958 poll for messages, while getmail is in the process of retrieving. (It
959 takes about 4 seconds for getmail to go from initialising a retrieval to
960 dropping the mail in the Maildir, so there is a big window for when I
961 press P, and I can replicate the problem reliably.) Every time, Sup
962 doesn't retrieve the new messages.
963
964 The log-mode buffer doesn't show anything relevant in my
965 artifically-produced replication of the problem, because it doesn't log
966 when you manually poll.
967
968 The poll-mode buffer for the source in question displays the exact same
969 message on every poll of the source (before getmail runs, during the
970 getmail run, after the getmail run) when repeatedly polling before and
971 during the getmail run:
972
973 Loading from maildir:///home/user/Mail/address at example.com/...
974
975 Found message at 12398138490002177 with labels {mylabel}
976
977 -- the timestamp never changes.
978
979 If I had to guess, I'd say that it looks like the shortcut taken
980 (looking at the mtime of the directory to see if scanning for a new
981 Maildir message is required) has a race condition. A weird race
982 condition, because I've verified (ls -l --time-style=+%s) that the "new"
983 and "tmp" folders are indeed having their timestamps updated when the
984 mail drops in (they are).
985
986 This might explain the infrequent lost messages: when not hitting P
987 repeatedly, this race condition is unlikely to occur, only happening
988 when the Sup poll occurs within the few seconds window during which
989 getmail is working and working with a new message to deliver.
990
991 ~Iain
992
993 From wmorgan-sup@masanjin.net Wed Apr 15 13:33:24 2009
994 From: wmorgan-sup@masanjin.net (William Morgan)
995 Date: Wed, 15 Apr 2009 10:33:24 -0700
996 Subject: [sup-talk] Saving status of merged threads with '#' on next
997 branch
998 In-Reply-To: <1239810733-sup-5572@snowstorm>
999 References: <1239177702-sup-8165@snowstorm> <1239299963-sup-5933@entry>
1000 <1239810733-sup-5572@snowstorm>
1001 Message-ID: <1239816596-sup-2531@entry>
1002
1003 Reformatted excerpts from Bjorn Michelsen's message of 2009-04-15:
1004 > I haven't replied earlier because I've been trying to figure out what
1005 > causes the strange From: address.
1006
1007 Is the weird encoding also present in the files in ~/.sup/sent.mbox? If
1008 so, it's could be Rubymail... AFAICT, Rubymail doesn't do anything with
1009 rfc2047, but I could have missed it.
1010
1011 If not, are you using some funky sendmail?
1012 --
1013 William <wmorgan-sup at masanjin.net>
1014
1015 From bm@bjornmichelsen.com Thu Apr 16 05:53:31 2009
1016 From: bm@bjornmichelsen.com (Bjorn Michelsen)
1017 Date: Thu, 16 Apr 2009 11:53:31 +0200
1018 Subject: [sup-talk] Saving status of merged threads with '#' on next
1019 branch
1020 In-Reply-To: <1239816596-sup-2531@entry>
1021 References: <1239177702-sup-8165@snowstorm> <1239299963-sup-5933@entry>
1022 <1239810733-sup-5572@snowstorm> <1239816596-sup-2531@entry>
1023 Message-ID: <1239875483-sup-5697@snowstorm>
1024
1025 Excerpts from William Morgan's message of on. april 15 19:33:24 +0200 2009:
1026
1027 > > I haven't replied earlier because I've been trying to figure out what
1028 > > causes the strange From: address.
1029 >
1030 > Is the weird encoding also present in the files in ~/.sup/sent.mbox? If
1031 > so, it's could be Rubymail... AFAICT, Rubymail doesn't do anything with
1032 > rfc2047, but I could have missed it.
1033
1034 No, everything is encoded correctly in ~/.sup/sent.mbox
1035
1036 > If not, are you using some funky sendmail?
1037
1038 I'm using sSMTP at the moment. Maybe it has something to do with the
1039 following bug
1040
1041 http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=341952#10 ?
1042 --
1043 Mvh.
1044 Bj?rn Michelsen
1045 MOB: +47 934 55 474
1046
1047 From nicolas.pouillard@gmail.com Thu Apr 16 15:47:31 2009
1048 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
1049 Date: Thu, 16 Apr 2009 21:47:31 +0200
1050 Subject: [sup-talk] Suggestion for '.' keybinding
1051 In-Reply-To: <1239638279-sup-6990@black>
1052 References: <1239638279-sup-6990@black>
1053 Message-ID: <1239911250-sup-9394@ausone>
1054
1055 Excerpts from Lee Hinman's message of Mon Apr 13 18:00:56 +0200 2009:
1056 > Sup,
1057 > Since Sup already emulates vi-bindings, I was wondering if it'd be possible to
1058 > have '.' bound to "do-it-again". So if I added a label to a mail, then wanted
1059 > to apply it to a different mail, I could go to the mail and use '.' to apply
1060 > whatever the last change was. (I know I could tag all the messages ahead of
1061 > time and label them all at once, but sometimes I want to do it a different
1062 > way).
1063 >
1064 > Is this possible with Sup right now? Does it store what the last action was?
1065 > (it might for the undo patch, I haven't looked at it)
1066
1067 I greatly support this idea!
1068
1069 --
1070 Nicolas Pouillard
1071
1072 From marka@pobox.com Thu Apr 16 18:05:59 2009
1073 From: marka@pobox.com (Mark Alexander)
1074 Date: Thu, 16 Apr 2009 15:05:59 -0700
1075 Subject: [sup-talk] Possible problem with maildir ID generation
1076 Message-ID: <a412e2a70904161505l3e1fdfc9l987013130b3f5ddd@mail.gmail.com>
1077
1078 I've been studying maildir.rb (and adding some debug code) while
1079 trying to figure out my lost message problem. I think there may be a
1080 problem with the way the internal message IDs are generated. The
1081 make_id method glues together the file timestamp and size. But I
1082 think this could lead to an out-of-order problem in the @ids array.
1083
1084 Consider two messages that arrive in the same second, but the second
1085 message is smaller than the first. Because the message size makes up
1086 the low seven (decimal) digits of the ID, the second message, even
1087 though it arrived later, will have an ID that is less than the first
1088 message.
1089
1090 Then suppose that sup polls the maildir directory after the first
1091 message arrives, but before the second message arrives, and sets the
1092 cur_offset to the ID of the first message. Then, the next time it
1093 polls, it will see the second message, but because its ID is less than
1094 that of the first message, it will appear before the first in the @ids
1095 array after it is sorted. So then the each method will skip the
1096 second message, because cur_offset (the ID of the first message) will
1097 be found in @ids after it.
1098
1099 Does this scenario make sense? I have seen what appears to be one
1100 instance of this happening, though I'm still watching closely and
1101 adding more debugging code to make sure that it explains all of the
1102 lost messages.
1103
1104 From reid.thompson@ateb.com Fri Apr 17 15:41:12 2009
1105 From: reid.thompson@ateb.com (Reid Thompson)
1106 Date: Fri, 17 Apr 2009 15:41:12 -0400
1107 Subject: [sup-talk] Two questions
1108 Message-ID: <1239997272.5948.104.camel@localhost>
1109
1110 >From the readme:
1111 Note that Sup never changes the contents of any mailboxes; it only
1112 indexes in to them. So it shouldn't ever corrupt your mail. The flip
1113 side is that if you change a mailbox (e.g. delete messages, or, in
1114 the case of mbox files, read an unread message) then Sup will be
1115 unable to load messages from that source and will ask you to run
1116 sup-sync --changed.
1117
1118 So, in order to actually manage my email, I have to utilize a different email client to delete unwanted mail - essentially doing the same work twice, or am I missing something?
1119
1120 Could sup-sync --changed be incorporated into sup, and triggered automatically by sup itself?
1121
1122
1123
1124 From btricha@gmail.com Mon Apr 20 17:52:24 2009
1125 From: btricha@gmail.com (Bryan Richardson)
1126 Date: Mon, 20 Apr 2009 15:52:24 -0600
1127 Subject: [sup-talk] Sup with Microsoft Exchange 2007
1128 In-Reply-To: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
1129 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
1130 Message-ID: <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
1131
1132 BUMP!!!
1133
1134 So... no one uses Sup with Microsoft Exchange?! :(
1135
1136 --
1137 Bryan
1138
1139 On 4/14/09, Bryan Richardson <btricha at gmail.com> wrote:
1140 > Hello all,
1141 >
1142 > Has anyone had success using Sup with Microsoft Exchange 2007? I'm able to
1143 > download email no problem, and I'm also able to send email through my
1144 > exchange server. However, my problem lies in the fact that when I send an
1145 > email from Sup, it doesn't show up in the Sent Items folder of my exchange
1146 > account. I'm not that familiar with IMAP, but I'm guessing this is maybe
1147 > due to the fact that I haven't subscribed to the Sent Items folder in Sup.
1148 > In response to this, another hurdle I'm trying to get over is how to even
1149 > tell what folders are available on my exchange account for subscribing to.
1150 > Is there a way to use Sup to query for available folders?
1151 >
1152 > Thanks in advance!
1153 >
1154 > --
1155 > Bryan
1156 >
1157
1158 From marka@pobox.com Mon Apr 20 18:54:57 2009
1159 From: marka@pobox.com (Mark Alexander)
1160 Date: Mon, 20 Apr 2009 15:54:57 -0700
1161 Subject: [sup-talk] Sup with Microsoft Exchange 2007
1162 In-Reply-To: <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
1163 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
1164 <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
1165 Message-ID: <1240267632-sup-2023@r50p>
1166
1167 Excerpts from Bryan Richardson's message of Mon Apr 20 14:52:24 -0700 2009:
1168 > So... no one uses Sup with Microsoft Exchange?! :(
1169
1170 Unfortunately, we use Exchange at work. But I hide that unpleasant
1171 fact from myself by using fetchmail and postfix on a Linux box. I
1172 have never used Outlook or the web interface that Exchange provides.
1173 Instead, I've always used mutt -- and more recently, sup. So I have
1174 no idea if I'm having the same problem you are. Sorry!
1175
1176 From wmorgan-sup@masanjin.net Tue Apr 21 09:02:35 2009
1177 From: wmorgan-sup@masanjin.net (William Morgan)
1178 Date: Tue, 21 Apr 2009 06:02:35 -0700
1179 Subject: [sup-talk] Sup with Microsoft Exchange 2007
1180 In-Reply-To: <3f81a4240904201638v94a7dbdpce0d865cd83d8873@mail.gmail.com>
1181 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
1182 <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
1183 <1240267632-sup-2023@r50p>
1184 <3f81a4240904201638v94a7dbdpce0d865cd83d8873@mail.gmail.com>
1185 Message-ID: <1240318807-sup-3080@entry>
1186
1187 Hi Bryan,
1188
1189 Reformatted excerpts from Bryan Richardson's message of 2009-04-20:
1190 > Is it possible to specify where my sent mail gets saved? I'd like to
1191 > be able to specify that it gets saved in one of my IMAP folders ('Sent
1192 > Items' in my Microsoft Exchange account). This way, if for some
1193 > reason I do ever have to access my mail via Microsoft Exchange Web
1194 > Access, I'll still have access to all my sent emails.
1195
1196 This is currently not possible with Sup, which as a rule doesn't play
1197 nicely with other mail clients. It wouldn't be terribly hard to add if
1198 you were so inclined (we have an IMAP library in there already) and I'd
1199 be happy to point you in the right direction, but it's not on my
1200 near-term list of things to do.
1201 --
1202 William <wmorgan-sup at masanjin.net>
1203
1204 From wmorgan-sup@masanjin.net Tue Apr 21 09:06:24 2009
1205 From: wmorgan-sup@masanjin.net (William Morgan)
1206 Date: Tue, 21 Apr 2009 06:06:24 -0700
1207 Subject: [sup-talk] Two questions
1208 In-Reply-To: <1239997272.5948.104.camel@localhost>
1209 References: <1239997272.5948.104.camel@localhost>
1210 Message-ID: <1240318974-sup-6743@entry>
1211
1212 Reformatted excerpts from Reid Thompson's message of 2009-04-17:
1213 > So, in order to actually manage my email, I have to utilize a
1214 > different email client to delete unwanted mail - essentially doing the
1215 > same work twice, or am I missing something?
1216
1217 For the two special cases of "physically" removing messages marked as
1218 deleted or spam, you can use sup-sync-back, which is a batch operation
1219 operating on an entire mail source at a time. Currently it only applies
1220 to mbox sources and can't be run while Sup is also running.
1221
1222 > Could sup-sync --changed be incorporated into sup, and triggered
1223 > automatically by sup itself?
1224
1225 You could certainly do that via Sup's hook mechanism, but it's a very
1226 slow operation (it has to scan over the entire mailbox).
1227 --
1228 William <wmorgan-sup at masanjin.net>
1229
1230 From reid.thompson@ateb.com Tue Apr 21 09:13:54 2009
1231 From: reid.thompson@ateb.com (Reid Thompson)
1232 Date: Tue, 21 Apr 2009 09:13:54 -0400
1233 Subject: [sup-talk] Two questions
1234 In-Reply-To: <1240318974-sup-6743@entry>
1235 References: <1239997272.5948.104.camel@localhost> <1240318974-sup-6743@entry>
1236 Message-ID: <1240319634.11793.11.camel@localhost>
1237
1238 On Tue, 2009-04-21 at 06:06 -0700, William Morgan wrote:
1239 > Reformatted excerpts from Reid Thompson's message of 2009-04-17:
1240 > > So, in order to actually manage my email, I have to utilize a
1241 > > different email client to delete unwanted mail - essentially doing the
1242 > > same work twice, or am I missing something?
1243 >
1244 > For the two special cases of "physically" removing messages marked as
1245 > deleted or spam, you can use sup-sync-back, which is a batch operation
1246 > operating on an entire mail source at a time. Currently it only applies
1247 > to mbox sources and can't be run while Sup is also running.
1248 >
1249 > > Could sup-sync --changed be incorporated into sup, and triggered
1250 > > automatically by sup itself?
1251 >
1252 > You could certainly do that via Sup's hook mechanism, but it's a very
1253 > slow operation (it has to scan over the entire mailbox).
1254
1255 OK -- so to 'manage' an imap store, i'd need to setup a mechanism to
1256 fetch all the email to a local store, deleting from the imap store, and
1257 then do something like schedule an overnight run of sup-sync-back,
1258
1259 From wmorgan-sup@masanjin.net Tue Apr 21 09:28:41 2009
1260 From: wmorgan-sup@masanjin.net (William Morgan)
1261 Date: Tue, 21 Apr 2009 06:28:41 -0700
1262 Subject: [sup-talk] Saving status of merged threads with '#' on next
1263 branch
1264 In-Reply-To: <1239875483-sup-5697@snowstorm>
1265 References: <1239177702-sup-8165@snowstorm> <1239299963-sup-5933@entry>
1266 <1239810733-sup-5572@snowstorm> <1239816596-sup-2531@entry>
1267 <1239875483-sup-5697@snowstorm>
1268 Message-ID: <1240320083-sup-2514@entry>
1269
1270 Reformatted excerpts from Bjorn Michelsen's message of 2009-04-16:
1271 > No, everything is encoded correctly in ~/.sup/sent.mbox
1272
1273 Then this is almost definitely your MTA, not Sup. But you could also try
1274 sending a message to yourself with another MUA and see what happens.
1275
1276 (Probably what will happen is that the MUA will RFC2047-encode your
1277 headers, and sSMTP will see that and leave them alone, and this problem
1278 will be hidden. So the right answer is really for Sup to RFC2047-encode
1279 headers in outgoing email.)
1280
1281 > I'm using sSMTP at the moment. Maybe it has something to do with the
1282 > following bug
1283 >
1284 > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=341952#10 ?
1285
1286 The problem could be someone trying to fix that bug (which is basically
1287 "we should add RFC2047 support"). Somehow it's not picking up your
1288 locale settings.
1289 --
1290 William <wmorgan-sup at masanjin.net>
1291
1292 From andrew@pimlott.net Tue Apr 21 09:48:39 2009
1293 From: andrew@pimlott.net (Andrew Pimlott)
1294 Date: Tue, 21 Apr 2009 06:48:39 -0700
1295 Subject: [sup-talk] Sup with Microsoft Exchange 2007
1296 In-Reply-To: <3f81a4240904210642o9c74049o27e164e317d0842e@mail.gmail.com>
1297 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
1298 <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
1299 <1240267632-sup-2023@r50p>
1300 <3f81a4240904201638v94a7dbdpce0d865cd83d8873@mail.gmail.com>
1301 <1240318807-sup-3080@entry>
1302 <3f81a4240904210642o9c74049o27e164e317d0842e@mail.gmail.com>
1303 Message-ID: <20090421134839.GY11701@pimlott.net>
1304
1305 On Tue, Apr 21, 2009 at 07:42:42AM -0600, Bryan Richardson wrote:
1306 > One question I do have though is why my sent messages get saved to my 'Sent
1307 > Mail' folder on my GMail account automatically (without the patch I
1308 > mentioned above) when I use Sup with GMail...
1309
1310 GMail's SMTP server does this.
1311
1312 Andrew
1313
1314 From wmorgan-sup@masanjin.net Tue Apr 21 10:00:30 2009
1315 From: wmorgan-sup@masanjin.net (William Morgan)
1316 Date: Tue, 21 Apr 2009 07:00:30 -0700
1317 Subject: [sup-talk] Possible problem with maildir ID generation
1318 In-Reply-To: <a412e2a70904161505l3e1fdfc9l987013130b3f5ddd@mail.gmail.com>
1319 References: <a412e2a70904161505l3e1fdfc9l987013130b3f5ddd@mail.gmail.com>
1320 Message-ID: <1240320547-sup-6957@entry>
1321
1322 Reformatted excerpts from Mark Alexander's message of 2009-04-16:
1323 > Consider two messages that arrive in the same second, but the second
1324 > message is smaller than the first. Because the message size makes up
1325 > the low seven (decimal) digits of the ID, the second message, even
1326 > though it arrived later, will have an ID that is less than the first
1327 > message.
1328
1329 I think you could be right. Using the size as part of the ID was
1330 supposed to differentiate messages with the same timestamp, but it would
1331 result in exactly the behavior you describe when polling.
1332
1333 I think there's a much simpler scheme we can use that will also fix
1334 this. I'll post a patch soon and we can see if it addresses the
1335 problem.
1336 --
1337 William <wmorgan-sup at masanjin.net>
1338
1339 From wmorgan-sup@masanjin.net Tue Apr 21 10:13:48 2009
1340 From: wmorgan-sup@masanjin.net (William Morgan)
1341 Date: Tue, 21 Apr 2009 07:13:48 -0700
1342 Subject: [sup-talk] Sup with Microsoft Exchange 2007
1343 In-Reply-To: <3f81a4240904210642o9c74049o27e164e317d0842e@mail.gmail.com>
1344 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
1345 <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
1346 <1240267632-sup-2023@r50p>
1347 <3f81a4240904201638v94a7dbdpce0d865cd83d8873@mail.gmail.com>
1348 <1240318807-sup-3080@entry>
1349 <3f81a4240904210642o9c74049o27e164e317d0842e@mail.gmail.com>
1350 Message-ID: <1240323082-sup-1515@entry>
1351
1352 Reformatted excerpts from Bryan Richardson's message of 2009-04-21:
1353 > First off, I want to say 'Thank You' for creating such a great
1354 > application here. Text-based is the way to go! :)
1355
1356 Glad you like it!
1357
1358 > As for saving sent mail in an IMAP folder, I did find a patch that I
1359 > was able to use to provide me with this functionality.
1360
1361 Interesting. Would you mind reposting it here, if you get a chance?
1362
1363 > One question I do have though is why my sent messages get saved to my
1364 > 'Sent Mail' folder on my GMail account automatically (without the
1365 > patch I mentioned above) when I use Sup with GMail...
1366
1367 As someone else pointed out, this is because GMail's MTA is clever.
1368
1369 > As a side note, does Sup have any sort of plugin architecture? I'm
1370 > thinking of maybe developing a text-based calendar app in Ruby at some
1371 > point... :)
1372
1373 It doesn't have plugins per se. It has a pretty good hook system, but
1374 that's probably not useful to you. What are you interested in using? The
1375 ncurses interface? The full-text search index?
1376 --
1377 William <wmorgan-sup at masanjin.net>
1378
1379 From wmorgan-sup@masanjin.net Tue Apr 21 10:26:20 2009
1380 From: wmorgan-sup@masanjin.net (William Morgan)
1381 Date: Tue, 21 Apr 2009 07:26:20 -0700
1382 Subject: [sup-talk] Two questions
1383 In-Reply-To: <1240319634.11793.11.camel@localhost>
1384 References: <1239997272.5948.104.camel@localhost> <1240318974-sup-6743@entry>
1385 <1240319634.11793.11.camel@localhost>
1386 Message-ID: <1240323252-sup-1276@entry>
1387
1388 Reformatted excerpts from Reid Thompson's message of 2009-04-21:
1389 > OK -- so to 'manage' an imap store, i'd need to setup a mechanism to
1390 > fetch all the email to a local store, deleting from the imap store,
1391 > and then do something like schedule an overnight run of sup-sync-back,
1392
1393 There are a couple issues at play. First, if you're serious about Sup
1394 with IMAP, many people have gone the route of mirroring their IMAP
1395 folders locally using something like offlineimap. The Ruby IMAP
1396 libraries, and possibly IMAP itself, is otherwise too slow for how Sup
1397 likes to treat its mailstores.
1398
1399 But that's not strictly necessary.
1400
1401 Second, if you're serious about deleting email from your IMAP server (as
1402 opposed to just letting it stay there forever, since storage is cheap
1403 and the too-fleeting moments of your precious mortality are not), you'll
1404 need to periodically run sup-sync-back with the appropriate flags.
1405
1406 This all stems from design decisions around Sup's target environment,
1407 which is that you have too much email to scan every message except in an
1408 offline manner. I have 229k emails in my inbox. Sup's the only client
1409 I know of that can scale to that. (Besides GMail of course.)
1410 --
1411 William <wmorgan-sup at masanjin.net>
1412
1413 From bdwalton@gmail.com Tue Apr 21 10:37:25 2009
1414 From: bdwalton@gmail.com (Ben Walton)
1415 Date: Tue, 21 Apr 2009 10:37:25 -0400
1416 Subject: [sup-talk] Sup with Microsoft Exchange 2007
1417 In-Reply-To: <3f81a4240904210732k11366cf7naec562af54ecabac@mail.gmail.com>
1418 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
1419 <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
1420 <1240267632-sup-2023@r50p>
1421 <3f81a4240904201638v94a7dbdpce0d865cd83d8873@mail.gmail.com>
1422 <1240318807-sup-3080@entry>
1423 <3f81a4240904210642o9c74049o27e164e317d0842e@mail.gmail.com>
1424 <1240323082-sup-1515@entry>
1425 <3f81a4240904210729h74ac436bn9e1140cf7021c5ad@mail.gmail.com>
1426 <3f81a4240904210732k11366cf7naec562af54ecabac@mail.gmail.com>
1427 Message-ID: <f96e0240904210737q71765989of31447a8de20fa62@mail.gmail.com>
1428
1429 I abandoned that patch for my own use after a while. [I moved my .sup
1430 to local storage from nfs and now use the mbox sent folder.] I still
1431 like the idea, but that patch would need much work before it became
1432 integration worthy. If there is sufficient interest, I'd invest the
1433 time.
1434
1435 William, what requirements would need to be met from your side to see
1436 this added?
1437
1438 Thanks
1439 -Ben
1440
1441
1442 On Tue, Apr 21, 2009 at 10:32 AM, Bryan Richardson <btricha at gmail.com> wrote:
1443 > The patch for what the author (Ben Walton) calls 'Flexible Sent Source' can
1444 > be found at the following URL.? It would be nice to have this integrated
1445 > into the official Sup source code... :)
1446 >
1447 > http://www.nabble.com/-PATCH--flexible-sent-source-td16960901.html#a16960901
1448 >
1449 > One more question: I noticed when I use Sup with my Exchange account that it
1450 > marks all my messages on the Exchange server as read when it syncs.? Is this
1451 > normal?
1452 >
1453 > On Tue, Apr 21, 2009 at 8:29 AM, Bryan Richardson <btricha at gmail.com> wrote:
1454 >>
1455 >> Yeah, I'll find the patch and post it here.
1456 >>
1457 >> As for the calendaring app, I figured having it integrated with Sup might
1458 >> be kinda cool.? The search index might help too. :)
1459 >>
1460 >> On Tue, Apr 21, 2009 at 8:13 AM, William Morgan <wmorgan-sup at masanjin.net>
1461 >> wrote:
1462 >>>
1463 >>> Reformatted excerpts from Bryan Richardson's message of 2009-04-21:
1464 >>> > First off, I want to say 'Thank You' for creating such a great
1465 >>> > application here. ?Text-based is the way to go! :)
1466 >>>
1467 >>> Glad you like it!
1468 >>>
1469 >>> > As for saving sent mail in an IMAP folder, I did find a patch that I
1470 >>> > was able to use to provide me with this functionality.
1471 >>>
1472 >>> Interesting. Would you mind reposting it here, if you get a chance?
1473 >>>
1474 >>> > One question I do have though is why my sent messages get saved to my
1475 >>> > 'Sent Mail' folder on my GMail account automatically (without the
1476 >>> > patch I mentioned above) when I use Sup with GMail...
1477 >>>
1478 >>> As someone else pointed out, this is because GMail's MTA is clever.
1479 >>>
1480 >>> > As a side note, does Sup have any sort of plugin architecture? ?I'm
1481 >>> > thinking of maybe developing a text-based calendar app in Ruby at some
1482 >>> > point... :)
1483 >>>
1484 >>> It doesn't have plugins per se. It has a pretty good hook system, but
1485 >>> that's probably not useful to you. What are you interested in using? The
1486 >>> ncurses interface? The full-text search index?
1487 >>> --
1488 >>> William <wmorgan-sup at masanjin.net>
1489 >>> _______________________________________________
1490 >>> sup-talk mailing list
1491 >>> sup-talk at rubyforge.org
1492 >>> http://rubyforge.org/mailman/listinfo/sup-talk
1493 >>
1494 >
1495 >
1496 > _______________________________________________
1497 > sup-talk mailing list
1498 > sup-talk at rubyforge.org
1499 > http://rubyforge.org/mailman/listinfo/sup-talk
1500 >
1501 >
1502
1503
1504
1505 --
1506 ---------------------------------------------------------------------------------------------------------------------------
1507 Ben Walton <bdwalton at gmail.com>
1508
1509 "With or without religion, good people can behave well and bad people
1510 can do evil; but for good people to do evil?that takes religion. "
1511 -Steven Weinberg
1512 ---------------------------------------------------------------------------------------------------------------------------
1513
1514 From marka@pobox.com Tue Apr 21 11:33:17 2009
1515 From: marka@pobox.com (Mark Alexander)
1516 Date: Tue, 21 Apr 2009 08:33:17 -0700
1517 Subject: [sup-talk] Possible problem with maildir ID generation
1518 In-Reply-To: <1240320547-sup-6957@entry>
1519 References: <a412e2a70904161505l3e1fdfc9l987013130b3f5ddd@mail.gmail.com>
1520 <1240320547-sup-6957@entry>
1521 Message-ID: <a412e2a70904210833r48c78a8ah5c19779cd8b99b53@mail.gmail.com>
1522
1523 On Tue, Apr 21, 2009 at 7:00 AM, William Morgan
1524 <wmorgan-sup at masanjin.net> wrote:
1525 > I think you could be right. Using the size as part of the ID was
1526 > supposed to differentiate messages with the same timestamp, but it would
1527 > result in exactly the behavior you describe when polling.
1528 >
1529 > I think there's a much simpler scheme we can use that will also fix
1530 > this. I'll post a patch soon and we can see if it addresses the
1531 > problem.
1532
1533 I'd be very interested in this patch.
1534
1535 In the meantime, I made some minor changes to maildir.rb, without
1536 changing the ID scheme. One problem was every time a maildir was
1537 polled, the most recent message (i.e., the one at cur_offset) would be
1538 treated as a new message again. I also changed last_offset to return
1539 an ID that would be one second later than the last message seen.
1540
1541 These changes seem to have mostly fixed the lost message problem I was
1542 having, though I'm not exactly sure why. I've only had one lost
1543 message over the last couple of days, instead of the expected 10 or
1544 20. I can't explain this one lost message, but I think it must be due
1545 to a different problem, unrelated to maildir handling. I was able to
1546 get sup to see this message again by doing a 'touch' on both the
1547 message itself and the containing maildir.
1548
1549 I doubt that my changes would fix the race condition I described
1550 earlier, but I've avoided this problem by not running fetchmail
1551 in the background while sup is running.
1552
1553 I'll send out my patch in a separate email.
1554
1555 From marka@pobox.com Tue Apr 21 11:43:44 2009
1556 From: marka@pobox.com (Mark Alexander)
1557 Date: Tue, 21 Apr 2009 08:43:44 -0700
1558 Subject: [sup-talk] [PATCH] Bug fixes and speed improvements for maildir
1559 handling.
1560 Message-ID: <a412e2a70904210843p6410e83dyabccb3dec5c9fd0a@mail.gmail.com>
1561
1562 ---
1563 lib/sup/maildir.rb | 10 +++++++---
1564 1 files changed, 7 insertions(+), 3 deletions(-)
1565
1566 diff --git a/lib/sup/maildir.rb b/lib/sup/maildir.rb
1567 index 3d584f7..d74279a 100644
1568 --- a/lib/sup/maildir.rb
1569 +++ b/lib/sup/maildir.rb
1570 @@ -10,6 +10,7 @@ module Redwood
1571
1572 class Maildir < Source
1573 SCAN_INTERVAL = 30 # seconds
1574 + TIME_SCALE = 10000000
1575
1576 ## remind me never to use inheritance again.
1577 yaml_properties :uri, :cur_offset, :usual, :archived, :id, :labels, :mtimes
1578 @@ -123,8 +124,11 @@ class Maildir < Source
1579 return unless start_offset
1580
1581 start = @ids.index(cur_offset || start_offset) or raise
1582 OutOfSyncSourceError, "Unknown message id #{cur_offset ||
1583 start_offset}." # couldn't find the most recent email
1584 + if cur_offset
1585 + start += 1
1586 + end
1587
1588 - start.upto(@ids.length - 1) do |i|
1589 + (start... at ids.length).each do |i|
1590 id = @ids[i]
1591 self.cur_offset = id
1592 yield id, @labels + (seen?(id) ? [] : [:unread]) +
1593 (trashed?(id) ? [:deleted] : []) + (flagged?(id) ? [:starred] : [])
1594 @@ -138,7 +142,7 @@ class Maildir < Source
1595
1596 def end_offset
1597 scan_mailbox :rescan => true
1598 - @ids.last + 1
1599 + ((@ids.last / TIME_SCALE) + 1) * TIME_SCALE
1600 end
1601
1602 def pct_done; 100.0 * (@ids.index(cur_offset) || 0).to_f /
1603 (@ids.length - 1).to_f; end
1604 @@ -164,7 +168,7 @@ private
1605 #makes a noticeable difference on nfs.
1606 stat = File.stat(fn)
1607 # use 7 digits for the size. why 7? seems nice.
1608 - sprintf("%d%07d", stat.mtime, stat.size % 10000000).to_i
1609 + (stat.mtime.to_i * TIME_SCALE) + (stat.size % TIME_SCALE)
1610 end
1611
1612 def with_file_for id
1613 --
1614 1.6.1.28.gc32f76
1615
1616 From reid.thompson@ateb.com Tue Apr 21 12:15:59 2009
1617 From: reid.thompson@ateb.com (Reid Thompson)
1618 Date: Tue, 21 Apr 2009 12:15:59 -0400
1619 Subject: [sup-talk] Two questions
1620 In-Reply-To: <1240323252-sup-1276@entry>
1621 References: <1239997272.5948.104.camel@localhost>
1622 <1240318974-sup-6743@entry> <1240319634.11793.11.camel@localhost>
1623 <1240323252-sup-1276@entry>
1624 Message-ID: <1240330559.11793.52.camel@localhost>
1625
1626 On Tue, 2009-04-21 at 07:26 -0700, William Morgan wrote:
1627 > Reformatted excerpts from Reid Thompson's message of 2009-04-21:
1628 > > OK -- so to 'manage' an imap store, i'd need to setup a mechanism to
1629 > > fetch all the email to a local store, deleting from the imap store,
1630 > > and then do something like schedule an overnight run of sup-sync-back,
1631 >
1632 > There are a couple issues at play. First, if you're serious about Sup
1633 > with IMAP, many people have gone the route of mirroring their IMAP
1634 > folders locally using something like offlineimap. The Ruby IMAP
1635 > libraries, and possibly IMAP itself, is otherwise too slow for how Sup
1636 > likes to treat its mailstores.
1637 >
1638 > But that's not strictly necessary.
1639 >
1640 > Second, if you're serious about deleting email from your IMAP server (as
1641 > opposed to just letting it stay there forever, since storage is cheap
1642 > and the too-fleeting moments of your precious mortality are not), you'll
1643 > need to periodically run sup-sync-back with the appropriate flags.
1644 >
1645 > This all stems from design decisions around Sup's target environment,
1646 > which is that you have too much email to scan every message except in an
1647 > offline manner. I have 229k emails in my inbox. Sup's the only client
1648 > I know of that can scale to that. (Besides GMail of course.)
1649
1650 for 'fun', i setup a fastmail.fm account, to which i'm using rss2email
1651 to push a number of feeds to. I setup offlineimap to pull these feeds
1652 down for sup, so that I could 'manage' the imap store via sup.
1653
1654
1655
1656 Why is it expecting mbox format?
1657
1658 rthompso at raker ~/.sup $ sup-sync-back -d maildir:~/.fastmaildotfm/INBOX
1659 [Tue Apr 21 12:10:07 -0400 2009] using character set encoding "UTF-8"
1660 [Tue Apr 21 12:10:08 -0400 2009] crypto: detected gpg binary
1661 in /usr/bin/gpg
1662 [Tue Apr 21 12:10:08 -0400 2009] locking /home/rthompso/.sup/lock...
1663 [Tue Apr 21 12:10:08 -0400 2009] loading index...
1664 [Tue Apr 21 12:10:08 -0400 2009] loaded index of 920 messages
1665 Error: maildir:~/.fastmaildotfm/INBOX is not an mbox source.
1666 [Tue Apr 21 12:10:08 -0400 2009] unlocking /home/rthompso/.sup/lock...
1667
1668
1669 offlineimap is populating ~/.fastmaildotfm/INBOX
1670
1671 rthompso at raker ~/.sup $ cat sources.yaml
1672 ---
1673 ....
1674 - !masanjin.net,2006-10-01/Redwood/Maildir
1675 uri: maildir:~/.fastmaildotfm/INBOX
1676 cur_offset: 12403255620003971
1677 usual: true
1678 archived: false
1679 id: 4
1680 labels:
1681 - rssmail
1682 mtimes:
1683 cur: 2009-04-21 11:47:05 -04:00
1684 new: 2009-04-21 11:47:08 -04:00
1685 - !masanjin.net,2006-10-01/Redwood/SentLoader
1686 cur_offset: 19809
1687 - !masanjin.net,2006-10-01/Redwood/DraftLoader
1688 cur_offset: 0
1689
1690 rthompso at raker ~ $ find .fastmaildotfm/
1691 .fastmaildotfm/
1692 .fastmaildotfm/INBOX.Trash
1693 .fastmaildotfm/INBOX.Trash/cur
1694 .fastmaildotfm/INBOX.Trash/new
1695 .fastmaildotfm/INBOX.Trash/tmp
1696 .fastmaildotfm/INBOX.Sent Items
1697 .fastmaildotfm/INBOX.Sent Items/cur
1698 .fastmaildotfm/INBOX.Sent Items/new
1699 .fastmaildotfm/INBOX.Sent Items/tmp
1700 .fastmaildotfm/INBOX
1701 .fastmaildotfm/INBOX/cur
1702 .fastmaildotfm/INBOX/cur/1240328825_0.15391.raker,U=1,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,S
1703 .fastmaildotfm/INBOX/new
1704 .fastmaildotfm/INBOX/new/1240328827_7.15391.raker,U=29,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1705 .fastmaildotfm/INBOX/new/1240328825_5.15391.raker,U=6,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1706 .fastmaildotfm/INBOX/new/1240328827_6.15391.raker,U=28,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1707 .fastmaildotfm/INBOX/new/1240328826_0.15391.raker,U=8,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1708 .fastmaildotfm/INBOX/new/1240328827_5.15391.raker,U=27,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1709 .fastmaildotfm/INBOX/new/1240328826_9.15391.raker,U=17,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1710 .fastmaildotfm/INBOX/new/1240328827_4.15391.raker,U=26,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1711 .fastmaildotfm/INBOX/new/1240328826_8.15391.raker,U=16,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1712 .fastmaildotfm/INBOX/new/1240328825_6.15391.raker,U=7,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1713 .fastmaildotfm/INBOX/new/1240328827_3.15391.raker,U=25,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1714 .fastmaildotfm/INBOX/new/1240328826_7.15391.raker,U=15,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1715 .fastmaildotfm/INBOX/new/1240328827_2.15391.raker,U=24,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1716 .fastmaildotfm/INBOX/new/1240328826_1.15391.raker,U=9,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1717 .fastmaildotfm/INBOX/new/1240328826_6.15391.raker,U=14,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1718 .fastmaildotfm/INBOX/new/1240328827_1.15391.raker,U=23,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1719 .fastmaildotfm/INBOX/new/1240328826_13.15391.raker,U=21,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1720 .fastmaildotfm/INBOX/new/1240328826_5.15391.raker,U=13,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1721 .fastmaildotfm/INBOX/new/1240328825_1.15391.raker,U=2,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1722 .fastmaildotfm/INBOX/new/1240328827_0.15391.raker,U=22,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1723 .fastmaildotfm/INBOX/new/1240328826_12.15391.raker,U=20,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1724 .fastmaildotfm/INBOX/new/1240328826_4.15391.raker,U=12,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1725 .fastmaildotfm/INBOX/new/1240328826_3.15391.raker,U=11,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1726 .fastmaildotfm/INBOX/new/1240328826_2.15391.raker,U=10,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1727 .fastmaildotfm/INBOX/new/1240328825_2.15391.raker,U=3,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1728 .fastmaildotfm/INBOX/new/1240328826_11.15391.raker,U=19,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1729 .fastmaildotfm/INBOX/new/1240328828_0.15391.raker,U=32,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1730 .fastmaildotfm/INBOX/new/1240328826_10.15391.raker,U=18,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1731 .fastmaildotfm/INBOX/new/1240328825_3.15391.raker,U=4,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1732 .fastmaildotfm/INBOX/new/1240328827_9.15391.raker,U=31,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1733 .fastmaildotfm/INBOX/new/1240328825_4.15391.raker,U=5,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1734 .fastmaildotfm/INBOX/new/1240328827_8.15391.raker,U=30,FMD5=7e33429f656f1e6e9d79b29c3f82c57e:2,
1735 .fastmaildotfm/INBOX/tmp
1736 .fastmaildotfm/INBOX.Drafts
1737 .fastmaildotfm/INBOX.Drafts/cur
1738 .fastmaildotfm/INBOX.Drafts/new
1739 .fastmaildotfm/INBOX.Drafts/tmp
1740
1741
1742 From saku@ytti.fi Wed Apr 22 03:29:56 2009
1743 From: saku@ytti.fi (Saku Ytti)
1744 Date: Wed, 22 Apr 2009 00:29:56 -0700 (PDT)
1745 Subject: [sup-talk] IMAP folder/label integration and playing better with
1746 changed sources?
1747 Message-ID: <0c334e4c-0480-4def-b64a-b4996431f5c9@x3g2000yqa.googlegroups.com>
1748
1749 First, thank you for sup-mail. I thought I just wanted mutt with
1750 indexed searches, but turns out the stuff copied
1751 from gmail are brilliant and the novel(?) idea of buffers really makes
1752 things simpler.
1753 Problem for me is, I want to use also mobile phone email client and
1754 webmail, so I'm kinda stuck with mutt. Is it likely that this could be
1755 addressed in future?
1756
1757 And for the actual subject related matter, could it be possible to
1758 store labels as folders optionally? This would
1759 play along really well for those who use gmail, as you would
1760 essentially get synchronised labeling between
1761 sup and webclient.
1762
1763 Thanks again.
1764
1765 From wmorgan-sup@masanjin.net Wed Apr 22 11:02:15 2009
1766 From: wmorgan-sup@masanjin.net (William Morgan)
1767 Date: Wed, 22 Apr 2009 08:02:15 -0700
1768 Subject: [sup-talk] sup crashes when starting, here is the exception-log
1769 In-Reply-To: <20090414165314.GA19668@gmail.com>
1770 References: <20090414165314.GA19668@gmail.com>
1771 Message-ID: <1240412232-sup-8540@entry>
1772
1773 Hi Sean,
1774
1775 Reformatted excerpts from Sean Escriva's message of 2009-04-14:
1776 > --- NoMethodError from thread: call #connect on
1777 > mbox+ssh://optimus//var/mail/seane
1778 > undefined method `synchronize' for nil:NilClass
1779 > /home/webframp/.gem/ruby/1.8/gems/sup-0.7/lib/sup/mbox/ssh-file.rb:181:in
1780
1781 Sorry to report this, but the mbox-ssh stuff hasn't been working for a
1782 while and fixing it is pretty low priority at the moment. You're welcome
1783 to investigate, of course, or you might consider another source type.
1784 (mbox+ssh was never was quite fast enough IMO anyways.)
1785 --
1786 William <wmorgan-sup at masanjin.net>
1787
1788 From wmorgan-sup@masanjin.net Wed Apr 22 11:07:22 2009
1789 From: wmorgan-sup@masanjin.net (William Morgan)
1790 Date: Wed, 22 Apr 2009 08:07:22 -0700
1791 Subject: [sup-talk] Suggestion for '.' keybinding
1792 In-Reply-To: <1239638279-sup-6990@black>
1793 References: <1239638279-sup-6990@black>
1794 Message-ID: <1240412747-sup-2285@entry>
1795
1796 Reformatted excerpts from Lee Hinman's message of 2009-04-13:
1797 > Is this possible with Sup right now? Does it store what the last
1798 > action was? (it might for the undo patch, I haven't looked at it)
1799
1800 It's not possible right now, but the undo patch does something similar
1801 to this. The best approach might be to extend UndoManager to be able to
1802 redo as well as undo.
1803 --
1804 William <wmorgan-sup at masanjin.net>
1805
1806 From wmorgan-sup@masanjin.net Wed Apr 22 11:12:40 2009
1807 From: wmorgan-sup@masanjin.net (William Morgan)
1808 Date: Wed, 22 Apr 2009 08:12:40 -0700
1809 Subject: [sup-talk] Two questions
1810 In-Reply-To: <1240330559.11793.52.camel@localhost>
1811 References: <1239997272.5948.104.camel@localhost> <1240318974-sup-6743@entry>
1812 <1240319634.11793.11.camel@localhost> <1240323252-sup-1276@entry>
1813 <1240330559.11793.52.camel@localhost>
1814 Message-ID: <1240412894-sup-3091@entry>
1815
1816 Reformatted excerpts from Reid Thompson's message of 2009-04-21:
1817 > Why is it expecting mbox format?
1818
1819 Sorry, I gave you kind of a crappy answer above. sup-sync-back currently
1820 only works on mbox files, though not for any reason other than no one's
1821 gotten around to extending it yet. Deleting files from a Maildir is
1822 significantly easier than removing them from an mbox, so the bar's not
1823 very high on this one.
1824 --
1825 William <wmorgan-sup at masanjin.net>
1826
1827 From ezyang@MIT.EDU Wed Apr 22 11:56:30 2009
1828 From: ezyang@MIT.EDU (Edward Z. Yang)
1829 Date: Wed, 22 Apr 2009 11:56:30 -0400
1830 Subject: [sup-talk] First time user of sup; some questions
1831 Message-ID: <1240415555-sup-5859@javelin>
1832
1833 Hello all,
1834
1835 I recently switched over to Sup, and I have a favorable first impression.
1836 However, I have a few questions:
1837
1838 1. How do I get date searches to work? I've tried the strings on the
1839 wiki, namely before:, on:, after: and during:, and they consistently
1840 return no results. I'm using sup v0.7.
1841
1842 2. I'd like to archive all of my email older than two weeks (in an
1843 attempt to keep my inbox "as clean as possible"). How might I
1844 go about doing this?
1845
1846 3. I am currently running sup client-side, but it seems to me that,
1847 given its index-centric operation nature, and the fact that this
1848 index does not get propagated back to the mailserver, it would
1849 be more appropriate to run this on a server (this also seems to
1850 jive with the recent "Sup as a Service" postings). Should I toss
1851 sup on a remote machine I have SSH access to, and if I do, how might
1852 I migrate the index I already have?
1853
1854 Cheers,
1855 Edward
1856 --
1857
1858 From ezyang@MIT.EDU Wed Apr 22 16:40:06 2009
1859 From: ezyang@MIT.EDU (Edward Z. Yang)
1860 Date: Wed, 22 Apr 2009 16:40:06 -0400
1861 Subject: [sup-talk] First time user of sup; some questions
1862 In-Reply-To: <1240415555-sup-5859@javelin>
1863 References: <1240415555-sup-5859@javelin>
1864 Message-ID: <1240432739-sup-2328@javelin>
1865
1866 Excerpts from Edward Z. Yang's message of Wed Apr 22 11:56:30 -0400 2009:
1867 > 2. I'd like to archive all of my email older than two weeks (in an
1868 > attempt to keep my inbox "as clean as possible"). How might I
1869 > go about doing this?
1870
1871 Ended up fixing this by !!, T, t (for messages I didn't want to remove), and then ;a
1872
1873 Kind of took a while, since I had 5000+ conversations in my inbox.
1874
1875 Cheers,
1876 Edward
1877 --
1878
1879 From wmorgan-sup@masanjin.net Wed Apr 22 18:26:43 2009
1880 From: wmorgan-sup@masanjin.net (William Morgan)
1881 Date: Wed, 22 Apr 2009 15:26:43 -0700
1882 Subject: [sup-talk] First time user of sup; some questions
1883 In-Reply-To: <1240415555-sup-5859@javelin>
1884 References: <1240415555-sup-5859@javelin>
1885 Message-ID: <1240439191-sup-6622@entry>
1886
1887 Reformatted excerpts from Edward Z. Yang's message of 2009-04-22:
1888 > 1. How do I get date searches to work? I've tried the strings on the
1889 > wiki, namely before:, on:, after: and during:, and they consistently
1890 > return no results. I'm using sup v0.7.
1891
1892 Do you have the chronic gem installed? It's an optional gem but the date
1893 search stuff requires it.
1894
1895 > 2. I'd like to archive all of my email older than two weeks (in an
1896 > attempt to keep my inbox "as clean as possible"). How might I go about
1897 > doing this?
1898
1899 Check out sup-tweak-labels for a way to do this offline (which is really
1900 what you want). With chronic installed, you should be able to pass the
1901 date range query and have it remove the inbox label from all matching
1902 messages. You might want to limit the query a bit so that you don't do
1903 this to every message in your index, over and over. Something like
1904 "+before(two weeks ago) +after(15 days ago)" maybe.
1905
1906 > 3. I am currently running sup client-side, but it seems to me that,
1907 > given its index-centric operation nature, and the fact that this
1908 > index does not get propagated back to the mailserver, it would
1909 > be more appropriate to run this on a server (this also seems to
1910 > jive with the recent "Sup as a Service" postings). Should I toss
1911 > sup on a remote machine I have SSH access to, and if I do, how might
1912 > I migrate the index I already have?
1913
1914 Until Sup the Service is ready (and believe it or not, I have actually
1915 been working on it recently), running it on a globally-accessible server
1916 is what I do. You should be able to simply copy your .sup directory
1917 over. (Although if you're migrating from Windows to a Linux box, I'm
1918 not entirely certain that will work... I'd be interested to hear if it
1919 does.)
1920 --
1921 William <wmorgan-sup at masanjin.net>
1922
1923 From ezyang@MIT.EDU Wed Apr 22 19:21:11 2009
1924 From: ezyang@MIT.EDU (Edward Z. Yang)
1925 Date: Wed, 22 Apr 2009 19:21:11 -0400
1926 Subject: [sup-talk] First time user of sup; some questions
1927 In-Reply-To: <1240439191-sup-6622@entry>
1928 References: <1240415555-sup-5859@javelin> <1240439191-sup-6622@entry>
1929 Message-ID: <1240442350-sup-9277@javelin>
1930
1931 Excerpts from William Morgan's message of Wed Apr 22 18:26:43 -0400 2009:
1932 > Do you have the chronic gem installed? It's an optional gem but the date
1933 > search stuff requires it.
1934
1935 Nope. Installing the chronic gem fixed things. I've updated the wiki
1936 article accordingly.
1937
1938 > Check out sup-tweak-labels for a way to do this offline (which is really
1939 > what you want). With chronic installed, you should be able to pass the
1940 > date range query and have it remove the inbox label from all matching
1941 > messages. You might want to limit the query a bit so that you don't do
1942 > this to every message in your index, over and over. Something like
1943 > "+before(two weeks ago) +after(15 days ago)" maybe.
1944
1945 Since I'm pretty good about archiving email when it's no longer relevant,
1946 this is not strictly necessary, but it's good to know the existence
1947 of sup-tweak-labels.
1948
1949 > Until Sup the Service is ready (and believe it or not, I have actually
1950 > been working on it recently), running it on a globally-accessible server
1951 > is what I do. You should be able to simply copy your .sup directory
1952 > over. (Although if you're migrating from Windows to a Linux box, I'm
1953 > not entirely certain that will work... I'd be interested to hear if it
1954 > does.)
1955
1956 Excellent. I'm running on Ubuntu Linux and am thinking of setting up
1957 a little bit of replication framework to make my index accessible
1958 on multiple machines.
1959
1960 Cheers,
1961 Edward
1962
1963 From jdugan@es.net Wed Apr 22 21:35:00 2009
1964 From: jdugan@es.net (Jon Dugan)
1965 Date: Wed, 22 Apr 2009 18:35:00 -0700
1966 Subject: [sup-talk] GSoC Project of Interest
1967 Message-ID: <1240449619-sup-9301@junction.es.net>
1968
1969 There's an GSoC project that may be of interest to folks on this list. It's
1970 aim is to add Gmail/sup like features to the Plan 9 mail system called upas.
1971
1972 This might end up creating something an awful lot like Sup the Service Not
1973 identical for sure, but there is at least some overlap in terms of aims and
1974 ideas.
1975
1976 Most services on Plan 9 are implemented as synthetic file systems. The
1977 synthetic filesystem that represents email on Plan 9 is known as upas. upas
1978 provides a filesytem view of mail boxes regardless of their backend storage
1979 medium (eg, POP, IMAP, etc) which provides a nice clean separation between the
1980 code that you use to do useful things to your mail and the code that deals
1981 with the mail store itself.
1982
1983 To quote the man page:
1984
1985 The mailbox itself becomes a directory under /mail/fs. Each message in the
1986 mailbox becomes a numbered directory in the mailbox directory, and each
1987 attachment becomes a numbered directory in the message directory. Since an
1988 attachment may itself be a mail message, this structure can recurse ad
1989 nauseam.
1990
1991 Each message and attachment directory contains the files:
1992 body the message minus the RFC822 style headers
1993 cc the address(es) from the CC: header
1994 date the date in the message, or if none, the time of delivery
1995 digest an SHA1 digest of the message contents
1996 subject the contents of the subject line
1997 .
1998 . etc
1999 .
2000
2001 Here's the manpage for upas:
2002
2003 http://plan9.bell-labs.com/magic/man2html/4/upasfs
2004
2005 The GSoC project:
2006
2007 http://socghop.appspot.com/student_project/show/google/gsoc2009/plan9/t124024225207
2008
2009 There's a ton of interesting and powerful stuff in Plan 9.
2010
2011 I'm hoping this will provide some useful ideas for Sup the Service.
2012
2013 Jon
2014 --
2015 Jon M. Dugan <jdugan at es.net> | GTalk: jdugan.esnet
2016 ESnet Network Engineering Group | http://www.es.net/
2017 Lawrence Berkeley National Laboratory | http://www.lbl.gov/
2018
2019 From jdugan@es.net Wed Apr 22 21:11:40 2009
2020 From: jdugan@es.net (Jon Dugan)
2021 Date: Wed, 22 Apr 2009 18:11:40 -0700
2022 Subject: [sup-talk] mime-view hook
2023 Message-ID: <1240448213-sup-1757@junction.es.net>
2024
2025 I'm running the mainline sup from git.
2026
2027 I have a mime-view.rb hook like this:
2028
2029 case content_type
2030 when "text/html"
2031 Redwood::log("w3m: " + '/opt/local/bin/w3m -dump -T ' + content_type + ' ' + filename)
2032 IO.popen('-') {|f| f ? f.read : exec('/opt/local/bin/w3m', '-dump', '-T', content_type, filename)}
2033 else
2034 Redwood::log("dumbplumb: " + filename)
2035 system '/Users/jdugan/projects/dumbplumb/dumbplumb', filename
2036 end
2037
2038 It's supposed to render HTML in the SUP window and hand everything else off to
2039 dumbplumb. It does hand everything else off to dumbplub, however it doesn't
2040 do what I expect for the HTML attachments.
2041
2042 Whatever gets returned from the hook should be displayed, right?
2043
2044 I am a Ruby noob so maybe it's my Ruby that's bad. (Although I've got a lot
2045 of experience with Python, Perl, etc...)
2046
2047 If I send the output of the IO.popen to Redwood::log I see what I'd expect in
2048 the log buffer, so I have confidence in the part that is using w3m to render
2049 the HTML.
2050
2051 Why didn't I use backticks (`) instead of the calls to system and exec?
2052 To sidestep shell quoting issues. I started with backticks but attachments
2053 with spaces and other shell meta characters were problematic.
2054
2055 Thanks for any suggestions,
2056
2057 Jon
2058
2059 PS: dumbplumb may be of interest. Here's the README:
2060
2061 dumbplumb is a simple mechanism for displaying files from remote systems
2062 locally. it is a brain dead hack that implements something which is something
2063 like the Plan 9 plumber but not really.
2064
2065 Eventually it may be reworked to actually use the plan9 port plumber, but for
2066 now it's just dumb.
2067
2068 dumbplumbd listens on port 9937 on your local system for requests. dumbplumb
2069 sends requests to dumbplumbd. ssh port forwarding is used to proxy the two
2070 together, eg:
2071
2072 ssh -R 9937:localhost:9937 remotehost
2073
2074 You can find dumbplumb at http://bitbucket.org/jdugan/dumbplumb/
2075 --
2076 Jon M. Dugan <jdugan at es.net> | GTalk: jdugan.esnet
2077 ESnet Network Engineering Group | http://www.es.net/
2078 Lawrence Berkeley National Laboratory | http://www.lbl.gov/
2079
2080 From wmorgan-sup@masanjin.net Thu Apr 23 08:47:59 2009
2081 From: wmorgan-sup@masanjin.net (William Morgan)
2082 Date: Thu, 23 Apr 2009 05:47:59 -0700
2083 Subject: [sup-talk] mime-view hook
2084 In-Reply-To: <1240448213-sup-1757@junction.es.net>
2085 References: <1240448213-sup-1757@junction.es.net>
2086 Message-ID: <1240489722-sup-3696@entry>
2087
2088 Reformatted excerpts from Jon Dugan's message of 2009-04-22:
2089 > It's supposed to render HTML in the SUP window and hand everything
2090 > else off to dumbplumb. It does hand everything else off to dumbplub,
2091 > however it doesn't do what I expect for the HTML attachments.
2092 >
2093 > Whatever gets returned from the hook should be displayed, right?
2094
2095 Not exactly. There are two MIME hooks, and you'll need them both for
2096 what you're trying to do: mime-decode, for turning an attachment into
2097 text (displayed directly in Sup), and mime-view, for launching
2098 third-party applications to view an attachment. I've updated the docs on
2099 these two in git to make their relationship a little more clear, but in
2100 summary: mime-decode should return a string, or nil if uncovertable, and
2101 mime-view should return true if the application was successful, and
2102 false otherwise.
2103
2104 Note that by default Sup calls run-mailcap to view attachments it can't
2105 convert to text, so you can make the dumbplumb behavior global by
2106 changing your mailcap instead. (If you desire that.)
2107
2108 > dumbplumb is a simple mechanism for displaying files from remote
2109 > systems locally. it is a brain dead hack that implements something
2110 > which is something like the Plan 9 plumber but not really.
2111
2112 That's awesome. Very useful for Sup.
2113 --
2114 William <wmorgan-sup at masanjin.net>
2115
2116 From wmorgan-sup@masanjin.net Thu Apr 23 08:52:56 2009
2117 From: wmorgan-sup@masanjin.net (William Morgan)
2118 Date: Thu, 23 Apr 2009 05:52:56 -0700
2119 Subject: [sup-talk] GSoC Project of Interest
2120 In-Reply-To: <1240449619-sup-9301@junction.es.net>
2121 References: <1240449619-sup-9301@junction.es.net>
2122 Message-ID: <1240490917-sup-3402@entry>
2123
2124 Reformatted excerpts from Jon Dugan's message of 2009-04-22:
2125 > Most services on Plan 9 are implemented as synthetic file systems.
2126 > The synthetic filesystem that represents email on Plan 9 is known as
2127 > upas. upas provides a filesytem view of mail boxes regardless of
2128 > their backend storage medium (eg, POP, IMAP, etc) which provides a
2129 > nice clean separation between the code that you use to do useful
2130 > things to your mail and the code that deals with the mail store
2131 > itself.
2132
2133 Very interesting and that's a great abstraction. Definitely lots of
2134 overlap with STS. I suspect the primary differences will be that STS
2135 uses fielded, full-text search as its primary access mechanism, and
2136 there's no notion of any kind of filesystem-like mailbox or directory
2137 hierarchy.
2138 --
2139 William <wmorgan-sup at masanjin.net>
2140
2141 From andrew@pimlott.net Thu Apr 23 13:53:36 2009
2142 From: andrew@pimlott.net (Andrew Pimlott)
2143 Date: Thu, 23 Apr 2009 10:53:36 -0700
2144 Subject: [sup-talk] mime-view hook
2145 In-Reply-To: <1240448213-sup-1757@junction.es.net>
2146 References: <1240448213-sup-1757@junction.es.net>
2147 Message-ID: <20090423175336.GX11701@pimlott.net>
2148
2149 On Wed, Apr 22, 2009 at 06:11:40PM -0700, Jon Dugan wrote:
2150 > dumbplumbd listens on port 9937 on your local system for requests. dumbplumb
2151 > sends requests to dumbplumbd. ssh port forwarding is used to proxy the two
2152 > together, eg:
2153 >
2154 > ssh -R 9937:localhost:9937 remotehost
2155
2156 You probably realize this, but... A well-known port doesn't work for
2157 this, because you need one plumber per display session. So the SSH
2158 forwarding needs to use the right plumber on this end and establish a
2159 corresponding session on the other end.
2160
2161 The obvious model for this is SSH agent forwarding. You'd have a
2162 PLUMBER_SOCK variable containing the path to a unix socket, and ssh
2163 would create a unix socket on the other end, forward it there, and set a
2164 new PLUMBER_SOCK variable. The obstacle is, the SSH developers haven't
2165 shown any interest in making the SSH agent forward mechanism availble to
2166 others. See for example
2167
2168 http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=294148
2169
2170 If you don't do this, you'll have plumbers stepping on each other, or
2171 you'll have to manage ports manually.
2172
2173 Andrew
2174
2175 From jdugan@es.net Thu Apr 23 14:14:48 2009
2176 From: jdugan@es.net (Jon Dugan)
2177 Date: Thu, 23 Apr 2009 11:14:48 -0700
2178 Subject: [sup-talk] mime-view hook
2179 In-Reply-To: <20090423175336.GX11701@pimlott.net>
2180 References: <1240448213-sup-1757@junction.es.net>
2181 <20090423175336.GX11701@pimlott.net>
2182 Message-ID: <1240509574-sup-3576@junction.es.net>
2183
2184 Excerpts from Andrew Pimlott's message of Thu Apr 23 10:53:36 -0700 2009:
2185 > On Wed, Apr 22, 2009 at 06:11:40PM -0700, Jon Dugan wrote:
2186 > > dumbplumbd listens on port 9937 on your local system for requests. dumbplumb
2187 > > sends requests to dumbplumbd. ssh port forwarding is used to proxy the two
2188 > > together, eg:
2189 > >
2190 > > ssh -R 9937:localhost:9937 remotehost
2191 >
2192 > You probably realize this, but... A well-known port doesn't work for
2193 > this, because you need one plumber per display session. So the SSH
2194 > forwarding needs to use the right plumber on this end and establish a
2195 > corresponding session on the other end.
2196
2197 That is definitely and issue and I should probably add that to the README.
2198 However in practice it doesn't seem to be a problem for me, I only forward the
2199 port for the first connection to my sup box. When I leave a display I log out
2200 of the sup box thus freeing the well known port for the next display I sit at.
2201 (Or if I forget I can log in and kill that ssh process by hand.) However, this
2202 whole fiasco is part of the reason I call it dumb.
2203
2204 There is also a significant security issue which is anyone on the sup box can
2205 send a dumbplumb request if they know what port to talk to. In my case this
2206 is a fairly minor risk as I am the only person who uses my sup box. This too
2207 is part of the reason I call it dumb.
2208
2209 > The obvious model for this is SSH agent forwarding. You'd have a
2210 > PLUMBER_SOCK variable containing the path to a unix socket, and ssh
2211 > would create a unix socket on the other end, forward it there, and set a
2212 > new PLUMBER_SOCK variable. The obstacle is, the SSH developers haven't
2213 > shown any interest in making the SSH agent forward mechanism availble to
2214 > others. See for example
2215 >
2216 > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=294148
2217 >
2218 > If you don't do this, you'll have plumbers stepping on each other, or
2219 > you'll have to manage ports manually.
2220
2221 I've wanted this kind of forwarding for a long, long time. I was unaware of
2222 the patch listed there. I'll have to take a look. This would be especially
2223 cool if it was forwardable like the agent socket, since sometimes I have to
2224 ssh through intermediate boxes. (But see my ssh-gw script for a cute trick
2225 for getting around this: http://bitbucket.org/jdugan/ssh-gw/).
2226
2227 The unix socket forwarding would make the whole thing much, much cleaner.
2228
2229 One hack to work around the port collision problem is to enable environment
2230 variable forwarding (see SendEnv in ssh_config(5)) and use that to dynamically
2231 choose a port per session. This could be used to forward unix domain sockets
2232 by combining this with something like socat. This, however, starts to become
2233 a huge tangle of duct tape and bailing wire... Also SendEnv has some security
2234 implications.
2235
2236 In short I'd love something less dumb, but for now this scratches an itch.
2237
2238 Jon
2239 --
2240 Jon M. Dugan <jdugan at es.net> | GTalk: jdugan.esnet
2241 ESnet Network Engineering Group | http://www.es.net/
2242 Lawrence Berkeley National Laboratory | http://www.lbl.gov/
2243
2244 From andrew@pimlott.net Thu Apr 23 18:59:13 2009
2245 From: andrew@pimlott.net (Andrew Pimlott)
2246 Date: Thu, 23 Apr 2009 15:59:13 -0700
2247 Subject: [sup-talk] mime-view hook
2248 In-Reply-To: <1240509574-sup-3576@junction.es.net>
2249 References: <1240448213-sup-1757@junction.es.net>
2250 <20090423175336.GX11701@pimlott.net>
2251 <1240509574-sup-3576@junction.es.net>
2252 Message-ID: <20090423225913.GY11701@pimlott.net>
2253
2254 On Thu, Apr 23, 2009 at 11:14:48AM -0700, Jon Dugan wrote:
2255 > I've wanted this kind of forwarding for a long, long time. I was unaware of
2256 > the patch listed there. I'll have to take a look. This would be especially
2257 > cool if it was forwardable like the agent socket, since sometimes I have to
2258 > ssh through intermediate boxes. (But see my ssh-gw script for a cute trick
2259 > for getting around this: http://bitbucket.org/jdugan/ssh-gw/).
2260 >
2261 > The unix socket forwarding would make the whole thing much, much cleaner.
2262
2263 It's sad that this hasn't been picked up. I looked into it a while
2264 back, and I can't remember exactly what the impediment is. It would be
2265 an extension to the SecSH protocol, and nobody on the ssh side seems to
2266 get the need for it (baffling to me, given ssh-agent). Even the code
2267 that exists (AFAICT) only connects explicitly-named ports on either end.
2268
2269 > One hack to work around the port collision problem is to enable environment
2270 > variable forwarding (see SendEnv in ssh_config(5)) and use that to dynamically
2271 > choose a port per session.
2272
2273 Even then, you're manually managing the ports: You have to assign a
2274 port number to every session you use; if others use the same machines
2275 (which is unthinkable in the first place for lack of access control),
2276 everyone's numbers have to be unique. That's just dumb--but you know
2277 that. :-)
2278
2279 > In short I'd love something less dumb, but for now this scratches an itch.
2280
2281 Credit to you for writing it. As soon as I saw it, I knew the plumber
2282 was the right thing, but when I ran into the forwarding problem, I gave
2283 up. I'm glad you didn't!
2284
2285 Andrew
2286
2287 From ezyang@MIT.EDU Sat Apr 25 20:47:23 2009
2288 From: ezyang@MIT.EDU (Edward Z. Yang)
2289 Date: Sat, 25 Apr 2009 20:47:23 -0400
2290 Subject: [sup-talk] Exception
2291 Message-ID: <1240706801-sup-2126@javelin>
2292
2293 Hello,
2294
2295 sup gets an uncaught exception if you x out a buffer window while it is
2296 loading messages:
2297
2298 ----------------------------------------------------------------
2299 I'm very sorry. It seems that an error occurred in Sup. Please
2300 accept my sincere apologies. If you don't mind, please send the
2301 contents of ~/.sup/exception-log.txt and a brief report of the
2302 circumstances to sup-talk at rubyforge dot orgs so that I might
2303 address this problem. Thank you!
2304
2305 Sincerely,
2306 William
2307 ----------------------------------------------------------------
2308 --- ArgumentError from thread: load messages for thread-view-mode
2309 buffer not on stack: #<Redwood::Buffer:0xb6586518>: "New message in forum"
2310 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/buffer.rb:395:in `kill_buffer'
2311 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/buffer.rb:386:in `kill_buffer_safely'
2312 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/util.rb:499:in `send'
2313 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/util.rb:499:in `method_missing'
2314 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-view-mode.rb:452:in `dispatch'
2315 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-index-mode.rb:114:in `call'
2316 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-index-mode.rb:114:in `select'
2317 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup.rb:85:in `reporting_thread'
2318 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup.rb:83:in `initialize'
2319 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup.rb:83:in `new'
2320 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup.rb:83:in `reporting_thread'
2321 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-index-mode.rb:94:in `select'
2322 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-index-mode.rb:144:in `launch_another_thread'
2323 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-index-mode.rb:126:in `launch_next_thread_after'
2324 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-view-mode.rb:457:in `dispatch'
2325 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-view-mode.rb:429:in `delete_and_then'
2326 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/modes/thread-view-mode.rb:404:in `delete_and_next'
2327 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/mode.rb:49:in `send'
2328 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/mode.rb:49:in `handle_input'
2329 /usr/lib/ruby/gems/1.8/gems/sup-0.7/lib/sup/buffer.rb:240:in `handle_input'
2330 /usr/lib/ruby/gems/1.8/gems/sup-0.7/bin/sup:207
2331 /var/lib/gems/1.8/bin/sup:19:in `load'
2332 /var/lib/gems/1.8/bin/sup:19
2333
2334 Cheers,
2335 Edward
2336
2337 From wmorgan-sup@masanjin.net Sun Apr 26 20:07:36 2009
2338 From: wmorgan-sup@masanjin.net (William Morgan)
2339 Date: Sun, 26 Apr 2009 17:07:36 -0700
2340 Subject: [sup-talk] message add speedup
2341 Message-ID: <1240790767-sup-9896@entry>
2342
2343 I've merged a branch 'scanning-speedup' into next that doubles the speed
2344 of adding messages to the index. There was a lot of time wasted in
2345 parsing the email headers, which I fixed, and I tweaked a couple other
2346 things. Various other operations that load data from the message source,
2347 like viewing a message thread, should now be slightly faster.
2348
2349 I'm able to index around 70 messages/s on my home computer, which is
2350 still slow, but hey, twice as fast as 35. Time is split about 50/50
2351 between scanning/parsing and Ferret index writing. Sadly, Ruby has a
2352 GIL, so I don't think threading these two operations will buy very much.
2353 (Though there might be complicated ways of getting around that.)
2354 --
2355 William <wmorgan-sup at masanjin.net>
2356
2357 From johnbent@lanl.gov Sun Apr 26 23:28:27 2009
2358 From: johnbent@lanl.gov (John Bent)
2359 Date: Sun, 26 Apr 2009 21:28:27 -0600
2360 Subject: [sup-talk] scary exception
2361 Message-ID: <1240802707-sup-2069@tangerine.lanl.gov>
2362
2363 On Friday, sup stopped loading and crashed with an exception, I also
2364 couldn't run sup-sync. At first I was a little scared, but then I
2365 remembered that sup doesn't actually modify mail data so that I could
2366 revert to pine, and then I got very, very scared.
2367
2368 I though I would have to do weird things at a ruby prompt but I just
2369 waited two days and now it works again. Somewhat strange since I tried
2370 about five times on Friday. Oh well, I'm running sup in screen so I'll
2371 just never quit again. :)
2372
2373 Here's the error message in case there's something obvious to someone
2374 else:
2375
2376 tangerine:~/mail>sup-sync
2377 [Fri Apr 24 16:43:10 -0600 2009] using character set encoding "US-ASCII"
2378 [Fri Apr 24 16:43:11 -0600 2009] crypto: no gpg binary detected
2379 [Fri Apr 24 16:43:11 -0600 2009] locking /Users/johnbent/.sup/lock...
2380 [Fri Apr 24 16:43:11 -0600 2009] loading index...
2381 [Fri Apr 24 16:43:11 -0600 2009] loaded index of 79908 messages
2382 Scanning mbox:/Users/johnbent/mail/mbox...
2383 [Fri Apr 24 16:43:11 -0600 2009] unlocking /Users/johnbent/.sup/lock...
2384 /opt/local/lib/ruby/gems/1.8/gems/ferret-0.11.6/lib/ferret/index.rb:768:in
2385 `search': IO Error occured at <except.c>:93 in xraise (IOError)
2386 Error occured in fs_store.c:284 - fsi_read_i
2387 couldn't read 1024 chars from : <Unknown error: 0>
2388
2389 from
2390 /opt/local/lib/ruby/gems/1.8/gems/ferret-0.11.6/lib/ferret/index.rb:768:in
2391 `do_search'
2392 from
2393 /opt/local/lib/ruby/gems/1.8/gems/ferret-0.11.6/lib/ferret/index.rb:339:in
2394 `search'
2395 from /opt/local/lib/ruby/1.8/monitor.rb:242:in `synchronize'
2396 from
2397 /opt/local/lib/ruby/gems/1.8/gems/ferret-0.11.6/lib/ferret/index.rb:338:in
2398 `search'
2399 from
2400 /opt/local/lib/ruby/gems/1.8/gems/sup-999/lib/sup/index.rb:422:in
2401 `load_entry_for_id'
2402 from /opt/local/lib/ruby/1.8/monitor.rb:242:in `synchronize'
2403 from
2404 /opt/local/lib/ruby/gems/1.8/gems/sup-999/lib/sup/index.rb:421:in
2405 `load_entry_for_id'
2406 from
2407 /opt/local/lib/ruby/gems/1.8/gems/sup-999/lib/sup/util.rb:499:in `send'
2408 ... 10 levels...
2409 from /opt/local/lib/ruby/gems/1.8/gems/sup-999/bin/sup-sync:131:in
2410 `each'
2411 from /opt/local/lib/ruby/gems/1.8/gems/sup-999/bin/sup-sync:131
2412 from /opt/local/bin/sup-sync:16:in `load'
2413 from /opt/local/bin/sup-sync:16
2414
2415
2416 Thanks,
2417
2418 JOHn
2419
2420 From wmorgan-sup@masanjin.net Mon Apr 27 13:25:19 2009
2421 From: wmorgan-sup@masanjin.net (William Morgan)
2422 Date: Mon, 27 Apr 2009 10:25:19 -0700
2423 Subject: [sup-talk] scary exception
2424 In-Reply-To: <1240802707-sup-2069@tangerine.lanl.gov>
2425 References: <1240802707-sup-2069@tangerine.lanl.gov>
2426 Message-ID: <1240852818-sup-1006@entry>
2427
2428 Hi John,
2429
2430 Reformatted excerpts from John Bent's message of 2009-04-26:
2431 > /opt/local/lib/ruby/gems/1.8/gems/ferret-0.11.6/lib/ferret/index.rb:768:in
2432 > `search': IO Error occured at <except.c>:93 in xraise (IOError)
2433 > Error occured in fs_store.c:284 - fsi_read_i
2434 > couldn't read 1024 chars from : <Unknown error: 0>
2435
2436 It appears that you're running off a gem generated directly from the git
2437 repo. How recently did you do that? This Ferret error is something I
2438 though we had kicked quite a while ago, so if you are running from a
2439 recent git, I'll be worried.
2440 --
2441 William <wmorgan-sup at masanjin.net>
2442
2443 From johnbent@lanl.gov Mon Apr 27 13:34:54 2009
2444 From: johnbent@lanl.gov (John Bent)
2445 Date: Mon, 27 Apr 2009 11:34:54 -0600
2446 Subject: [sup-talk] scary exception
2447 In-Reply-To: <1240852818-sup-1006@entry>
2448 References: <1240802707-sup-2069@tangerine.lanl.gov>
2449 <1240852818-sup-1006@entry>
2450 Message-ID: <1240853542-sup-4778@tangerine.lanl.gov>
2451
2452 Excerpts from William Morgan's message of Mon Apr 27 11:25:19 -0600 2009:
2453 > Hi John,
2454 >
2455 > Reformatted excerpts from John Bent's message of 2009-04-26:
2456 > > /opt/local/lib/ruby/gems/1.8/gems/ferret-0.11.6/lib/ferret/index.rb:768:in
2457 > > `search': IO Error occured at <except.c>:93 in xraise (IOError)
2458 > > Error occured in fs_store.c:284 - fsi_read_i
2459 > > couldn't read 1024 chars from : <Unknown error: 0>
2460 >
2461 > It appears that you're running off a gem generated directly from the git
2462 > repo. How recently did you do that? This Ferret error is something I
2463 > though we had kicked quite a while ago, so if you are running from a
2464 > recent git, I'll be worried.
2465 >
2466 I'm sorry. I don't remember. The timestamp on my sup executable says
2467 Jan 13 2009. I'll try to upgrade and see if I ever see this again.
2468
2469 John
2470
2471 From wmorgan-sup@masanjin.net Mon Apr 27 13:46:43 2009
2472 From: wmorgan-sup@masanjin.net (William Morgan)
2473 Date: Mon, 27 Apr 2009 10:46:43 -0700
2474 Subject: [sup-talk] scary exception
2475 In-Reply-To: <1240853542-sup-4778@tangerine.lanl.gov>
2476 References: <1240802707-sup-2069@tangerine.lanl.gov>
2477 <1240852818-sup-1006@entry>
2478 <1240853542-sup-4778@tangerine.lanl.gov>
2479 Message-ID: <1240854270-sup-8870@entry>
2480
2481 Reformatted excerpts from John Bent's message of 2009-04-27:
2482 > I'm sorry. I don't remember. The timestamp on my sup executable says
2483 > Jan 13 2009. I'll try to upgrade and see if I ever see this again.
2484
2485 Yeah, I think it was around March that things got merged in. Try it with
2486 the latest & greatest and see if it happens again.
2487 --
2488 William <wmorgan-sup at masanjin.net>
2489
2490 From wmorgan-sup@masanjin.net Mon Apr 27 14:18:27 2009
2491 From: wmorgan-sup@masanjin.net (William Morgan)
2492 Date: Mon, 27 Apr 2009 11:18:27 -0700
2493 Subject: [sup-talk] IMAP folder/label integration and playing better
2494 with changed sources?
2495 In-Reply-To: <0c334e4c-0480-4def-b64a-b4996431f5c9@x3g2000yqa.googlegroups.com>
2496 References: <0c334e4c-0480-4def-b64a-b4996431f5c9@x3g2000yqa.googlegroups.com>
2497 Message-ID: <1240856180-sup-6270@entry>
2498
2499 Reformatted excerpts from Saku Ytti's message of 2009-04-22:
2500 > Problem for me is, I want to use also mobile phone email client and
2501 > webmail, so I'm kinda stuck with mutt. Is it likely that this could be
2502 > addressed in future?
2503
2504 One thing I'd like to do with Sup the Service would be to provide an
2505 IMAP server interface to it. Then you could use with standard IMAP
2506 clients. But that's probably a ways off.
2507
2508 > And for the actual subject related matter, could it be possible to
2509 > store labels as folders optionally? This would play along really well
2510 > for those who use gmail, as you would essentially get synchronised
2511 > labeling between sup and webclient.
2512
2513 Sounds like a good idea but a lot of work...
2514 --
2515 William <wmorgan-sup at masanjin.net>
2516
2517 From nicolas.pouillard@gmail.com Mon Apr 27 15:47:00 2009
2518 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
2519 Date: Mon, 27 Apr 2009 21:47:00 +0200
2520 Subject: [sup-talk] redo ideas
2521 In-Reply-To: <200904271244.n3RCi1VO027803@smtp6.server.rpi.edu>
2522 References: <200904271244.n3RCi1VO027803@smtp6.server.rpi.edu>
2523 Message-ID: <1240861270-sup-8603@ausone.local>
2524
2525 Excerpts from Mike S's message of Mon Apr 27 14:43:46 +0200 2009:
2526 > I'm graduating in a few weeks, so I'll have some free time I can dedicate
2527 > to sup again.
2528 >
2529 > Recently redo functionality was suggested, I believe this was meant to be
2530 > a solution for something, but I have been thinking about it for a while.
2531 > I'd like to register Ctrl-R to keep with the vim bindings.
2532
2533 Just some thoughts about this... I was more thinking about the repeat feature
2534 of Vi/Vim (the '.' command) than the redo one.
2535
2536 Two other ways of doing the undo/redo:
2537
2538 1/ Save the actions using a data type that we can inverse.
2539 Example in Ruby syntax
2540 a = Action.add_labels(:foo, :bar)
2541 a.apply # actually do the job
2542 a.invert # equals to Action.remove_labels(:foo, :bar)
2543
2544 2/ Save the state (has to be defined) at each action.
2545 This solution would be limited to actions where the state is manageable.
2546
2547 Best regards,
2548
2549 --
2550 Nicolas Pouillard
2551
2552 From helgedt@tihlde.org Mon Apr 27 16:00:44 2009
2553 From: helgedt@tihlde.org (Helge Titlestad)
2554 Date: Mon, 27 Apr 2009 22:00:44 +0200
2555 Subject: [sup-talk] UTF-8 message sending patch
2556 Message-ID: <1240861799-sup-787@colargol.tihlde.org>
2557
2558 Hi,
2559 I just installed sup and noticed that it didn't play extremely well
2560 with utf-8 out of the box.
2561
2562 http://sup.rubyforge.org/wiki/wiki.pl?UTF8 together with the String
2563 hack from http://www.nabble.com/UTF-8-woes-td21598658.html#a21598658
2564 fixed the viewing parts (I think), but it's still unacceptable to
2565 send raw utf-8 in email headers.
2566
2567 So I fixed it with another little hack (to edit-message-mode.rb),
2568 which sets Content-Transfer-Encoding to 8-bit and more importantly
2569 tries to convert any utf-8 headers to quoted printable.
2570
2571 I think the patch (attached) fixes my problems, but it's probably far
2572 from complete. It doesn't detect non-utf8-but-still-illegal-strings,
2573 it assumes every header except Subject is an address, and so on.
2574
2575 Any feedback is welcome. (:
2576 --
2577 alge
2578 -------------- next part --------------
2579 A non-text attachment was scrubbed...
2580 Name: sup-utf8-message-sending.patch
2581 Type: application/octet-stream
2582 Size: 1904 bytes
2583 Desc: not available
2584 URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090427/6cae2b53/attachment.obj>
2585
2586 From mailinglist@flasht.de Tue Apr 28 13:49:04 2009
2587 From: mailinglist@flasht.de (Christopher Bertels)
2588 Date: Tue, 28 Apr 2009 19:49:04 +0200
2589 Subject: [sup-talk] New to Sup and some imap sync questions
2590 Message-ID: <1240940037-sup-2915@bakkdoor-ubuntu>
2591
2592 Hi!
2593 I'm new to using Sup and I really like it.
2594 I know that it works a little different than most mail clients I've used before.
2595 I'be been using Thunderbird but I#ve always missed a way to view my mails in one big inbox with multiple accounts.
2596 Fortunately, Sup does this just the way I want it to. And since I like Ruby as well, it's definately another plus to be able to customize it with Ruby.
2597 I do have one question though:
2598 Are there any plans on making it sync changes back to the imap server somehow? I'm used to having different mail clients on different machines dealing with
2599 the same accounts on several imap servers. I'm so used to having all the changes happening on the server itself, that it's something I'm really missing with Sup.
2600 Just wondering if this is ever planned? Since now, even if I have Sup installed on my different machines, I still need to sync all the settings when I change something (e.g. adding a hook-script or something else). Or is there an easy way to sync my Sup settings etc?
2601 I'm new to it, but it seems very promising...
2602
2603 Thanks for any help and keep up the good work!
2604
2605 Christopher.
2606
2607 From sgoldman@tower-research.com Tue Apr 28 15:19:26 2009
2608 From: sgoldman@tower-research.com (Steve Goldman)
2609 Date: Tue, 28 Apr 2009 15:19:26 -0400
2610 Subject: [sup-talk] Inconsistent inbox after restart
2611 Message-ID: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2612
2613 This only started happening after I upgraded to the latest version...
2614
2615 Oftentimes when I quit sup and then restart, my inbox looks different.
2616 Messages that I had previously archived are back in the inbox. Has
2617 anyone else seen this? I'm losing sleep over it.
2618
2619 Thanks.
2620 --
2621
2622 Steve Goldman
2623 sgoldman at tower-research.com
2624
2625 T: 212.219.6014
2626 F: 212.219.6007
2627
2628 Tower Research Capital, LLC
2629 377 Broadway, 11th Fl.
2630 New York, NY 10013
2631
2632 From marka@pobox.com Tue Apr 28 19:29:46 2009
2633 From: marka@pobox.com (Mark Alexander)
2634 Date: Tue, 28 Apr 2009 19:29:46 -0400
2635 Subject: [sup-talk] Possible problem with maildir ID generation
2636 In-Reply-To: <20090428191822.GB10581@cabinet.hsd1.ma.comcast.net>
2637 References: <a412e2a70904161505l3e1fdfc9l987013130b3f5ddd@mail.gmail.com>
2638 <1240320547-sup-6957@entry>
2639 <20090428191822.GB10581@cabinet.hsd1.ma.comcast.net>
2640 Message-ID: <a412e2a70904281629n6171bbb6i4c6330e375f8c6ad@mail.gmail.com>
2641
2642 On Tue, Apr 28, 2009 at 3:18 PM, Marc Hartstein
2643 <marc.hartstein at alum.vassar.edu> wrote:
2644 > Isn't part of the maildir scheme that the filenames are guaranteed to be
2645 > unique? ?It's been a while since I looked at this part of the sup
2646 > source, but would it be possible to simply use the filename as the ID
2647 > when working with maildir, rather than generating a new ID? ?Or is there
2648 > an additional constraint (like ordering?) that needs to be satisfied and
2649 > isn't by maildir?
2650
2651 Maildir filenames are unique, but they would need to be ordered
2652 by time, since sup depends on that ordering (look in maildir.rb for
2653 where it uses sort). I'm not sure if mail delivery programs
2654 (I use procmail) guarantee that the filenames are ordered that way.
2655
2656 I will say that the patch I sent out for maildir.rb has made
2657 my life a lot happier, but it's still not ideal because of
2658 the race condition I mentioned.
2659
2660 William was talking about using some other scheme to generate IDs.
2661 We should see what he has to say about this.
2662
2663 From nicolas.pouillard@gmail.com Wed Apr 29 04:40:13 2009
2664 From: nicolas.pouillard@gmail.com (Nicolas Pouillard)
2665 Date: Wed, 29 Apr 2009 10:40:13 +0200
2666 Subject: [sup-talk] Inconsistent inbox after restart
2667 In-Reply-To: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2668 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2669 Message-ID: <1240994294-sup-8386@ausone.inria.fr>
2670
2671 Excerpts from Steve Goldman's message of Tue Apr 28 21:19:26 +0200 2009:
2672 > This only started happening after I upgraded to the latest version...
2673 >
2674 > Oftentimes when I quit sup and then restart, my inbox looks different.
2675 > Messages that I had previously archived are back in the inbox. Has
2676 > anyone else seen this? I'm losing sleep over it.
2677
2678 From time to time I also encounter this issue: previously archived emails
2679 come back to the inbox.
2680
2681 --
2682 Nicolas Pouillard
2683
2684 From tyberius_prime@coonabibba.de Wed Apr 29 04:37:08 2009
2685 From: tyberius_prime@coonabibba.de (Tyberius Prime)
2686 Date: Wed, 29 Apr 2009 10:37:08 +0200
2687 Subject: [sup-talk] Inconsistent inbox after restart
2688 In-Reply-To: <1240994294-sup-8386@ausone.inria.fr>
2689 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2690 <1240994294-sup-8386@ausone.inria.fr>
2691 Message-ID: <1240994200-sup-9656@h984274.serverkompetenz.net>
2692
2693 I should add, the read status is being kept for me.
2694
2695 Excerpts from Nicolas Pouillard's message of Wed Apr 29 10:40:13 +0200 2009:
2696 > Excerpts from Steve Goldman's message of Tue Apr 28 21:19:26 +0200 2009:
2697 > > This only started happening after I upgraded to the latest version...
2698 > >
2699 > > Oftentimes when I quit sup and then restart, my inbox looks different.
2700 > > Messages that I had previously archived are back in the inbox. Has
2701 > > anyone else seen this? I'm losing sleep over it.
2702 >
2703 > From time to time I also encounter this issue: previously archived emails
2704 > come back to the inbox.
2705 >
2706
2707 From tyberius_prime@coonabibba.de Wed Apr 29 04:17:23 2009
2708 From: tyberius_prime@coonabibba.de (Tyberius Prime)
2709 Date: Wed, 29 Apr 2009 10:17:23 +0200
2710 Subject: [sup-talk] Inconsistent inbox after restart
2711 In-Reply-To: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2712 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2713 Message-ID: <1240992967-sup-2852@h984274.serverkompetenz.net>
2714
2715 Hi,
2716
2717 yes, I see the same,
2718 haven't dug into it so far either, simply never restart sup
2719 if I can avoid it... (yeah, great conflict strategy, but
2720 life's short).
2721
2722 So long,
2723 Tyberius Prime
2724
2725
2726 Excerpts from Steve Goldman's message of Tue Apr 28 21:19:26 +0200 2009:
2727 > This only started happening after I upgraded to the latest version...
2728 >
2729 > Oftentimes when I quit sup and then restart, my inbox looks different.
2730 > Messages that I had previously archived are back in the inbox. Has
2731 > anyone else seen this? I'm losing sleep over it.
2732 >
2733 > Thanks.
2734 > --
2735 >
2736 > Steve Goldman
2737 > sgoldman at tower-research.com
2738 >
2739 > T: 212.219.6014
2740 > F: 212.219.6007
2741 >
2742 > Tower Research Capital, LLC
2743 > 377 Broadway, 11th Fl.
2744 > New York, NY 10013
2745
2746 From ezyang@MIT.EDU Wed Apr 29 13:04:40 2009
2747 From: ezyang@MIT.EDU (Edward Z. Yang)
2748 Date: Wed, 29 Apr 2009 13:04:40 -0400
2749 Subject: [sup-talk] New to Sup and some imap sync questions
2750 In-Reply-To: <1240940037-sup-2915@bakkdoor-ubuntu>
2751 References: <1240940037-sup-2915@bakkdoor-ubuntu>
2752 Message-ID: <1241024581-sup-9014@javelin>
2753
2754 Excerpts from Christopher Bertels's message of Tue Apr 28 13:49:04 -0400 2009:
2755 > Just wondering if this is ever planned? Since now, even if I have Sup installed
2756 > on my different machines, I still need to sync all the settings when I change
2757 > something (e.g. adding a hook-script or something else). Or is there an easy
2758 > way to sync my Sup settings etc?
2759
2760 Hello Christopher,
2761
2762 My current understanding is that William is not interested in mucking around
2763 with IMAP any more than he has to, so unless someone steps up and submits
2764 some patches there will not be syncing back to IMAP.
2765
2766 As for handling Sup on multiple machines, I think the current best practice
2767 is "don't"; pick one machine, make it ssh'able into, and use that to handle
2768 all of your mail.
2769
2770 Cheers,
2771 Edward
2772
2773 From wmorgan-sup@masanjin.net Wed Apr 29 14:02:06 2009
2774 From: wmorgan-sup@masanjin.net (William Morgan)
2775 Date: Wed, 29 Apr 2009 11:02:06 -0700
2776 Subject: [sup-talk] possible mbox "initial From" fix
2777 Message-ID: <1241027916-sup-7642@entry>
2778
2779 After a lot of toying with RubyMail, hoping I could get it to behave
2780 well, I finally gave up and just tweaked the regexp that determines
2781 whether a line is an mbox separator or not, and bypassed RubyMail mbox
2782 splitting entirely. It might still be too lenient---I have it looking
2783 for /^From \S+@\S+ /, so it's not even bothering to parse a date, etc.
2784 I'm hoping to strike somewhat of a balance between strict and liberal.
2785
2786 So, please try it out and see if it solves your mbox problems.
2787 --
2788 William <wmorgan-sup at masanjin.net>
2789
2790 From wmorgan-sup@masanjin.net Wed Apr 29 14:09:16 2009
2791 From: wmorgan-sup@masanjin.net (William Morgan)
2792 Date: Wed, 29 Apr 2009 11:09:16 -0700
2793 Subject: [sup-talk] New to Sup and some imap sync questions
2794 In-Reply-To: <1241024581-sup-9014@javelin>
2795 References: <1240940037-sup-2915@bakkdoor-ubuntu> <1241024581-sup-9014@javelin>
2796 Message-ID: <1241028139-sup-8070@entry>
2797
2798 Reformatted excerpts from Edward Z. Yang's message of 2009-04-29:
2799 > My current understanding is that William is not interested in mucking
2800 > around with IMAP any more than he has to, so unless someone steps up
2801 > and submits some patches there will not be syncing back to IMAP.
2802
2803 That's pretty much the case, but I hope it's ameliorated by the fact
2804 that I do plan to get sup-sync-back working with Maildir ("any day
2805 now"), and then you can use offlineimap to really sync between IMAP and
2806 Sup.
2807
2808 > As for handling Sup on multiple machines, I think the current best
2809 > practice is "don't"; pick one machine, make it ssh'able into, and use
2810 > that to handle all of your mail.
2811
2812 Correct.
2813
2814 Recently I've been thinking about the possibility of storing one's
2815 mbox/Maildir in git, syncing it between machines (Maildir would probably
2816 work best for this, as mbox will generate spurious conflicts when
2817 deleting+adding), and maintaining the Ferret index locally on each
2818 machine. If we add a notion of an outbound message queue to Sup (i.e.
2819 each machine knows whether it has the ability to send mail or not), and
2820 also synchronize that and the drafts and sent folders between machines,
2821 you could use Sup for completely offline, distributed email. Crazy?
2822 --
2823 William <wmorgan-sup at masanjin.net>
2824
2825 From wmorgan-sup@masanjin.net Wed Apr 29 14:10:53 2009
2826 From: wmorgan-sup@masanjin.net (William Morgan)
2827 Date: Wed, 29 Apr 2009 11:10:53 -0700
2828 Subject: [sup-talk] Inconsistent inbox after restart
2829 In-Reply-To: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2830 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
2831 Message-ID: <1241028590-sup-8155@entry>
2832
2833 Reformatted excerpts from Steve Goldman's message of 2009-04-28:
2834 > Oftentimes when I quit sup and then restart, my inbox looks different.
2835 > Messages that I had previously archived are back in the inbox. Has
2836 > anyone else seen this? I'm losing sleep over it.
2837
2838 I see it periodically too (I think I also see read messages turned
2839 unread again) and have been trying to find a pattern---is it email
2840 that's autosaved when I quit Sup, etc.?
2841 --
2842 William <wmorgan-sup at masanjin.net>
2843
2844 From wmorgan-sup@masanjin.net Wed Apr 29 14:22:41 2009
2845 From: wmorgan-sup@masanjin.net (William Morgan)
2846 Date: Wed, 29 Apr 2009 11:22:41 -0700
2847 Subject: [sup-talk] redo ideas
2848 In-Reply-To: <200904271244.n3RCi1VO027803@smtp6.server.rpi.edu>
2849 References: <200904271244.n3RCi1VO027803@smtp6.server.rpi.edu>
2850 Message-ID: <1241028879-sup-6375@entry>
2851
2852 Reformatted excerpts from Mike S's message of 2009-04-27:
2853 > I'm graduating in a few weeks, so I'll have some free time I can
2854 > dedicate to sup again.
2855
2856 Congrats! Great!
2857
2858 > I'd like to register Ctrl-R to keep with the vim bindings.
2859
2860 Sure.
2861
2862 > Ugly method 2: write code in duplicate, register a redo and call redo
2863 > This saves duplication of code, but it seems unnecessarily complex.
2864 >
2865 > * create undo lambda
2866 > * create redo lambda
2867 > * register undo and redo, but 'queue up' redo
2868 > * UndoManager.redo
2869
2870 Redo is actually a slightly different operation from do. Do has to ask
2871 for user input (what label do you want to apply?), redo just reuses it.
2872 Maybe that's not such a big deal though; do/redo can just check to see
2873 if it already has the value from the user, and ask if not.
2874
2875 > Slightly clever method: have primitives return their own undo/redo.
2876 > This can be seen in toggle_starred where actually_toggle_starred
2877 > returns its inverse. This shifts the complexity down and keeps higher
2878 > level code clean.
2879
2880 That sounds eminently reasonable to me.
2881 --
2882 William <wmorgan-sup at masanjin.net>
2883
2884 From ezyang@MIT.EDU Wed Apr 29 14:38:13 2009
2885 From: ezyang@MIT.EDU (Edward Z. Yang)
2886 Date: Wed, 29 Apr 2009 14:38:13 -0400
2887 Subject: [sup-talk] New to Sup and some imap sync questions
2888 In-Reply-To: <1241028139-sup-8070@entry>
2889 References: <1240940037-sup-2915@bakkdoor-ubuntu>
2890 <1241024581-sup-9014@javelin> <1241028139-sup-8070@entry>
2891 Message-ID: <1241030207-sup-8690@javelin>
2892
2893 Excerpts from William Morgan's message of Wed Apr 29 14:09:16 -0400 2009:
2894 > Recently I've been thinking about the possibility of storing one's
2895 > mbox/Maildir in git, syncing it between machines (Maildir would probably
2896 > work best for this, as mbox will generate spurious conflicts when
2897 > deleting+adding), and maintaining the Ferret index locally on each
2898 > machine. If we add a notion of an outbound message queue to Sup (i.e.
2899 > each machine knows whether it has the ability to send mail or not), and
2900 > also synchronize that and the drafts and sent folders between machines,
2901 > you could use Sup for completely offline, distributed email. Crazy?
2902
2903 I was under the impression that the interesting stuff (e.g. tags) was
2904 stored in the index, so you would have to sync that too?
2905
2906 Cheers,
2907 Edward
2908
2909 From wmorgan-sup@masanjin.net Wed Apr 29 16:16:30 2009
2910 From: wmorgan-sup@masanjin.net (William Morgan)
2911 Date: Wed, 29 Apr 2009 13:16:30 -0700
2912 Subject: [sup-talk] New to Sup and some imap sync questions
2913 In-Reply-To: <1241030207-sup-8690@javelin>
2914 References: <1240940037-sup-2915@bakkdoor-ubuntu>
2915 <1241024581-sup-9014@javelin> <1241028139-sup-8070@entry>
2916 <1241030207-sup-8690@javelin>
2917 Message-ID: <1241036141-sup-3541@entry>
2918
2919 Reformatted excerpts from Edward Z. Yang's message of 2009-04-29:
2920 > I was under the impression that the interesting stuff (e.g. tags) was
2921 > stored in the index, so you would have to sync that too?
2922
2923 That would have to be update to include all new messages every time you
2924 synced. And the flags would have to be synced too. Not a trivial
2925 undertaking, but within the realm of possibility.
2926 --
2927 William <wmorgan-sup at masanjin.net>
2928
2929 From mailinglist@flasht.de Wed Apr 29 16:48:35 2009
2930 From: mailinglist@flasht.de (Christopher Bertels)
2931 Date: Wed, 29 Apr 2009 22:48:35 +0200
2932 Subject: [sup-talk] New to Sup and some imap sync questions
2933 In-Reply-To: <1241028139-sup-8070@entry>
2934 References: <1240940037-sup-2915@bakkdoor-ubuntu>
2935 <1241024581-sup-9014@javelin> <1241028139-sup-8070@entry>
2936 Message-ID: <1241037842-sup-8569@bakkdoor-ubuntu>
2937
2938 Excerpts from William Morgan's message of Mi Apr 29 20:09:16 +0200 2009:
2939 > Recently I've been thinking about the possibility of storing one's
2940 > mbox/Maildir in git, syncing it between machines (Maildir would probably
2941 > work best for this, as mbox will generate spurious conflicts when
2942 > deleting+adding), and maintaining the Ferret index locally on each
2943 > machine. If we add a notion of an outbound message queue to Sup (i.e.
2944 > each machine knows whether it has the ability to send mail or not), and
2945 > also synchronize that and the drafts and sent folders between machines,
2946 > you could use Sup for completely offline, distributed email. Crazy?
2947
2948 Actually, that's something I've thought about as well. Seems kinda crazy, but since I don't switch between
2949 machines too often (mainly laptop & desktop machine - maybe switching once a day) this could be an optoin.
2950 Or I'll use my server and ssh into it to view my mail.
2951 Anyhow, I guess I'll stick with Sup - I just like it too much already ;)
2952
2953 Christopher.
2954
2955 From wmorgan-sup@masanjin.net Wed Apr 29 16:58:01 2009
2956 From: wmorgan-sup@masanjin.net (William Morgan)
2957 Date: Wed, 29 Apr 2009 13:58:01 -0700
2958 Subject: [sup-talk] New to Sup and some imap sync questions
2959 In-Reply-To: <1241036141-sup-3541@entry>
2960 References: <1240940037-sup-2915@bakkdoor-ubuntu>
2961 <1241024581-sup-9014@javelin> <1241028139-sup-8070@entry>
2962 <1241030207-sup-8690@javelin> <1241036141-sup-3541@entry>
2963 Message-ID: <1241038425-sup-3748@entry>
2964
2965 Reformatted excerpts from William Morgan's message of 2009-04-29:
2966 > That would have to be update to include all new messages every time
2967 > you synced. And the flags would have to be synced too. Not a trivial
2968 > undertaking, but within the realm of possibility.
2969
2970 That wasn't very clear. Let me try again. The Ferret index (a scary
2971 binary thing) would not be synced. Individual sources would be synced,
2972 along with some version of the message flags (probably as a
2973 newline-separated text file, to allow conflict resolution (!)), and then
2974 the index would be updated on the local machine to reflect those
2975 changes.
2976
2977 Kinda tantamount to rsyncing your .sup directory and all your sources
2978 across different machines, but a little more refined.
2979 --
2980 William <wmorgan-sup at masanjin.net>
2981
2982 From wmorgan-sup@masanjin.net Wed Apr 29 18:31:52 2009
2983 From: wmorgan-sup@masanjin.net (William Morgan)
2984 Date: Wed, 29 Apr 2009 15:31:52 -0700
2985 Subject: [sup-talk] Possible problem with maildir ID generation
2986 In-Reply-To: <a412e2a70904281629n6171bbb6i4c6330e375f8c6ad@mail.gmail.com>
2987 References: <a412e2a70904161505l3e1fdfc9l987013130b3f5ddd@mail.gmail.com>
2988 <1240320547-sup-6957@entry>
2989 <20090428191822.GB10581@cabinet.hsd1.ma.comcast.net>
2990 <a412e2a70904281629n6171bbb6i4c6330e375f8c6ad@mail.gmail.com>
2991 Message-ID: <1241038730-sup-2939@entry>
2992
2993 Reformatted excerpts from Mark Alexander's message of 2009-04-28:
2994 > Maildir filenames are unique, but they would need to be ordered by
2995 > time, since sup depends on that ordering (look in maildir.rb for where
2996 > it uses sort). I'm not sure if mail delivery programs (I use
2997 > procmail) guarantee that the filenames are ordered that way.
2998
2999 That's correct; the name is not sufficient as ids because Sup needs a
3000 single pointer into the Maildir as a marker for what it has already
3001 processed, so we have to use something ordinal. But it can't just be
3002 any old ordinal, it has to be something that corresponds with the way
3003 messages are written to the Maildir, in order to be able to divide newer
3004 messages from older ones.
3005
3006 A timestamp is the obvious choice, but messages can have the same
3007 timestamp, so then what do you do? The current approach is to sort by
3008 another arbitrary field (in this cae, message size), which gives a
3009 unique ordering, but doesn't match up
3010
3011 (All this rigamarole about ordinals and blah blah blah is necessary
3012 because I don't want Sup to rescan the entire Maildir unless absolutely
3013 necessary. One day I'll convert my mbox to a Maildir with 250k files in
3014 it, and a rescan will kill me, especially at Ruby speed.)
3015
3016 > I will say that the patch I sent out for maildir.rb has made my life a
3017 > lot happier, but it's still not ideal because of the race condition I
3018 > mentioned.
3019 >
3020 > William was talking about using some other scheme to generate IDs. We
3021 > should see what he has to say about this.
3022
3023 Well I haven't quite started on it yet, but my plan is to:
3024
3025 a) Sort files by timestamp, and then by something else (maybe name), and
3026 use the position in that array instead of the timestamp. This doesn't
3027 solve anything, but it will make the ids prettier, and removes the
3028 hideous "%7d" thing.
3029 b) When polling, if the current "offset" is N, return all messages that
3030 have a timestamp >= the Nth message. So this will mean that we'll
3031 rescan messages on occasion, but we shouldn't miss any.
3032
3033 Any obvious flaws?
3034 --
3035 William <wmorgan-sup at masanjin.net>
3036
3037 From wmorgan-sup@masanjin.net Wed Apr 29 18:38:23 2009
3038 From: wmorgan-sup@masanjin.net (William Morgan)
3039 Date: Wed, 29 Apr 2009 15:38:23 -0700
3040 Subject: [sup-talk] UTF-8 message sending patch
3041 In-Reply-To: <1240861799-sup-787@colargol.tihlde.org>
3042 References: <1240861799-sup-787@colargol.tihlde.org>
3043 Message-ID: <1241044621-sup-9157@entry>
3044
3045 Reformatted excerpts from Helge Titlestad's message of 2009-04-27:
3046 > I think the patch (attached) fixes my problems, but it's probably far
3047 > from complete. It doesn't detect non-utf8-but-still-illegal-strings,
3048 > it assumes every header except Subject is an address, and so on.
3049
3050 Thanks! Good timing on this; it was near the top of my todo list.
3051 I will probably edit this a bit and merge it in as part of a bigger
3052 utf-8 fixing branch.
3053 --
3054 William <wmorgan-sup at masanjin.net>
3055
3056 From wmorgan-sup@masanjin.net Wed Apr 29 18:39:31 2009
3057 From: wmorgan-sup@masanjin.net (William Morgan)
3058 Date: Wed, 29 Apr 2009 15:39:31 -0700
3059 Subject: [sup-talk] Possible problem with maildir ID generation
3060 In-Reply-To: <1241038730-sup-2939@entry>
3061 References: <a412e2a70904161505l3e1fdfc9l987013130b3f5ddd@mail.gmail.com>
3062 <1240320547-sup-6957@entry>
3063 <20090428191822.GB10581@cabinet.hsd1.ma.comcast.net>
3064 <a412e2a70904281629n6171bbb6i4c6330e375f8c6ad@mail.gmail.com>
3065 <1241038730-sup-2939@entry>
3066 Message-ID: <1241044743-sup-2889@entry>
3067
3068 Reformatted excerpts from William Morgan's message of 2009-04-29:
3069 > A timestamp is the obvious choice, but messages can have the same
3070 > timestamp, so then what do you do? The current approach is to sort by
3071 > another arbitrary field (in this cae, message size), which gives a
3072 > unique ordering, but doesn't match up
3073
3074 Sigh.
3075
3076 Doesn't match up with that procmail, or whatever MUA, is giving us.
3077 --
3078 William <wmorgan-sup at masanjin.net>
3079
3080 From wmorgan-sup@masanjin.net Wed Apr 29 18:45:29 2009
3081 From: wmorgan-sup@masanjin.net (William Morgan)
3082 Date: Wed, 29 Apr 2009 15:45:29 -0700
3083 Subject: [sup-talk] Sup with Microsoft Exchange 2007
3084 In-Reply-To: <f96e0240904210737q71765989of31447a8de20fa62@mail.gmail.com>
3085 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
3086 <3f81a4240904201452u78abe68bj2a4b9863b850e8a@mail.gmail.com>
3087 <1240267632-sup-2023@r50p>
3088 <3f81a4240904201638v94a7dbdpce0d865cd83d8873@mail.gmail.com>
3089 <1240318807-sup-3080@entry>
3090 <3f81a4240904210642o9c74049o27e164e317d0842e@mail.gmail.com>
3091 <1240323082-sup-1515@entry>
3092 <3f81a4240904210729h74ac436bn9e1140cf7021c5ad@mail.gmail.com>
3093 <3f81a4240904210732k11366cf7naec562af54ecabac@mail.gmail.com>
3094 <f96e0240904210737q71765989of31447a8de20fa62@mail.gmail.com>
3095 Message-ID: <1241045035-sup-1534@entry>
3096
3097 Reformatted excerpts from Ben Walton's message of 2009-04-21:
3098 > William, what requirements would need to be met from your side to see
3099 > this added?
3100
3101 As far as I'm concerned, if it works, I'll add it. I'd love to have this
3102 functionality in Sup, and it is frequently requested.
3103 --
3104 William <wmorgan-sup at masanjin.net>
3105
3106 From barton.schaefer@gmail.com Wed Apr 29 20:51:15 2009
3107 From: barton.schaefer@gmail.com (Bart Schaefer)
3108 Date: Wed, 29 Apr 2009 17:51:15 -0700
3109 Subject: [sup-talk] possible mbox "initial From" fix
3110 In-Reply-To: <1241027916-sup-7642@entry>
3111 References: <1241027916-sup-7642@entry>
3112 Message-ID: <6bb609560904291751n3cc62f46g6a4edcba1f97d6f7@mail.gmail.com>
3113
3114 On Wed, Apr 29, 2009 at 11:02 AM, William Morgan
3115 <wmorgan-sup at masanjin.net> wrote:
3116 > After a lot of toying with RubyMail, hoping I could get it to behave
3117 > well, I finally gave up and just tweaked the regexp that determines
3118 > whether a line is an mbox separator or not, and bypassed RubyMail mbox
3119 > splitting entirely. It might still be too lenient---I have it looking
3120 > for /^From \S+@\S+ /, so it's not even bothering to parse a date, etc.
3121 > I'm hoping to strike somewhat of a balance between strict and liberal.
3122
3123 Offering a geezer perspective on this, as one of the primary
3124 programmers on an old Unix mail reader that originally didn't
3125 understand any kind of folder *except* mbox ... the "match separator"
3126 method that worked best for us back in the early '90s went like this:
3127
3128 (1) Check for "From " at start of line; if not found, return "not a separator".
3129 (2) Skip 5 characters, then skip any whitespace.
3130 (3) Remember this location.
3131 (4) Skip everything that is NOT whitespace, ignoring syntax for now.
3132 (5) Skip any whitespace.
3133 (6) Attempt to parse a date string in any of a variety of formats.
3134 (6a) If successful, return "is a separator"
3135 (6b) If unsuccessful, rewind to the location saved at (3)
3136 (7) Attempt to parse an email address in full RFC822 (now 5322)
3137 syntax, including comments, phrases, etc; if unsuccessful, return "not
3138 a separator"
3139 (8) Skip any whitespace following the parsed email address
3140 (9) Attempt again to parse a date; if successful, return "is a separator"
3141 (10) Return "not a separator"
3142
3143 We found that in most cases this failed at (1) or succeeded very
3144 quickly at (6a). Only obscure cases proceed to (7), but if you're
3145 dealing with anything like old USENET news archives or folders written
3146 by '80s-era mail clients you need either step (4) or step (7) to get
3147 past the cruft.
3148
3149 Note that the key is finding "From ... DATE" rather than "From ADDRESS
3150 ..." if you really want to distinguish message separators from stuff
3151 people type in a message body. I'm not sure you can do this with a
3152 regular expression.
3153
3154 If you want details on the variety of date formats that we recognized,
3155 let me know ...
3156
3157 From tyberius_prime@coonabibba.de Thu Apr 30 03:11:29 2009
3158 From: tyberius_prime@coonabibba.de (Tyberius Prime)
3159 Date: Thu, 30 Apr 2009 09:11:29 +0200
3160 Subject: [sup-talk] Inconsistent inbox after restart
3161 In-Reply-To: <1241028590-sup-8155@entry>
3162 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
3163 <1241028590-sup-8155@entry>
3164 Message-ID: <1241075456-sup-909@h984274.serverkompetenz.net>
3165
3166 For me it seems to be messages that have been saved 'hours' ago by pressing $.
3167
3168
3169 Excerpts from William Morgan's message of Wed Apr 29 20:10:53 +0200 2009:
3170 > Reformatted excerpts from Steve Goldman's message of 2009-04-28:
3171 > > Oftentimes when I quit sup and then restart, my inbox looks different.
3172 > > Messages that I had previously archived are back in the inbox. Has
3173 > > anyone else seen this? I'm losing sleep over it.
3174 >
3175 > I see it periodically too (I think I also see read messages turned
3176 > unread again) and have been trying to find a pattern---is it email
3177 > that's autosaved when I quit Sup, etc.?
3178
3179 From sgoldman@tower-research.com Thu Apr 30 08:51:42 2009
3180 From: sgoldman@tower-research.com (Steve Goldman)
3181 Date: Thu, 30 Apr 2009 08:51:42 -0400
3182 Subject: [sup-talk] Inconsistent inbox after restart
3183 In-Reply-To: <1241075456-sup-909@h984274.serverkompetenz.net>
3184 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
3185 <1241028590-sup-8155@entry>
3186 <1241075456-sup-909@h984274.serverkompetenz.net>
3187 Message-ID: <1241095872-sup-9569@sgoldmanlinux.tower-research.com>
3188
3189 Excerpts from Tyberius Prime's message of Thu Apr 30 03:11:29 -0400 2009:
3190 > For me it seems to be messages that have been saved 'hours' ago by pressing $.
3191 >
3192 > Excerpts from William Morgan's message of Wed Apr 29 20:10:53 +0200 2009:
3193 > > Reformatted excerpts from Steve Goldman's message of 2009-04-28:
3194 > > > Oftentimes when I quit sup and then restart, my inbox looks different.
3195 > > > Messages that I had previously archived are back in the inbox. Has
3196 > > > anyone else seen this? I'm losing sleep over it.
3197 > >
3198 > > I see it periodically too (I think I also see read messages turned
3199 > > unread again) and have been trying to find a pattern---is it email
3200 > > that's autosaved when I quit Sup, etc.?
3201
3202 I have confirmed that 0.7 is fine, but master is not. So we just have
3203 to track down which commit(s) in between broke it...
3204 --
3205
3206 Steve Goldman
3207 sgoldman at tower-research.com
3208
3209 T: 212.219.6014
3210 F: 212.219.6007
3211
3212 Tower Research Capital, LLC
3213 377 Broadway, 11th Fl.
3214 New York, NY 10013
3215
3216 From bdwalton@gmail.com Thu Apr 30 09:10:20 2009
3217 From: bdwalton@gmail.com (Ben Walton)
3218 Date: Thu, 30 Apr 2009 09:10:20 -0400
3219 Subject: [sup-talk] Inconsistent inbox after restart
3220 In-Reply-To: <1241095872-sup-9569@sgoldmanlinux.tower-research.com>
3221 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
3222 <1241028590-sup-8155@entry>
3223 <1241075456-sup-909@h984274.serverkompetenz.net>
3224 <1241095872-sup-9569@sgoldmanlinux.tower-research.com>
3225 Message-ID: <f96e0240904300610n741d83aq95dd0c4b10876243@mail.gmail.com>
3226
3227 On Thu, Apr 30, 2009 at 8:51 AM, Steve Goldman
3228 <sgoldman at tower-research.com> wrote:
3229 > Excerpts from Tyberius Prime's message of Thu Apr 30 03:11:29 -0400 2009:
3230 >> For me it seems to be messages that have been saved 'hours' ago by pressing $.
3231 >
3232 > I have confirmed that 0.7 is fine, but master is not. ?So we just have
3233 > to track down which commit(s) in between broke it...
3234
3235 git-bisect to the rescue? Anyone experiencing this and comfortable
3236 with git that wants to track down where the problem was introduced?
3237 It may take a little while, unless the problem can be recreated at
3238 will, but the bisect tool is awesome for situations like this.
3239
3240 -Ben
3241
3242
3243 --
3244 ---------------------------------------------------------------------------------------------------------------------------
3245 Ben Walton <bdwalton at gmail.com>
3246
3247 "With or without religion, good people can behave well and bad people
3248 can do evil; but for good people to do evil?that takes religion. "
3249 -Steven Weinberg
3250 ---------------------------------------------------------------------------------------------------------------------------
3251
3252 From wmorgan-sup@masanjin.net Thu Apr 30 09:19:20 2009
3253 From: wmorgan-sup@masanjin.net (William Morgan)
3254 Date: Thu, 30 Apr 2009 06:19:20 -0700
3255 Subject: [sup-talk] Inconsistent inbox after restart
3256 In-Reply-To: <1241095872-sup-9569@sgoldmanlinux.tower-research.com>
3257 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
3258 <1241028590-sup-8155@entry>
3259 <1241075456-sup-909@h984274.serverkompetenz.net>
3260 <1241095872-sup-9569@sgoldmanlinux.tower-research.com>
3261 Message-ID: <1241097437-sup-8272@entry>
3262
3263 Reformatted excerpts from Steve Goldman's message of 2009-04-30:
3264 > I have confirmed that 0.7 is fine, but master is not. So we just have
3265 > to track down which commit(s) in between broke it...
3266
3267 Ok, now we're onto something! As an educated guess, I've published a
3268 branch revert-background-save, which is identical to master except that
3269 the commits on the background-save branch have been reverted. Can you
3270 try that branch please?
3271 --
3272 William <wmorgan-sup at masanjin.net>
3273
3274 From wmorgan-sup@masanjin.net Thu Apr 30 09:36:22 2009
3275 From: wmorgan-sup@masanjin.net (William Morgan)
3276 Date: Thu, 30 Apr 2009 06:36:22 -0700
3277 Subject: [sup-talk] Inconsistent inbox after restart
3278 In-Reply-To: <f96e0240904300610n741d83aq95dd0c4b10876243@mail.gmail.com>
3279 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
3280 <1241028590-sup-8155@entry>
3281 <1241075456-sup-909@h984274.serverkompetenz.net>
3282 <1241095872-sup-9569@sgoldmanlinux.tower-research.com>
3283 <f96e0240904300610n741d83aq95dd0c4b10876243@mail.gmail.com>
3284 Message-ID: <1241098531-sup-1508@entry>
3285
3286 Reformatted excerpts from Ben Walton's message of 2009-04-30:
3287 > git-bisect to the rescue? Anyone experiencing this and comfortable
3288 > with git that wants to track down where the problem was introduced?
3289 > It may take a little while, unless the problem can be recreated at
3290 > will, but the bisect tool is awesome for situations like this.
3291
3292 If the educated guesses fall through, then we'll punish Steve for his
3293 insulin by making him binary search through all commits since 0.7.
3294 --
3295 William <wmorgan-sup at masanjin.net>
3296
3297 From bdwalton@gmail.com Thu Apr 30 10:07:57 2009
3298 From: bdwalton@gmail.com (Ben Walton)
3299 Date: Thu, 30 Apr 2009 10:07:57 -0400
3300 Subject: [sup-talk] Sup with Microsoft Exchange 2007
3301 In-Reply-To: <1241045035-sup-1534@entry>
3302 References: <3f81a4240904140559ubd286a5x2f026d6b875dd091@mail.gmail.com>
3303 <1240267632-sup-2023@r50p>
3304 <3f81a4240904201638v94a7dbdpce0d865cd83d8873@mail.gmail.com>
3305 <1240318807-sup-3080@entry>
3306 <3f81a4240904210642o9c74049o27e164e317d0842e@mail.gmail.com>
3307 <1240323082-sup-1515@entry>
3308 <3f81a4240904210729h74ac436bn9e1140cf7021c5ad@mail.gmail.com>
3309 <3f81a4240904210732k11366cf7naec562af54ecabac@mail.gmail.com>
3310 <f96e0240904210737q71765989of31447a8de20fa62@mail.gmail.com>
3311 <1241045035-sup-1534@entry>
3312 Message-ID: <f96e0240904300707k4d629f33hc660a9792545257e@mail.gmail.com>
3313
3314 On Wed, Apr 29, 2009 at 6:45 PM, William Morgan
3315 <wmorgan-sup at masanjin.net> wrote:
3316 > As far as I'm concerned, if it works, I'll add it. I'd love to have this
3317 > functionality in Sup, and it is frequently requested.
3318
3319 Ok. I started cleaning up the original patch last night. I think it
3320 was decent for the most part. The bad parts were the integration into
3321 sup-config. I'll have something ready in a day or two, hopefully.
3322
3323 Since I'm back into mucking with this bit, are you open to having the
3324 maildir scanning code move messages from new/ to cur/? This could
3325 help with the unique id vs directory scanning issue.
3326
3327 -Ben
3328 > --
3329 > William <wmorgan-sup at masanjin.net>
3330 > _______________________________________________
3331 > sup-talk mailing list
3332 > sup-talk at rubyforge.org
3333 > http://rubyforge.org/mailman/listinfo/sup-talk
3334 >
3335
3336
3337
3338 --
3339 ---------------------------------------------------------------------------------------------------------------------------
3340 Ben Walton <bdwalton at gmail.com>
3341
3342 "With or without religion, good people can behave well and bad people
3343 can do evil; but for good people to do evil?that takes religion. "
3344 -Steven Weinberg
3345 ---------------------------------------------------------------------------------------------------------------------------
3346
3347 From sgoldman@tower-research.com Thu Apr 30 10:23:25 2009
3348 From: sgoldman@tower-research.com (Steve Goldman)
3349 Date: Thu, 30 Apr 2009 10:23:25 -0400
3350 Subject: [sup-talk] Inconsistent inbox after restart
3351 In-Reply-To: <1241098531-sup-1508@entry>
3352 References: <1240945125-sup-8484@sgoldmanlinux.tower-research.com>
3353 <1241028590-sup-8155@entry>
3354 <1241075456-sup-909@h984274.serverkompetenz.net>
3355 <1241095872-sup-9569@sgoldmanlinux.tower-research.com>
3356 <f96e0240904300610n741d83aq95dd0c4b10876243@mail.gmail.com>
3357 <1241098531-sup-1508@entry>
3358 Message-ID: <1241101364-sup-9621@sgoldmanlinux.tower-research.com>
3359
3360 Excerpts from William Morgan's message of Thu Apr 30 09:36:22 -0400 2009:
3361 > Reformatted excerpts from Ben Walton's message of 2009-04-30:
3362 > > git-bisect to the rescue? Anyone experiencing this and comfortable
3363 > > with git that wants to track down where the problem was introduced?
3364 > > It may take a little while, unless the problem can be recreated at
3365 > > will, but the bisect tool is awesome for situations like this.
3366 >
3367 > If the educated guesses fall through, then we'll punish Steve for his
3368 > insulin by making him binary search through all commits since 0.7.
3369
3370 Bad news. This new branch is also buggy.
3371
3372 Time to apply the force of brute.
3373 --
3374
3375 Steve Goldman
3376 sgoldman at tower-research.com
3377
3378 T: 212.219.6014
3379 F: 212.219.6007
3380
3381 Tower Research Capital, LLC
3382 377 Broadway, 11th Fl.
3383 New York, NY 10013
3384