* [sup-talk] problems with Maildir and IMAP offline
@ 2009-07-13 21:20 Luis Cañas Díaz
2009-07-14 13:24 ` Andrei Thorp
2009-07-14 16:21 ` Israel Herraiz
0 siblings, 2 replies; 11+ messages in thread
From: Luis Cañas Díaz @ 2009-07-13 21:20 UTC (permalink / raw)
Hi guys,
first things first. Your mail client looks promising, I've been testing many of them (most of them from the kde/gnome world) and yours seems to be perfect to be running in my dear mac mini ;)
This afternoon I've been trying to set up a gmail account with offlineimap and I'm having the same problem reported by this guy[1]. I run offlineimap and it creates a Maildir directory with 4hundred read mails and 2hundred unread mails (yes, I should pay more attention to my gmail account;). The problem is that sup sees all of the messages as unread which is not true according to the Maildir structure:
[luis at gongbu INBOX]$ ls new/|wc -l;ls cur/|wc -l
210
412
After applying changes with sup, the state is the same. When using sup I "delete" messages and mark them as read.
The sup version is:
[luis at gongbu ~]$ sup -v
[Mon Jul 13 23:14:25 +0200 2009] using character set encoding "UTF-8"
sup v0.8.1
Last thing, I haven't seen it written by I guess it's a good idea having the files locally to use the search engine. Am I right?
Thanks for your help! :)
[1] http://osdir.com/ml/mail.sup.general/2008-08/msg00029.html
--
Luis Ca?as D?az | GSyC/LibreSoft Research Lab
http://libresoft.es | Grupo de Sistemas y Comunicaciones
Tel: (+34) 91 488 85 23 | Universidad Rey Juan Carlos
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-13 21:20 [sup-talk] problems with Maildir and IMAP offline Luis Cañas Díaz
@ 2009-07-14 13:24 ` Andrei Thorp
[not found] ` <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
2009-07-14 16:21 ` Israel Herraiz
1 sibling, 1 reply; 11+ messages in thread
From: Andrei Thorp @ 2009-07-14 13:24 UTC (permalink / raw)
Excerpts from Luis Ca?as D?az's message of Mon Jul 13 17:20:22 -0400 2009:
> After applying changes with sup, the state is the same. When using sup I
> "delete" messages and mark them as read.
I'm somewhat unhappy about this too. It seems to me that sup just plain
does not support the read features of maildirs.
a) It doesn't import them as read
b) sup-sync-back does not mark them as read.
The best I could find is manually marking things as read and deleting
them, and then using sup-sync-back with the deleted options which it
does understand.
On the other hand, sup provides hooks to make calling offlineimap and
sup-sync-back completely transparent and well-timed. You can call
sup-sync-back followed by offlineimap on each sup poll, so that's pretty
sweet.
--
Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
[not found] ` <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
@ 2009-07-14 14:02 ` Andrei Thorp
2009-07-14 15:00 ` Tim Gray
0 siblings, 1 reply; 11+ messages in thread
From: Andrei Thorp @ 2009-07-14 14:02 UTC (permalink / raw)
Excerpts from Tim Gray's message of Tue Jul 14 09:45:44 -0400 2009:
> On Tue 14, Jul'09 at 9:24 AM -0400, Andrei Thorp wrote:
>
> > a) It doesn't import them as read
> > b) sup-sync-back does not mark them as read.
I'm forwarding a summary of your message with my replies to the mailing
list. It seems like you replied to me only by accident?
> From my playing around with sup and from what I've read, sup just doesn't
> play nicely with other mail clients. Sup will read from your sources, but
> the sources never get modified.
Again, see sup-sync-back -- it does indeed have _some_ ability to write
its state back to the source.
> I know sup is slowly moving in the direction of a more locked in design. I
> just wish sup added automatic sync back capabilities.
Put this in a hook and it's automatic. That's the beauty of the
hook/multiple binary design.
> As far as OfflineIMAP goes, I didn't think I would do this, but I've been
> running it in it's full curses mode with an auto refresh set.
I'm not entirely sure why you want this. If you're worried about
failures, do they really happen? If you want to see the log, aren't you
already piping it? If you want notifications, you could hook them up to
happen in your sup hook (the one I described before) rather trivially
via notify-send.
--
Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-14 14:02 ` Andrei Thorp
@ 2009-07-14 15:00 ` Tim Gray
2009-07-14 15:07 ` Ben Walton
2009-07-14 15:14 ` Andrei Thorp
0 siblings, 2 replies; 11+ messages in thread
From: Tim Gray @ 2009-07-14 15:00 UTC (permalink / raw)
On Tue 14, Jul'09 at 10:02 AM -0400, Andrei Thorp wrote:
> I'm forwarding a summary of your message with my replies to the mailing
> list. It seems like you replied to me only by accident?
Whoops. I didn't realize this list didn't have reply-to set. Thanks.
> Again, see sup-sync-back -- it does indeed have _some_ ability to write
> its state back to the source.
To me, this is a vital feature of any mail client. I'll look into it, but I
would really like this to be fully integrated into my mail client. And from
I've read, this isn't something that's going to happen.
Sometimes I need to use mutt/pine. Sometimes webmail. Most importantly, I
want all my mail in a form that is easy to backup, human readable, and can
be manipulated with standard utilities. Maildir fits the bill.
I think it'd be fantastic if there was a mail client that allowed you to
sort by folders, but also provided a sup-like view that laid on top if/when
you needed.
> Put this in a hook and it's automatic. That's the beauty of the
> hook/multiple binary design.
Honestly, if it's that easy, shouldn't it be configured like that out of the
box?
> I'm not entirely sure why you want this. If you're worried about
> failures, do they really happen? If you want to see the log, aren't you
> already piping it? If you want notifications, you could hook them up to
> happen in your sup hook (the one I described before) rather trivially
> via notify-send.
For use with other mail clients for one. It's kind of nice having my IMAP
syncing separate from the mail client. I'm sure I could run it
automatically via cron, but then you'd have to give up the quick refresh
capability (minor) and the IDLE mode. Sure, I could pipe the output
somewhere else, but wouldn't that accomplish the same thing as just looking
at the output already provided, either curses or one of the other ones?
Again, it's running in screen so I don't even have it open on any windows.
Of course, that doesn't mean this is the best route to go, but it's been
working for me for so far - I am new to it though. It's a nice pretty
colored interface too :)
Tim
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-14 15:00 ` Tim Gray
@ 2009-07-14 15:07 ` Ben Walton
2009-07-14 15:28 ` Tim Gray
2009-07-14 15:14 ` Andrei Thorp
1 sibling, 1 reply; 11+ messages in thread
From: Ben Walton @ 2009-07-14 15:07 UTC (permalink / raw)
Excerpts from Tim Gray's message of Tue Jul 14 11:00:34 -0400 2009:
> > Again, see sup-sync-back -- it does indeed have _some_ ability to write
> > its state back to the source.
>
> To me, this is a vital feature of any mail client. I'll look into it, but I
> would really like this to be fully integrated into my mail client. And from
> I've read, this isn't something that's going to happen.
There was some talk a while back about modifying the behaviour of
Maildir sources. The issue was that there is an odd scanning bug with
Maildir that sometimes sees messages get skipped. A proposed solution
was to have sup start 'playing nice' with Maildir so that when new
messages were found in new/, they'd be indexed and recorded with a
filename in cur/, presumably with the S (seen) flag appended properly.
I _think_ William was looking at that, but I'm not sure. It's
something I'd like too (not to play nice with other clients, but
because it's "just better"). I haven't had much time lately, but if
William confirms he's not working on it, I'd be interested in
implementing it.
Thanks
-Ben
--
Ben Walton
Systems Programmer - CHASS
University of Toronto
C:416.407.5610 | W:416.978.4302
GPG Key Id: 8E89F6D2; Key Server: pgp.mit.edu
Contact me to arrange for a CAcert assurance meeting.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: not available
URL: <http://rubyforge.org/pipermail/sup-talk/attachments/20090714/e30a5b14/attachment.bin>
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-14 15:00 ` Tim Gray
2009-07-14 15:07 ` Ben Walton
@ 2009-07-14 15:14 ` Andrei Thorp
2009-07-14 15:45 ` Tim Gray
1 sibling, 1 reply; 11+ messages in thread
From: Andrei Thorp @ 2009-07-14 15:14 UTC (permalink / raw)
Excerpts from Tim Gray's message of Tue Jul 14 11:00:34 -0400 2009:
> On Tue 14, Jul'09 at 10:02 AM -0400, Andrei Thorp wrote:
> > Put this in a hook and it's automatic. That's the beauty of the
> > hook/multiple binary design.
>
> Honestly, if it's that easy, shouldn't it be configured like that out of the
> box?
People perhaps don't want this. It's slower, and a lot of folks probably
do no syncing back since all they use is sup anyway.
> > I'm not entirely sure why you want this. If you're worried about
> > failures, do they really happen? If you want to see the log, aren't you
> > already piping it? If you want notifications, you could hook them up to
> > happen in your sup hook (the one I described before) rather trivially
> > via notify-send.
>
> For use with other mail clients for one.
Understood. Makes sense in your use case. I don't really understand why
you'd want to use pine/mutt when you've already got sup though ;)
--
Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-14 15:07 ` Ben Walton
@ 2009-07-14 15:28 ` Tim Gray
2009-07-14 15:39 ` Andrei Thorp
0 siblings, 1 reply; 11+ messages in thread
From: Tim Gray @ 2009-07-14 15:28 UTC (permalink / raw)
On Tue 14, Jul'09 at 11:07 AM -0400, Ben Walton wrote:
> It's something I'd like too (not to play nice with other clients, but
> because it's "just better").
This sound like a good thing. In my experience, 'just better' usually
equals 'playing nice', since 'playing nice' usually equals following the
standards. That's how Maildirs are supposed to work - if everybody followed
the spec, we'd be set.
Though I don't program for a living, nor do I know any Ruby, it seems like a
doable thing. Is there something fundamental blocking per-message sync-back
of status as you read/delete/otherwise modify your mail? I would assume
there a reference to the original message location in a message's database
entry. If a message gets read, write an S at the end of the filename and
move it to /cur. If it gets deleted, delete it. Operations on a message
should affect the database and the mail store at the same time. Why is
something like sup-sync-back even necessary?
Anyway, these are just the musings of someone who doesn't have the tools to
write something like sup, so I'll be quiet now before I embarrass myself any
further.
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-14 15:28 ` Tim Gray
@ 2009-07-14 15:39 ` Andrei Thorp
2009-07-14 15:59 ` Tim Gray
0 siblings, 1 reply; 11+ messages in thread
From: Andrei Thorp @ 2009-07-14 15:39 UTC (permalink / raw)
Excerpts from Tim Gray's message of Tue Jul 14 11:28:06 -0400 2009:
> On Tue 14, Jul'09 at 11:07 AM -0400, Ben Walton wrote:
> > It's something I'd like too (not to play nice with other clients, but
> > because it's "just better").
>
> This sound like a good thing. In my experience, 'just better' usually
> equals 'playing nice', since 'playing nice' usually equals following the
> standards. That's how Maildirs are supposed to work - if everybody followed
> the spec, we'd be set.
I'd just like to mention that the reason we tend not to sync back in
general isn't because we hate standards and want people to get hurt :)
It's roughly because of the extra features in sup:
- It keeps a database so it can search for stuff quickly
- It implements its own tagging regardless of source (unlike stuff like
mutt that just rely on "physical" folders)
- It merges sources
So while it's possible to do some merging back, it's sometimes awkward
because sup's tags do not have to map 1:1 to IMAP folders or anything
else. It's otherwise also a bit awkward because we might have mail from
many sources in one place, so writing back isn't as simple as just
editing files. You also have to _not_ edit files.
Anyway, that all said, it's clearly possible and would be very nice to
have.
--
Andrei Thorp, Developer: Xandros Corp. (http://www.xandros.com)
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-14 15:14 ` Andrei Thorp
@ 2009-07-14 15:45 ` Tim Gray
0 siblings, 0 replies; 11+ messages in thread
From: Tim Gray @ 2009-07-14 15:45 UTC (permalink / raw)
On Tue 14, Jul'09 at 11:14 AM -0400, Andrei Thorp wrote:
> People perhaps don't want this. It's slower, and a lot of folks probably
> do no syncing back since all they use is sup anyway.
I would hope in this day in age we can change a database entry and move a
file at the same time without too much of a performance hit. I would think
it only gets unbearable when you don't update as you go and you have to do a
large batch of messages. But you are right, maybe people don't want that.
Personally, and this is a side note, if I was involved in the project, I'd
push for canning the built in IMAP capabilities all together. Just run
offlineimap or one of the other IMAP syncing utilities. Add to that beefing
up the Maildir handling. Just worry about better and more transparent
sync-back-to-Maildir capabilities and let offlineimap worry about the server
side of the equation.
> Understood. Makes sense in your use case. I don't really understand why
> you'd want to use pine/mutt when you've already got sup though ;)
As you can tell, I'm not quite sold on sup yet. I've switched mail clients
enough over the past few years that switching in and of itself is a giant
pain. I've settled on Maildir as my 'client' for now. I can serve it via
IMAP if I need, I can read it with a couple mail clients, and I can easily
convert it to mbox however I want to with some simple Python code.
If I switch to sup full time, I would be comforted by the fact that if I
choose to change in 2 years, all of my mail is marked read, deleted mail is
actually deleted, and even though I was using sup labels for my
organization, things are still organized in some fashion by appropriate
folders on the file system. The last part could be achievable by some
combination of offlineimap + gmail/sieve filtering and fetchmail/getmail +
procmail. It'd still be nice to be able to move physical messages around in
sup though. Maybe I'm just nuts though.
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-14 15:39 ` Andrei Thorp
@ 2009-07-14 15:59 ` Tim Gray
0 siblings, 0 replies; 11+ messages in thread
From: Tim Gray @ 2009-07-14 15:59 UTC (permalink / raw)
On Tue 14, Jul'09 at 11:39 AM -0400, Andrei Thorp wrote:
> I'd just like to mention that the reason we tend not to sync back in
> general isn't because we hate standards and want people to get hurt :)
Haha. Of course.
> It's roughly because of the extra features in sup:
I got you. Still, I envisage a mail client that has an underlying structure
built on folders. On top of that a database/virtual folder interface is
built. Of course, you'd have the ability to access the folder based
structure when needed. So you could move a message or a conversation to a
given folder if you want.
For example, I have work emails for a certain project with a given label.
It's wonderful that in sup, those currently in my physical inbox and those
currently in an archive folder somewhere show up under the same label in
sup. But there's no mechanism to moving those in my physical inbox to the
archive folder. Some might say who cares, but I can't leave all my email in
my physical inbox forever, which is synced by offlineimap, because people
associated with this project have a nasty habit of sending 10-20 mb
attachments and I don't want to clutter up my IMAP boxes with hundreds of
megs of attachments forever. Heck, I can't do that unless I have an IMAP
service with 25 gigs of storage.* Sometimes they just need to be collected
in a totally offline box, but somewhere that is still accessible by
searching if I need access to it.
Sup is pretty close to this already, minus the access to the underlying
structure.
---
[*] Obviously for those of you using Gmail, this isn't an issue. Who cares
about deleting messages?
^ permalink raw reply [flat|nested] 11+ messages in thread
* [sup-talk] problems with Maildir and IMAP offline
2009-07-13 21:20 [sup-talk] problems with Maildir and IMAP offline Luis Cañas Díaz
2009-07-14 13:24 ` Andrei Thorp
@ 2009-07-14 16:21 ` Israel Herraiz
1 sibling, 0 replies; 11+ messages in thread
From: Israel Herraiz @ 2009-07-14 16:21 UTC (permalink / raw)
Excerpts from Luis's message on Jul 13, 2009 about 11 PM:
> This afternoon I've been trying to set up a gmail account with offlineimap and
> I'm having the same problem reported by this guy[1]. I run offlineimap and it
> creates a Maildir directory with 4hundred read mails and 2hundred unread mails
> (yes, I should pay more attention to my gmail account;).
I have not used IMAP with Sup, but AFAIK, Sup does not touch the
original sources of email. For instance, it does not read nor modify
messages using IMAP, it just read them using that protocol (or maildir
or whatever).
Therefore, the only way to get those messages marked as read is using
sup-sync with the --read option. That will mark the messages as read
in Sup.
However there are two problems. If all the messages (unread or read)
are in the same source, there is no way to indicate which messages are
going to be marked as read and which are not.
Moreover, if you read a message in Sup, it still will appear in Gmail
as unread.
I also use Gmail with Sup, but using POP. I use the web interface of
Gmail when I cannnot access my laptop. I use IMAP from my mobile
phone. And I download all my email to my laptop using POP.
If I get a message in my laptop, it is marked as archived and read in
GMail, so it does not appear as unread in the web nor in my phone.
However, if I read the message in the phone or the web, it will appear
as unread in Sup.
Still it is a good solution if you have a "central" node where you
store your mail, and do your main work (my laptop), and a couple of
"external" agents (phone, web) to be able of reading your email if you
do not have your laptop at hand.
Another advantage is that you keep a copy of your mail in your
laptop. GMail is not going to last forever (of course, it still has a
long live) and with this you ensure that you will not loose your
old-email in GMail is closed some day, and it is also very handy to
make backups of all your email (just copy the mbox file to another
location).
To get the email I use getmail [1], and msmtp [2] with these scripts
[3] (see last section) as a lightweight replacement for sendmail. I
can provide you my config scripts if you want.
It is not a good solution though if you read your email from several
different computers.
Cheers,
Israel
[1] http://pyropus.ca/software/getmail/
[2] http://msmtp.sourceforge.net/
[3] http://wiki.archlinux.org/index.php/Msmtp
^ permalink raw reply [flat|nested] 11+ messages in thread
end of thread, other threads:[~2009-07-14 16:21 UTC | newest]
Thread overview: 11+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2009-07-13 21:20 [sup-talk] problems with Maildir and IMAP offline Luis Cañas Díaz
2009-07-14 13:24 ` Andrei Thorp
[not found] ` <20090714134544.GD90157@d228.scdc1.swarthmore.edu>
2009-07-14 14:02 ` Andrei Thorp
2009-07-14 15:00 ` Tim Gray
2009-07-14 15:07 ` Ben Walton
2009-07-14 15:28 ` Tim Gray
2009-07-14 15:39 ` Andrei Thorp
2009-07-14 15:59 ` Tim Gray
2009-07-14 15:14 ` Andrei Thorp
2009-07-14 15:45 ` Tim Gray
2009-07-14 16:21 ` Israel Herraiz
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox