Archive of RubyForge sup-devel mailing list
 help / color / mirror / Atom feed

* A maildir root source: syncing labels with maildirs (imap folders)
@ 2013-11-25 15:24 Gaute Hope
  2013-11-25 18:23 ` [sup-devel] " Steven Schmeiser
                   ` (2 more replies)
  0 siblings, 3 replies; 18+ messages in thread
From: Gaute Hope @ 2013-11-25 15:24 UTC (permalink / raw)
  To: sup-devel

[-- Attachment #1: Type: text/plain, Size: 2435 bytes --]

Hi fellow suppers,

for a while I have been using a 'maildir-root' source that I created.
It is based on the maildir-syncback code, but goes further: you only
specify a root folder with maildirs to the source, then each sub folder
(maildirsub) is mapped to a label. Some of the labels are special: like
deleted, inbox and archive (the special-label to maildirsub mapping can
be specified in the source configuration).

This means that a sup label corresponds to maildir inside the
maildir-root and the behavior works like this:

  - (remote to local) if a message is found in a maildirsub that label is added to it.
  - (remote to local) if a message is removed from a maildirsub that
    label is removed (unless it has just been moved).
  - (local to remote) if you add a label the message is written to that
    maildirsub (of all the maildir-roots the message belongs to)
  - (local to remote) if you remove a label from a message the message is deleted
    from that maildirsub. if it is deleted from all maildirsubs it is
    copied to the archive maildirsub.
  - (local to remote) if you archive a message it is removed from the
    inbox maildirsub, if it doesn't belong to any other
    labels/maildirsubs it is copied to archive.
  - (local to remote / remote to local) the same flag features as
    maildir-syncback (done on all copies in all maildirsubs)
  - (local to remote) if you add a label to a message and the message
    belongs to a maildir-root where no corresponding maildirsub exists a
    maildir will be created for it.

I have been using it for 4-5 months now and it is getting fairly stable.
It works fairly well on gmail (label sync), but I am also using it on
regular IMAP servers (here it might, in the future, be useful to always keep a copy in
archive).

If you are interested in trying this please have a look at:
https://github.com/gauteh/sup/blob/maildir-root/lib/sup/maildirroot.rb

or my branch: https://github.com/gauteh/sup/tree/maildir-root, but please
be careful.

I am using this with offlineimap and utf-7-imap to utf-8 conversion. It
is probably necessary to do a full sync every time to make sure things
stay in sync. Remember that it is technically possible to still do
changes to the maildir while offlineimap is syncing, I haven't had any
problems with this (except read flag), but it is potentially a little
careless.


Cheers, Gaute


[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

^ permalink raw reply	[flat|nested] 18+ messages in thread

• * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
    2013-11-25 15:24 A maildir root source: syncing labels with maildirs (imap folders) Gaute Hope
  @ 2013-11-25 18:23 ` Steven Schmeiser
    2013-11-25 21:08 ` Matthieu Rakotojaona
    2013-11-25 21:51 ` Gaute Hope
    2 siblings, 0 replies; 18+ messages in thread
  From: Steven Schmeiser @ 2013-11-25 18:23 UTC (permalink / raw)
    To: sup-devel
  
  Hi,
  I'm very interested in trying out this branch.
  
  I don't know the sup internals very well, so I'm having a hard time figuring this out on my own, but what config options need to be changed/set to use maildir-root?  I'm currently using marildir-sync.
  
  Thanks for all your work on sup!
  
  Steve
   
  > Hi fellow suppers,
  > 
  > for a while I have been using a 'maildir-root' source that I created.
  > It is based on the maildir-syncback code, but goes further: you only
  > specify a root folder with maildirs to the source, then each sub folder
  > (maildirsub) is mapped to a label. Some of the labels are special: like
  > deleted, inbox and archive (the special-label to maildirsub mapping can
  > be specified in the source configuration).
  > 
  > This means that a sup label corresponds to maildir inside the
  > maildir-root and the behavior works like this:
  > 
  >   - (remote to local) if a message is found in a maildirsub that label is added to it.
  >   - (remote to local) if a message is removed from a maildirsub that
  >     label is removed (unless it has just been moved).
  >   - (local to remote) if you add a label the message is written to that
  >     maildirsub (of all the maildir-roots the message belongs to)
  >   - (local to remote) if you remove a label from a message the message is deleted
  >     from that maildirsub. if it is deleted from all maildirsubs it is
  >     copied to the archive maildirsub.
  >   - (local to remote) if you archive a message it is removed from the
  >     inbox maildirsub, if it doesn't belong to any other
  >     labels/maildirsubs it is copied to archive.
  >   - (local to remote / remote to local) the same flag features as
  >     maildir-syncback (done on all copies in all maildirsubs)
  >   - (local to remote) if you add a label to a message and the message
  >     belongs to a maildir-root where no corresponding maildirsub exists a
  >     maildir will be created for it.
  > 
  > I have been using it for 4-5 months now and it is getting fairly stable.
  > It works fairly well on gmail (label sync), but I am also using it on
  > regular IMAP servers (here it might, in the future, be useful to always keep a copy in
  > archive).
  > 
  > If you are interested in trying this please have a look at:
  > https://github.com/gauteh/sup/blob/maildir-root/lib/sup/maildirroot.rb
  > 
  > or my branch: https://github.com/gauteh/sup/tree/maildir-root, but please
  > be careful.
  > 
  > I am using this with offlineimap and utf-7-imap to utf-8 conversion. It
  > is probably necessary to do a full sync every time to make sure things
  > stay in sync. Remember that it is technically possible to still do
  > changes to the maildir while offlineimap is syncing, I haven't had any
  > problems with this (except read flag), but it is potentially a little
  > careless.
  > 
  > 
  > Cheers, Gaute
  _______________________________________________
  Sup-devel mailing list
  Sup-devel@rubyforge.org
  http://rubyforge.org/mailman/listinfo/sup-devel
  
  
  ^ permalink raw reply	[flat|nested] 18+ messages in thread

• * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
    2013-11-25 15:24 A maildir root source: syncing labels with maildirs (imap folders) Gaute Hope
    2013-11-25 18:23 ` [sup-devel] " Steven Schmeiser
  @ 2013-11-25 21:08 ` Matthieu Rakotojaona
    2013-11-25 21:51 ` Gaute Hope
    2 siblings, 0 replies; 18+ messages in thread
  From: Matthieu Rakotojaona @ 2013-11-25 21:08 UTC (permalink / raw)
    To: sup-devel
  
  
  [-- Attachment #1.1: Type: text/plain, Size: 372 bytes --]
  
  Wow, that's amazing stuff. Would you care to share your .offlineimaprc ?
  I myself use the gmail source
  (https://github.com/rakoo/sup/tree/gmail_source), but it's not very
  smart at syncing old labels, and it's mostly targeted towards gmail, so
  I'd like to switch to something else (plus having a local tree of
  maildirs is always helpful)
  
  -- 
  Matthieu Rakotojaona
  
  [-- Attachment #1.2: signature.asc --]
  [-- Type: application/pgp-signature, Size: 836 bytes --]
  
  [-- Attachment #2: Type: text/plain, Size: 143 bytes --]
  
  _______________________________________________
  Sup-devel mailing list
  Sup-devel@rubyforge.org
  http://rubyforge.org/mailman/listinfo/sup-devel
  
  ^ permalink raw reply	[flat|nested] 18+ messages in thread

• * Re: A maildir root source: syncing labels with maildirs (imap folders)
    2013-11-25 15:24 A maildir root source: syncing labels with maildirs (imap folders) Gaute Hope
    2013-11-25 18:23 ` [sup-devel] " Steven Schmeiser
    2013-11-25 21:08 ` Matthieu Rakotojaona
  @ 2013-11-25 21:51 ` Gaute Hope
    2013-11-25 22:28   ` Gaute Hope
    2013-11-26 14:43   ` [sup-devel] " Steven Schmeiser
    2 siblings, 2 replies; 18+ messages in thread
  From: Gaute Hope @ 2013-11-25 21:51 UTC (permalink / raw)
    To: sup-devel
  
  
  [-- Attachment #1.1: Type: text/plain, Size: 3144 bytes --]
  
  Hi,
  
  I have attached my relevant configs (and hopefully managed to anonymize
  them enough). As you can see I use the 'utf7.py' module (placed in
  ~/.offlineimap/) to decode/encode between imap4-utf-7 and utf-8 on
  system (if your filesystem uses a different encoding you might have
  issues). Please don't use the configs verbatim, but rather as
  inspiration: I might have cut out important parts. Some of this is
  in the wiki.
  
  Some of the folders are translated (bi-directional of course) in my
  offlineimaprc, but if you check out my sources.yaml you will see that I
  have specified which folders are related to special (deleted, starred,
  inbox, etc) for some of the sources.
  
  My translation setup in offlineimaprc for my first GMail account
  corresponds to the default values the maildirroot source suggests. The
  only relevant change in config.yaml is to set sync_back_to_maildir:
  true.
  
  The way I set up sup with maildirroot is:
  $ sup-config
  
  fill in, don't add any sources. If you have a working config.yaml, you
  can use it.
  
  add sources:
  $ sup-add maildirroot:///home/gaute/.mail/imap_account
  
  I edit ~/.sup/sources.yaml and enable:
  - confirm_enable_experimental: true
  - sync_back: true
  - maildir_creation_allowed: true
  
  and tweak the folder names if necessary.
  
  Then if your index is empty (you _cannot_ merge an existing maildir
  source by using the same source id) - I run sup-sync:
  $ sup-sync -v
  
  Note that sup-sync does not support the :updated flag (when a message
  has moved on disk), for that you have to run regular Sup and do a poll.
  sup-sync scans through and adds labels; you can also just start up sup
  and see what happens, but that takes a longer time: you probably do not
  need to enable the stuff in sources.yaml before after sup-sync if you
  are nervous (I would be!). 
  
  Some annoying issues:
  - deleting a maildir is hard:
    * if you delete it remotely it will be recreated by offlineimap (i
      think)
    * you have to first remove all emails remotely, sync sup, to make sure
      labels are removed.
    * if you remove all messages from a label the maildir will be empty,
      to delete the maildir: sync, delete the maildir locally + delete it
      remotely; then re-sync.
  
      this is the behaviour of offlineimap, but I think it is hard to do
      it differently. this means that if you accidentally add a bogus
      label, it is a bit of a pain to get rid of the maildir.
  
  
  - if a message is deleted from the inbox remotely (archived) it is not
    removed from the inbox view (or any thread index view it is visible
    in) before sup is restarted.
  
  To test maildirroot:
  checkout my branch; make the gem: $ rake gem and install it: $ gem
  install pkg/sup-999.gem. If develop has changed you can try to merge it in
  first.
  
  Again; please make a backup copy of your .mail so that you can restore
  it if it turns out maildirroot has been eating or multiplying emails :)
  
  I probably don't have the time to difficult bugs, but I would be happy
  to accept patches and I could also put this branch on official Sup if it
  turns out to be worth something.
  
  
  Cheers, Gaute
  
  [-- Attachment #1.2: offlineimaprc --]
  [-- Type: application/octet-stream, Size: 3998 bytes --]
  
  [general]
  accounts = gaute.vetsj.com, vetsj.com, imap_1, imap_2
  #ui = Noninteractive.Basic
  pythonfile = ~/.offlineimap/utf7.py
  autorefresh = 3
  
  [Account gaute.vetsj.com]
  localrepository = LocalVetsj
  remoterepository = RemoteVetsj
  
  [Repository LocalVetsj]
  type = Maildir
  localfolders = /home/gaute/.mail/gaute.vetsj.com
  nametrans: lambda s: dict((value,key) for key,value in
                        {  '[Gmail]/Starred' : 'starred',
                           '[Gmail]/Trash'   : 'trash',
                           '[Gmail]/Spam'    : 'spam',
                           '[Gmail]/Sent Mail' : 'sent',
                           '[Gmail]/Important' : 'important',
                           '[Gmail]/Drafts'    : 'drafts',
                           '[Gmail]/All Mail'  : 'archive',
                           'INBOX'             : 'inbox',
                        }.iteritems()).get (s, s).decode ('utf8').encode ('imap4-utf-7')
  
  [Repository RemoteVetsj]
  type = Gmail
  ssl = yes
  nametrans: lambda s: {  '[Gmail]/Starred' : 'starred',
                          '[Gmail]/Trash'   : 'trash',
                          '[Gmail]/Spam'    : 'spam',
                          '[Gmail]/Sent Mail' : 'sent',
                          '[Gmail]/Important' : 'important',
                          '[Gmail]/Drafts'    : 'drafts',
                          '[Gmail]/All Mail'  : 'archive',
                          'INBOX'             : 'inbox',
                        }.get (s, s).decode ('imap4-utf-7').encode ('utf8')
  
  #folderfilter = lambda foldername: foldername in ['[Gmail]/All Mail']
  
  [Account vetsj.com]
  localrepository = LocalVetsjCom
  remoterepository = RemoteVetsjCom
  
  [Repository LocalVetsjCom]
  type = Maildir
  localfolders = /home/gaute/.mail/vetsj.com
  nametrans: lambda s: dict((value,key) for key,value in
                        {  '[Gmail]/Starred' : 'starred',
                           '[Gmail]/Trash'   : 'trash',
                           '[Gmail]/Spam'    : 'spam',
                           '[Gmail]/Sent Mail' : 'sent',
                           '[Gmail]/Important' : 'important',
                           '[Gmail]/Drafts'    : 'drafts',
                           '[Gmail]/All Mail'  : 'archive',
                           'INBOX'             : 'inbox',
                        }.iteritems()).get (s, s).decode ('utf8').encode ('imap4-utf-7')
  
  [Repository RemoteVetsjCom]
  type = Gmail
  ssl = yes
  nametrans: lambda s: {  '[Gmail]/Starred' : 'starred',
                          '[Gmail]/Trash'   : 'trash',
                          '[Gmail]/Spam'    : 'spam',
                          '[Gmail]/Sent Mail' : 'sent',
                          '[Gmail]/Important' : 'important',
                          '[Gmail]/Drafts'    : 'drafts',
                          '[Gmail]/All Mail'  : 'archive',
                          'INBOX'             : 'inbox',
                        }.get (s, s).decode ('imap4-utf-7').encode ('utf8')
  
  
  [Account imap_1]
  localrepository = Local_imap1
  remoterepository = Remote_imap1
  
  [Repository Local_imap1]
  type = Maildir
  localfolders = /home/gaute/.mail/imap_1
  nametrans = lambda s: s.replace ('archive', 'Archives').replace ('drafts', 'Drafts').replace ('sent', 'Sent').replace ('trash', 'Trash').decode ('utf8').encode ('imap4-utf-7')
  
  [Repository Remote_imap1]
  type = IMAP
  remotehost = imap_1
  nametrans  = lambda s: s.replace ('Archives', 'archive').replace ('Drafts', 'drafts').replace ('Sent', 'sent').replace ('Trash', 'trash').decode ('imap4-utf-7').encode ('utf8')
  
  [Account imap_2]
  localrepository = Local_imap2
  remoterepository = Remote_imap2
  
  [Repository Local_imap2]
  type = Maildir
  localfolders = /home/gaute/.mail/imap_2
  nametrans: lambda s: dict((value,key) for key,value in
                        {  'INBOX'             : 'inbox',
                        }.iteritems()).get (s, s).decode ('utf8').encode ('imap4-utf-7')
  
  [Repository Remote_imap2]
  type = IMAP
  remotehost = imap_2
  nametrans: lambda s: {  'INBOX'             : 'inbox',
                        }.get (s, s).decode ('imap4-utf-7').encode ('utf8')
  
  
  [-- Attachment #1.3: utf7.py --]
  [-- Type: application/x-python, Size: 2213 bytes --]
  
  [-- Warning: decoded text below may be mangled, UTF-8 assumed --]
  [-- Attachment #1.4: sources.yaml --]
  [-- Type: text/x-yaml; name="sources.yaml", Size: 1560 bytes --]
  
  ---
  - !supmua.org,2006-10-01/Redwood/MaildirRoot
    uri: maildirroot:/home/gaute/.mail/gaute.vetsj.com/
    usual: true
    archived: false
    id: 1
    labels: []
    sync_back: true
    confirm_enable_experimental: true
    maildir_creation_allowed: true
    inbox_folder: inbox
    sent_folder: sent
    drafts_folder: drafts
    spam_folder: spam
    trash_folder: trash
    archive_folder: archive
  - !supmua.org,2006-10-01/Redwood/MaildirRoot
    uri: maildirroot:/home/gaute/.mail/vetsj.com/
    usual: true
    archived: false
    id: 2
    labels: []
    sync_back: true
    confirm_enable_experimental: true
    maildir_creation_allowed: true
    inbox_folder: inbox
    sent_folder: sent
    drafts_folder: drafts
    spam_folder: spam
    trash_folder: trash
    archive_folder: archive
  - !supmua.org,2006-10-01/Redwood/MaildirRoot
    uri: maildirroot:/home/gaute/.mail/imap_1
    usual: true
    archived: false
    id: 3
    labels:
    - some_1 =
  
    sync_back: true
    confirm_enable_experimental: true
    maildir_creation_allowed: true
    inbox_folder: INBOX
    sent_folder: sent
    drafts_folder: drafts
    spam_folder: spam
    trash_folder: trash
    archive_folder: archive
  - !supmua.org,2006-10-01/Redwood/MaildirRoot
    uri: maildirroot:/home/gaute/.mail/imap_2
    usual: true
    archived: false
    id: 4
    labels:
    - some_2 =
  
    sync_back: true
    confirm_enable_experimental: true
    maildir_creation_allowed: true
    inbox_folder: inbox
    sent_folder: Sent Items
    drafts_folder: Drafts
    spam_folder: Junk E-mail
    trash_folder: Deleted Items
    archive_folder: archive
  - !supmua.org,2006-10-01/Redwood/SentLoader {}
  
  [-- Warning: decoded text below may be mangled, UTF-8 assumed --]
  [-- Attachment #1.5: config.yaml --]
  [-- Type: text/x-yaml; name="config.yaml", Size: 603 bytes --]
  
  [...]
  :editor: vim -f -c 'set ft=3Dmail' '+/^\s*\n/' '+nohl'
  :confirm_no_attachments: true
  :thread_by_subject: false
  :edit_signature: false
  :ask_for_from: false
  :ask_for_to: true
  :ask_for_cc: false
  :ask_for_bcc: false
  :ask_for_subject: true
  :account_selector: true
  :confirm_top_posting: false
  :jump_to_open_message: true
  :discard_snippets_from_encrypted_messages: false
  :load_more_threads_when_scrolling: true
  :default_attachment_save_dir: ''
  :sent_source: sup://sent
  :archive_sent: true
  :poll_interval: 300
  :wrap_width: 0
  :slip_rows: 0
  :col_jump: 2
  :stem_language: english
  :sync_back_to_maildir: true
  
  
  [-- Attachment #2: signature.asc --]
  [-- Type: application/pgp-signature, Size: 836 bytes --]
  
  ^ permalink raw reply	[flat|nested] 18+ messages in thread

• • * Re: A maildir root source: syncing labels with maildirs (imap folders)
      2013-11-25 21:51 ` Gaute Hope
    @ 2013-11-25 22:28   ` Gaute Hope
      2013-11-26 14:43   ` [sup-devel] " Steven Schmeiser
      1 sibling, 0 replies; 18+ messages in thread
    From: Gaute Hope @ 2013-11-25 22:28 UTC (permalink / raw)
      To: sup-devel
    
    [-- Attachment #1: Type: text/plain, Size: 191 bytes --]
    
    By the way:
    
    sub dirs show up with dots between them so maildir:
    dev/sup becomes label dev.sup (can't remember if this is standard
    offlineimap behavior or something I did).
    
    - gaute
    
    
    [-- Attachment #2: signature.asc --]
    [-- Type: application/pgp-signature, Size: 836 bytes --]
    
    ^ permalink raw reply	[flat|nested] 18+ messages in thread

  • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
      2013-11-25 21:51 ` Gaute Hope
      2013-11-25 22:28   ` Gaute Hope
    @ 2013-11-26 14:43   ` Steven Schmeiser
      2013-11-26 15:14     ` Gaute Hope
      1 sibling, 1 reply; 18+ messages in thread
    From: Steven Schmeiser @ 2013-11-26 14:43 UTC (permalink / raw)
      To: sup-devel
    
    I've installed the branch and am trying it out.  So far it looks good, but there have been a few oddities...
    
    I'm running with a standard IMAP account (not Gmail).  The root looks like
    
    [steve@indy ~]$ ls -l .mail
    total 0
    drwx------  5 steve  staff  170 Nov 19 13:44 Archive
    drwx------  5 steve  staff  170 Nov 22 12:31 INBOX
    drwx------  5 steve  staff  170 Nov 19 13:44 drafts
    drwx------  5 steve  staff  170 Nov 19 13:44 econpapers
    drwx------  5 steve  staff  170 Nov 19 13:44 sent
    drwx------  5 steve  staff  170 Nov 19 13:44 spam
    drwx------  5 steve  staff  170 Nov 25 19:25 trash
    
    and my sources are configured as follows
    
    [steve@indy ~]$ more .sup/sources.yaml
    ---
    - !supmua.org,2006-10-01/Redwood/MaildirRoot
      uri: maildirroot:///Users/steve/.mail
      usual: true
      archived: false
      id: 1
      labels: []
      sync_back: true
      confirm_enable_experimental: true
      maildir_creation_allowed: true
      inbox_folder: INBOX
      sent_folder: sent
      drafts_folder: drafts
      spam_folder: spam
      trash_folder: trash
      archive_folder: Archive
    - !supmua.org,2006-10-01/Redwood/SentLoader{}
    
    I had around 40k messages in the Archive folder and ~20 in the INBOX.  After sup-sync, around 10k of the messages in Archive were moved into sup's inbox with labels 'INBOX' and 'Inbox'.  They were also (incorrectly) marked as unread.
    
    I'll keep experimenting.  Thanks for your effort -- I think this is a great new feature and would really like to see it merged into the mainline someday.
    
    Steve
    
    
    > Hi,
    > 
    > I have attached my relevant configs (and hopefully managed to anonymize
    > them enough). As you can see I use the 'utf7.py' module (placed in
    > ~/.offlineimap/) to decode/encode between imap4-utf-7 and utf-8 on
    > system (if your filesystem uses a different encoding you might have
    > issues). Please don't use the configs verbatim, but rather as
    > inspiration: I might have cut out important parts. Some of this is
    > in the wiki.
    > 
    > Some of the folders are translated (bi-directional of course) in my
    > offlineimaprc, but if you check out my sources.yaml you will see that I
    > have specified which folders are related to special (deleted, starred,
    > inbox, etc) for some of the sources.
    > 
    > My translation setup in offlineimaprc for my first GMail account
    > corresponds to the default values the maildirroot source suggests. The
    > only relevant change in config.yaml is to set sync_back_to_maildir:
    > true.
    > 
    > The way I set up sup with maildirroot is:
    > $ sup-config
    > 
    > fill in, don't add any sources. If you have a working config.yaml, you
    > can use it.
    > 
    > add sources:
    > $ sup-add maildirroot:///home/gaute/.mail/imap_account
    > 
    > I edit ~/.sup/sources.yaml and enable:
    > - confirm_enable_experimental: true
    > - sync_back: true
    > - maildir_creation_allowed: true
    > 
    > and tweak the folder names if necessary.
    > 
    > Then if your index is empty (you _cannot_ merge an existing maildir
    > source by using the same source id) - I run sup-sync:
    > $ sup-sync -v
    > 
    > Note that sup-sync does not support the :updated flag (when a message
    > has moved on disk), for that you have to run regular Sup and do a poll.
    > sup-sync scans through and adds labels; you can also just start up sup
    > and see what happens, but that takes a longer time: you probably do not
    > need to enable the stuff in sources.yaml before after sup-sync if you
    > are nervous (I would be!). 
    > 
    > Some annoying issues:
    > - deleting a maildir is hard:
    >   * if you delete it remotely it will be recreated by offlineimap (i
    >     think)
    >   * you have to first remove all emails remotely, sync sup, to make sure
    >     labels are removed.
    >   * if you remove all messages from a label the maildir will be empty,
    >     to delete the maildir: sync, delete the maildir locally + delete it
    >     remotely; then re-sync.
    > 
    >     this is the behaviour of offlineimap, but I think it is hard to do
    >     it differently. this means that if you accidentally add a bogus
    >     label, it is a bit of a pain to get rid of the maildir.
    > 
    > 
    > - if a message is deleted from the inbox remotely (archived) it is not
    >   removed from the inbox view (or any thread index view it is visible
    >   in) before sup is restarted.
    > 
    > To test maildirroot:
    > checkout my branch; make the gem: $ rake gem and install it: $ gem
    > install pkg/sup-999.gem. If develop has changed you can try to merge it in
    > first.
    > 
    > Again; please make a backup copy of your .mail so that you can restore
    > it if it turns out maildirroot has been eating or multiplying emails :)
    > 
    > I probably don't have the time to difficult bugs, but I would be happy
    > to accept patches and I could also put this branch on official Sup if it
    > turns out to be worth something.
    > 
    > 
    > Cheers, Gaute
    _______________________________________________
    Sup-devel mailing list
    Sup-devel@rubyforge.org
    http://rubyforge.org/mailman/listinfo/sup-devel
    
    
    ^ permalink raw reply	[flat|nested] 18+ messages in thread

  • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
        2013-11-26 14:43   ` [sup-devel] " Steven Schmeiser
      @ 2013-11-26 15:14     ` Gaute Hope
        2013-11-26 16:42       ` Steven Schmeiser
        0 siblings, 1 reply; 18+ messages in thread
      From: Gaute Hope @ 2013-11-26 15:14 UTC (permalink / raw)
        To: sup-devel
      
      Excerpts from Steven Schmeiser's message of 2013-11-26 15:43:49 +0100:
      > I've installed the branch and am trying it out.  So far it looks good, but there have been a few oddities...
      > 
      > I'm running with a standard IMAP account (not Gmail).  The root looks like
      > 
      > [steve@indy ~]$ ls -l .mail
      > total 0
      > drwx------  5 steve  staff  170 Nov 19 13:44 Archive
      > drwx------  5 steve  staff  170 Nov 22 12:31 INBOX
      > drwx------  5 steve  staff  170 Nov 19 13:44 drafts
      > drwx------  5 steve  staff  170 Nov 19 13:44 econpapers
      > drwx------  5 steve  staff  170 Nov 19 13:44 sent
      > drwx------  5 steve  staff  170 Nov 19 13:44 spam
      > drwx------  5 steve  staff  170 Nov 25 19:25 trash
      > 
      > and my sources are configured as follows
      > 
      > [steve@indy ~]$ more .sup/sources.yaml
      > ---
      > - !supmua.org,2006-10-01/Redwood/MaildirRoot
      >   uri: maildirroot:///Users/steve/.mail
      >   usual: true
      >   archived: false
      >   id: 1
      >   labels: []
      >   sync_back: true
      >   confirm_enable_experimental: true
      >   maildir_creation_allowed: true
      >   inbox_folder: INBOX
      >   sent_folder: sent
      >   drafts_folder: drafts
      >   spam_folder: spam
      >   trash_folder: trash
      >   archive_folder: Archive
      > - !supmua.org,2006-10-01/Redwood/SentLoader{}
      > 
      > I had around 40k messages in the Archive folder and ~20 in the INBOX.  After sup-sync, around 10k of the messages in Archive were moved into sup's inbox with labels 'INBOX' and 'Inbox'.  They were also (incorrectly) marked as unread.
      > 
      > I'll keep experimenting.  Thanks for your effort -- I think this is a great new feature and would really like to see it merged into the mainline someday.
      
      Ok, there are likely to be a few more of the oddities - you are brave :)
      
      Please set the environment variable: SUP_LOG_LEVEL=debug and try to
      start sup, it would be interesting to see how the maildirsubs are
      initialized (the startup section from ~/.sup/log).
      
      Were any of the messages in Archive also somewhere else (duplicates with
      the same id)? Also, if sup discovers a message that is part of a thread
      it will join them and (possibly) apply all the labels to all the
      messages in that thread. If any of those are unread it might be
      affected.
      
      The labels 'INBOX' and 'Inbox' are both not the same as the special
      label 'inbox', so apparently it is not recognized as the special label
      but a custom label.
      
      It could be that you have more luck with starting with a clean index and
      just starting regular sup (not sup-sync). You can follow the log by
      doing: tail -f ~/.sup/log.
      
      - gaute
      
      
      
      ^ permalink raw reply	[flat|nested] 18+ messages in thread

    • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
          2013-11-26 15:14     ` Gaute Hope
        @ 2013-11-26 16:42       ` Steven Schmeiser
          2013-11-26 16:55         ` Gaute Hope
          0 siblings, 1 reply; 18+ messages in thread
        From: Steven Schmeiser @ 2013-11-26 16:42 UTC (permalink / raw)
          To: Sup developer discussion
        
        
        
        On Nov 26, 2013, at 10:14, Gaute Hope <eg@gaute.vetsj.com> wrote:
        
        > Excerpts from Steven Schmeiser's message of 2013-11-26 15:43:49 +0100:
        >> I've installed the branch and am trying it out.  So far it looks good, but there have been a few oddities...
        >> 
        >> I'm running with a standard IMAP account (not Gmail).  The root looks like
        >> 
        >> [steve@indy ~]$ ls -l .mail
        >> total 0
        >> drwx------  5 steve  staff  170 Nov 19 13:44 Archive
        >> drwx------  5 steve  staff  170 Nov 22 12:31 INBOX
        >> drwx------  5 steve  staff  170 Nov 19 13:44 drafts
        >> drwx------  5 steve  staff  170 Nov 19 13:44 econpapers
        >> drwx------  5 steve  staff  170 Nov 19 13:44 sent
        >> drwx------  5 steve  staff  170 Nov 19 13:44 spam
        >> drwx------  5 steve  staff  170 Nov 25 19:25 trash
        >> 
        >> and my sources are configured as follows
        >> 
        >> [steve@indy ~]$ more .sup/sources.yaml
        >> ---
        >> - !supmua.org,2006-10-01/Redwood/MaildirRoot
        >>  uri: maildirroot:///Users/steve/.mail
        >>  usual: true
        >>  archived: false
        >>  id: 1
        >>  labels: []
        >>  sync_back: true
        >>  confirm_enable_experimental: true
        >>  maildir_creation_allowed: true
        >>  inbox_folder: INBOX
        >>  sent_folder: sent
        >>  drafts_folder: drafts
        >>  spam_folder: spam
        >>  trash_folder: trash
        >>  archive_folder: Archive
        >> - !supmua.org,2006-10-01/Redwood/SentLoader{}
        >> 
        >> I had around 40k messages in the Archive folder and ~20 in the INBOX. After sup-sync, around 10k of the messages in Archive were moved into sup's inbox with labels 'INBOX' and 'Inbox'.  They were also (incorrectly) marked as unread.
        >> 
        >> I'll keep experimenting.  Thanks for your effort -- I think this is a great new feature and would really like to see it merged into the mainline someday.
        > 
        > Ok, there are likely to be a few more of the oddities - you are brave :)
        > 
        > Please set the environment variable: SUP_LOG_LEVEL=debug and try to
        > start sup, it would be interesting to see how the maildirsubs are
        > initialized (the startup section from ~/.sup/log).
        > 
        > Were any of the messages in Archive also somewhere else (duplicates with
        > the same id)? Also, if sup discovers a message that is part of a thread
        > it will join them and (possibly) apply all the labels to all the
        > messages in that thread. If any of those are unread it might be
        > affected.
        > 
        > The labels 'INBOX' and 'Inbox' are both not the same as the special
        > label 'inbox', so apparently it is not recognized as the special label
        > but a custom label.
        > 
        > It could be that you have more luck with starting with a clean index and
        > just starting regular sup (not sup-sync). You can follow the log by
        > doing: tail -f ~/.sup/log.
        > 
        > - gaute
        
        Startup log follows...
        
        [2013-11-26 11:34:20 -0500] using character set encoding "UTF-8"
        [2013-11-26 11:34:21 -0500] dynamically loading setlocale() from libc.dylib
        [2013-11-26 11:34:21 -0500] setting locale...
        [2013-11-26 11:34:21 -0500] locking /Users/steve/.sup/lock...
        [2013-11-26 11:34:21 -0500] maildirroot:///Users/steve/.mail: setting up maildirroot..
        [2013-11-26 11:34:21 -0500] setting up maildir subs..
        [2013-11-26 11:34:21 -0500] maildirsub set up, type: archive, label: archive
        [2013-11-26 11:34:21 -0500] maildirsub set up, type: inbox, label: inbox
        [2013-11-26 11:34:21 -0500] maildirsub set up, type: sent, label: sent
        [2013-11-26 11:34:21 -0500] maildirsub set up, type: draft, label: draft
        [2013-11-26 11:34:21 -0500] maildirsub set up, type: spam, label: spam
        [2013-11-26 11:34:21 -0500] maildirsub set up, type: deleted, label: deleted
        [2013-11-26 11:34:21 -0500] setting up generic folders..
        [2013-11-26 11:34:21 -0500] maildirsub set up, type: generic, label: econpapers
        [2013-11-26 11:34:21 -0500] no draft source, auto-adding...
        [2013-11-26 11:34:21 -0500] starting curses
        [2013-11-26 11:34:21 -0500] loading user colors from /Users/steve/.sup/colors.yaml
        [2013-11-26 11:34:21 -0500] initializing log buffer
        [2013-11-26 11:34:21 -0500] Welcome to Sup! Log level is set to debug.
        [2013-11-26 11:34:21 -0500] initializing inbox buffer
        [2013-11-26 11:34:21 -0500] ready for interaction!
        
        I'm now not able to run sup-sync or open some of the threads in my inbox without crashing with the following error:
        
        /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/bin/sup-sync:180:in `block (2 levels) in <top (required)>': NotImplementedError (NotImplementedError)
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/poll.rb:292:in `block (2 levels) in poll_from'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/index.rb:298:in `block in each_message'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/index.rb:285:in `block in each_id'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/index.rb:285:in `each'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/index.rb:285:in `each_id'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/index.rb:297:in `each_message'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/util.rb:649:in `method_missing'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/poll.rb:251:in `block in poll_from'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/maildirroot.rb:512:in `block (2 levels) in poll'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/maildirroot.rb:511:in `each'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/maildirroot.rb:511:in `block in poll'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/util.rb:261:in `call'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/util.rb:261:in `block in benchmark'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/1.9.1/benchmark.rb:280:in `measure'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/util.rb:261:in `benchmark'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/maildirroot.rb:474:in `poll'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/poll.rb:201:in `poll_from'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/lib/sup/util.rb:649:in `method_missing'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/bin/sup-sync:125:in `block in <top (required)>'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/bin/sup-sync:120:in `each'
                from /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/bin/sup-sync:120:in `<top (required)>'
                from /usr/local/opt/ruby193/bin/sup-sync:23:in `load'
                from /usr/local/opt/ruby193/bin/sup-sync:23:in `<main>'
        
        I'll try starting with a clean index.
        
        Steve
        _______________________________________________
        Sup-devel mailing list
        Sup-devel@rubyforge.org
        http://rubyforge.org/mailman/listinfo/sup-devel
        
        
        ^ permalink raw reply	[flat|nested] 18+ messages in thread

      • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
            2013-11-26 16:42       ` Steven Schmeiser
          @ 2013-11-26 16:55         ` Gaute Hope
            2013-11-27  0:48           ` Steven Schmeiser
            2013-11-27  6:23           ` Gaute Hope
            0 siblings, 2 replies; 18+ messages in thread
          From: Gaute Hope @ 2013-11-26 16:55 UTC (permalink / raw)
            To: sup-devel
          
          Excerpts from Steven Schmeiser's message of 2013-11-26 17:42:48 +0100:
          > 
          > On Nov 26, 2013, at 10:14, Gaute Hope <eg@gaute.vetsj.com> wrote:
          > 
          > > Excerpts from Steven Schmeiser's message of 2013-11-26 15:43:49 +0100:
          > [2013-11-26 11:34:21 -0500] maildirsub set up, type: deleted, label: deleted
          > [2013-11-26 11:34:21 -0500] setting up generic folders..
          > [2013-11-26 11:34:21 -0500] maildirsub set up, type: generic, label: econpapers
          > [2013-11-26 11:34:21 -0500] no draft source, auto-adding...
          > [2013-11-26 11:34:21 -0500] starting curses
          > [2013-11-26 11:34:21 -0500] loading user colors from /Users/steve/.sup/colors.yaml
          > [2013-11-26 11:34:21 -0500] initializing log buffer
          > [2013-11-26 11:34:21 -0500] Welcome to Sup! Log level is set to debug.
          > [2013-11-26 11:34:21 -0500] initializing inbox buffer
          > [2013-11-26 11:34:21 -0500] ready for interaction!
          
          Looks good: Only econpapers is identified as a generic label, the other
          folders are mapped to one of the specials.
          
          
          > 
          > I'm now not able to run sup-sync or open some of the threads in my inbox without crashing with the following error:
          > 
          > /usr/local/Cellar/ruby193/1.9.3-p448/lib/ruby/gems/1.9.1/gems/sup-999/bin/sup-sync:180:in `block (2 levels) in <top (required)>': NotImplementedError (NotImplementedError)
          
          I haven't implemented :updated in sup-sync yet (see first, or possibly
          second email). To update: start Sup normally, let the Sup poll _finish_
          before you try to open the problematic message. This happens now and
          then, when you label a message (copy to a label dir) it gets a generic
          name, upon offlinimap sync it is renamed (by offlineimap) and untill a
          new poll has been run the source is out of sync. Since the poll has to
          finish to fix the error it is easy to trigger it again when if you start
          sup again.
           
          
          > I'll try starting with a clean index.
          
          Always a good idea :)
          
          - gaute
          
          
          
          ^ permalink raw reply	[flat|nested] 18+ messages in thread

        • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
              2013-11-26 16:55         ` Gaute Hope
            @ 2013-11-27  0:48           ` Steven Schmeiser
              2013-11-27  6:21             ` Gaute Hope
              2013-11-27  6:23           ` Gaute Hope
              1 sibling, 1 reply; 18+ messages in thread
            From: Steven Schmeiser @ 2013-11-27  0:48 UTC (permalink / raw)
              To: sup-devel
            
            
             
            > Excerpts from Steven Schmeiser's message of 2013-11-26 17:42:48 +0100:
            > > 
            > > On Nov 26, 2013, at 10:14, Gaute Hope <eg@gaute.vetsj.com> wrote:
            > > 
            > > > Excerpts from Steven Schmeiser's message of 2013-11-26 15:43:49 +0100:
            > > [2013-11-26 11:34:21 -0500] maildirsub set up, type: deleted, label: deleted
            > > [2013-11-26 11:34:21 -0500] setting up generic folders..
            > > [2013-11-26 11:34:21 -0500] maildirsub set up, type: generic, label: econpapers
            > > [2013-11-26 11:34:21 -0500] no draft source, auto-adding...
            > > [2013-11-26 11:34:21 -0500] starting curses
            > > [2013-11-26 11:34:21 -0500] loading user colors from /Users/steve/.sup/colors.yaml
            > > [2013-11-26 11:34:21 -0500] initializing log buffer
            > > [2013-11-26 11:34:21 -0500] Welcome to Sup! Log level is set to debug.
            > > [2013-11-26 11:34:21 -0500] initializing inbox buffer
            > > [2013-11-26 11:34:21 -0500] ready for interaction!
            > 
            > Looks good: Only econpapers is identified as a generic label, the other
            > folders are mapped to one of the specials.
            
            It turned out to be a before-add-message hook that was causing all the problems.  Working great now.
            
            Steve
            _______________________________________________
            Sup-devel mailing list
            Sup-devel@rubyforge.org
            http://rubyforge.org/mailman/listinfo/sup-devel
            
            
            ^ permalink raw reply	[flat|nested] 18+ messages in thread

          • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
                2013-11-27  0:48           ` Steven Schmeiser
              @ 2013-11-27  6:21             ` Gaute Hope
                2013-11-27 12:42               ` Steven Schmeiser
                0 siblings, 1 reply; 18+ messages in thread
              From: Gaute Hope @ 2013-11-27  6:21 UTC (permalink / raw)
                To: sup-devel
              
              Excerpts from Steven Schmeiser's message of 2013-11-27 01:48:20 +0100:
              >
              > > Excerpts from Steven Schmeiser's message of 2013-11-26 17:42:48 +0100:
              > > >
              > > > On Nov 26, 2013, at 10:14, Gaute Hope <eg@gaute.vetsj.com> wrote:
              > > >
              > > > > Excerpts from Steven Schmeiser's message of 2013-11-26 15:43:49 +0100:
              > > > [2013-11-26 11:34:21 -0500] maildirsub set up, type: deleted, label: deleted
              > > > [2013-11-26 11:34:21 -0500] setting up generic folders..
              > > > [2013-11-26 11:34:21 -0500] maildirsub set up, type: generic, label: econpapers
              > > > [2013-11-26 11:34:21 -0500] no draft source, auto-adding...
              > > > [2013-11-26 11:34:21 -0500] starting curses
              > > > [2013-11-26 11:34:21 -0500] loading user colors from /Users/steve/.sup/colors.yaml
              > > > [2013-11-26 11:34:21 -0500] initializing log buffer
              > > > [2013-11-26 11:34:21 -0500] Welcome to Sup! Log level is set to debug.
              > > > [2013-11-26 11:34:21 -0500] initializing inbox buffer
              > > > [2013-11-26 11:34:21 -0500] ready for interaction!
              > >
              > > Looks good: Only econpapers is identified as a generic label, the other
              > > folders are mapped to one of the specials.
              >
              > It turned out to be a before-add-message hook that was causing all the problems.  Working great now.
              
              Cool! Let me know how it works in the longer run!
              
              I was thinking about changing one thing: currently messages are not
              copied into 'archive' before it has been _no_ other labels. On GMail you
              can still find it on the 'All mail' page on the web interface, but for
              regular IMAP accounts that doesn't work. Should the message always be
              copied to 'archive' when it is removed from the inbox?
              
              - gaute
              
              
              
              ^ permalink raw reply	[flat|nested] 18+ messages in thread

            • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
                  2013-11-27  6:21             ` Gaute Hope
                @ 2013-11-27 12:42               ` Steven Schmeiser
                  2013-11-27 13:08                 ` Gaute Hope
                  0 siblings, 1 reply; 18+ messages in thread
                From: Steven Schmeiser @ 2013-11-27 12:42 UTC (permalink / raw)
                  To: sup-devel
                
                 
                > Excerpts from Steven Schmeiser's message of 2013-11-27 01:48:20 +0100:
                > >
                > > > Excerpts from Steven Schmeiser's message of 2013-11-26 17:42:48 +0100:
                > > > >
                > > > > On Nov 26, 2013, at 10:14, Gaute Hope <eg@gaute.vetsj.com> wrote:
                > > > >
                > > > > > Excerpts from Steven Schmeiser's message of 2013-11-26 15:43:49 +0100:
                > > > > [2013-11-26 11:34:21 -0500] maildirsub set up, type: deleted, label: deleted
                > > > > [2013-11-26 11:34:21 -0500] setting up generic folders..
                > > > > [2013-11-26 11:34:21 -0500] maildirsub set up, type: generic, label: econpapers
                > > > > [2013-11-26 11:34:21 -0500] no draft source, auto-adding...
                > > > > [2013-11-26 11:34:21 -0500] starting curses
                > > > > [2013-11-26 11:34:21 -0500] loading user colors from /Users/steve/.sup/colors.yaml
                > > > > [2013-11-26 11:34:21 -0500] initializing log buffer
                > > > > [2013-11-26 11:34:21 -0500] Welcome to Sup! Log level is set to debug.
                > > > > [2013-11-26 11:34:21 -0500] initializing inbox buffer
                > > > > [2013-11-26 11:34:21 -0500] ready for interaction!
                > > >
                > > > Looks good: Only econpapers is identified as a generic label, the other
                > > > folders are mapped to one of the specials.
                > >
                > > It turned out to be a before-add-message hook that was causing all the problems.  Working great now.
                > 
                > Cool! Let me know how it works in the longer run!
                > 
                > I was thinking about changing one thing: currently messages are not
                > copied into 'archive' before it has been _no_ other labels. On GMail you
                > can still find it on the 'All mail' page on the web interface, but for
                > regular IMAP accounts that doesn't work. Should the message always be
                > copied to 'archive' when it is removed from the inbox?
                > 
                > - gaute
                
                I don't have much personal preference between these two options.  The second option is closer to Gmail's "All Mail" folder that a lot of people are familiar with, so maybe that is the way to go.  Especially if the "copy" is a hard link that doesn't take up disk space. 
                
                Steve
                _______________________________________________
                Sup-devel mailing list
                Sup-devel@rubyforge.org
                http://rubyforge.org/mailman/listinfo/sup-devel
                
                
                ^ permalink raw reply	[flat|nested] 18+ messages in thread

              • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
                    2013-11-27 12:42               ` Steven Schmeiser
                  @ 2013-11-27 13:08                 ` Gaute Hope
                    2013-11-27 13:24                   ` Gaute Hope
                    2013-11-27 18:32                   ` Matthieu Rakotojaona
                    0 siblings, 2 replies; 18+ messages in thread
                  From: Gaute Hope @ 2013-11-27 13:08 UTC (permalink / raw)
                    To: sup-devel
                  
                  Excerpts from Steven Schmeiser's message of 2013-11-27 13:42:33 +0100:
                  > > I was thinking about changing one thing: currently messages are not
                  > > copied into 'archive' before it has been _no_ other labels. On GMail
                  > > you can still find it on the 'All mail' page on the web interface,
                  > > but for regular IMAP accounts that doesn't work. Should the message
                  > > always be copied to 'archive' when it is removed from the inbox?
                  > >
                  > > - gaute
                  >
                  > I don't have much personal preference between these two options.  The
                  > second option is closer to Gmail's "All Mail" folder that a lot of
                  > people are familiar with, so maybe that is the way to go.  Especially
                  > if the "copy" is a hard link that doesn't take up disk space.
                  
                  I noticed Gmail does it that way in their IMAP interface (archive on no
                  other labels), thats why I did it. I guess it doesn't matter all that
                  much as long as we are all using Sup. Archive becomes a place for the
                  uncategorized. I don't delete an email from archive if it is already in
                  there, so if it at some point has been copied in there - it stays.
                  
                  Copy is hard-link, but I doubt offlineimap is able to identify remote
                  identical emails. So hard-linking is only on the machine that the
                  link happened on.
                  
                  - gaute
                  
                  
                  
                  ^ permalink raw reply	[flat|nested] 18+ messages in thread

                • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
                      2013-11-27 13:08                 ` Gaute Hope
                    @ 2013-11-27 13:24                   ` Gaute Hope
                      2013-11-27 18:32                   ` Matthieu Rakotojaona
                      1 sibling, 0 replies; 18+ messages in thread
                    From: Gaute Hope @ 2013-11-27 13:24 UTC (permalink / raw)
                      To: sup-devel
                    
                    Excerpts from Gaute Hope's message of 2013-11-27 14:08:36 +0100:
                    > Excerpts from Steven Schmeiser's message of 2013-11-27 13:42:33 +0100:
                    > > > I was thinking about changing one thing: currently messages are not
                    > > > copied into 'archive' before it has been _no_ other labels. On GMail
                    > > > you can still find it on the 'All mail' page on the web interface,
                    > > > but for regular IMAP accounts that doesn't work. Should the message
                    > > > always be copied to 'archive' when it is removed from the inbox?
                    > > >
                    > > > - gaute
                    > >
                    > > I don't have much personal preference between these two options.  The
                    > > second option is closer to Gmail's "All Mail" folder that a lot of
                    > > people are familiar with, so maybe that is the way to go.  Especially
                    > > if the "copy" is a hard link that doesn't take up disk space.
                    >
                    > I noticed Gmail does it that way in their IMAP interface (archive on no
                    > other labels), thats why I did it. I guess it doesn't matter all that
                    > much as long as we are all using Sup. Archive becomes a place for the
                    > uncategorized. I don't delete an email from archive if it is already in
                    > there, so if it at some point has been copied in there - it stays.
                    >
                    > Copy is hard-link, but I doubt offlineimap is able to identify remote
                    > identical emails. So hard-linking is only on the machine that the
                    > link happened on.
                    
                    Another nice feature is that I now have the possibility to have my
                    filters on the server copy/move the message to a IMAP folder and it will be
                    automatically tagged in Sup as well.
                    
                    Some servers automatically delete stuff in Trash / Deleted Items or
                    email marked as Trash (T), these will also be removed from Sup when they
                    are deleted (might not work when it is in several folders and only
                    marked with T).
                    
                    - gaute
                    
                    
                    
                    ^ permalink raw reply	[flat|nested] 18+ messages in thread

                  • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
                      2013-11-27 13:08                 ` Gaute Hope
                      2013-11-27 13:24                   ` Gaute Hope
                    @ 2013-11-27 18:32                   ` Matthieu Rakotojaona
                      2013-11-27 21:10                     ` Gaute Hope
                      1 sibling, 1 reply; 18+ messages in thread
                    From: Matthieu Rakotojaona @ 2013-11-27 18:32 UTC (permalink / raw)
                      To: sup-devel
                    
                    
                    [-- Attachment #1.1: Type: text/plain, Size: 1118 bytes --]
                    
                    Excerpts from Gaute Hope's message of 2013-11-27 14:08:36 +0100:
                    > I noticed Gmail does it that way in their IMAP interface (archive on no
                    > other labels), thats why I did it.
                    
                    _Any_ email in gmail is also in the All Mail [0], except when it is
                    manually moved to the [Gmail]/Trash folder, in which case it disappears
                    forever (well, at least for you :). I think this is the best solution,
                    because it is the most understandable for all MUAs out there: the fact
                    that "a maildir is a label" is something pretty specific to
                    gmail-pioneered MUAs, so at least when I backup the [Gmail]/All Mail I
                    know I won't have lost any of them (even if I have lost the labels).
                    
                    Regarding hardlinking, I'm afraid of the cross-platform issues. I know
                    some people here use Mac OSX, is it safe to use hardlinking on this
                    platform ?
                    
                    (Oh and by the way I found a script [1] that basically hardlinks every
                    copy of an email, this could be especially useful for gmail-based
                    installations)
                    
                    
                    
                    [0] https://support.google.com/mail/answer/78755?hl=en
                    [1] http://jak-linux.org/projects/hardlink/
                    
                    -- 
                    Matthieu Rakotojaona
                    
                    [-- Attachment #1.2: signature.asc --]
                    [-- Type: application/pgp-signature, Size: 836 bytes --]
                    
                    [-- Attachment #2: Type: text/plain, Size: 143 bytes --]
                    
                    _______________________________________________
                    Sup-devel mailing list
                    Sup-devel@rubyforge.org
                    http://rubyforge.org/mailman/listinfo/sup-devel
                    
                    ^ permalink raw reply	[flat|nested] 18+ messages in thread

                  • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
                        2013-11-27 18:32                   ` Matthieu Rakotojaona
                      @ 2013-11-27 21:10                     ` Gaute Hope
                        2013-11-29  9:22                       ` Gaute Hope
                        0 siblings, 1 reply; 18+ messages in thread
                      From: Gaute Hope @ 2013-11-27 21:10 UTC (permalink / raw)
                        To: sup-devel
                      
                      [-- Attachment #1: Type: text/plain, Size: 2429 bytes --]
                      
                      Excerpts from Matthieu Rakotojaona's message of 2013-11-27 19:32:02 +0100:
                      > Excerpts from Gaute Hope's message of 2013-11-27 14:08:36 +0100:
                      > > I noticed Gmail does it that way in their IMAP interface (archive on no
                      > > other labels), thats why I did it.
                      >
                      > _Any_ email in gmail is also in the All Mail [0], except when it is
                      > manually moved to the [Gmail]/Trash folder, in which case it disappears
                      > forever (well, at least for you :). I think this is the best solution,
                      > because it is the most understandable for all MUAs out there: the fact
                      > that "a maildir is a label" is something pretty specific to
                      > gmail-pioneered MUAs, so at least when I backup the [Gmail]/All Mail I
                      > know I won't have lost any of them (even if I have lost the labels).
                      
                      Hm ok. I just figured it out by trail-and-error, I probably missed
                      something. I have changed sync_back to always make sure the message is
                      present in the archive. This does not have any effect on existing
                      messages before you do some edit that triggers sync_back. It also
                      currently does not check new messages (since non-gmail sources will not
                      have a copy in archive), we should do a check upon :add in
                      poll.rb#do_poll to the source that checks if existing_sources has
                      @archive, if not add and return to poll with updated locations (no
                      sync_back needed and no index sync needed as poll will do that
                      afterwards).
                      
                      About deletion, current behavior:
                      - apply :deleted label; this means:
                      - the message is moved to the trash folder
                      - the T flag is added to all the labels it is part of
                      
                      this might not work exactly as it should on GMail, but it is the only
                      way to preserve labels (in case of restore).
                      
                      > Regarding hardlinking, I'm afraid of the cross-platform issues. I know
                      > some people here use Mac OSX, is it safe to use hardlinking on this
                      > platform ?
                      
                      I am using the util function I created for maildir-sync (in develop)
                      which falls back to copying the file if hardlinking fails, that function
                      works on Mac OS X. Hardlinking doesn't work for me since I am using
                      encfs to store mail.
                      
                      
                      > (Oh and by the way I found a script [1] that basically hardlinks every
                      > copy of an email, this could be especially useful for gmail-based
                      > installations)
                      >
                      > [0] https://support.google.com/mail/answer/78755?hl=en
                      > [1] http://jak-linux.org/projects/hardlink/
                      
                      That could be very useful and run as a cronjob now and then.
                      
                      - gaute
                      
                      
                      [-- Attachment #2: signature.asc --]
                      [-- Type: application/pgp-signature, Size: 836 bytes --]
                      
                      ^ permalink raw reply	[flat|nested] 18+ messages in thread

                    • • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
                          2013-11-27 21:10                     ` Gaute Hope
                        @ 2013-11-29  9:22                       ` Gaute Hope
                          0 siblings, 0 replies; 18+ messages in thread
                        From: Gaute Hope @ 2013-11-29  9:22 UTC (permalink / raw)
                          To: sup-devel
                        
                        [-- Attachment #1: Type: text/plain, Size: 997 bytes --]
                        
                        Excerpts from Gaute Hope's message of 2013-11-27 22:10:38 +0100:
                        > Excerpts from Matthieu Rakotojaona's message of 2013-11-27 19:32:02 +0100:
                        > > Excerpts from Gaute Hope's message of 2013-11-27 14:08:36 +0100:
                        [..]
                        
                        > It also
                        > currently does not check new messages (since non-gmail sources will not
                        > have a copy in archive), we should do a check upon :add in
                        > poll.rb#do_poll to the source that checks if existing_sources has
                        > @archive, if not add and return to poll with updated locations (no
                        > sync_back needed and no index sync needed as poll will do that
                        > afterwards).
                        
                        As of commit db5e75f we check in poll if the message is in archive,
                        otherwise add (archive is the first subdir to be polled so it should
                        always be present).
                        
                        Another issue is messages that get labels added automatically, these are
                        not synced back before the message is opened or somehow otherwise
                        activated. Could possibly do a full sync_back after :add, :delete or
                        :update in poll.
                        
                        - gaute
                        
                        
                        [-- Attachment #2: signature.asc --]
                        [-- Type: application/pgp-signature, Size: 836 bytes --]
                        
                        ^ permalink raw reply	[flat|nested] 18+ messages in thread

          • * Re: [sup-devel] A maildir root source: syncing labels with maildirs (imap folders)
              2013-11-26 16:55         ` Gaute Hope
              2013-11-27  0:48           ` Steven Schmeiser
            @ 2013-11-27  6:23           ` Gaute Hope
              1 sibling, 0 replies; 18+ messages in thread
            From: Gaute Hope @ 2013-11-27  6:23 UTC (permalink / raw)
              To: sup-devel
            
            [-- Attachment #1: Type: text/plain, Size: 748 bytes --]
            
            Excerpts from Gaute Hope's message of 2013-11-26 17:55:16 +0100:
            > I haven't implemented :updated in sup-sync yet (see first, or possibly
            > second email). To update: start Sup normally, let the Sup poll _finish_
            > before you try to open the problematic message. This happens now and
            > then, when you label a message (copy to a label dir) it gets a generic
            > name, upon offlinimap sync it is renamed (by offlineimap) and untill a
            > new poll has been run the source is out of sync. Since the poll has to
            > finish to fix the error it is easy to trigger it again when if you start
            > sup again.
            
            This, by the way, is also a problem in current Sup (maildir-syncback) -
            :updated is not handled in sup-sync. Only in lib/sup/poll.rb.
            
            - gaute
            
            [-- Attachment #2: signature.asc --]
            [-- Type: application/pgp-signature, Size: 836 bytes --]
            
            ^ permalink raw reply	[flat|nested] 18+ messages in thread

end of thread, other threads:[~2013-11-29  9:24 UTC | newest]

Thread overview: 18+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2013-11-25 15:24 A maildir root source: syncing labels with maildirs (imap folders) Gaute Hope
2013-11-25 18:23 ` [sup-devel] " Steven Schmeiser
2013-11-25 21:08 ` Matthieu Rakotojaona
2013-11-25 21:51 ` Gaute Hope
2013-11-25 22:28   ` Gaute Hope
2013-11-26 14:43   ` [sup-devel] " Steven Schmeiser
2013-11-26 15:14     ` Gaute Hope
2013-11-26 16:42       ` Steven Schmeiser
2013-11-26 16:55         ` Gaute Hope
2013-11-27  0:48           ` Steven Schmeiser
2013-11-27  6:21             ` Gaute Hope
2013-11-27 12:42               ` Steven Schmeiser
2013-11-27 13:08                 ` Gaute Hope
2013-11-27 13:24                   ` Gaute Hope
2013-11-27 18:32                   ` Matthieu Rakotojaona
2013-11-27 21:10                     ` Gaute Hope
2013-11-29  9:22                       ` Gaute Hope
2013-11-27  6:23           ` Gaute Hope

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox