Subject: Re: [sup-talk] search by message size (incl. attachments)

From: Iain <[email-masked]>
Date: Thu, 16 Dec 2010 13:21:10 +0000

Excerpts from Moritz Wilhelmy's message of Thu Dec 16 12:49:31 +0000 2010:
> You could use encfs locally and just rsync the encrypted encfs on the server?
> Also, see rsnapshot for incrememtal backups.

Another approach is duplicity, "Encrypted bandwidth-efficient backup
using the rsync algorithm": <http://duplicity.nongnu.org/>.

~Iain
_______________________________________________
sup-talk mailing list
[email-masked]
http://rubyforge.org/mailman/listinfo/sup-talk

---

From: Marc Hartstein <[email-masked]>
Date: Wed, 15 Dec 2010 16:15:14 -0500

Excerpts from Piotr Kempa's message of Wed Dec 15 10:59:06 -0500 2010:
> tl;dr: can you search by message size? or sort by that? 

Not sure, but maildir is one-file-per-message, so you could go ahead and
use your favorite tool which lets you inspect the filesystem and
identify large files.

You'd still have to work around sup potentially getting cranky that you
removed a file it was expecting to still be there. I forget how that all
works out.
_______________________________________________
sup-talk mailing list
[email-masked]
http://rubyforge.org/mailman/listinfo/sup-talk

---

From: Piotr Kempa <[email-masked]>
Date: Thu, 16 Dec 2010 14:19:30 +0100

Excerpts from Moritz Wilhelmy's message of 2010-12-16 13:49:31 +0100:
> Excerpts from Piotr Kempa's message of Thu Dec 16 10:22:03 +0100 2010:
> > Re incremental backup - that's something I'll have to do, true, but
> > since I want it to be encrypted on the backup server (with no other
> > users or root getting a peek:) I settled on just bzipping, encrypting
> > and uploading one huge file. Even when there are small changes, when
> > it's one file and it's encrypted, it changes the whole file. 
> > 
> > I could think about getting some loopfile and cryptsetup a LUKS on it on
> > the server, or maybe encfs (I'm not sure they have encfs the server
> > though...).
> 
Thanks, all great suggestions (especially rsyncing the encrypted encfs,
why didn't I think of that!). 

But from all the answers I gather there's no way to search or sort by
mail size in sup, correct? 

Piotr

---

From: Moritz Wilhelmy <[email-masked]>
Date: Thu, 16 Dec 2010 13:49:31 +0100

Cheers,

Moritz

---

From: Piotr Kempa <[email-masked]>
Date: Wed, 15 Dec 2010 16:59:06 +0100

'sup dear users of sup
(see the little joke I made there?)

So anyway, my question is this: is there any way to search (or sort) by
message size? E.g. find all emails bigger than 20MB.

Background: I've been using sup for a little over a year now and already
my work maildir is close to 2GB, and while sup works blazingly fast (I
love it for that) and I have plenty of space on my HDD, I need to backup
my maildir regularly, have it zipped, encrypted and sent away, and it's
taking more and more time. And backup space on our company central
server, per user, is not as large as on my own HDD. So I'm gonna have to
face the problem sooner or later. 

So I was thinking that some time in the future I'll have to find all
those huge (20meg+) emails and possibly delete some of them. I know
there's no sync-back to maildir in the main trunk now, but maybe there
will be before I get to 5 gig maildir. AFAIK there's something working
quite alright in the branches for some time now, so I guess it's gonna
make it to main sooner or later. 

And if all else fails I can always kick up the ruby interpreter, import
the index and generate a list of files with the 'Deleted' tag and just
'rm' that (it doesn't sound very safe maybe but I have backup:) 
But still I first need to find those large messages, right? 

Thanks!

---

From: Tero Tilus <[email-masked]>
Date: Thu, 16 Dec 2010 00:03:11 +0200

Piotr Kempa, 2010-12-15 17:59:
> I need to backup my maildir regularly, have it zipped, encrypted and
> sent away, and it's taking more and more time.

I'd go with incremental backups in that scenario.  Daily backup size
is gonna be a tiny fraction of the whole mail archive.

Repeatedly sending stuff that has not changed (as most of your mail in
current backup were in the previous too) is plain waste of resources.
No matter if the zip is a gig or five.

--
Tero Tilus ## 050 3635 235 ## http://tero.tilus.net/
_______________________________________________
sup-talk mailing list
[email-masked]
http://rubyforge.org/mailman/listinfo/sup-talk

---

From: Piotr Kempa <[email-masked]>
Date: Thu, 16 Dec 2010 10:22:03 +0100

> removed a file it was expecting to still be there. I forget how that all

Thanks for the suggestions, I thought about just finding the large
files, inspecting and removing but I'm afraid sup's will panic. But I
think I saw some way to sync it again to a changed source, so maybe
there's that. 

Thanks again!