* [sup-talk] search by message size (incl. attachments)
@ 2010-12-15 15:59 Piotr Kempa
2010-12-15 21:15 ` Marc Hartstein
2010-12-15 22:03 ` Tero Tilus
0 siblings, 2 replies; 7+ messages in thread
From: Piotr Kempa @ 2010-12-15 15:59 UTC (permalink / raw)
To: sup-talk
'sup dear users of sup
(see the little joke I made there?)
So anyway, my question is this: is there any way to search (or sort) by
message size? E.g. find all emails bigger than 20MB.
Background: I've been using sup for a little over a year now and already
my work maildir is close to 2GB, and while sup works blazingly fast (I
love it for that) and I have plenty of space on my HDD, I need to backup
my maildir regularly, have it zipped, encrypted and sent away, and it's
taking more and more time. And backup space on our company central
server, per user, is not as large as on my own HDD. So I'm gonna have to
face the problem sooner or later.
So I was thinking that some time in the future I'll have to find all
those huge (20meg+) emails and possibly delete some of them. I know
there's no sync-back to maildir in the main trunk now, but maybe there
will be before I get to 5 gig maildir. AFAIK there's something working
quite alright in the branches for some time now, so I guess it's gonna
make it to main sooner or later.
And if all else fails I can always kick up the ruby interpreter, import
the index and generate a list of files with the 'Deleted' tag and just
'rm' that (it doesn't sound very safe maybe but I have backup:)
But still I first need to find those large messages, right?
tl;dr: can you search by message size? or sort by that?
Thanks!
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-talk] search by message size (incl. attachments)
2010-12-15 15:59 [sup-talk] search by message size (incl. attachments) Piotr Kempa
@ 2010-12-15 21:15 ` Marc Hartstein
2010-12-16 9:22 ` Piotr Kempa
2010-12-15 22:03 ` Tero Tilus
1 sibling, 1 reply; 7+ messages in thread
From: Marc Hartstein @ 2010-12-15 21:15 UTC (permalink / raw)
To: sup-talk
[-- Attachment #1.1: Type: text/plain, Size: 458 bytes --]
Excerpts from Piotr Kempa's message of Wed Dec 15 10:59:06 -0500 2010:
> tl;dr: can you search by message size? or sort by that?
Not sure, but maildir is one-file-per-message, so you could go ahead and
use your favorite tool which lets you inspect the filesystem and
identify large files.
You'd still have to work around sup potentially getting cranky that you
removed a file it was expecting to still be there. I forget how that all
works out.
[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]
[-- Attachment #2: Type: text/plain, Size: 140 bytes --]
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-talk] search by message size (incl. attachments)
2010-12-15 15:59 [sup-talk] search by message size (incl. attachments) Piotr Kempa
2010-12-15 21:15 ` Marc Hartstein
@ 2010-12-15 22:03 ` Tero Tilus
1 sibling, 0 replies; 7+ messages in thread
From: Tero Tilus @ 2010-12-15 22:03 UTC (permalink / raw)
To: sup-talk
Piotr Kempa, 2010-12-15 17:59:
> I need to backup my maildir regularly, have it zipped, encrypted and
> sent away, and it's taking more and more time.
I'd go with incremental backups in that scenario. Daily backup size
is gonna be a tiny fraction of the whole mail archive.
Repeatedly sending stuff that has not changed (as most of your mail in
current backup were in the previous too) is plain waste of resources.
No matter if the zip is a gig or five.
--
Tero Tilus ## 050 3635 235 ## http://tero.tilus.net/
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-talk] search by message size (incl. attachments)
2010-12-15 21:15 ` Marc Hartstein
@ 2010-12-16 9:22 ` Piotr Kempa
2010-12-16 12:49 ` Moritz Wilhelmy
0 siblings, 1 reply; 7+ messages in thread
From: Piotr Kempa @ 2010-12-16 9:22 UTC (permalink / raw)
To: sup-talk
Excerpts from Marc Hartstein's message of 2010-12-15 22:15:14 +0100:
> Excerpts from Piotr Kempa's message of Wed Dec 15 10:59:06 -0500 2010:
> > tl;dr: can you search by message size? or sort by that?
>
> Not sure, but maildir is one-file-per-message, so you could go ahead and
> use your favorite tool which lets you inspect the filesystem and
> identify large files.
>
> You'd still have to work around sup potentially getting cranky that you
> removed a file it was expecting to still be there. I forget how that all
> works out.
Thanks for the suggestions, I thought about just finding the large
files, inspecting and removing but I'm afraid sup's will panic. But I
think I saw some way to sync it again to a changed source, so maybe
there's that.
Re incremental backup - that's something I'll have to do, true, but
since I want it to be encrypted on the backup server (with no other
users or root getting a peek:) I settled on just bzipping, encrypting
and uploading one huge file. Even when there are small changes, when
it's one file and it's encrypted, it changes the whole file.
I could think about getting some loopfile and cryptsetup a LUKS on it on
the server, or maybe encfs (I'm not sure they have encfs the server
though...).
Thanks again!
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-talk] search by message size (incl. attachments)
2010-12-16 9:22 ` Piotr Kempa
@ 2010-12-16 12:49 ` Moritz Wilhelmy
2010-12-16 13:19 ` Piotr Kempa
2010-12-16 13:21 ` Iain
0 siblings, 2 replies; 7+ messages in thread
From: Moritz Wilhelmy @ 2010-12-16 12:49 UTC (permalink / raw)
To: sup-talk
Excerpts from Piotr Kempa's message of Thu Dec 16 10:22:03 +0100 2010:
> Re incremental backup - that's something I'll have to do, true, but
> since I want it to be encrypted on the backup server (with no other
> users or root getting a peek:) I settled on just bzipping, encrypting
> and uploading one huge file. Even when there are small changes, when
> it's one file and it's encrypted, it changes the whole file.
>
> I could think about getting some loopfile and cryptsetup a LUKS on it on
> the server, or maybe encfs (I'm not sure they have encfs the server
> though...).
You could use encfs locally and just rsync the encrypted encfs on the server?
Also, see rsnapshot for incrememtal backups.
Cheers,
Moritz
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-talk] search by message size (incl. attachments)
2010-12-16 12:49 ` Moritz Wilhelmy
@ 2010-12-16 13:19 ` Piotr Kempa
2010-12-16 13:21 ` Iain
1 sibling, 0 replies; 7+ messages in thread
From: Piotr Kempa @ 2010-12-16 13:19 UTC (permalink / raw)
To: sup-talk
Excerpts from Moritz Wilhelmy's message of 2010-12-16 13:49:31 +0100:
> Excerpts from Piotr Kempa's message of Thu Dec 16 10:22:03 +0100 2010:
> > Re incremental backup - that's something I'll have to do, true, but
> > since I want it to be encrypted on the backup server (with no other
> > users or root getting a peek:) I settled on just bzipping, encrypting
> > and uploading one huge file. Even when there are small changes, when
> > it's one file and it's encrypted, it changes the whole file.
> >
> > I could think about getting some loopfile and cryptsetup a LUKS on it on
> > the server, or maybe encfs (I'm not sure they have encfs the server
> > though...).
>
> You could use encfs locally and just rsync the encrypted encfs on the server?
> Also, see rsnapshot for incrememtal backups.
>
Thanks, all great suggestions (especially rsyncing the encrypted encfs,
why didn't I think of that!).
But from all the answers I gather there's no way to search or sort by
mail size in sup, correct?
Piotr
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [sup-talk] search by message size (incl. attachments)
2010-12-16 12:49 ` Moritz Wilhelmy
2010-12-16 13:19 ` Piotr Kempa
@ 2010-12-16 13:21 ` Iain
1 sibling, 0 replies; 7+ messages in thread
From: Iain @ 2010-12-16 13:21 UTC (permalink / raw)
To: sup-talk
Excerpts from Moritz Wilhelmy's message of Thu Dec 16 12:49:31 +0000 2010:
> You could use encfs locally and just rsync the encrypted encfs on the server?
> Also, see rsnapshot for incrememtal backups.
Another approach is duplicity, "Encrypted bandwidth-efficient backup
using the rsync algorithm": <http://duplicity.nongnu.org/>.
~Iain
_______________________________________________
sup-talk mailing list
sup-talk@rubyforge.org
http://rubyforge.org/mailman/listinfo/sup-talk
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2010-12-16 13:48 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2010-12-15 15:59 [sup-talk] search by message size (incl. attachments) Piotr Kempa
2010-12-15 21:15 ` Marc Hartstein
2010-12-16 9:22 ` Piotr Kempa
2010-12-16 12:49 ` Moritz Wilhelmy
2010-12-16 13:19 ` Piotr Kempa
2010-12-16 13:21 ` Iain
2010-12-15 22:03 ` Tero Tilus
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox