From mboxrd@z Thu Jan 1 00:00:00 1970 Received: by 10.182.92.230 with SMTP id cp6csp531533obb; Tue, 1 Jan 2013 11:04:28 -0800 (PST) X-Received: by 10.236.176.41 with SMTP id a29mr41419903yhm.17.1357067068029; Tue, 01 Jan 2013 11:04:28 -0800 (PST) Return-Path: Received: from rubyforge.org (50-56-192-79.static.cloud-ips.com. [50.56.192.79]) by mx.google.com with ESMTP id s7si8557474ank.102.2013.01.01.11.04.27; Tue, 01 Jan 2013 11:04:28 -0800 (PST) Received-SPF: pass (google.com: domain of sup-devel-bounces@rubyforge.org designates 50.56.192.79 as permitted sender) client-ip=50.56.192.79; Authentication-Results: mx.google.com; spf=pass (google.com: domain of sup-devel-bounces@rubyforge.org designates 50.56.192.79 as permitted sender) smtp.mail=sup-devel-bounces@rubyforge.org Received: from localhost.localdomain (localhost [127.0.0.1]) by rubyforge.org (Postfix) with ESMTP id 34FC32E096; Tue, 1 Jan 2013 19:04:28 +0000 (UTC) X-Greylist: delayed 1458 seconds by postgrey-1.31 at rubyforge; Tue, 01 Jan 2013 19:04:18 UTC Received: from mail-we0-f169.google.com (mail-we0-f169.google.com [74.125.82.169]) by rubyforge.org (Postfix) with ESMTP id 0A3162E083 for ; Tue, 1 Jan 2013 19:04:18 +0000 (UTC) Received: by mail-we0-f169.google.com with SMTP id t49so6476919wey.14 for ; Tue, 01 Jan 2013 11:04:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=hmFAHFhE/8DBHtApuvEhwkket+tKaqQ6Y9jTLkijLbI=; b=lSL0hXmb1dhwqIpvSXVtkpej+oC5flpAobBcmXRxIbNklcgaMkrpTvCRZrOZ5iTxDm t5Pa1fgmATeCHoxXjtBTlYMdDI8rLF5Ii5VXYctgy2GU41V4LVodOhYSPpuhAaEShq5e k5CRJZ8uRQRnvBnWOFoz0q5z/xGqmZC5GBfbjab4MrMleYXkt+9wWvVhYqljkjZTI5kc s3oahg/yPdY4vdapWJjlevaXbWZ0+Qvd6BBmlmg/Z46Ze+quAwf1F+wWrklbqQyVlENj u4/NQvMO3xfYdCEBWOoj80YhHIN6cqVD6Q54opNEIb73PrRVZVr8u/jVe99SAc5snyYQ DxyQ== Received: by 10.180.109.10 with SMTP id ho10mr37297220wib.9.1357065209290; Tue, 01 Jan 2013 10:33:29 -0800 (PST) MIME-Version: 1.0 Received: by 10.194.6.70 with HTTP; Tue, 1 Jan 2013 10:33:09 -0800 (PST) In-Reply-To: References: From: Hamish D Date: Tue, 1 Jan 2013 18:33:09 +0000 Message-ID: To: Sup developer discussion Subject: Re: [sup-devel] after second heliotrope import, new messages not appearing X-BeenThere: sup-devel@rubyforge.org X-Mailman-Version: 2.1.12 Precedence: list Reply-To: Sup developer discussion List-Id: Sup developer discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: sup-devel-bounces@rubyforge.org Errors-To: sup-devel-bounces@rubyforge.org > Your problem may have multiple origins, and I have no idea where you could > start : > > - Did you use the correct directories for messages and index for _both_ the > import and the server ? (sorry if this sounds stupid) Always good to check the basics, but yes, I do use the same directory. I have scripts for the import and the server and both use the -d argument to ensure they use the same directory. > - Did the index size in heliotrope change ? (as given by a GET to > /size.json) No - it remained the same. (And is about half of the count that sup reports). > - Did the messages file size change ? It did on one import, but not the most recent. > - Are the messages absent in inbox only or from the whole turnsole ? All searches that I do stop in May. > - As a last resort, could you send the mbox file so that I can try this at > home, if your mails aren't too personal ? It's my work email, with a total of over 100,000 messages. So I'd prefer not to send it over. Any logs that might be worth looking at? While doing the import, I do get various lines along the line of: ; scanned 71, indexed 71, skipped 0 bad and 0 seen messages in 22.1s = 3.2 m/s I do use the state argument (-t) to save reimporting old mail. I have also tried doing a reindex (as I import from multiple mboxes) but to no avail. I could just try another import of the whole lot into a clean directory I guess. I'm also happy to type stuff into heliotrope-console if that will help diagnose stuff. Thanks for your suggestions so far Hamish > On Thu, Dec 27, 2012 at 5:19 PM, Hamish D wrote: >> >> Hello >> >> I've just been trying to carry on from where I left off with migrating >> my work email into heliotrope (which I last worked on in May). >> >> So I've rsynced the mbox files across to where I will run heliotrope >> and tried running heliotrope-import to put all the new messages in the >> index. It appeared to work properly, reporting that messages were >> being added to the index and the index files themselves have had their >> timestamps updated. But when I start turnsole, I can't find any email >> after May. >> >> Any ideas on where to start looking to work out what is going on? >> >> Hamish _______________________________________________ Sup-devel mailing list Sup-devel@rubyforge.org http://rubyforge.org/mailman/listinfo/sup-devel