From mboxrd@z Thu Jan 1 00:00:00 1970 Received: by 10.150.133.10 with SMTP id g10cs104301ybd; Wed, 22 Jun 2011 15:52:40 -0700 (PDT) Received: by 10.52.184.66 with SMTP id es2mr1754734vdc.114.1308783160008; Wed, 22 Jun 2011 15:52:40 -0700 (PDT) Return-Path: Received: from rubyforge.org (rubyforge.org [205.234.109.19]) by mx.google.com with ESMTP id n6si1294857vdf.142.2011.06.22.15.52.39; Wed, 22 Jun 2011 15:52:40 -0700 (PDT) Received-SPF: pass (google.com: domain of sup-devel-bounces@rubyforge.org designates 205.234.109.19 as permitted sender) client-ip=205.234.109.19; Authentication-Results: mx.google.com; spf=pass (google.com: domain of sup-devel-bounces@rubyforge.org designates 205.234.109.19 as permitted sender) smtp.mail=sup-devel-bounces@rubyforge.org; dkim=neutral (body hash did not verify) header.i=@gmail.com Received: from rubyforge.org (rubyforge.org [127.0.0.1]) by rubyforge.org (Postfix) with ESMTP id 9F7FF159808C; Wed, 22 Jun 2011 18:52:39 -0400 (EDT) Received: from mail-pz0-f50.google.com (mail-pz0-f50.google.com [209.85.210.50]) by rubyforge.org (Postfix) with ESMTP id C223D1858367 for ; Wed, 22 Jun 2011 18:41:24 -0400 (EDT) Received: by pzk2 with SMTP id 2so1002450pzk.23 for ; Wed, 22 Jun 2011 15:41:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:organization:to:subject:date:user-agent :references:in-reply-to:mime-version:x-uid:content-type :content-transfer-encoding:message-id; bh=2mXgQ8t5h77R3xyEIjVfVwf6WjrrMtASPTb6RpMnKqE=; b=ulJv3cej3509cRrzzAlU5KSBT58i1e7PJN2sQ7P3lNMjLe1ZqN0G5vAMpVRKJ5yu7i V22v+rTLbP/mO8KtlhwTHpYGeubHoVkdFd5lhGdBfNaL8ulfuH9W/ZhTcPJko9P+OW9K Si9LTsG42s/yCu828cCzE0q6JlX2AUUTUMs/w= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:organization:to:subject:date:user-agent:references:in-reply-to :mime-version:x-uid:content-type:content-transfer-encoding :message-id; b=Fp/uONtwjd6bY9FBjOsBhoijblKpHR1A/gkhnjsyqz0uZYO8KRlKkFz3KvI9jjFN/Q nZcmCaoq+lTuPad+Rh3lzbMy5N3yMUJh/vUfdEyjFiNHYrWG8vl/UT4++BLfbRjU5hjV 5UsihRQ9lJPh2+8H3LCDi/hwGwKsaqNeQF3VE= Received: by 10.68.7.234 with SMTP id m10mr810396pba.94.1308782483882; Wed, 22 Jun 2011 15:41:23 -0700 (PDT) Received: from panama.localnet (125.net112138030.t-com.ne.jp [112.138.30.125]) by mx.google.com with ESMTPS id b8sm743421pbj.30.2011.06.22.15.41.21 (version=SSLv3 cipher=OTHER); Wed, 22 Jun 2011 15:41:22 -0700 (PDT) From: Horacio Sanson Organization: piaotech To: Sup developer discussion Date: Thu, 23 Jun 2011 07:41:19 +0900 User-Agent: KMail/1.13.6 (Linux/2.6.38-8-generic; KDE/4.6.4; x86_64; ; ) References: <1308610289-sup-7090@masanjin.net> <1308713034-sup-9195@masanjin.net> In-Reply-To: <1308713034-sup-9195@masanjin.net> MIME-Version: 1.0 X-UID: 4419 Message-Id: <201106230741.19602.hsanson@gmail.com> Subject: Re: [sup-devel] Tokyo Cabinet fails with invalid record header X-BeenThere: sup-devel@rubyforge.org X-Mailman-Version: 2.1.12 Precedence: list Reply-To: Sup developer discussion List-Id: Sup developer discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: sup-devel-bounces@rubyforge.org Errors-To: sup-devel-bounces@rubyforge.org I left heliotrope-add running but it did not finished. I got some strange nil errors (see below): I think this error happens when find_msgids is unable to find the message's id. Not sure what is the best action in this case but skipping it sounds a good option. ################################################### ; requesting messages 141445..141564 from imap server scanned 130401, indexed 130278, skipped 25 bad and 98 seen messages in 9566.0s = 13.6 m/s ; requesting messages 141565..141688 from imap server scanned 130501, indexed 130378, skipped 25 bad and 98 seen messages in 9572.0s = 13.6 m/s /media/DATA/Apps/heliotrope/lib/heliotrope/message.rb:155:in `digest': can't convert nil into String (TypeError) from /media/DATA/Apps/heliotrope/lib/heliotrope/message.rb:155:in `hexdigest' from /media/DATA/Apps/heliotrope/lib/heliotrope/message.rb:155:in `munge_msgid' from /media/DATA/Apps/heliotrope/lib/heliotrope/message.rb:20:in `parse!' from bin/heliotrope-add:138:in `
' #################################################### This error happens when @imap.uid_fetch doesn't raise any exception and returns nil instead of empty array. Was thinking to check for nil and set it to an empty array if true but it would likely result in an infinite loop. #################################################### ; loading mail... ; connecting... ; login as horacio.sanson@gmail.com ... ; found 293004 new messages... ; found 293004 messages to scan ; requesting messages 283664..283763 from imap server scanned 1, indexed 1, skipped 0 bad and 0 seen messages in 7.9s = 0.1 m/s ; requesting messages 283764..283863 from imap server /media/DATA/Apps/heliotrope/lib/heliotrope/gmail-dumper.rb:171:in `next_message': undefined method `empty?' for nil:NilClass (NoMethodError) from bin/heliotrope-add:128:in `
' ##################################################### Finally the leveldb branch is not working that well. After reaching 130378 indexed messages I started the heliotrope server and the web interface only showed two messages. I will try again without the hooks for Japanese and see how it goes. On Wednesday 22 June 2011 12:25:16 William Morgan wrote: > Hi Horacio, > > Reformatted excerpts from William Morgan's message of 2011-06-20: > > Ok, I have a potential fix for this that I'll try and get out tonight. > > Can you please: > > 1. git clone git://github.com/wmorgan/leveldb-ruby.git > 2. git checkout fpic > 3. rake gem > 4. gem install pkg/leveldb-ruby-0.4.gem > > And tell me if that works? > > If so, I will release that as 0.5. > > Thanks! -- regards, Horacio Sanson _______________________________________________ Sup-devel mailing list Sup-devel@rubyforge.org http://rubyforge.org/mailman/listinfo/sup-devel