From mboxrd@z Thu Jan 1 00:00:00 1970 Received: by 10.52.187.5 with SMTP id fo5cs240879vdc; Fri, 6 May 2011 15:45:50 -0700 (PDT) Received: by 10.224.204.137 with SMTP id fm9mr4100984qab.9.1304721949872; Fri, 06 May 2011 15:45:49 -0700 (PDT) Return-Path: Received: from rubyforge.org (rubyforge.org [205.234.109.19]) by mx.google.com with ESMTP id g23si8086587qcs.186.2011.05.06.15.45.48; Fri, 06 May 2011 15:45:48 -0700 (PDT) Received-SPF: pass (google.com: domain of sup-talk-bounces@rubyforge.org designates 205.234.109.19 as permitted sender) client-ip=205.234.109.19; Authentication-Results: mx.google.com; spf=pass (google.com: domain of sup-talk-bounces@rubyforge.org designates 205.234.109.19 as permitted sender) smtp.mail=sup-talk-bounces@rubyforge.org; dkim=neutral (body hash did not verify) header.i=@pimlott.net Received: from rubyforge.org (rubyforge.org [127.0.0.1]) by rubyforge.org (Postfix) with ESMTP id CBD54185836C; Fri, 6 May 2011 18:45:47 -0400 (EDT) X-Greylist: delayed 1470 seconds by postgrey-1.31 at rubyforge.org; Fri, 06 May 2011 18:31:31 EDT Received: from fugue.pimlott.net (pimlott.net [72.249.23.100]) by rubyforge.org (Postfix) with ESMTP id DC90B1858112 for ; Fri, 6 May 2011 18:31:31 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=pimlott.net; s=default; h=Content-Type:MIME-Version:Message-ID:Subject:To:From:Date; bh=RoT/XmA/RuJUYfdfqjsOVuWi1Axi5EztTw6YrnIc2fA=; b=n++KdEL6siKf5fqlyEWsFEEWc458sCFOY38Vfux/yb1L3IyluzXhLR/pMEb0Pq+Ovs+xhsUSkbRVuyFlEaYrCmA18heLAA+0vPxZZokkHjW83JlbKzlA2BbCnsVbrKuZBIckjV+fpRQaqsSPJSAq2FQniuB/NKu9cxNMhe9NP6A=; Received: from c-69-181-107-25.hsd1.ca.comcast.net ([69.181.107.25] helo=localhost.localdomain) by fugue.pimlott.net with esmtpsa (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.72) (envelope-from ) id 1QITAG-0002R4-6g; Fri, 06 May 2011 15:06:24 -0700 Received: from andrew by localhost.localdomain with local (Exim 4.75) (envelope-from ) id 1QITAg-00063L-IU; Fri, 06 May 2011 15:06:50 -0700 Date: Fri, 6 May 2011 15:06:50 -0700 From: Andrew Pimlott To: sup-talk@rubyforge.org Message-ID: <20110506220650.GA23223@pimlott.net> MIME-Version: 1.0 Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) Subject: [sup-talk] DatabaseCorruptError X-BeenThere: sup-talk@rubyforge.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: User & developer discussion of Sup List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: sup-talk-bounces@rubyforge.org Errors-To: sup-talk-bounces@rubyforge.org Sup had been running for a while, and I just came back to my terminal to find it dead: --- IOError from thread: periodic poll DatabaseError: Error reading block 4279173482: got end of file ./lib/sup/index.rb:271:in `_dangerous_allterms_begin' ./lib/sup/index.rb:271:in `each_prefixed_term' ./lib/sup/index.rb:284:in `each_source_info' ./lib/sup/mbox.rb:147:in `each' ./lib/sup/mbox.rb:147:in `map' ./lib/sup/mbox.rb:147:in `last_indexed_message' ./lib/sup/util.rb:204:in `call' ./lib/sup/util.rb:204:in `benchmark' /usr/lib/ruby/1.8/benchmark.rb:293:in `measure' ./lib/sup/util.rb:204:in `benchmark' ./lib/sup/mbox.rb:147:in `last_indexed_message' ./lib/sup/mbox.rb:152:in `first_new_message' ./lib/sup/mbox.rb:124:in `poll' ./lib/sup/poll.rb:154:in `poll_from' ./lib/sup/poll.rb:113:in `do_poll' ./lib/sup/poll.rb:103:in `each' ./lib/sup/poll.rb:103:in `do_poll' ./lib/sup/poll.rb:102:in `synchronize' ./lib/sup/poll.rb:102:in `do_poll' ./lib/sup/util.rb:609:in `send' ./lib/sup/util.rb:609:in `method_missing' ./lib/sup/modes/poll-mode.rb:15:in `poll' ./lib/sup/poll.rb:49:in `poll_with_sources' ./lib/sup/poll.rb:68:in `poll' ./lib/sup/poll.rb:86:in `start' ./lib/sup.rb:78:in `reporting_thread' ./lib/sup.rb:76:in `initialize' ./lib/sup.rb:76:in `new' ./lib/sup.rb:76:in `reporting_thread' ./lib/sup/poll.rb:83:in `start' ./lib/sup/util.rb:609:in `send' ./lib/sup/util.rb:609:in `method_missing' bin/sup:222 I tried to start it again, and got --- IOError from thread: poll after loading inbox DatabaseCorruptError: Db block overwritten - are there multiple writers? /usr/lib/ruby/1.8/xapian.rb:259:in `_dangerous_postlist_begin' /usr/lib/ruby/1.8/xapian.rb:259:in `postlist' ./lib/sup/index.rb:530:in `term_docids' ./lib/sup/index.rb:717:in `index_message_threading' ./lib/sup/index.rb:633:in `sync_message' ./lib/sup/util.rb:609:in `send' ./lib/sup/util.rb:609:in `method_missing' ./lib/sup/poll.rb:168:in `poll_from' ./lib/sup/mbox.rb:127:in `poll' ./lib/sup/poll.rb:154:in `poll_from' ./lib/sup/poll.rb:113:in `do_poll' ./lib/sup/poll.rb:103:in `each' ./lib/sup/poll.rb:103:in `do_poll' ./lib/sup/poll.rb:102:in `synchronize' ./lib/sup/poll.rb:102:in `do_poll' ./lib/sup/util.rb:609:in `send' ./lib/sup/util.rb:609:in `method_missing' ./lib/sup/modes/poll-mode.rb:15:in `poll' ./lib/sup/poll.rb:49:in `poll_with_sources' ./lib/sup/poll.rb:68:in `poll' ./lib/sup/util.rb:609:in `send' ./lib/sup/util.rb:609:in `method_missing' bin/sup:212 ./lib/sup.rb:78:in `reporting_thread' ./lib/sup.rb:76:in `initialize' ./lib/sup.rb:76:in `new' ./lib/sup.rb:76:in `reporting_thread' bin/sup:212 ./lib/sup/modes/thread-index-mode.rb:684:in `call' ./lib/sup/modes/thread-index-mode.rb:684:in `__unprotected_load_threads' ./lib/sup/modes/thread-index-mode.rb:625:in `call' ./lib/sup/modes/thread-index-mode.rb:625:in `load_n_threads_background' ./lib/sup.rb:78:in `reporting_thread' ./lib/sup.rb:76:in `initialize' ./lib/sup.rb:76:in `new' ./lib/sup.rb:76:in `reporting_thread' ./lib/sup/modes/thread-index-mode.rb:623:in `load_n_threads_background' ./lib/sup/modes/thread-index-mode.rb:694:in `__unprotected_load_threads' (eval):12:in `load_threads' bin/sup:212 My xapian dir looks like: total 334396 -rw------- 1 andrew andrew 0 May 6 14:43 flintlock -rw-rw-r-- 1 andrew andrew 12 May 31 2010 iamflint -rw-rw-r-- 1 andrew andrew 103014400 May 6 13:09 position.DB -rw-rw-r-- 1 andrew andrew 1594 May 6 11:22 position.baseA -rw-rw-r-- 1 andrew andrew 161333248 May 6 13:29 postlist.DB -rw-rw-r-- 1 andrew andrew 2475 May 6 11:22 postlist.baseA -rw-rw-r-- 1 andrew andrew 20807680 May 6 13:04 record.DB -rw-rw-r-- 1 andrew andrew 339 May 6 11:22 record.baseA -rw-rw-r-- 1 andrew andrew 50692096 May 6 13:29 termlist.DB -rw-rw-r-- 1 andrew andrew 795 May 6 11:22 termlist.baseA -rw-rw-r-- 1 andrew andrew 6184960 May 6 13:04 value.DB -rw-rw-r-- 1 andrew andrew 115 May 6 11:22 value.baseA I'm running an old git pull from next, commit 1bafcf6 dated 2010-10-12. Anything I should do to try to diagnose and recover this? Or just load from sup-dump? Andrew _______________________________________________ sup-talk mailing list sup-talk@rubyforge.org http://rubyforge.org/mailman/listinfo/sup-talk