Ceph

2013-08-22 02:55:51.670551 a33c700 10 mon.c@2(peon).osd e24 e24: 6 osds: 6 up, 4 in
2013-08-22 02:55:51.670705 a33c700 10 mon.c@2(peon).log v44 log
2013-08-22 02:55:51.670804 a33c700 10 mon.c@2(peon).auth v9 auth
2013-08-22 02:55:51.670910 a33c700 20 mon.c@2(peon) e1 sync_trim_providers
2013-08-22 02:55:51.689575 ab3d700  1 -- 10.214.133.32:6790/0 <== mon.0 10.214.133.32:6789/0 31 ==== paxos(commit lc 130 fc 0 pn 1300 opn 0) v3 ==== 467+0+0 (2378928223 0 0) 0xd9b0230 con 0x9251220
2013-08-22 02:55:51.690378 ab3d700 20 mon.c@2(peon) e1 have connection
2013-08-22 02:55:51.690561 ab3d700 20 mon.c@2(peon) e1 ms_dispatch existing session MonSession: mon.0 10.214.133.32:6789/0 is openallow * for mon.0 10.214.133.32:6789/0
2013-08-22 02:55:51.691120 ab3d700 20 mon.c@2(peon) e1  caps allow *
2013-08-22 02:55:51.691300 ab3d700 10 mon.c@2(peon).paxos(paxos updating c 1..129) handle_commit on 130
2013-08-22 02:55:51.691623 ab3d700 10 mon.c@2(peon).paxos(paxos updating c 1..130) store_state [130..130]
2013-08-22 02:55:51.737771 ab3d700 10 mon.c@2(peon) e1 refresh_from_paxos
2013-08-22 02:55:51.739937 ab3d700 10 mon.c@2(peon).paxosservice(pgmap 1..44) refresh
2013-08-22 02:55:51.741903 ab3d700 10 mon.c@2(peon).paxosservice(mdsmap 1..7) refresh
2013-08-22 02:55:51.744013 ab3d700 10 mon.c@2(peon).paxosservice(osdmap 1..26) refresh
2013-08-22 02:55:51.744140 ab3d700 15 mon.c@2(peon).osd e24 update_from_paxos paxos e 26, my e 24
2013-08-22 02:55:51.882049 ab3d700 -1 mon/OSDMonitor.cc: In function 'virtual void OSDMonitor::update_from_paxos(bool*)' thread ab3d700 time 2013-08-22 02:55:51.746960
mon/OSDMonitor.cc: 186: FAILED assert(err == 0)

 ceph version 0.67-260-g9242d01 (9242d01cc007f44f5be4e7138e9019234e61d6fc)
 1: (OSDMonitor::update_from_paxos(bool*)+0x21bd) [0x5acd0d]
 2: (PaxosService::refresh(bool*)+0x331) [0x59dc41]
 3: (Monitor::refresh_from_paxos(bool*)+0x57) [0x53fb37]
 4: (Paxos::do_refresh()+0x31) [0x58a391]
 5: (Paxos::handle_commit(MMonPaxos*)+0x21a) [0x58eefa]
 6: (Paxos::dispatch(PaxosServiceMessage*)+0x23b) [0x596c3b]
 7: (Monitor::_ms_dispatch(Message*)+0x112c) [0x572c7c]
 8: (Monitor::ms_dispatch(Message*)+0x32) [0x589ae2]
 9: (DispatchQueue::entry()+0x549) [0x7d4b89]
 10: (DispatchQueue::DispatchThread::entry()+0xd) [0x709cbd]
 11: (()+0x7e9a) [0x4e39e9a]
 12: (clone()+0x6d) [0x686bccd]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

ubuntu@teuthology:/var/lib/teuthworker/archive/teuthology-2013-08-22_01:00:13-rados-next-testing-basic-plana/857