Project

General

Profile

Actions

Bug #4448

closed

ceph upgrade from bobtail to master fails

Added by Tamilarasi muthamizhan about 11 years ago. Updated about 11 years ago.

Status:
Resolved
Priority:
Immediate
Category:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

upgrading from bobtail to master branch worked fine, but when restarting ceph daemons, monitors crash.

2013-03-14T17:44:16.820 DEBUG:teuthology.orchestra.run:Running [10.214.131.10]: '/tmp/cephtest/tamil@ubuntu-2013-03-14_17-41-11/enable-coredump ceph-coverage /tmp/cephtest/tamil@ubuntu-2013-03-14_17-41-11/archive/coverage ceph mds set_max_mds 1'
2013-03-14T17:44:16.824 INFO:teuthology.task.ceph.mon.a.err:Invalid argument: /var/lib/ceph/mon/ceph-a/store.db: does not exist (create_if_missing is false)
2013-03-14T17:44:16.827 INFO:teuthology.task.ceph.mon.a.err:mon/Monitor.cc: In function 'bool Monitor::StoreConverter::needs_conversion()' thread 7faf33f22780 time 2013-03-14 17:44:17.097212
2013-03-14T17:44:16.827 INFO:teuthology.task.ceph.mon.a.err:mon/Monitor.cc: 4097: FAILED assert(0 "non-existent store in mon data directory")
2013-03-14T17:44:16.828 INFO:teuthology.task.ceph.mon.a.err: ceph version 0.58-637-g7370b55 (7370b5564606474f11b9ac5afb7cc60e0ac36ed1)
2013-03-14T17:44:16.828 INFO:teuthology.task.ceph.mon.a.err: 1: (Monitor::StoreConverter::needs_conversion()+0x544) [0x49edb4]
2013-03-14T17:44:16.828 INFO:teuthology.task.ceph.mon.a.err: 2: (main()+0x7a1) [0x486491]
2013-03-14T17:44:16.829 INFO:teuthology.task.ceph.mon.a.err: 3: (_libc_start_main()+0xed) [0x7faf31fdc76d]
2013-03-14T17:44:16.829 INFO:teuthology.task.ceph.mon.a.err: 4: ceph-mon() [0x48983d]
2013-03-14T17:44:16.829 INFO:teuthology.task.ceph.mon.a.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-03-14T17:44:16.829 INFO:teuthology.task.ceph.mon.a.err:2013-03-14 17:44:17.097995 7faf33f22780 -1 mon/Monitor.cc: In function 'bool Monitor::StoreConverter::needs_conversion()' thread 7faf33f22780 time 2013-03-14 17:44:17.097212
2013-03-14T17:44:16.830 INFO:teuthology.task.ceph.mon.a.err:mon/Monitor.cc: 4097: FAILED assert(0 "non-existent store in mon data directory")
2013-03-14T17:44:16.831 INFO:teuthology.task.ceph.mon.a.err:
2013-03-14T17:44:16.832 INFO:teuthology.task.ceph.mon.a.err: ceph version 0.58-637-g7370b55 (7370b5564606474f11b9ac5afb7cc60e0ac36ed1)
2013-03-14T17:44:16.832 INFO:teuthology.task.ceph.mon.a.err: 1: (Monitor::StoreConverter::needs_conversion()+0x544) [0x49edb4]
2013-03-14T17:44:16.832 INFO:teuthology.task.ceph.mon.a.err: 2: (main()+0x7a1) [0x486491]
2013-03-14T17:44:16.832 INFO:teuthology.task.ceph.mon.a.err: 3: (
_libc_start_main()+0xed) [0x7faf31fdc76d]
2013-03-14T17:44:16.833 INFO:teuthology.task.ceph.mon.a.err: 4: ceph-mon() [0x48983d]
2013-03-14T17:44:16.833 INFO:teuthology.task.ceph.mon.a.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-03-14T17:44:16.833 INFO:teuthology.task.ceph.mon.a.err:
2013-03-14T17:44:16.834 INFO:teuthology.task.ceph.mon.a.err: 0> 2013-03-14 17:44:17.097995 7faf33f22780 -1 mon/Monitor.cc: In function 'bool Monitor::StoreConverter::needs_conversion()' thread 7faf33f22780 time 2013-03-14 17:44:17.097212
2013-03-14T17:44:16.834 INFO:teuthology.task.ceph.mon.a.err:mon/Monitor.cc: 4097: FAILED assert(0 == "non-existent store in mon data directory")
2013-03-14T17:44:16.834 INFO:teuthology.task.ceph.mon.a.err:
2013-03-14T17:44:16.835 INFO:teuthology.task.ceph.mon.a.err: ceph version 0.58-637-g7370b55 (7370b5564606474f11b9ac5afb7cc60e0ac36ed1)
2013-03-14T17:44:16.835 INFO:teuthology.task.ceph.mon.a.err: 1: (Monitor::StoreConverter::needs_conversion()+0x544) [0x49edb4]
2013-03-14T17:44:16.835 INFO:teuthology.task.ceph.mon.a.err: 2: (main()+0x7a1) [0x486491]
2013-03-14T17:44:16.836 INFO:teuthology.task.ceph.mon.a.err: 3: (__libc_start_main()+0xed) [0x7faf31fdc76d]
2013-03-14T17:44:16.836 INFO:teuthology.task.ceph.mon.a.err: 4: ceph-mon() [0x48983d]
2013-03-14T17:44:16.836 INFO:teuthology.task.ceph.mon.a.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-03-14T17:44:16.837 INFO:teuthology.task.ceph.mon.a.err:
2013-03-14T17:44:16.837 INFO:teuthology.task.ceph.mon.a.err:terminate called after throwing an instance of 'ceph::FailedAssertion'

have copied the logs to burnupi06.front.sepia.ceph.com:/home/ubuntu/upgrade_bug

Actions

Also available in: Atom PDF