Actions
Bug #9682
closed"os/FileJournal.cc: 1677: FAILED assert(0)" in upgrade:firefly-firefly-distro-basic-multi run
Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2014-10-06T16:29:02.055 INFO:tasks.thrashosds.ceph_manager:waiting on admin_socket for 1, ['dump_ops_in_flight'] 2014-10-06T16:29:02.241 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.241098 7f2368425780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2014-10-06T16:29:02.287 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.286272 7f2368425780 -1 journal Unable to read past sequence 39581 but header indicates the journal has committed up through 39647, journal is corrupt 2014-10-06T16:29:02.289 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2368425780 time 2014-10-06 16:29:02.286293 2014-10-06T16:29:02.289 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: 1677: FAILED assert(0) 2014-10-06T16:29:02.297 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0) 2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 1: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f] 2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5] 2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d] 2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (FileStore::mount()+0x30c2) [0x890792] 2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a] 2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (main()+0x1d88) [0x6079b8] 2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (__libc_start_main()+0xed) [0x7f236622776d] 2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: 8: ceph-osd() [0x60bca9] 2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. 2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.297264 7f2368425780 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2368425780 time 2014-10-06 16:29:02.286293 2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: 1677: FAILED assert(0) 2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0) 2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 1: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f] 2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5] 2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d] 2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (FileStore::mount()+0x30c2) [0x890792] 2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a] 2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (main()+0x1d88) [0x6079b8] 2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (__libc_start_main()+0xed) [0x7f236622776d] 2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 8: ceph-osd() [0x60bca9] 2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. 2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 2014-10-06T16:29:02.302 INFO:tasks.ceph.osd.1.plana30.stderr: -10> 2014-10-06 16:29:02.241098 7f2368425780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2014-10-06T16:29:02.302 INFO:tasks.ceph.osd.1.plana30.stderr: -1> 2014-10-06 16:29:02.286272 7f2368425780 -1 journal Unable to read past sequence 39581 but header indicates the journal has committed up through 39647, journal is corrupt 2014-10-06T16:29:02.302 INFO:tasks.ceph.osd.1.plana30.stderr: 0> 2014-10-06 16:29:02.297264 7f2368425780 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2368425780 time 2014-10-06 16:29:02.286293 2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: 1677: FAILED assert(0) 2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: 2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0) 2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: 1: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f] 2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5] 2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d] 2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (FileStore::mount()+0x30c2) [0x890792] 2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a] 2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (main()+0x1d88) [0x6079b8] 2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (__libc_start_main()+0xed) [0x7f236622776d] 2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 8: ceph-osd() [0x60bca9] 2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. 2014-10-06T16:29:02.305 INFO:tasks.ceph.osd.1.plana30.stderr: 2014-10-06T16:29:02.322 INFO:tasks.ceph.osd.1.plana30.stderr:terminate called after throwing an instance of 'ceph::FailedAssertion' 2014-10-06T16:29:02.322 INFO:tasks.ceph.osd.1.plana30.stderr:*** Caught signal (Aborted) ** 2014-10-06T16:29:02.323 INFO:tasks.ceph.osd.1.plana30.stderr: in thread 7f2368425780 2014-10-06T16:29:02.343 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0) 2014-10-06T16:29:02.343 INFO:tasks.ceph.osd.1.plana30.stderr: 1: ceph-osd() [0x99c7fa] 2014-10-06T16:29:02.343 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (()+0xfcb0) [0x7f2367951cb0] 2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (gsignal()+0x35) [0x7f236623c425] 2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (abort()+0x17b) [0x7f236623fb8b] 2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f2366b8f69d] 2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (()+0xb5846) [0x7f2366b8d846] 2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (()+0xb5873) [0x7f2366b8d873] 2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 8: (()+0xb596e) [0x7f2366b8d96e] 2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0xa7e26f] 2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 10: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f] 2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 11: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5] 2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 12: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d] 2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 13: (FileStore::mount()+0x30c2) [0x890792] 2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 14: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a] 2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr: 15: (main()+0x1d88) [0x6079b8] 2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr: 16: (__libc_start_main()+0xed) [0x7f236622776d] 2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr: 17: ceph-osd() [0x60bca9] 2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.342255 7f2368425780 -1 *** Caught signal (Aborted) ** 2014-10-06T16:29:02.348 INFO:tasks.ceph.osd.1.plana30.stderr: in thread 7f2368425780 2014-10-06T16:29:02.348 INFO:tasks.ceph.osd.1.plana30.stderr: 2014-10-06T16:29:02.348 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0) 2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 1: ceph-osd() [0x99c7fa] 2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (()+0xfcb0) [0x7f2367951cb0] 2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (gsignal()+0x35) [0x7f236623c425] 2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (abort()+0x17b) [0x7f236623fb8b] 2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f2366b8f69d] 2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (()+0xb5846) [0x7f2366b8d846] 2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (()+0xb5873) [0x7f2366b8d873] 2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 8: (()+0xb596e) [0x7f2366b8d96e] 2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0xa7e26f] 2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 10: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f] 2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 11: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5] 2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 12: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d] 2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 13: (FileStore::mount()+0x30c2) [0x890792] 2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 14: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a] 2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 15: (main()+0x1d88) [0x6079b8] 2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 16: (__libc_start_main()+0xed) [0x7f236622776d] 2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr: 17: ceph-osd() [0x60bca9] 2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. 2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr: 2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr: 0> 2014-10-06 16:29:02.342255 7f2368425780 -1 *** Caught signal (Aborted) ** 2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr: in thread 7f2368425780 2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr: 2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0) 2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr: 1: ceph-osd() [0x99c7fa] 2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (()+0xfcb0) [0x7f2367951cb0] 2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (gsignal()+0x35) [0x7f236623c425] 2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (abort()+0x17b) [0x7f236623fb8b] 2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f2366b8f69d] 2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (()+0xb5846) [0x7f2366b8d846] 2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (()+0xb5873) [0x7f2366b8d873] 2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 8: (()+0xb596e) [0x7f2366b8d96e] 2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0xa7e26f] 2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 10: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f] 2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 11: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5] 2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 12: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d] 2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 13: (FileStore::mount()+0x30c2) [0x890792] 2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 14: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a] 2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 15: (main()+0x1d88) [0x6079b8] 2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 16: (__libc_start_main()+0xed) [0x7f236622776d] 2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 17: ceph-osd() [0x60bca9] 2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
archive_path: /var/lib/teuthworker/archive/teuthology-2014-10-05_10:00:04-upgrade:firefly-firefly-distro-basic-multi/528734 branch: firefly description: upgrade:firefly/newer/{0-cluster/start.yaml 1-install/v0.80.4.yaml 2-workload/testrados.yaml 3-upgrade-sequence/upgrade-osd-mon-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml testrgw.yaml} distros/ubuntu_12.04.yaml} email: ceph-qa@ceph.com job_id: '528734' kernel: &id001 kdb: true sha1: distro last_in_suite: false machine_type: plana,mira,burnupi name: teuthology-2014-10-05_10:00:04-upgrade:firefly-firefly-distro-basic-multi nuke-on-error: true os_type: ubuntu os_version: '12.04' overrides: admin_socket: branch: firefly ceph: conf: mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 20 fs: xfs log-whitelist: - slow request - scrub - wrongly marked me down - objects unfound and apparently lost - log bound mismatch sha1: 9a3bac0c1a7a42cdf7ba846c9ad0a3ae0f15b4bb ceph-deploy: branch: dev: firefly conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: debug mon: 1 debug ms: 20 debug paxos: 20 osd default pool size: 2 install: ceph: sha1: 9a3bac0c1a7a42cdf7ba846c9ad0a3ae0f15b4bb s3tests: branch: firefly workunit: sha1: 9a3bac0c1a7a42cdf7ba846c9ad0a3ae0f15b4bb owner: scheduled_teuthology@teuthology priority: 1000 roles: - - mon.a - mds.a - osd.0 - osd.1 - osd.2 - - mon.b - mon.c - osd.3 - osd.4 - osd.5 - client.0 - client.1 suite: upgrade:firefly suite_branch: firefly suite_path: /var/lib/teuthworker/src/ceph-qa-suite_firefly targets: ubuntu@plana30.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGNnMbdHQFiegL3t8y+JNTNrecrimI3z2pUSKadAnRFWNQXPaS2JlYFb0v9H6byh6jL9oh/c8JaE/dYRGya7PqL/Mz/3WIJD9mVe59BpHjNn7neD9ngaRM1PSMT0gnjqIvjdPWAW61fWdEIn2I7eqHG3jcoqnsM6AG+DXc/7q8eC5uWkeuKgKogbIzfLbJAmkHXonrtYcxWrybyvTZAOlEV47cnJEeTjzvdSoaq14YVkxtuYRHbCLMCLy5KrcOEB7Chi3sVgAK/krvdSJ3dwUX1aiRw136LRFy87gP0cTllfMhdOa9tJr7m9SbbVNx5Q/86xxUNkpPe+RvwjQC8f5J ubuntu@plana75.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDd+2bdpxp8O9cLQ+wpb3wxDMG2+muqLa/mYfxwBZ4AiPKSVO7aVAfSLo22Po5b9AbYp7D0i9/qBfHuAnhqaDlqXRldd8UnFiqUa0Am+brWaxezcAnfv9CJGnw8gQcWVbQP3BprM0Z1FOs/zX3oiRBhKLfRIpn58odVjwFPuek+EUiBxQc4xb1ZZ8NF4KebhOeFTQdFD79lLMCjwS7fLvJOZ7xzV/97MY53bp9xBWO5ZTsAtTZNBWKvZCsP4bDtph8CQ078KF6ZKhVkjzmgf2VRf7n4qiKKsrghCEZ+Mpjpzxy2CWHtRGr9tkWZDU9JbSk/P4WhJnlp9+ePEr4s6c5z tasks: - internal.lock_machines: - 2 - plana,mira,burnupi - internal.save_config: null - internal.check_lock: null - internal.connect: null - internal.push_inventory: null - internal.serialize_remote_roles: null - internal.check_conflict: null - internal.check_ceph_data: null - internal.vm_setup: null - kernel: *id001 - internal.base: null - internal.archive: null - internal.coredump: null - internal.sudo: null - internal.syslog: null - internal.timer: null - chef: null - clock.check: null - install: tag: v0.80.4 - ceph: log-whitelist: - scrub mismatch - ScrubResult - parallel: - workload - upgrade-sequence - sequential: - mon_thrash: revive_delay: 20 thrash_delay: 1 - ceph-fuse: null - workunit: clients: client.0: - suites/dbench.sh - sequential: - thrashosds: chance_pgnum_grow: 1 chance_pgpnum_fix: 1 timeout: 1200 - ceph-fuse: - client.0 - workunit: clients: client.0: - suites/iogen.sh - sequential: - rgw: - client.1 - s3tests: client.1: rgw_server: client.1 teuthology_branch: master tube: multi upgrade-sequence: sequential: - install.upgrade: all: branch: firefly - ceph.restart: - osd.0 - sleep: duration: 30 - ceph.restart: - osd.1 - sleep: duration: 30 - ceph.restart: - osd.2 - sleep: duration: 30 - ceph.restart: - osd.3 - sleep: duration: 30 - ceph.restart: - osd.4 - sleep: duration: 30 - ceph.restart: - osd.5 - sleep: duration: 60 - ceph.restart: - mon.a - sleep: duration: 60 - ceph.restart: - mon.b - sleep: duration: 60 - ceph.restart: - mon.c - sleep: duration: 60 - ceph.restart: - mds.a verbose: true worker_log: /var/lib/teuthworker/archive/worker_logs/worker.multi.3140 workload: rados: clients: - client.0 objects: 50 op_weights: delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 2000
description: upgrade:firefly/newer/{0-cluster/start.yaml 1-install/v0.80.4.yaml 2-workload/testrados.yaml 3-upgrade-sequence/upgrade-osd-mon-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml testrgw.yaml} distros/ubuntu_12.04.yaml} duration: 3554.4638800621033 failure_reason: timed out waiting for admin_socket to appear after osd.1 restart flavor: basic owner: scheduled_teuthology@teuthology success: false
Actions