Project

General

Profile

Actions
Copy link

Bug #9682

closed

"os/FileJournal.cc: 1677: FAILED assert(0)" in upgrade:firefly-firefly-distro-basic-multi run

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-10-05_10:00:04-upgrade:firefly-firefly-distro-basic-multi/528734/

2014-10-06T16:29:02.055 INFO:tasks.thrashosds.ceph_manager:waiting on admin_socket for 1, ['dump_ops_in_flight']
2014-10-06T16:29:02.241 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.241098 7f2368425780 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
2014-10-06T16:29:02.287 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.286272 7f2368425780 -1 journal Unable to read past sequence 39581 but header indicates the journal has committed up through 39647, journal is corrupt
2014-10-06T16:29:02.289 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2368425780 time 2014-10-06 16:29:02.286293
2014-10-06T16:29:02.289 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: 1677: FAILED assert(0)
2014-10-06T16:29:02.297 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0)
2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 1: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f]
2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5]
2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d]
2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (FileStore::mount()+0x30c2) [0x890792]
2014-10-06T16:29:02.298 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a]
2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (main()+0x1d88) [0x6079b8]
2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (__libc_start_main()+0xed) [0x7f236622776d]
2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: 8: ceph-osd() [0x60bca9]
2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.297264 7f2368425780 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2368425780 time 2014-10-06 16:29:02.286293
2014-10-06T16:29:02.299 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: 1677: FAILED assert(0)
2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr:
2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0)
2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 1: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f]
2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5]
2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d]
2014-10-06T16:29:02.300 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (FileStore::mount()+0x30c2) [0x890792]
2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a]
2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (main()+0x1d88) [0x6079b8]
2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (__libc_start_main()+0xed) [0x7f236622776d]
2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: 8: ceph-osd() [0x60bca9]
2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-10-06T16:29:02.301 INFO:tasks.ceph.osd.1.plana30.stderr:
2014-10-06T16:29:02.302 INFO:tasks.ceph.osd.1.plana30.stderr:   -10> 2014-10-06 16:29:02.241098 7f2368425780 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
2014-10-06T16:29:02.302 INFO:tasks.ceph.osd.1.plana30.stderr:    -1> 2014-10-06 16:29:02.286272 7f2368425780 -1 journal Unable to read past sequence 39581 but header indicates the journal has committed up through 39647, journal is corrupt
2014-10-06T16:29:02.302 INFO:tasks.ceph.osd.1.plana30.stderr:     0> 2014-10-06 16:29:02.297264 7f2368425780 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2368425780 time 2014-10-06 16:29:02.286293
2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr:os/FileJournal.cc: 1677: FAILED assert(0)
2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr:
2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0)
2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: 1: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f]
2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5]
2014-10-06T16:29:02.303 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d]
2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (FileStore::mount()+0x30c2) [0x890792]
2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a]
2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (main()+0x1d88) [0x6079b8]
2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (__libc_start_main()+0xed) [0x7f236622776d]
2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: 8: ceph-osd() [0x60bca9]
2014-10-06T16:29:02.304 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-10-06T16:29:02.305 INFO:tasks.ceph.osd.1.plana30.stderr:
2014-10-06T16:29:02.322 INFO:tasks.ceph.osd.1.plana30.stderr:terminate called after throwing an instance of 'ceph::FailedAssertion'
2014-10-06T16:29:02.322 INFO:tasks.ceph.osd.1.plana30.stderr:*** Caught signal (Aborted) **
2014-10-06T16:29:02.323 INFO:tasks.ceph.osd.1.plana30.stderr: in thread 7f2368425780
2014-10-06T16:29:02.343 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0)
2014-10-06T16:29:02.343 INFO:tasks.ceph.osd.1.plana30.stderr: 1: ceph-osd() [0x99c7fa]
2014-10-06T16:29:02.343 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (()+0xfcb0) [0x7f2367951cb0]
2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (gsignal()+0x35) [0x7f236623c425]
2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (abort()+0x17b) [0x7f236623fb8b]
2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f2366b8f69d]
2014-10-06T16:29:02.344 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (()+0xb5846) [0x7f2366b8d846]
2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (()+0xb5873) [0x7f2366b8d873]
2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 8: (()+0xb596e) [0x7f2366b8d96e]
2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0xa7e26f]
2014-10-06T16:29:02.345 INFO:tasks.ceph.osd.1.plana30.stderr: 10: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f]
2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 11: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5]
2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 12: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d]
2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 13: (FileStore::mount()+0x30c2) [0x890792]
2014-10-06T16:29:02.346 INFO:tasks.ceph.osd.1.plana30.stderr: 14: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a]
2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr: 15: (main()+0x1d88) [0x6079b8]
2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr: 16: (__libc_start_main()+0xed) [0x7f236622776d]
2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr: 17: ceph-osd() [0x60bca9]
2014-10-06T16:29:02.347 INFO:tasks.ceph.osd.1.plana30.stderr:2014-10-06 16:29:02.342255 7f2368425780 -1 *** Caught signal (Aborted) **
2014-10-06T16:29:02.348 INFO:tasks.ceph.osd.1.plana30.stderr: in thread 7f2368425780
2014-10-06T16:29:02.348 INFO:tasks.ceph.osd.1.plana30.stderr:
2014-10-06T16:29:02.348 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0)
2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 1: ceph-osd() [0x99c7fa]
2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (()+0xfcb0) [0x7f2367951cb0]
2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (gsignal()+0x35) [0x7f236623c425]
2014-10-06T16:29:02.349 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (abort()+0x17b) [0x7f236623fb8b]
2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f2366b8f69d]
2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (()+0xb5846) [0x7f2366b8d846]
2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (()+0xb5873) [0x7f2366b8d873]
2014-10-06T16:29:02.350 INFO:tasks.ceph.osd.1.plana30.stderr: 8: (()+0xb596e) [0x7f2366b8d96e]
2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0xa7e26f]
2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 10: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f]
2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 11: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5]
2014-10-06T16:29:02.351 INFO:tasks.ceph.osd.1.plana30.stderr: 12: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d]
2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 13: (FileStore::mount()+0x30c2) [0x890792]
2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 14: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a]
2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 15: (main()+0x1d88) [0x6079b8]
2014-10-06T16:29:02.352 INFO:tasks.ceph.osd.1.plana30.stderr: 16: (__libc_start_main()+0xed) [0x7f236622776d]
2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr: 17: ceph-osd() [0x60bca9]
2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr:
2014-10-06T16:29:02.353 INFO:tasks.ceph.osd.1.plana30.stderr:     0> 2014-10-06 16:29:02.342255 7f2368425780 -1 *** Caught signal (Aborted) **
2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr: in thread 7f2368425780
2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr:
2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr: ceph version 0.80.6-48-g884f7c4 (884f7c40c4a28d519847d3995c8d98e5837ceaf0)
2014-10-06T16:29:02.354 INFO:tasks.ceph.osd.1.plana30.stderr: 1: ceph-osd() [0x99c7fa]
2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 2: (()+0xfcb0) [0x7f2367951cb0]
2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 3: (gsignal()+0x35) [0x7f236623c425]
2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 4: (abort()+0x17b) [0x7f236623fb8b]
2014-10-06T16:29:02.355 INFO:tasks.ceph.osd.1.plana30.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f2366b8f69d]
2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 6: (()+0xb5846) [0x7f2366b8d846]
2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 7: (()+0xb5873) [0x7f2366b8d873]
2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 8: (()+0xb596e) [0x7f2366b8d96e]
2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0xa7e26f]
2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 10: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x86f) [0x97918f]
2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 11: (FileJournal::open(unsigned long)+0x6b5) [0x9766f5]
2014-10-06T16:29:02.356 INFO:tasks.ceph.osd.1.plana30.stderr: 12: (JournalingObjectStore::journal_replay(unsigned long)+0x26d) [0x8bd39d]
2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 13: (FileStore::mount()+0x30c2) [0x890792]
2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 14: (OSD::do_convertfs(ObjectStore*)+0x1a) [0x61fd8a]
2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 15: (main()+0x1d88) [0x6079b8]
2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 16: (__libc_start_main()+0xed) [0x7f236622776d]
2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: 17: ceph-osd() [0x60bca9]
2014-10-06T16:29:02.357 INFO:tasks.ceph.osd.1.plana30.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

archive_path: /var/lib/teuthworker/archive/teuthology-2014-10-05_10:00:04-upgrade:firefly-firefly-distro-basic-multi/528734
branch: firefly
description: upgrade:firefly/newer/{0-cluster/start.yaml 1-install/v0.80.4.yaml 2-workload/testrados.yaml
  3-upgrade-sequence/upgrade-osd-mon-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml
  testrgw.yaml} distros/ubuntu_12.04.yaml}
email: ceph-qa@ceph.com
job_id: '528734'
kernel: &id001
  kdb: true
  sha1: distro
last_in_suite: false
machine_type: plana,mira,burnupi
name: teuthology-2014-10-05_10:00:04-upgrade:firefly-firefly-distro-basic-multi
nuke-on-error: true
os_type: ubuntu
os_version: '12.04'
overrides:
  admin_socket:
    branch: firefly
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    fs: xfs
    log-whitelist:
    - slow request
    - scrub
    - wrongly marked me down
    - objects unfound and apparently lost
    - log bound mismatch
    sha1: 9a3bac0c1a7a42cdf7ba846c9ad0a3ae0f15b4bb
  ceph-deploy:
    branch:
      dev: firefly
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 9a3bac0c1a7a42cdf7ba846c9ad0a3ae0f15b4bb
  s3tests:
    branch: firefly
  workunit:
    sha1: 9a3bac0c1a7a42cdf7ba846c9ad0a3ae0f15b4bb
owner: scheduled_teuthology@teuthology
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mon.c
  - osd.3
  - osd.4
  - osd.5
  - client.0
  - client.1
suite: upgrade:firefly
suite_branch: firefly
suite_path: /var/lib/teuthworker/src/ceph-qa-suite_firefly
targets:
  ubuntu@plana30.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGNnMbdHQFiegL3t8y+JNTNrecrimI3z2pUSKadAnRFWNQXPaS2JlYFb0v9H6byh6jL9oh/c8JaE/dYRGya7PqL/Mz/3WIJD9mVe59BpHjNn7neD9ngaRM1PSMT0gnjqIvjdPWAW61fWdEIn2I7eqHG3jcoqnsM6AG+DXc/7q8eC5uWkeuKgKogbIzfLbJAmkHXonrtYcxWrybyvTZAOlEV47cnJEeTjzvdSoaq14YVkxtuYRHbCLMCLy5KrcOEB7Chi3sVgAK/krvdSJ3dwUX1aiRw136LRFy87gP0cTllfMhdOa9tJr7m9SbbVNx5Q/86xxUNkpPe+RvwjQC8f5J
  ubuntu@plana75.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDd+2bdpxp8O9cLQ+wpb3wxDMG2+muqLa/mYfxwBZ4AiPKSVO7aVAfSLo22Po5b9AbYp7D0i9/qBfHuAnhqaDlqXRldd8UnFiqUa0Am+brWaxezcAnfv9CJGnw8gQcWVbQP3BprM0Z1FOs/zX3oiRBhKLfRIpn58odVjwFPuek+EUiBxQc4xb1ZZ8NF4KebhOeFTQdFD79lLMCjwS7fLvJOZ7xzV/97MY53bp9xBWO5ZTsAtTZNBWKvZCsP4bDtph8CQ078KF6ZKhVkjzmgf2VRf7n4qiKKsrghCEZ+Mpjpzxy2CWHtRGr9tkWZDU9JbSk/P4WhJnlp9+ePEr4s6c5z
tasks:
- internal.lock_machines:
  - 2
  - plana,mira,burnupi
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.push_inventory: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    tag: v0.80.4
- ceph:
    log-whitelist:
    - scrub mismatch
    - ScrubResult
- parallel:
  - workload
  - upgrade-sequence
- sequential:
  - mon_thrash:
      revive_delay: 20
      thrash_delay: 1
  - ceph-fuse: null
  - workunit:
      clients:
        client.0:
        - suites/dbench.sh
- sequential:
  - thrashosds:
      chance_pgnum_grow: 1
      chance_pgpnum_fix: 1
      timeout: 1200
  - ceph-fuse:
    - client.0
  - workunit:
      clients:
        client.0:
        - suites/iogen.sh
- sequential:
  - rgw:
    - client.1
  - s3tests:
      client.1:
        rgw_server: client.1
teuthology_branch: master
tube: multi
upgrade-sequence:
  sequential:
  - install.upgrade:
      all:
        branch: firefly
  - ceph.restart:
    - osd.0
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.1
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.2
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.3
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.4
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.5
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.a
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.b
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.c
  - sleep:
      duration: 60
  - ceph.restart:
    - mds.a
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.multi.3140
workload:
  rados:
    clients:
    - client.0
    objects: 50
    op_weights:
      delete: 50
      read: 100
      rollback: 50
      snap_create: 50
      snap_remove: 50
      write: 100
    ops: 2000

description: upgrade:firefly/newer/{0-cluster/start.yaml 1-install/v0.80.4.yaml 2-workload/testrados.yaml
  3-upgrade-sequence/upgrade-osd-mon-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml
  testrgw.yaml} distros/ubuntu_12.04.yaml}
duration: 3554.4638800621033
failure_reason: timed out waiting for admin_socket to appear after osd.1 restart
flavor: basic
owner: scheduled_teuthology@teuthology
success: false

Related issues 1 (0 open — 1 closed)

Is duplicate of Ceph - Bug #6003: journal Unable to read past sequence 406 ...ResolvedSamuel Just08/15/2013

Actions
Actions
Copy link
 #1

Updated by Samuel Just over 9 years ago

  • Status changed from New to Duplicate
Actions
Copy link

Also available in: Atom PDF