Project

General

Profile

Actions

Bug #10120

closed

"Assertion: os/FileStore.cc" in upgrade:firefly-x-next-distro-basic-multi run

Added by Yuri Weinstein over 9 years ago. Updated almost 6 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
Sandon Van Ness
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
bad_disk
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/

Assertion: os/FileStore.cc: 1120: FAILED assert(!m_filestore_fail_eio || ret != -5)
ceph version 0.80.7-129-gc069bce (c069bce4e8180da3c0ca4951365032a45df76468)
 1: (FileStore::write_op_seq(int, unsigned long)+0xed) [0x87382d]
 2: (FileStore::sync_entry()+0x1964) [0x893014]
 3: (FileStore::SyncThread::entry()+0xd) [0x8afc5d]
 4: (()+0x7e9a) [0x7fcfa005fe9a]
 5: (clone()+0x6d) [0x7fcf9ea2a31d]

in osd.7:

/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz:2014-11-15 21:02:02.049475 7fcf96d87700 -1 *** Caught signal (Aborted) **
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: in thread 7fcf96d87700
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz:
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: ceph version 0.80.7-129-gc069bce (c069bce4e8180da3c0ca4951365032a45df76468)
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 1: ceph-osd() [0x99c9ba]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 2: (()+0xfcb0) [0x7fcfa0067cb0]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 3: (gsignal()+0x35) [0x7fcf9e96c0d5]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 4: (abort()+0x17b) [0x7fcf9e96f83b]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fcf9f2be69d]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 6: (()+0xb5846) [0x7fcf9f2bc846]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 7: (()+0xb5873) [0x7fcf9f2bc873]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 8: (()+0xb596e) [0x7fcf9f2bc96e]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0xa7ee1f]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 10: (FileStore::write_op_seq(int, unsigned long)+0xed) [0x87382d]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 11: (FileStore::sync_entry()+0x1964) [0x893014]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 12: (FileStore::SyncThread::entry()+0xd) [0x8afc5d]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 13: (()+0x7e9a) [0x7fcfa005fe9a]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: 14: (clone()+0x6d) [0x7fcf9ea2a31d]
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
/a/teuthology-2014-11-15_17:13:01-upgrade:firefly-x-next-distro-basic-multi/603049/remote/mira034/log/ceph-osd.7.log.gz:

Actions #1

Updated by Sage Weil over 9 years ago

  • Status changed from New to Rejected

that fail_eio assert means we got EIO back from the fs, whcih means there is a bad disk

Actions #2

Updated by Yuri Weinstein over 9 years ago

  • Tags set to bad_disk
Actions #3

Updated by Yuri Weinstein over 9 years ago

  • Project changed from Ceph to devops
  • Status changed from Rejected to New
  • Assignee set to Sandon Van Ness

Sandon, that was mira034:

2014-11-15T20:46:04.965 INFO:teuthology.task.internal:roles: ubuntu@mira034.front.sepia.ceph.com - ['osd.7', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'osd.12', 'osd.13']
Actions #4

Updated by Sage Weil almost 6 years ago

  • Status changed from New to Rejected
Actions

Also available in: Atom PDF