Actions
Bug #19360
closed"bluestore/KernelDevice.cc: 446: FAILED assert(r == 0)" in rbd, cephfs, upgrade suites
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/kraken-x
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Run: http://pulpito.ceph.com/teuthology-2017-03-22_03:25:11-upgrade:kraken-x-master-distro-basic-ovh/
Jobs: ['930633', '930612', '930618']
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2017-03-22_03:25:11-upgrade:kraken-x-master-distro-basic-ovh/930612/teuthology.log
2017-03-22T04:51:21.177 INFO:tasks.ceph.osd.1.ovh084.stderr:2017-03-22 04:51:21.165584 7f8348f4a700 -1 osd.1 889 check_full_status full_ratio or nearfull_ratio is <= 0 2017-03-22T04:51:22.658 INFO:tasks.ceph.osd.0.ovh084.stderr:2017-03-22 04:51:22.645094 7fc45e5c1700 -1 osd.0 889 check_full_status full_ratio or nearfull_ratio is <= 0 2017-03-22T04:51:24.874 INFO:tasks.ceph.osd.2.ovh029.stderr:2017-03-22 04:51:24.864986 7ff121061700 -1 osd.2 889 check_full_status full_ratio or nearfull_ratio is <= 0 2017-03-22T04:51:25.279 INFO:tasks.ceph.osd.1.ovh084.stderr:2017-03-22 04:51:25.266795 7f8348f4a700 -1 osd.1 889 check_full_status full_ratio or nearfull_ratio is <= 0 2017-03-22T04:51:25.687 INFO:tasks.ceph.osd.1.ovh084.stderr:/build/ceph-12.0.0-1634-g68bc509/src/os/bluestore/KernelDevice.cc: In function 'virtual void KernelDevice::aio_submit(IOContext*)' thread 7f8354f62700 time 2017-03-22 04:51:25.669107 2017-03-22T04:51:25.688 INFO:tasks.ceph.osd.1.ovh084.stderr:/build/ceph-12.0.0-1634-g68bc509/src/os/bluestore/KernelDevice.cc: 446: FAILED assert(r == 0) 2017-03-22T04:51:25.688 INFO:tasks.ceph.osd.1.ovh084.stderr: ceph version 12.0.0-1634-g68bc509 (68bc50941303c8ccaa489342204b1f5fcc63b12b) 2017-03-22T04:51:25.688 INFO:tasks.ceph.osd.1.ovh084.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x564efab1bc82] 2017-03-22T04:51:25.688 INFO:tasks.ceph.osd.1.ovh084.stderr: 2: (KernelDevice::aio_submit(IOContext*)+0xa72) [0x564efaaa1612] 2017-03-22T04:51:25.688 INFO:tasks.ceph.osd.1.ovh084.stderr: 3: (BlueStore::_txc_aio_submit(BlueStore::TransContext*)+0x161) [0x564efa95bd51] 2017-03-22T04:51:25.688 INFO:tasks.ceph.osd.1.ovh084.stderr: 4: (BlueStore::_deferred_try_submit(BlueStore::OpSequencer*)+0x15df) [0x564efa99f8cf] 2017-03-22T04:51:25.688 INFO:tasks.ceph.osd.1.ovh084.stderr: 5: (BlueStore::_deferred_try_submit()+0x20f) [0x564efa9a025f] 2017-03-22T04:51:25.689 INFO:tasks.ceph.osd.1.ovh084.stderr: 6: (BlueStore::_kv_sync_thread()+0x213f) [0x564efa9a7b8f] 2017-03-22T04:51:25.689 INFO:tasks.ceph.osd.1.ovh084.stderr: 7: (BlueStore::KVSyncThread::entry()+0xd) [0x564efa9e2b2d] 2017-03-22T04:51:25.689 INFO:tasks.ceph.osd.1.ovh084.stderr: 8: (()+0x76ba) [0x7f83654046ba] 2017-03-22T04:51:25.689 INFO:tasks.ceph.osd.1.ovh084.stderr: 9: (clone()+0x6d) [0x7f836447b82d] 2017-03-22T04:51:25.689 INFO:tasks.ceph.osd.1.ovh084.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Updated by John Spray about 7 years ago
Same backtrace on most of the failures in this fs-master run: http://pulpito.ceph.com/teuthology-2017-03-25_03:15:02-fs-master---basic-smithi/
Updated by Sage Weil about 7 years ago
- Assignee set to Sage Weil
- Priority changed from Normal to Urgent
Updated by Jason Dillaman about 7 years ago
Updated by John Spray about 7 years ago
- Subject changed from "bluestore/KernelDevice.cc: 446: FAILED assert(r == 0)" in upgrade:kraken-x-master-distro-basic-ovh to "bluestore/KernelDevice.cc: 446: FAILED assert(r == 0)" in rbd, cephfs, upgrade suites
Updated by Dmitry Smirnov about 7 years ago
Struggling with same issue, more details in bug report #19511
Actions