Project

General

Profile

Actions

Bug #20302

closed

"BlueStore.cc: 9023: FAILED assert(0 == "unexpected error")" in powercycle-master-distro-basic-smithi

Added by Yuri Weinstein almost 7 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
powercycle
Component(RADOS):
BlueStore
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2017-06-14_15:26:27-powercycle-master-distro-basic-smithi/
Job: 1285969
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2017-06-14_15:26:27-powercycle-master-distro-basic-smithi/1285969/teuthology.log

Assertion: /build/ceph-12.0.3-1621-gb4e75a3/src/os/bluestore/BlueStore.cc: 9023: FAILED assert(0 == "unexpected error")
ceph version 12.0.3-1621-gb4e75a3 (b4e75a3990c66146424bc24ef8762dd4edb16794) luminous (dev)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x10e) [0x7f5265e77cbe]
 2: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x13d9) [0x7f5265d5a9b9]
 3: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x388) [0x7f5265d5b9a8]
 4: (PrimaryLogPG::queue_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<OpRequest>)+0x55) [0x7f5265afd195]
 5: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr<PGTransaction, std::default_delete<PGTransaction> >&&, eversion_t const&, eversion_t const&, std::vector<pg_log_entry_t, std::allocator<pg_log_entry_t> > const&, boost::optional<pg_hit_set_history_t>&, Context*, Context*, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr<OpRequest>)+0xc87) [0x7f5265be83c7]
 6: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x9d3) [0x7f5265a91a63]
 7: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13f5) [0x7f5265adecd5]
 8: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpRequest>&)+0x2cfe) [0x7f5265ae22de]
 9: (PrimaryLogPG::do_request(boost::intrusive_ptr<OpRequest>&, ThreadPool::TPHandle&)+0xe46) [0x7f5265a9fcd6]
 10: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost::intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x21c) [0x7f526594c0cc]
 11: (PGQueueable::RunVis::operator()(boost::intrusive_ptr<OpRequest> const&)+0x47) [0x7f526594c507]
 12: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xff5) [0x7f52659763c5]
 13: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x8fc) [0x7f5265e7d49c]
 14: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x7f5265e7f620]
 15: (()+0x8184) [0x7f5263993184]
 16: (clone()+0x6d) [0x7f5262a8337d]

Actions #1

Updated by Greg Farnum almost 7 years ago

  • Project changed from Ceph to RADOS
  • Component(RADOS) BlueStore added
Actions #2

Updated by Sage Weil almost 7 years ago

  • Status changed from New to Fix Under Review
2017-06-14T16:58:23.809 INFO:tasks.ceph.osd.0.smithi063.stderr:2017-06-14 16:58:23.809341 7f524570e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _do_write _do_alloc_write failed with (28) No space left on device
2017-06-14T16:58:23.809 INFO:tasks.ceph.osd.0.smithi063.stderr:2017-06-14 16:58:23.809487 7f524570e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _txc_add_transaction error (28) No space left on device not handled on operation 10 (op 3, counting from 0)
2017-06-14T16:58:23.810 INFO:tasks.ceph.osd.0.smithi063.stderr:2017-06-14 16:58:23.809492 7f524570e700 -1 bluestore(/var/lib/ceph/osd/ceph-0) ENOSPC from bluestore, misconfigured cluster

https://github.com/ceph/ceph/pull/15794 closed
Actions #3

Updated by Yuri Weinstein almost 7 years ago

merged

Actions #4

Updated by Nathan Cutler almost 7 years ago

  • Status changed from Fix Under Review to Resolved
Actions

Also available in: Atom PDF