Project

General

Profile

Actions

Bug #23459

closed

BlueStore kv_sync_thread() crash

Added by Alex Gorbachev about 6 years ago. Updated almost 6 years ago.

Status:
Can't reproduce
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2018-03-25 06:49:02.894926 7ff4fdc97700 -1 ** Caught signal (Aborted) *
in thread 7ff4fdc97700 thread_name:bstore_kv_sync

ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
1: (()+0xa74234) [0x562dcc031234]
2: (()+0x11390) [0x7ff50f81c390]
3: (gsignal()+0x38) [0x7ff50e7b7428]
4: (abort()+0x16a) [0x7ff50e7b902a]
5: (_gnu_cxx::_verbose_terminate_handler()+0x16d) [0x7ff50f0fa84d]
6: (()+0x8d6b6) [0x7ff50f0f86b6]
7: (()+0x8d701) [0x7ff50f0f8701]
8: (()+0x8d919) [0x7ff50f0f8919]
9: (()+0x1228f) [0x7ff5103e328f]
10: (operator new[](unsigned long)+0x4e7) [0x7ff510407417]
11: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x70) [0x562dcc43b8c0]
12: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x45) [0x562dcc43ba45]
13: (rocksdb::Arena::AllocateAligned(unsigned long, unsigned long, rocksdb::Logger*)+0x100) [0x562dcc43bbd0]
14: (rocksdb::ConcurrentArena::AllocateAligned(unsigned long, unsigned long, rocksdb::Logger*)+0x175) [0x562dcc3aa965]
15: (()+0xe27593) [0x562dcc3e4593]
16: (()+0xe27d6d) [0x562dcc3e4d6d]
17: (rocksdb::MemTable::Add(unsigned long, rocksdb::ValueType, rocksdb::Slice const&, rocksdb::Slice const&, bool, rocksdb::MemTablePostProcessInfo*)+0x109) [0x562dcc3a5eb9]
18: (rocksdb::MemTableInserter::PutCF(unsigned int, rocksdb::Slice const&, rocksdb::Slice const&)+0x39c) [0x562dcc3ddf5c]
19: (rocksdb::WriteBatch::Iterate(rocksdb::WriteBatch::Handler*) const+0x5b7) [0x562dcc3d7837]
20: (rocksdb::WriteBatchInternal::InsertInto(rocksdb::autovector<rocksdb::WriteThread::Writer*, 8ul> const&, unsigned long, rocksdb::ColumnFamilyMemTables*, rocksdb::FlushScheduler*, bool, unsigned long, rocksdb::DB*, bool)+0x14b) [0x562dcc3db65b]
21: (rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool)+0x14a7) [0x562dcc4a0967]
22: (rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*)+0x2a) [0x562dcc4a13ca]
23: (RocksDBStore::submit_transaction(std::shared_ptr<KeyValueDB::TransactionImpl>)+0xaf) [0x562dcbf6fc1f]
24: (BlueStore::_kv_sync_thread()+0x23ec) [0x562dcbf0857c]
25: (BlueStore::KVSyncThread::entry()+0xd) [0x562dcbf4c08d]
26: (()+0x76ba) [0x7ff50f8126ba]
27: (clone()+0x6d) [0x7ff50e88941d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-2334> 2018-03-24 09:29:50.618040 7ff511338e00 5 asok(0x562dd60bf4a0) register_command perfcounters_dump hook 0x562dd60721b0
-2333> 2018-03-24 09:29:50.618063 7ff511338e00 5 asok(0x562dd60bf4a0) register_command 1 hook 0x562dd60721b0
-2332> 2018-03-24 09:29:50.618069 7ff511338e00 5 asok(0x562dd60bf4a0) register_command perf dump hook 0x562dd60721b0
-2331> 2018-03-24 09:29:50.618075 7ff511338e00 5 asok(0x562dd60bf4a0) register_command perfcounters_schema hook 0x562dd60721b0
-2330> 2018-03-24 09:29:50.618080 7ff511338e00 5 asok(0x562dd60bf4a0) register_command perf histogram dump hook 0x562dd60721b0
-2329> 2018-03-24 09:29:50.618085 7ff511338e00 5 asok(0x562dd60bf4a0) register_command 2 hook 0x562dd60721b0
-2328> 2018-03-24 09:29:50.618089 7ff511338e00 5 asok(0x562dd60bf4a0) register_command perf schema hook 0x562dd60721b0
-2327> 2018-03-24 09:29:50.618094 7ff511338e00 5 asok(0x562dd60bf4a0) register_command perf histogram schema hook 0x562dd60721b0
-2326> 2018-03-24 09:29:50.618104 7ff511338e00 5 asok(0x562dd60bf4a0) register_command perf reset hook 0x562dd60721b0
-2325> 2018-03-24 09:29:50.618110 7ff511338e00 5 asok(0x562dd60bf4a0) register_command config show hook 0x562dd60721b0
-2324> 2018-03-24 09:29:50.618115 7ff511338e00 5 asok(0x562dd60bf4a0) register_command config help hook 0x562dd60721b0
-2323> 2018-03-24 09:29:50.618120 7ff511338e00 5 asok(0x562dd60bf4a0) register_command config set hook 0x562dd60721b0
-2322> 2018-03-24 09:29:50.618125 7ff511338e00 5 asok(0x562dd60bf4a0) register_command config get hook 0x562dd60721b0
-2321> 2018-03-24 09:29:50.618130 7ff511338e00 5 asok(0x562dd60bf4a0) register_command config diff hook 0x562dd60721b0


Files

_usr_bin_ceph-osd.64045.crash.gz (4.35 KB) _usr_bin_ceph-osd.64045.crash.gz Alex Gorbachev, 03/26/2018 03:58 AM
Actions #2

Updated by Greg Farnum about 6 years ago

  • Project changed from Ceph to bluestore
Actions #3

Updated by Alex Gorbachev almost 6 years ago

I have not seen this happen in 12.2.5 any more

Actions #4

Updated by Sage Weil almost 6 years ago

  • Status changed from New to Can't reproduce
Actions

Also available in: Atom PDF