Project

General

Profile

Bug #20557 » osd.6-segfault.txt

HDD - Mikko Tanner, 08/27/2017 02:05 PM

 
ceph-osd[8381]: *** Caught signal (Segmentation fault) **
ceph-osd[8381]: in thread 7f3fbebe6700 thread_name:tp_osd_tp
ceph-osd[8381]: ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc)
ceph-osd[8381]: 1: (()+0xa542b4) [0xa9672b82b4]
ceph-osd[8381]: 2: (()+0x11390) [0x7f3fdd07e390]
ceph-osd[8381]: 3: (()+0x1f8af) [0x7f3fde9ab8af]
ceph-osd[8381]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry<rocksdb::Block>*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0x1d9) [0xa9676841e9]
ceph-osd[8381]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry<rocksdb::Block>*, bool)+0x3b7) [0xa967685bc7]
ceph-osd[8381]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x2ac) [0xa967685f0c]
ceph-osd[8381]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x97) [0xa96768e687]
ceph-osd[8381]: 8: (()+0xe5594e) [0xa9676b994e]
ceph-osd[8381]: 9: (()+0xe55a16) [0xa9676b9a16]
ceph-osd[8381]: 10: (()+0xe55b91) [0xa9676b9b91]
ceph-osd[8381]: 11: (rocksdb::MergingIterator::Next()+0x449) [0xa96769cce9]
ceph-osd[8381]: 12: (rocksdb::DBIter::FindNextUserEntryInternal(bool, bool)+0x182) [0xa96773a0b2]
ceph-osd[8381]: 13: (rocksdb::DBIter::Seek(rocksdb::Slice const&)+0x314) [0xa96773b454]
ceph-osd[8381]: 14: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::lower_bound(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x46) [0xa9671fb036]
ceph-osd[8381]: 15: (BlueStore::_omap_rmkey_range(BlueStore::TransContext*, boost::intrusive_ptr<BlueStore::Collection>&, boost::intrusive_ptr<BlueStore::Onode>&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x14e) [0xa967155a3e]
ceph-osd[8381]: 16: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x1e50) [0xa9671b7930]
ceph-osd[8381]: 17: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction>>&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x52e) [0xa9671b879e]
ceph-osd[8381]: 18: (PrimaryLogPG::queue_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<OpRequest>)+0x66) [0xa966ee2b86]
ceph-osd[8381]: 19: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr<PGTransaction, std::default_delete<PGTransaction> >&&, eversion_t const&, eversion_t const&, std::vector<pg_log_entry_t, std::allocator<pg_log_entry_t> > const&, boost::optional<pg_hit_set_history_t>&, Context*, Context*, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr<OpRequest>)+0xcb8) [0xa967012838]
ceph-osd[8381]: 20: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x9fa) [0xa966e7fc2a]
ceph-osd[8381]: 21: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x139b) [0xa966ec826b]
ceph-osd[8381]: 22: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpRequest>&)+0x308b) [0xa966ecbc8b]
ceph-osd[8381]: 23: (PrimaryLogPG::do_request(boost::intrusive_ptr<OpRequest>&, ThreadPool::TPHandle&)+0xe73) [0xa966e85d03]
ceph-osd[8381]: 24: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost::intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x3a9) [0xa966d09fd9]
ceph-osd[8381]: 25: (PGQueueable::RunVis::operator()(boost::intrusive_ptr<OpRequest> const&)+0x57) [0xa966fa13f7]
ceph-osd[8381]: 26: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x130e) [0xa966d3157e]
ceph-osd[8381]: 27: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x884) [0xa9672ffe34]
ceph-osd[8381]: 28: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xa967302e70]
ceph-osd[8381]: 29: (()+0x76ba) [0x7f3fdd0746ba]
ceph-osd[8381]: 30: (clone()+0x6d) [0x7f3fdc0eb3dd]

ceph-osd[8381]: 2017-08-23 13:45:03.938883 7f3fbebe6700 -1 *** Caught signal (Segmentation fault) **
ceph-osd[8381]: in thread 7f3fbebe6700 thread_name:tp_osd_tp
ceph-osd[8381]: ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc)
ceph-osd[8381]: 1: (()+0xa542b4) [0xa9672b82b4]
ceph-osd[8381]: 2: (()+0x11390) [0x7f3fdd07e390]
ceph-osd[8381]: 3: (()+0x1f8af) [0x7f3fde9ab8af]
ceph-osd[8381]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry<rocksdb::Block>*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0x1d9) [0xa9676841e9]
ceph-osd[8381]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry<rocksdb::Block>*, bool)+0x3b7) [0xa967685bc7]
ceph-osd[8381]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x2ac) [0xa967685f0c]
ceph-osd[8381]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x97) [0xa96768e687]
ceph-osd[8381]: 8: (()+0xe5594e) [0xa9676b994e]
ceph-osd[8381]: 9: (()+0xe55a16) [0xa9676b9a16]
ceph-osd[8381]: 10: (()+0xe55b91) [0xa9676b9b91]
ceph-osd[8381]: 11: (rocksdb::MergingIterator::Next()+0x449) [0xa96769cce9]
ceph-osd[8381]: 12: (rocksdb::DBIter::FindNextUserEntryInternal(bool, bool)+0x182) [0xa96773a0b2]
ceph-osd[8381]: 13: (rocksdb::DBIter::Seek(rocksdb::Slice const&)+0x314) [0xa96773b454]
ceph-osd[8381]: 14: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::lower_bound(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x46) [0xa9671fb036]
ceph-osd[8381]: 15: (BlueStore::_omap_rmkey_range(BlueStore::TransContext*, boost::intrusive_ptr<BlueStore::Collection>&, boost::intrusive_ptr<BlueStore::Onode>&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x14e) [0xa967155a3e]
ceph-osd[8381]: 16: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x1e50) [0xa9671b7930]
ceph-osd[8381]: 17: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x52e) [0xa9671b879e]
ceph-osd[8381]: 18: (PrimaryLogPG::queue_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<OpRequest>)+0x66) [0xa966ee2b86]
ceph-osd[8381]: 19: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr<PGTransaction, std::default_delete<PGTransaction> >&&, eversion_t const&, eversion_t const&, std::vector<pg_log_entry_t, std::allocator<pg_log_entry_t> > const&, boost::optional<pg_hit_set_history_t>&, Context*, Context*, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr<OpRequest>)+0xcb8) [0xa967012838]
ceph-osd[8381]: 20: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x9fa) [0xa966e7fc2a]
ceph-osd[8381]: 21: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x139b) [0xa966ec826b]
ceph-osd[8381]: 22: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpRequest>&)+0x308b) [0xa966ecbc8b]
ceph-osd[8381]: 23: (PrimaryLogPG::do_request(boost::intrusive_ptr<OpRequest>&, ThreadPool::TPHandle&)+0xe73) [0xa966e85d03]
ceph-osd[8381]: 24: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost::intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x3a9) [0xa966d09fd9]
ceph-osd[8381]: 25: (PGQueueable::RunVis::operator()(boost::intrusive_ptr<OpRequest> const&)+0x57) [0xa966fa13f7]
ceph-osd[8381]: 26: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x130e) [0xa966d3157e]
ceph-osd[8381]: 27: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x884) [0xa9672ffe34]
ceph-osd[8381]: 28: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xa967302e70]
ceph-osd[8381]: 29: (()+0x76ba) [0x7f3fdd0746ba]
ceph-osd[8381]: 30: (clone()+0x6d) [0x7f3fdc0eb3dd]
ceph-osd[8381]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

ceph-osd[8381]: 0> 2017-08-23 13:45:03.938883 7f3fbebe6700 -1 *** Caught signal (Segmentation fault) **
ceph-osd[8381]: in thread 7f3fbebe6700 thread_name:tp_osd_tp
ceph-osd[8381]: ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc)
ceph-osd[8381]: 1: (()+0xa542b4) [0xa9672b82b4]
ceph-osd[8381]: 2: (()+0x11390) [0x7f3fdd07e390]
ceph-osd[8381]: 3: (()+0x1f8af) [0x7f3fde9ab8af]
ceph-osd[8381]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry<rocksdb::Block>*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0x1d9) [0xa9676841e9]
ceph-osd[8381]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry<rocksdb::Block>*, bool)+0x3b7) [0xa967685bc7]
ceph-osd[8381]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x2ac) [0xa967685f0c]
ceph-osd[8381]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x97) [0xa96768e687]
ceph-osd[8381]: 8: (()+0xe5594e) [0xa9676b994e]
ceph-osd[8381]: 9: (()+0xe55a16) [0xa9676b9a16]
ceph-osd[8381]: 10: (()+0xe55b91) [0xa9676b9b91]
ceph-osd[8381]: 11: (rocksdb::MergingIterator::Next()+0x449) [0xa96769cce9]
ceph-osd[8381]: 12: (rocksdb::DBIter::FindNextUserEntryInternal(bool, bool)+0x182) [0xa96773a0b2]
ceph-osd[8381]: 13: (rocksdb::DBIter::Seek(rocksdb::Slice const&)+0x314) [0xa96773b454]
ceph-osd[8381]: 14: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::lower_bound(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x46) [0xa9671fb036]
ceph-osd[8381]: 15: (BlueStore::_omap_rmkey_range(BlueStore::TransContext*, boost::intrusive_ptr<BlueStore::Collection>&, boost::intrusive_ptr<BlueStore::Onode>&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x14e) [0xa967155a3e]
ceph-osd[8381]: 16: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x1e50) [0xa9671b7930]
ceph-osd[8381]: 17: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x52e) [0xa9671b879e]
ceph-osd[8381]: 18: (PrimaryLogPG::queue_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_ptr<OpRequest>)+0x66) [0xa966ee2b86]
ceph-osd[8381]: 19: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr<PGTransaction, std::default_delete<PGTransaction> >&&, eversion_t const&, eversion_t const&, std::vector<pg_log_entry_t, std::allocator<pg_log_entry_t> > const&, boost::optional<pg_hit_set_history_t>&, Context*, Context*, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr<OpRequest>)+0xcb8) [0xa967012838]
ceph-osd[8381]: 20: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x9fa) [0xa966e7fc2a]
ceph-osd[8381]: 21: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x139b) [0xa966ec826b]
ceph-osd[8381]: 22: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpRequest>&)+0x308b) [0xa966ecbc8b]
ceph-osd[8381]: 23: (PrimaryLogPG::do_request(boost::intrusive_ptr<OpRequest>&, ThreadPool::TPHandle&)+0xe73) [0xa966e85d03]
ceph-osd[8381]: 24: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost::intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x3a9) [0xa966d09fd9]
ceph-osd[8381]: 25: (PGQueueable::RunVis::operator()(boost::intrusive_ptr<OpRequest> const&)+0x57) [0xa966fa13f7]
ceph-osd[8381]: 26: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x130e) [0xa966d3157e]
ceph-osd[8381]: 27: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x884) [0xa9672ffe34]
ceph-osd[8381]: 28: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xa967302e70]
ceph-osd[8381]: 29: (()+0x76ba) [0x7f3fdd0746ba]
ceph-osd[8381]: 30: (clone()+0x6d) [0x7f3fdc0eb3dd]
ceph-osd[8381]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

systemd[1]: ceph-osd@6.service: Main process exited, code=killed, status=11/SEGV
systemd[1]: ceph-osd@6.service: Unit entered failed state.
systemd[1]: ceph-osd@6.service: Failed with result 'signal'.
systemd[1]: ceph-osd@6.service: Service hold-off time over, scheduling restart.
systemd[1]: Stopped Ceph object storage daemon osd.6.
systemd[1]: Starting Ceph object storage daemon osd.6...
systemd[1]: Started Ceph object storage daemon osd.6.

ceph-osd[31539]: starting osd.6 at - osd_data /var/lib/ceph/osd/ceph-6 /var/lib/ceph/osd/ceph-6/journal
ceph-osd[31539]: *** Caught signal (Segmentation fault) **
ceph-osd[31539]: in thread 7faa494cde40 thread_name:ceph-osd
ceph-osd[31539]: ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc)
ceph-osd[31539]: 1: (()+0xa542b4) [0x4d844992b4]
ceph-osd[31539]: 2: (()+0x11390) [0x7faa4777e390]
ceph-osd[31539]: 3: (()+0x1f8af) [0x7faa490ab8af]
ceph-osd[31539]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry<rocksdb::BlockBasedTable::IndexReader>*)+0x5cc) [0x4d8486846c]
ceph-osd[31539]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x2a8) [0x4d848691c8]
ceph-osd[31539]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x655) [0x4d8494d725]
ceph-osd[31539]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x43b) [0x4d84828dab]
ceph-osd[31539]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57e) [0x4d848f27be]
ceph-osd[31539]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x22) [0x4d848f2c22]
ceph-osd[31539]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)+0xc1) [0x4d843e4561]
ceph-osd[31539]: 11: (RocksDBStore::get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, ceph::buffer::list*)+0x144) [0x4d843dbcb4]
ceph-osd[31539]: 12: (BlueStore::_open_super_meta()+0x641) [0x4d84393e51]
ceph-osd[31539]: 13: (BlueStore::_mount(bool)+0x3a8) [0x4d8439d2e8]
ceph-osd[31539]: 14: (OSD::init()+0x3df) [0x4d83f18a8f]
ceph-osd[31539]: 15: (main()+0x2eb8) [0x4d83e2b138]
ceph-osd[31539]: 16: (__libc_start_main()+0xf0) [0x7faa46704830]
ceph-osd[31539]: 17: (_start()+0x29) [0x4d83eb6a69]
ceph-osd[31539]: 2017-08-23 13:47:24.606174 7faa494cde40 -1 *** Caught signal (Segmentation fault) **
ceph-osd[31539]: in thread 7faa494cde40 thread_name:ceph-osd
ceph-osd[31539]: ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc)
ceph-osd[31539]: 1: (()+0xa542b4) [0x4d844992b4]
ceph-osd[31539]: 2: (()+0x11390) [0x7faa4777e390]
ceph-osd[31539]: 3: (()+0x1f8af) [0x7faa490ab8af]
ceph-osd[31539]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry<rocksdb::BlockBasedTable::IndexReader>*)+0x5cc) [0x4d8486846c]
ceph-osd[31539]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x2a8) [0x4d848691c8]
ceph-osd[31539]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x655) [0x4d8494d725]
ceph-osd[31539]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x43b) [0x4d84828dab]
ceph-osd[31539]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57e) [0x4d848f27be]
ceph-osd[31539]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x22) [0x4d848f2c22]
ceph-osd[31539]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)+0xc1) [0x4d843e4561]
ceph-osd[31539]: 11: (RocksDBStore::get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, ceph::buffer::list*)+0x144) [0x4d843dbcb4]
ceph-osd[31539]: 12: (BlueStore::_open_super_meta()+0x641) [0x4d84393e51]
ceph-osd[31539]: 13: (BlueStore::_mount(bool)+0x3a8) [0x4d8439d2e8]
ceph-osd[31539]: 14: (OSD::init()+0x3df) [0x4d83f18a8f]
ceph-osd[31539]: 15: (main()+0x2eb8) [0x4d83e2b138]
ceph-osd[31539]: 16: (__libc_start_main()+0xf0) [0x7faa46704830]
ceph-osd[31539]: 17: (_start()+0x29) [0x4d83eb6a69]
ceph-osd[31539]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

ceph-osd[31539]: 0> 2017-08-23 13:47:24.606174 7faa494cde40 -1 *** Caught signal (Segmentation fault) **
ceph-osd[31539]: in thread 7faa494cde40 thread_name:ceph-osd
ceph-osd[31539]: ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc)
ceph-osd[31539]: 1: (()+0xa542b4) [0x4d844992b4]
ceph-osd[31539]: 2: (()+0x11390) [0x7faa4777e390]
ceph-osd[31539]: 3: (()+0x1f8af) [0x7faa490ab8af]
ceph-osd[31539]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry<rocksdb::BlockBasedTable::IndexReader>*)+0x5cc) [0x4d8486846c]
ceph-osd[31539]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x2a8) [0x4d848691c8]
ceph-osd[31539]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x655) [0x4d8494d725]
ceph-osd[31539]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x43b) [0x4d84828dab]
ceph-osd[31539]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57e) [0x4d848f27be]
ceph-osd[31539]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x22) [0x4d848f2c22]
ceph-osd[31539]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)+0xc1) [0x4d843e4561]
ceph-osd[31539]: 11: (RocksDBStore::get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, ceph::buffer::list*)+0x144) [0x4d843dbcb4]
ceph-osd[31539]: 12: (BlueStore::_open_super_meta()+0x641) [0x4d84393e51]
ceph-osd[31539]: 13: (BlueStore::_mount(bool)+0x3a8) [0x4d8439d2e8]
ceph-osd[31539]: 14: (OSD::init()+0x3df) [0x4d83f18a8f]
ceph-osd[31539]: 15: (main()+0x2eb8) [0x4d83e2b138]
ceph-osd[31539]: 16: (__libc_start_main()+0xf0) [0x7faa46704830]
ceph-osd[31539]: 17: (_start()+0x29) [0x4d83eb6a69]
ceph-osd[31539]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

systemd[1]: ceph-osd@6.service: Main process exited, code=dumped, status=11/SEGV
systemd[1]: ceph-osd@6.service: Unit entered failed state.
systemd[1]: ceph-osd@6.service: Failed with result 'core-dump'.
systemd[1]: ceph-osd@6.service: Service hold-off time over, scheduling restart.
systemd[1]: Stopped Ceph object storage daemon osd.6.
systemd[1]: Starting Ceph object storage daemon osd.6...
systemd[1]: Started Ceph object storage daemon osd.6.

ceph-osd[31951]: starting osd.6 at - osd_data /var/lib/ceph/osd/ceph-6 /var/lib/ceph/osd/ceph-6/journal
ceph-osd[31951]: 2017-08-23 13:47:54.280738 7fc95058ae40 -1 osd.6 4911 log_to_monitors {default=true}
(1-1/3)