Project

General

Profile

Bug #21314 ยป cephlog.txt

Bob Bobington, 09/08/2017 03:39 PM

 
Sep 08 06:17:07 host ceph-osd[10263]: *** Caught signal (Aborted) **
Sep 08 06:17:07 host ceph-osd[10263]: in thread 7fa865782700 thread_name:tp_osd_tp
Sep 08 06:17:07 host ceph-osd[10263]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43
bab910c) luminous (rc)
Sep 08 06:17:07 host ceph-osd[10263]: 1: (()+0x9a6968) [0x55c1a0eba968]
Sep 08 06:17:07 host ceph-osd[10263]: 2: (()+0x117e0) [0x7fa880e207e0]
Sep 08 06:17:07 host ceph-osd[10263]: 3: (pthread_cond_wait()+0x1fd) [0x7fa880e1c1ad]
Sep 08 06:17:07 host ceph-osd[10263]: 4: (Throttle::_wait(long)+0x33c) [0x55c1a0ef5c8c]
Sep 08 06:17:07 host ceph-osd[10263]: 5: (Throttle::get(long, long)+0x2a2) [0x55c1a0ef6a52]
Sep 08 06:17:07 host ceph-osd[10263]: 6: (BlueStore::queue_transactions(ObjectStore::Sequenc
er*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive
_ptr<TrackedOp>, ThreadPool::TPHandle*)+0xdc7) [0x55c1a0dbe137]
Sep 08 06:17:07 host ceph-osd[10263]: 7: (non-virtual thunk to PrimaryLogPG::queue_transacti
ons(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_
ptr<OpRequest>)+0x68) [0x55c1a0af9d08]
Sep 08 06:17:07 host ceph-osd[10263]: 8: (ECBackend::handle_sub_write(pg_shard_t, boost::int
rusive_ptr<OpRequest>, ECSubWrite&, ZTracer::Trace const&, Context*)+0x963) [0x55c1a0c383b3]
Sep 08 06:17:07 host ceph-osd[10263]: 9: (ECBackend::try_reads_to_commit()+0xa7b) [0x55c1a0c
45c5b]
Sep 08 06:17:07 host ceph-osd[10263]: 10: (ECBackend::check_ops()+0x1c) [0x55c1a0c4852c]
Sep 08 06:17:07 host ceph-osd[10263]: 11: (ECBackend::start_rmw(ECBackend::Op*, std::unique_
ptr<PGTransaction, std::default_delete<PGTransaction> >&&)+0x1e0a) [0x55c1a0c5285a]
Sep 08 06:17:07 host ceph-osd[10263]: 12: (ECBackend::submit_transaction(hobject_t const&, o
bject_stat_sum_t const&, eversion_t const&, std::unique_ptr<PGTransaction, std::default_delete<PGTransac
tion> >&&, eversion_t const&, eversion_t const&, std::vector<pg_log_entry_t, std::allocator<pg_log_entry
_t> > const&, boost::optional<pg_hit_set_history_t>&, Context*, Context*, Context*, unsigned long, osd_r
eqid_t, boost::intrusive_ptr<OpRequest>)+0x4a1) [0x55c1a0c53751]
Sep 08 06:17:07 host ceph-osd[10263]: 13: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather
*, PrimaryLogPG::OpContext*)+0x810) [0x55c1a0a9b800]
Sep 08 06:17:07 host ceph-osd[10263]: 14: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext
*)+0x1238) [0x55c1a0ae0538]
Sep 08 06:17:07 host ceph-osd[10263]: 15: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpReques
t>&)+0x389e) [0x55c1a0ae464e]
Sep 08 06:17:07 host ceph-osd[10263]: 16: (PrimaryLogPG::do_request(boost::intrusive_ptr<OpR
equest>&, ThreadPool::TPHandle&)+0xe17) [0x55c1a0aa2e27]
Sep 08 06:17:07 host ceph-osd[10263]: 17: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost::
intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x387) [0x55c1a0931d07]
Sep 08 06:17:07 host ceph-osd[10263]: 18: (PGQueueable::RunVis::operator()(boost::intrusive_
ptr<OpRequest> const&)+0x5a) [0x55c1a0bb4ffa]
Sep 08 06:17:07 host ceph-osd[10263]: 19: (OSD::ShardedOpWQ::_process(unsigned int, ceph::he
artbeat_handle_d*)+0x1ae7) [0x55c1a0955b97]
Sep 08 06:17:07 host ceph-osd[10263]: 20: (ShardedThreadPool::shardedthreadpool_worker(unsig
ned int)+0x5b2) [0x55c1a0f05032]
Sep 08 06:17:07 host ceph-osd[10263]: 21: (ShardedThreadPool::WorkThreadSharded::entry()+0x1
0) [0x55c1a0f085a0]
Sep 08 06:17:07 host ceph-osd[10263]: 22: (()+0x7049) [0x7fa880e16049]
Sep 08 06:17:07 host ceph-osd[10263]: 23: (clone()+0x3f) [0x7fa8802a5f0f]
Sep 08 06:17:07 host ceph-osd[10263]: 2017-09-08 06:17:07.525955 7fa865782700 -1 *** Caught s
ignal (Aborted) **
Sep 08 06:17:07 host ceph-osd[10263]: in thread 7fa865782700 thread_name:tp_osd_tp
Sep 08 06:17:07 host ceph-osd[10263]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43
bab910c) luminous (rc)
Sep 08 06:17:07 host ceph-osd[10263]: 1: (()+0x9a6968) [0x55c1a0eba968]
Sep 08 06:17:07 host ceph-osd[10263]: 2: (()+0x117e0) [0x7fa880e207e0]
Sep 08 06:17:07 host ceph-osd[10263]: 3: (pthread_cond_wait()+0x1fd) [0x7fa880e1c1ad]
Sep 08 06:17:07 host ceph-osd[10263]: 4: (Throttle::_wait(long)+0x33c) [0x55c1a0ef5c8c]
Sep 08 06:17:07 host ceph-osd[10263]: 5: (Throttle::get(long, long)+0x2a2) [0x55c1a0ef6a52]
Sep 08 06:17:07 host ceph-osd[10263]: 6: (BlueStore::queue_transactions(ObjectStore::Sequenc
er*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive
_ptr<TrackedOp>, ThreadPool::TPHandle*)+0xdc7) [0x55c1a0dbe137]
Sep 08 06:17:07 host ceph-osd[10263]: 7: (non-virtual thunk to PrimaryLogPG::queue_transacti
ons(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_
ptr<OpRequest>)+0x68) [0x55c1a0af9d08]
Sep 08 06:17:07 host ceph-osd[10263]: 8: (ECBackend::handle_sub_write(pg_shard_t, boost::int
rusive_ptr<OpRequest>, ECSubWrite&, ZTracer::Trace const&, Context*)+0x963) [0x55c1a0c383b3]
Sep 08 06:17:07 host ceph-osd[10263]: 9: (ECBackend::try_reads_to_commit()+0xa7b) [0x55c1a0c
45c5b]
Sep 08 06:17:07 host ceph-osd[10263]: 10: (ECBackend::check_ops()+0x1c) [0x55c1a0c4852c]
Sep 08 06:17:07 host ceph-osd[10263]: 11: (ECBackend::start_rmw(ECBackend::Op*, std::unique_
ptr<PGTransaction, std::default_delete<PGTransaction> >&&)+0x1e0a) [0x55c1a0c5285a]
Sep 08 06:17:07 host ceph-osd[10263]: 12: (ECBackend::submit_transaction(hobject_t const&, o
bject_stat_sum_t const&, eversion_t const&, std::unique_ptr<PGTransaction, std::default_delete<PGTransac
tion> >&&, eversion_t const&, eversion_t const&, std::vector<pg_log_entry_t, std::allocator<pg_log_entry
_t> > const&, boost::optional<pg_hit_set_history_t>&, Context*, Context*, Context*, unsigned long, osd_r
eqid_t, boost::intrusive_ptr<OpRequest>)+0x4a1) [0x55c1a0c53751]
Sep 08 06:17:07 host ceph-osd[10263]: 13: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather
*, PrimaryLogPG::OpContext*)+0x810) [0x55c1a0a9b800]
Sep 08 06:17:07 host ceph-osd[10263]: 14: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext
*)+0x1238) [0x55c1a0ae0538]
Sep 08 06:17:07 host ceph-osd[10263]: 15: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpReques
t>&)+0x389e) [0x55c1a0ae464e]
Sep 08 06:17:07 host ceph-osd[10263]: 16: (PrimaryLogPG::do_request(boost::intrusive_ptr<OpR
equest>&, ThreadPool::TPHandle&)+0xe17) [0x55c1a0aa2e27]
Sep 08 06:17:07 host ceph-osd[10263]: 17: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost::
intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x387) [0x55c1a0931d07]
Sep 08 06:17:07 host ceph-osd[10263]: 18: (PGQueueable::RunVis::operator()(boost::intrusive_
ptr<OpRequest> const&)+0x5a) [0x55c1a0bb4ffa]
Sep 08 06:17:07 host ceph-osd[10263]: 19: (OSD::ShardedOpWQ::_process(unsigned int, ceph::he
artbeat_handle_d*)+0x1ae7) [0x55c1a0955b97]
Sep 08 06:17:07 host ceph-osd[10263]: 20: (ShardedThreadPool::shardedthreadpool_worker(unsig
ned int)+0x5b2) [0x55c1a0f05032]
Sep 08 06:17:07 host ceph-osd[10263]: 21: (ShardedThreadPool::WorkThreadSharded::entry()+0x1
0) [0x55c1a0f085a0]
Sep 08 06:17:07 host ceph-osd[10263]: 22: (()+0x7049) [0x7fa880e16049]
Sep 08 06:17:07 host ceph-osd[10263]: 23: (clone()+0x3f) [0x7fa8802a5f0f]
Sep 08 06:17:07 host ceph-osd[10263]: NOTE: a copy of the executable, or `objdump -rdS <exec
utable>` is needed to interpret this.
Sep 08 06:17:07 host ceph-osd[10263]: 0> 2017-09-08 06:17:07.525955 7fa865782700 -1 ***
Caught signal (Aborted) **
Sep 08 06:17:07 host ceph-osd[10263]: in thread 7fa865782700 thread_name:tp_osd_tp
Sep 08 06:17:07 host ceph-osd[10263]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43
bab910c) luminous (rc)
Sep 08 06:17:07 host ceph-osd[10263]: 1: (()+0x9a6968) [0x55c1a0eba968]
Sep 08 06:17:07 host ceph-osd[10263]: 2: (()+0x117e0) [0x7fa880e207e0]
Sep 08 06:17:07 host ceph-osd[10263]: 3: (pthread_cond_wait()+0x1fd) [0x7fa880e1c1ad]
Sep 08 06:17:07 host ceph-osd[10263]: 4: (Throttle::_wait(long)+0x33c) [0x55c1a0ef5c8c]
Sep 08 06:17:07 host ceph-osd[10263]: 5: (Throttle::get(long, long)+0x2a2) [0x55c1a0ef6a52]
Sep 08 06:17:07 host ceph-osd[10263]: 6: (BlueStore::queue_transactions(ObjectStore::Sequenc
er*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive
_ptr<TrackedOp>, ThreadPool::TPHandle*)+0xdc7) [0x55c1a0dbe137]
Sep 08 06:17:07 host ceph-osd[10263]: 7: (non-virtual thunk to PrimaryLogPG::queue_transacti
ons(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, boost::intrusive_
ptr<OpRequest>)+0x68) [0x55c1a0af9d08]
Sep 08 06:17:07 host ceph-osd[10263]: 8: (ECBackend::handle_sub_write(pg_shard_t, boost::int
rusive_ptr<OpRequest>, ECSubWrite&, ZTracer::Trace const&, Context*)+0x963) [0x55c1a0c383b3]
Sep 08 06:17:07 host ceph-osd[10263]: 9: (ECBackend::try_reads_to_commit()+0xa7b) [0x55c1a0c
45c5b]
Sep 08 06:17:07 host ceph-osd[10263]: 10: (ECBackend::check_ops()+0x1c) [0x55c1a0c4852c]
Sep 08 06:17:07 host ceph-osd[10263]: 11: (ECBackend::start_rmw(ECBackend::Op*, std::unique$
ptr<PGTransaction, std::default_delete<PGTransaction> >&&)+0x1e0a) [0x55c1a0c5285a]
Sep 08 06:17:07 host ceph-osd[10263]: 12: (ECBackend::submit_transaction(hobject_t const&, $
bject_stat_sum_t const&, eversion_t const&, std::unique_ptr<PGTransaction, std::default_delete<PGTransa$
tion> >&&, eversion_t const&, eversion_t const&, std::vector<pg_log_entry_t, std::allocator<pg_log_entr$
_t> > const&, boost::optional<pg_hit_set_history_t>&, Context*, Context*, Context*, unsigned long, osd_$
eqid_t, boost::intrusive_ptr<OpRequest>)+0x4a1) [0x55c1a0c53751]
Sep 08 06:17:07 host ceph-osd[10263]: 13: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGathe$
*, PrimaryLogPG::OpContext*)+0x810) [0x55c1a0a9b800]
Sep 08 06:17:07 host ceph-osd[10263]: 14: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContex$
*)+0x1238) [0x55c1a0ae0538]
Sep 08 06:17:07 host ceph-osd[10263]: 15: (PrimaryLogPG::do_op(boost::intrusive_ptr<OpReque$
t>&)+0x389e) [0x55c1a0ae464e]
Sep 08 06:17:07 host ceph-osd[10263]: 16: (PrimaryLogPG::do_request(boost::intrusive_ptr<Op$
equest>&, ThreadPool::TPHandle&)+0xe17) [0x55c1a0aa2e27]
Sep 08 06:17:07 host ceph-osd[10263]: 17: (OSD::dequeue_op(boost::intrusive_ptr<PG>, boost:$
intrusive_ptr<OpRequest>, ThreadPool::TPHandle&)+0x387) [0x55c1a0931d07]
Sep 08 06:17:07 host ceph-osd[10263]: 18: (PGQueueable::RunVis::operator()(boost::intrusive$
ptr<OpRequest> const&)+0x5a) [0x55c1a0bb4ffa]
Sep 08 06:17:07 host ceph-osd[10263]: 19: (OSD::ShardedOpWQ::_process(unsigned int, ceph::h$
artbeat_handle_d*)+0x1ae7) [0x55c1a0955b97]
Sep 08 06:17:07 host ceph-osd[10263]: 20: (ShardedThreadPool::shardedthreadpool_worker(unsi$
ned int)+0x5b2) [0x55c1a0f05032]
Sep 08 06:17:07 host ceph-osd[10263]: 21: (ShardedThreadPool::WorkThreadSharded::entry()+0x$
0) [0x55c1a0f085a0]
Sep 08 06:17:07 host ceph-osd[10263]: 22: (()+0x7049) [0x7fa880e16049]
Sep 08 06:17:07 host ceph-osd[10263]: 23: (clone()+0x3f) [0x7fa8802a5f0f]
Sep 08 06:17:07 host ceph-osd[10263]: NOTE: a copy of the executable, or `objdump -rdS <exe$
utable>` is needed to interpret this.
    (1-1/1)