Actions
Bug #20846
openceph_test_rados_list_parallel: options dtor racing with DispatchQueue lockdep -> segv
Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
The interesting threads seem to be
Thread 1 (Thread 0x7f93bdc0d700 (LWP 24894)): #0 _M_bucket_index (this=<optimized out>, __n=23, __p=0x30) at /usr/include/c++/4.8.2/bits/hashtable_policy.h:1028 #1 _M_bucket_index (this=<optimized out>, __n=0x30) at /usr/include/c++/4.8.2/bits/hashtable.h:589 #2 _M_find_before_node (__code=140272520451840, __k=@0x7f93bdc0b238: 140272520451840, __n=12, this=0x7f93cc126ee0 <held>) at /usr/include/c++/4.8.2/bits/hashtable.h:1167 #3 _M_find_node (__c=140272520451840, __key=@0x7f93bdc0b238: 140272520451840, __bkt=12, this=0x7f93cc126ee0 <held>) at /usr/include/c++/4.8.2/bits/hashtable.h:604 #4 std::__detail::_Map_base<unsigned long, std::pair<unsigned long const, std::map<int, ceph::BackTrace*, std::less<int>, std::allocator<std::pair<int const, ceph::BackTrace*> > > >, std::allocator<std::pair<unsigned long const, std::map<int, ceph::BackTrace*, std::less<int>, std::allocator<std::pair<int const, ceph::BackTrace*> > > > >, std::__detail::_Select1st, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, false, true>, true>::operator[] ( this=this@entry=0x7f93cc126ee0 <held>, __k=@0x7f93bdc0b238: 140272520451840) at /usr/include/c++/4.8.2/bits/hashtable_policy.h:489 #5 0x00007f93c3a1c8ba in operator[] (__k=@0x7f93bdc0b238: 140272520451840, this=0x7f93cc126ee0 <held>) at /usr/include/c++/4.8.2/bits/unordered_map.h:596 #6 lockdep_will_lock (name=0x7f93cea39db8 "Throttle::lock", id=6, force_backtrace=false) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/lockdep.cc:278 #7 0x00007f93c374e0ba in _will_lock (this=0x7f93cea39720) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Mutex.h:56 #8 Mutex::Lock (this=this@entry=0x7f93cea39720, no_lockdep=no_lockdep@entry=false) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Mutex.cc:92 #9 0x00007f93c37721ea in Locker (m=..., this=<synthetic pointer>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Mutex.h:115 #10 Throttle::put (this=this@entry=0x7f93cea39700, c=c@entry=1092) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Throttle.cc:226 #11 0x00007f93c37ea7e0 in DispatchQueue::dispatch_throttle_release (this=this@entry=0x7f93cea39460, msize=msize@entry=1092) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.cc:138 #12 0x00007f93c37eaa32 in DispatchQueue::post_dispatch (this=this@entry=0x7f93cea39460, m=m@entry=0x7f93900015f0, msize=msize@entry=1092) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.cc:59 #13 0x00007f93c37ebbc6 in DispatchQueue::entry (this=0x7f93cea39460) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.cc:198 #14 0x00007f93c38d388d in DispatchQueue::DispatchThread::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.h:101 #15 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #16 0x00007f93c133a73d in clone () from /lib64/libc.so.6
and
Thread 11 (Thread 0x7f93ccef5880 (LWP 22266)): #0 Option::~Option (this=0x7f93ce95c760, __in_chrg=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/options.h:13 #1 0x00007f93c39d5eb7 in _Destroy<Option> (__pointer=0x7f93ce95c760) at /usr/include/c++/4.8.2/bits/stl_construct.h:93 #2 __destroy<Option*> (__last=<optimized out>, __first=0x7f93ce95c760) at /usr/include/c++/4.8.2/bits/stl_construct.h:103 #3 _Destroy<Option*> (__last=<optimized out>, __first=<optimized out>) at /usr/include/c++/4.8.2/bits/stl_construct.h:126 #4 _Destroy<Option*, Option> (__last=0x7f93ce9611b0, __first=<optimized out>) at /usr/include/c++/4.8.2/bits/stl_construct.h:151 #5 std::vector<Option, std::allocator<Option> >::~vector (this=0x7f93c3f26de0 <rbd_options>, __in_chrg=<optimized out>) at /usr/include/c++/4.8.2/bits/stl_vector.h:415 #6 0x00007f93c127bdba in __cxa_finalize () from /lib64/libc.so.6 #7 0x00007f93c3728323 in __do_global_dtors_aux () from /usr/lib64/ceph/libceph-common.so.0 #8 0x00007ffffd259520 in ?? () #9 0x00007f93ccd0185a in _dl_fini () from /lib64/ld-linux-x86-64.so.2 Backtrace stopped: frame did not save the PC
/a/sage-2017-07-28_04:13:20-rados-wip-sage-testing-distro-basic-smithi/1455329
The fini is called, so this is shutdown, but messenger is still running? Maybe this is just sloppy shutdown?
Updated by Sage Weil over 6 years ago
all threads:
(gdb) thr app all bt Thread 17 (Thread 0x7f93bd40c700 (LWP 24895)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c37ee18f in Wait (mutex=..., this=0x7f93cea39678) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 DispatchQueue::run_local_delivery (this=0x7f93cea39460) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.cc:113 #3 0x00007f93c38d38ad in DispatchQueue::LocalDeliveryThread::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.h:115 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f93a6ffd700 (LWP 24905)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c37770bf in Wait (mutex=..., this=0x7f93ce9e49d0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 SafeTimer::timer_thread (this=0x7f93ce9e49c0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Timer.cc:108 #3 0x00007f93c37786ed in SafeTimerThread::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Timer.cc:30 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f93a5ffb700 (LWP 24907)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c3779981 in Wait (mutex=..., this=0x7f93ce9e4dc0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 Finisher::finisher_thread_entry (this=0x7f93ce9e4d60) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Finisher.cc:101 #3 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f93bc107700 (LWP 24908)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c38c8749 in Wait (mutex=..., this=0x7f93a800bdc0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 Pipe::writer (this=0x7f93a800abe0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:1975 #3 0x00007f93c38cc22d in Pipe::Writer::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.h:62 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f93a67fc700 (LWP 24906)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c37770bf in Wait (mutex=..., this=0x7f93ce9e4c30) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 SafeTimer::timer_thread (this=0x7f93ce9e4c20) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Timer.cc:108 #3 0x00007f93c37786ed in SafeTimerThread::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Timer.cc:30 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f93bcc0b700 (LWP 24896)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c38cecbf in Wait (mutex=..., this=0x7f93cea39928) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 SimpleMessenger::reaper_entry (this=0x7f93cea392e0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/SimpleMessenger.cc:217 #3 0x00007f93c38d446d in SimpleMessenger::ReaperThread::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/SimpleMessenger.h:197 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f93ccef5880 (LWP 22266)): #0 Option::~Option (this=0x7f93ce95c760, __in_chrg=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/options.h:13 #1 0x00007f93c39d5eb7 in _Destroy<Option> (__pointer=0x7f93ce95c760) at /usr/include/c++/4.8.2/bits/stl_construct.h:93 #2 __destroy<Option*> (__last=<optimized out>, __first=0x7f93ce95c760) at /usr/include/c++/4.8.2/bits/stl_construct.h:103 #3 _Destroy<Option*> (__last=<optimized out>, __first=<optimized out>) at /usr/include/c++/4.8.2/bits/stl_construct.h:126 #4 _Destroy<Option*, Option> (__last=0x7f93ce9611b0, __first=<optimized out>) at /usr/include/c++/4.8.2/bits/stl_construct.h:151 #5 std::vector<Option, std::allocator<Option> >::~vector (this=0x7f93c3f26de0 <rbd_options>, __in_chrg=<optimized out>) at /usr/include/c++/4.8.2/bits/stl_vector.h:415 #6 0x00007f93c127bdba in __cxa_finalize () from /lib64/libc.so.6 #7 0x00007f93c3728323 in __do_global_dtors_aux () from /usr/lib64/ceph/libceph-common.so.0 #8 0x00007ffffd259520 in ?? () #9 0x00007f93ccd0185a in _dl_fini () from /lib64/ld-linux-x86-64.so.2 Backtrace stopped: frame did not save the PC Thread 10 (Thread 0x7f93bc309700 (LWP 24900)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c38c8749 in Wait (mutex=..., this=0x7f93cea80250) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 Pipe::writer (this=0x7f93cea7f070) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:1975 #3 0x00007f93c38cc22d in Pipe::Writer::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.h:62 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f93bec0f700 (LWP 24892)): #0 0x00007f93c132fdfd in poll () from /lib64/libc.so.6 #1 0x00007f93c375aab3 in poll (__timeout=-1, __nfds=2, __fds=0x7f93bec0dc70) at /usr/include/bits/poll2.h:46 #2 AdminSocket::entry (this=0x7f93ce9e0c50) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/admin_socket.cc:250 #3 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f93bf410700 (LWP 24891)): #0 0x00007f93cc77da82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c39b652a in WaitUntil (when=..., mutex=..., this=0x7f93cea36db0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:64 #2 WaitInterval (interval=..., mutex=..., this=0x7f93cea36db0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:73 #3 CephContextServiceThread::entry (this=0x7f93cea36d30) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/ceph_context.cc:135 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f93bc40a700 (LWP 24909)): #0 0x00007f93c132fdfd in poll () from /lib64/libc.so.6 #1 0x00007f93c38b38d2 in poll (__timeout=<optimized out>, __nfds=1, __fds=0x7f93bc408a60) at /usr/include/bits/poll2.h:46 ---Type <return> to continue, or q <return> to quit--- #2 Pipe::tcp_read_wait (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:2608 #3 0x00007f93c38b3f98 in Pipe::tcp_read (this=this@entry=0x7f93a800abe0, buf=buf@entry=0x7f93bc408c2f "\377", len=len@entry=1) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:2578 #4 0x00007f93c38c164f in Pipe::reader (this=0x7f93a800abe0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:1647 #5 0x00007f93c38cc20d in Pipe::Reader::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.h:51 #6 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f93a77fe700 (LWP 24898)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c3779981 in Wait (mutex=..., this=0x7f93ce9e4588) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:48 #2 Finisher::finisher_thread_entry (this=0x7f93ce9e4528) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Finisher.cc:101 #3 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f93be40e700 (LWP 24893)): #0 0x00007f93cc77da82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93cca467ab in __gthread_cond_timedwait (__abs_timeout=0x7f93be40cd60, __mutex=<optimized out>, __cond=0x7f93cea3bd40) at /usr/include/c++/4.8.2/x86_64-redhat-linux/bits/gthr-default.h:871 #2 __wait_until_impl<std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> > > (__atime=<synthetic pointer>, __lock=..., this=0x7f93cea3bd40) at /usr/include/c++/4.8.2/condition_variable:160 #3 wait_until<ceph::time_detail::mono_clock, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x7f93cea3bd40) at /usr/include/c++/4.8.2/condition_variable:113 #4 ceph::timer_detail::timer<ceph::time_detail::mono_clock>::timer_thread (this=0x7f93cea3bcd8) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/ceph_timer.h:144 #5 0x00007f93c1bd1230 in ?? () from /lib64/libstdc++.so.6 #6 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f93a7fff700 (LWP 24897)): #0 0x00007f93cc77da82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c377735e in WaitUntil (when=..., mutex=..., this=0x7f93ce9e4470) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Cond.h:64 #2 SafeTimer::timer_thread (this=0x7f93ce9e4460) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Timer.cc:110 #3 0x00007f93c37786ed in SafeTimerThread::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Timer.cc:30 #4 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f93bc208700 (LWP 24903)): #0 0x00007f93c132fdfd in poll () from /lib64/libc.so.6 #1 0x00007f93c38b38d2 in poll (__timeout=<optimized out>, __nfds=1, __fds=0x7f93bc206a60) at /usr/include/bits/poll2.h:46 #2 Pipe::tcp_read_wait (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:2608 #3 0x00007f93c38b3f98 in Pipe::tcp_read (this=this@entry=0x7f93cea7f070, buf=buf@entry=0x7f93bc206c2f "\377`l \274\223\177", len=len@entry=1) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:2578 #4 0x00007f93c38c164f in Pipe::reader (this=0x7f93cea7f070) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.cc:1647 #5 0x00007f93c38cc20d in Pipe::Reader::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/simple/Pipe.h:51 #6 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f93c0383700 (LWP 24890)): #0 0x00007f93cc77d6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f93c37a206b in ceph::logging::Log::entry (this=0x7f93ce9dffd0) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/log/Log.cc:454 #2 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #3 0x00007f93c133a73d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f93bdc0d700 (LWP 24894)): #0 _M_bucket_index (this=<optimized out>, __n=23, __p=0x30) at /usr/include/c++/4.8.2/bits/hashtable_policy.h:1028 #1 _M_bucket_index (this=<optimized out>, __n=0x30) at /usr/include/c++/4.8.2/bits/hashtable.h:589 #2 _M_find_before_node (__code=140272520451840, __k=@0x7f93bdc0b238: 140272520451840, __n=12, this=0x7f93cc126ee0 <held>) at /usr/include/c++/4.8.2/bits/hashtable.h:1167 #3 _M_find_node (__c=140272520451840, __key=@0x7f93bdc0b238: 140272520451840, __bkt=12, this=0x7f93cc126ee0 <held>) at /usr/include/c++/4.8.2/bits/hashtable.h:604 #4 std::__detail::_Map_base<unsigned long, std::pair<unsigned long const, std::map<int, ceph::BackTrace*, std::less<int>, std::allocator<std::pair<int const, ceph::BackTrace*> > > >, std::allocator<std::pair<unsigned long const, std::map<int, ceph::BackTrace*, std::less<int>, std::allocator<std::pair<int const, ceph::BackTrace*> > > > >, std::__detail::_Select1st, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, false, true>, true>::operator[] ( this=this@entry=0x7f93cc126ee0 <held>, __k=@0x7f93bdc0b238: 140272520451840) at /usr/include/c++/4.8.2/bits/hashtable_policy.h:489 #5 0x00007f93c3a1c8ba in operator[] (__k=@0x7f93bdc0b238: 140272520451840, this=0x7f93cc126ee0 <held>) at /usr/include/c++/4.8.2/bits/unordered_map.h:596 #6 lockdep_will_lock (name=0x7f93cea39db8 "Throttle::lock", id=6, force_backtrace=false) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/lockdep.cc:278 #7 0x00007f93c374e0ba in _will_lock (this=0x7f93cea39720) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Mutex.h:56 #8 Mutex::Lock (this=this@entry=0x7f93cea39720, no_lockdep=no_lockdep@entry=false) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Mutex.cc:92 #9 0x00007f93c37721ea in Locker (m=..., this=<synthetic pointer>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Mutex.h:115 #10 Throttle::put (this=this@entry=0x7f93cea39700, c=c@entry=1092) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/common/Throttle.cc:226 #11 0x00007f93c37ea7e0 in DispatchQueue::dispatch_throttle_release (this=this@entry=0x7f93cea39460, msize=msize@entry=1092) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.cc:138 #12 0x00007f93c37eaa32 in DispatchQueue::post_dispatch (this=this@entry=0x7f93cea39460, m=m@entry=0x7f93900015f0, msize=msize@entry=1092) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.cc:59 #13 0x00007f93c37ebbc6 in DispatchQueue::entry (this=0x7f93cea39460) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.cc:198 #14 0x00007f93c38d388d in DispatchQueue::DispatchThread::entry (this=<optimized out>) at /usr/src/debug/ceph-12.1.1-795-g788745f/src/msg/DispatchQueue.h:101 #15 0x00007f93cc779dc5 in start_thread () from /lib64/libpthread.so.0 #16 0x00007f93c133a73d in clone () from /lib64/libc.so.6
Actions