Project

General

Profile

ceph-mgr-crashlog.txt

Harry Coin, 09/03/2019 03:58 PM

Download (114 KB)

 
1
GNU gdb (Ubuntu 8.3-0ubuntu1) 8.3
2
Copyright (C) 2019 Free Software Foundation, Inc.
3
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
4
This is free software: you are free to change and redistribute it.
5
There is NO WARRANTY, to the extent permitted by law.
6
Type "show copying" and "show warranty" for details.
7
This GDB was configured as "x86_64-linux-gnu".
8
Type "show configuration" for configuration details.
9
For bug reporting instructions, please see:
10
<http://www.gnu.org/software/gdb/bugs/>.
11
Find the GDB manual and other documentation resources online at:
12
    <http://www.gnu.org/software/gdb/documentation/>.
13

    
14
For help, type "help".
15
Type "apropos word" to search for commands related to "word"...
16
Reading symbols from /usr/bin/ceph-mgr...
17
Reading symbols from /usr/lib/debug/.build-id/6d/a3a059f4257d5fb849cbe8abfc251da7df4b21.debug...
18
(gdb) handle SIG33 pass nostop noprint
19
Signal        Stop	Print	Pass to program	Description
20
SIG33         No	No	Yes		Real-time event 33
21
(gdb) set pagination 0
22
(gdb) run -d --cluster ceph --id nocsupport4 --setuser ceph --setgroup ceph
23
Starting program: /usr/bin/ceph-mgr -d --cluster ceph --id nocsupport4 --setuser ceph --setgroup ceph
24
[Thread debugging using libthread_db enabled]
25
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
26
[New Thread 0x7fffedc61700 (LWP 3106)]
27
[New Thread 0x7fffed460700 (LWP 3107)]
28
[New Thread 0x7fffecc5f700 (LWP 3109)]
29
[New Thread 0x7fffec45e700 (LWP 3110)]
30
[New Thread 0x7fffebc5d700 (LWP 3111)]
31
[New Thread 0x7fffeb45c700 (LWP 3112)]
32
[New Thread 0x7fffeac5b700 (LWP 3113)]
33
[Thread 0x7fffeac5b700 (LWP 3113) exited]
34
[Thread 0x7fffeb45c700 (LWP 3112) exited]
35
[Thread 0x7fffebc5d700 (LWP 3111) exited]
36
[Thread 0x7fffec45e700 (LWP 3110) exited]
37
[New Thread 0x7fffec45e700 (LWP 3114)]
38
2019-09-03 10:49:12.655 7fffede98d00  0 set uid:gid to 64045:64045 (ceph:ceph)
39
2019-09-03 10:49:12.655 7fffede98d00  0 ceph version 14.2.2 (4f8fa0a0024755aae7d95567c63f11d6862d55be) nautilus (stable), process ceph-mgr, pid 3102
40
2019-09-03 10:49:12.655 7fffede98d00  0 pidfile_write: ignore empty --pid-file
41
[New Thread 0x7fffebc5d700 (LWP 3115)]
42
[New Thread 0x7fffeb45c700 (LWP 3116)]
43
[New Thread 0x7fffeac5b700 (LWP 3117)]
44
[New Thread 0x7fffea45a700 (LWP 3118)]
45
[New Thread 0x7fffe9c59700 (LWP 3119)]
46
[New Thread 0x7fffe9458700 (LWP 3120)]
47
[New Thread 0x7fffe8c57700 (LWP 3121)]
48
[New Thread 0x7fffe8456700 (LWP 3122)]
49
[New Thread 0x7fffe7c55700 (LWP 3123)]
50
[New Thread 0x7fffe7454700 (LWP 3124)]
51
[New Thread 0x7fffe6c53700 (LWP 3125)]
52
[New Thread 0x7fffe6452700 (LWP 3126)]
53
[New Thread 0x7fffe5c51700 (LWP 3127)]
54
[New Thread 0x7fffe5450700 (LWP 3128)]
55
[New Thread 0x7fffe4c4f700 (LWP 3129)]
56
2019-09-03 10:49:12.955 7fffede98d00  1 mgr[py] Loading python module 'ansible'
57
[Detaching after fork from child process 3130]
58
2019-09-03 10:49:23.603 7fffede98d00  1 mgr[py] Loading python module 'balancer'
59
2019-09-03 10:49:23.863 7fffede98d00  1 mgr[py] Loading python module 'crash'
60
2019-09-03 10:49:24.031 7fffede98d00  1 mgr[py] Loading python module 'dashboard'
61
[Detaching after fork from child process 3131]
62
[Detaching after fork from child process 3132]
63
2019-09-03 10:50:11.915 7fffede98d00  1 mgr[py] Loading python module 'deepsea'
64
[Detaching after fork from child process 3134]
65
2019-09-03 10:50:13.715 7fffede98d00  1 mgr[py] Loading python module 'devicehealth'
66
2019-09-03 10:50:13.967 7fffede98d00  1 mgr[py] Loading python module 'diskprediction_cloud'
67
2019-09-03 10:50:14.319 7fffede98d00  1 mgr[py] Loading python module 'diskprediction_local'
68
2019-09-03 10:50:14.507 7fffede98d00  1 mgr[py] Loading python module 'influx'
69
2019-09-03 10:50:14.699 7fffede98d00  1 mgr[py] Loading python module 'insights'
70
2019-09-03 10:50:14.907 7fffede98d00  1 mgr[py] Loading python module 'iostat'
71
2019-09-03 10:50:15.707 7fffede98d00  1 mgr[py] Loading python module 'localpool'
72
2019-09-03 10:50:15.871 7fffede98d00  1 mgr[py] Loading python module 'orchestrator_cli'
73
2019-09-03 10:50:16.091 7fffede98d00  1 mgr[py] Loading python module 'pg_autoscaler'
74
2019-09-03 10:50:16.343 7fffede98d00  1 mgr[py] Loading python module 'progress'
75
2019-09-03 10:50:16.543 7fffede98d00  1 mgr[py] Loading python module 'prometheus'
76
[Detaching after fork from child process 3135]
77
2019-09-03 10:50:17.855 7fffede98d00  1 mgr[py] Loading python module 'rbd_support'
78
2019-09-03 10:50:18.119 7fffede98d00  1 mgr[py] Loading python module 'restful'
79
[Detaching after fork from child process 3137]
80
2019-09-03 10:50:20.259 7fffede98d00  1 mgr[py] Loading python module 'rook'
81
2019-09-03 10:50:20.455 7fffede98d00  1 mgr[py] Loading python module 'selftest'
82
2019-09-03 10:50:22.603 7fffede98d00  1 mgr[py] Loading python module 'ssh'
83
2019-09-03 10:50:22.931 7fffede98d00  1 mgr[py] Loading python module 'status'
84
2019-09-03 10:50:23.167 7fffede98d00  1 mgr[py] Loading python module 'telegraf'
85
2019-09-03 10:50:23.379 7fffede98d00  1 mgr[py] Loading python module 'telemetry'
86
[Detaching after fork from child process 3138]
87
2019-09-03 10:50:24.815 7fffede98d00  1 mgr[py] Loading python module 'test_orchestrator'
88
2019-09-03 10:50:25.055 7fffede98d00  1 mgr[py] Loading python module 'volumes'
89
2019-09-03 10:50:36.787 7fffede98d00  1 mgr[py] Loading python module 'zabbix'
90
2019-09-03 10:50:36.971 7fffe8456700  0 ms_deliver_dispatch: unhandled message 0x5555561bb400 mon_map magic: 0 v1 from mon.1 v2:[fc00:1002:c7::b2]:3300/0
91
2019-09-03 10:50:37.251 7fffe8456700  1 mgr handle_mgr_map Activating!
92
[New Thread 0x7fffdad92700 (LWP 3139)]
93
2019-09-03 10:50:37.259 7fffe8456700  1 mgr handle_mgr_map I am now activating
94
[New Thread 0x7fffda591700 (LWP 3140)]
95
[New Thread 0x7fffd9d90700 (LWP 3141)]
96
[New Thread 0x7fffd958f700 (LWP 3142)]
97
2019-09-03 10:50:37.415 7fffdad92700  1 mgr load_all_metadata Skipping incomplete metadata entry
98
2019-09-03 10:50:37.487 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
99
[New Thread 0x7fffd8d8e700 (LWP 3143)]
100
2019-09-03 10:50:37.767 7fffdad92700  1 mgr load Constructed class from module: balancer
101
[New Thread 0x7fffd858d700 (LWP 3144)]
102
2019-09-03 10:50:37.771 7fffdad92700  1 mgr load Constructed class from module: crash
103
[New Thread 0x7fffd7d8c700 (LWP 3145)]
104
2019-09-03 10:50:37.779 7fffdad92700  1 mgr load Constructed class from module: dashboard
105
[Thread 0x7fffd7d8c700 (LWP 3145) exited]
106
[New Thread 0x7fffd758b700 (LWP 3146)]
107
2019-09-03 10:50:38.747 7fffda591700  0 log_channel(audit) log [DBG] : from='client.3690753 -' entity='client.admin' cmd=[{"prefix": "crash post", "target": ["mgr", ""]}]: dispatch
108
2019-09-03 10:50:38.843 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555a7516c0 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
109
2019-09-03 10:50:38.867 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
110
2019-09-03 10:50:38.967 7fffdad92700  1 mgr load Constructed class from module: devicehealth
111
[New Thread 0x7fffd628a700 (LWP 3147)]
112
2019-09-03 10:50:38.999 7fffdad92700  1 mgr load Constructed class from module: orchestrator_cli
113
[New Thread 0x7fffd59c9700 (LWP 3148)]
114
2019-09-03 10:50:39.019 7fffdad92700  1 mgr load Constructed class from module: progress
115
[New Thread 0x7fffd5188700 (LWP 3149)]
116
[Thread 0x7fffd59c9700 (LWP 3148) exited]
117
2019-09-03 10:50:39.039 7fffdad92700  1 mgr load Constructed class from module: status
118
[New Thread 0x7fffd4987700 (LWP 3150)]
119
2019-09-03 10:50:39.043 7fffdad92700  1 mgr load Constructed class from module: telemetry
120
[New Thread 0x7fffd4186700 (LWP 3151)]
121
[Thread 0x7fffd4987700 (LWP 3150) exited]
122
[New Thread 0x7fffd3985700 (LWP 3152)]
123
2019-09-03 10:50:39.043 7fffdad92700  1 mgr load Constructed class from module: volumes
124
[New Thread 0x7fffd3184700 (LWP 3154)]
125
[New Thread 0x7fffd2983700 (LWP 3153)]
126
[New Thread 0x7fffd2182700 (LWP 3156)]
127
[New Thread 0x7fffd1981700 (LWP 3157)]
128
[Thread 0x7fffd2983700 (LWP 3153) exited]
129
[Thread 0x7fffd1981700 (LWP 3157) exited]
130
[Thread 0x7fffd2182700 (LWP 3156) exited]
131
[Thread 0x7fffd3184700 (LWP 3154) exited]
132
[Thread 0x7fffd4186700 (LWP 3151) exited]
133
[New Thread 0x7fffd4186700 (LWP 3158)]
134
[New Thread 0x7fffd3184700 (LWP 3159)]
135
[New Thread 0x7fffd2182700 (LWP 3160)]
136
[New Thread 0x7fffd1981700 (LWP 3161)]
137
[New Thread 0x7fffd1180700 (LWP 3162)]
138
[New Thread 0x7fffd097f700 (LWP 3163)]
139
[New Thread 0x7fffd007e700 (LWP 3164)]
140
[New Thread 0x7fffcf7fd700 (LWP 3165)]
141
2019-09-03 10:50:39.135 7fffda591700  0 log_channel(cluster) log [DBG] : pgmap v2: 1361 pgs: 1 active+clean+scrubbing+deep+repair, 1360 active+clean; 12 TiB data, 34 TiB used, 26 TiB / 61 TiB avail
142
2019-09-03 10:50:39.267 7fffd958f700  0 log_channel(cluster) log [DBG] : pgmap v3: 1361 pgs: 1 active+clean+scrubbing+deep+repair, 1360 active+clean; 12 TiB data, 34 TiB used, 26 TiB / 61 TiB avail
143
[03/Sep/2019:10:50:39] ENGINE Bus STARTING
144
[New Thread 0x7fffcee3c700 (LWP 3166)]
145
[03/Sep/2019:10:50:39] ENGINE Started monitor thread '_TimeoutMonitor'.
146
2019-09-03 10:50:39.707 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555ba096c0 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
147
[New Thread 0x7fffce63b700 (LWP 3167)]
148
[New Thread 0x7fffcde3a700 (LWP 3168)]
149
[New Thread 0x7fffcd639700 (LWP 3169)]
150
[New Thread 0x7fffcce38700 (LWP 3170)]
151
[New Thread 0x7fffcc637700 (LWP 3171)]
152
[New Thread 0x7fffcbe36700 (LWP 3172)]
153
[New Thread 0x7fffcb635700 (LWP 3173)]
154
[New Thread 0x7fffcae34700 (LWP 3174)]
155
[New Thread 0x7fffca633700 (LWP 3175)]
156
[New Thread 0x7fffc9e32700 (LWP 3176)]
157
[New Thread 0x7fffc9631700 (LWP 3177)]
158
[03/Sep/2019:10:50:39] ENGINE Serving on http://:::8080
159
[03/Sep/2019:10:50:39] ENGINE Bus STARTED
160
[New Thread 0x7fffc8e30700 (LWP 3178)]
161
2019-09-03 10:50:39.847 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
162
2019-09-03 10:50:40.175 7fffda591700  0 log_channel(audit) log [DBG] : from='client.3724686 -' entity='client.admin' cmd=[{"prefix": "crash post", "target": ["mgr", ""]}]: dispatch
163
2019-09-03 10:50:40.711 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555ba0a080 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
164
2019-09-03 10:50:40.715 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
165
2019-09-03 10:50:41.267 7fffd958f700  0 log_channel(cluster) log [DBG] : pgmap v4: 1361 pgs: 1 active+clean+scrubbing+deep+repair, 1360 active+clean; 12 TiB data, 34 TiB used, 26 TiB / 61 TiB avail
166
2019-09-03 10:50:41.695 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555ba0a3c0 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
167
2019-09-03 10:50:41.699 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
168
2019-09-03 10:50:42.139 7fffda591700  0 log_channel(audit) log [DBG] : from='client.3724694 -' entity='client.admin' cmd=[{"prefix": "crash post", "target": ["mgr", ""]}]: dispatch
169
2019-09-03 10:50:42.695 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555ab009c0 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
170
2019-09-03 10:50:42.699 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
171
2019-09-03 10:50:43.271 7fffd958f700  0 log_channel(cluster) log [DBG] : pgmap v5: 1361 pgs: 1 active+clean+scrubbing+deep+repair, 1360 active+clean; 12 TiB data, 34 TiB used, 26 TiB / 61 TiB avail
172
2019-09-03 10:50:43.695 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555ba0a700 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
173
2019-09-03 10:50:43.739 7fffda591700  0 log_channel(audit) log [DBG] : from='client.3691315 -' entity='client.admin' cmd=[{"prefix": "crash post", "target": ["mgr", ""]}]: dispatch
174
2019-09-03 10:50:43.775 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
175
2019-09-03 10:50:44.695 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555acb89c0 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
176
2019-09-03 10:50:44.699 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
177
2019-09-03 10:50:45.047 7fffda591700  0 log_channel(audit) log [DBG] : from='client.3689676 -' entity='client.admin' cmd=[{"prefix": "crash post", "target": ["mgr", ""]}]: dispatch
178
2019-09-03 10:50:45.411 7fffd958f700  0 log_channel(cluster) log [DBG] : pgmap v6: 1361 pgs: 1 active+clean+scrubbing+deep+repair, 1360 active+clean; 12 TiB data, 34 TiB used, 26 TiB / 61 TiB avail; 394 KiB/s wr, 17 op/s
179
2019-09-03 10:50:45.727 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555acb8d00 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
180
2019-09-03 10:50:45.731 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
181
2019-09-03 10:50:46.699 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555acb96c0 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
182
2019-09-03 10:50:46.703 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
183
2019-09-03 10:50:47.415 7fffd958f700  0 log_channel(cluster) log [DBG] : pgmap v7: 1361 pgs: 1 active+clean+scrubbing+deep+repair, 1360 active+clean; 12 TiB data, 34 TiB used, 26 TiB / 61 TiB avail; 298 KiB/s wr, 13 op/s
184
2019-09-03 10:50:47.703 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x55555a649040 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
185
2019-09-03 10:50:47.703 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
186
2019-09-03 10:50:48.699 7fffda591700  0 ms_deliver_dispatch: unhandled message 0x555559fbf040 mgrreport(mds.nocsupport3 +110-0 packed 1366) v7 from mds.0 v2:[fc00:1002:c7::b3]:6800/4251044327
187
2019-09-03 10:50:48.807 7fffe6c53700  1 mgr finish mon failed to return metadata for mds.nocsupport3: (2) No such file or directory
188

    
189
Thread 33 "devicehealth" received signal SIGSEGV, Segmentation fault.
190
[Switching to Thread 0x7fffd628a700 (LWP 3147)]
191
0x00007fffe2fb9368 in _rados_write_op_omap_set (write_op=0x55555a2451e0, keys=keys@entry=0x5555562573f8, vals=vals@entry=0x0, lens=lens@entry=0x555556257df8, num=num@entry=1) at ./src/librados/librados_c.cc:3308
192
3308	./src/librados/librados_c.cc: No such file or directory.
193
(gdb) backtrace full
194
#0  0x00007fffe2fb9368 in _rados_write_op_omap_set (write_op=0x55555a2451e0, keys=keys@entry=0x5555562573f8, vals=vals@entry=0x0, lens=lens@entry=0x555556257df8, num=num@entry=1) at ./src/librados/librados_c.cc:3308
195
        bl = {_buffers = {_root = {next = 0x55555af95cc0}, _tail = 0x55555af95cc0, _size = 1}, _carriage = 0x55555af95cc8, _len = 0, _memcopy_count = 0, last_p = {<ceph::buffer::v14_2_0::list::iterator_impl<false>> = {bl = 0x7fffd6286b70, ls = 0x7fffd6286b70, p = {cur = 0x7fffd6286b70}, off = 0, p_off = 0}, <No data fields>}, static always_empty_bptr = {_raw = 0x0, _off = 0, _len = 0}, static CLAIM_DEFAULT = 0, static CLAIM_ALLOW_NONSHAREABLE = 1}
196
        i = 0
197
        entries = std::map with 0 elements
198
#1  0x00007fffe3170a85 in __pyx_pf_5rados_5Ioctx_100set_omap (__pyx_v_self=<optimized out>, __pyx_v_values=<optimized out>, __pyx_v_keys=<optimized out>, __pyx_v_write_op=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:45051
199
        _save = 0x55555bff4880
200
        __pyx_v__lens = 0x555556257df8
201
        __pyx_t_2 = <optimized out>
202
        __pyx_t_7 = <optimized out>
203
        __pyx_v_v = <optimized out>
204
        __pyx_t_3 = <optimized out>
205
        __pyx_t_8 = <optimized out>
206
        __pyx_t_4 = 0x0
207
        __pyx_t_9 = <optimized out>
208
        __pyx_v__write_op = <optimized out>
209
        __pyx_r = 0x0
210
        __pyx_t_5 = 0x0
211
        __pyx_v_key_num = 1
212
        __pyx_v__keys = 0x5555562573f8
213
        __pyx_v__values = 0x0
214
        __pyx_t_1 = <optimized out>
215
        __pyx_t_6 = 0x0
216
        __pyx_v__write_op = <optimized out>
217
        __pyx_v_key_num = <optimized out>
218
        __pyx_v__keys = <optimized out>
219
        __pyx_v__values = <optimized out>
220
        __pyx_v__lens = <optimized out>
221
        __pyx_v_v = <optimized out>
222
        __pyx_r = <optimized out>
223
        __pyx_t_1 = <optimized out>
224
        __pyx_t_2 = <optimized out>
225
        __pyx_t_3 = <optimized out>
226
        __pyx_t_4 = <optimized out>
227
        __pyx_t_5 = <optimized out>
228
        __pyx_t_6 = <optimized out>
229
        __pyx_t_7 = <optimized out>
230
        __pyx_t_8 = <optimized out>
231
        __pyx_t_9 = <optimized out>
232
        __pyx_dict_version = 0
233
        __pyx_dict_cached_value = 0x0
234
        function = <optimized out>
235
        tmp = <optimized out>
236
        _py_decref_tmp = <optimized out>
237
        _py_xdecref_tmp = <optimized out>
238
        _py_decref_tmp = <optimized out>
239
        _py_decref_tmp = <optimized out>
240
        _py_decref_tmp = <optimized out>
241
        __pyx_dict_version = 1957547
242
        __pyx_dict_cached_value = 0x7fffe32e40f0
243
        function = <optimized out>
244
        tmp = <optimized out>
245
        _py_decref_tmp = <optimized out>
246
        __pyx_temp = <optimized out>
247
        _py_xdecref_tmp = <optimized out>
248
        _py_decref_tmp = <optimized out>
249
        __pyx_temp = <optimized out>
250
        _py_xdecref_tmp = <optimized out>
251
        _py_decref_tmp = <optimized out>
252
        _py_decref_tmp = <optimized out>
253
        _py_decref_tmp = <optimized out>
254
        tmp = <optimized out>
255
        _py_decref_tmp = <optimized out>
256
        exc_type = <optimized out>
257
        tmp = <optimized out>
258
        _py_xdecref_tmp = <optimized out>
259
        _py_decref_tmp = <optimized out>
260
        _py_decref_tmp = <optimized out>
261
        _py_decref_tmp = <optimized out>
262
        _py_decref_tmp = <optimized out>
263
        _save = <optimized out>
264
        _py_xdecref_tmp = <optimized out>
265
        _py_decref_tmp = <optimized out>
266
        _py_xdecref_tmp = <optimized out>
267
        _py_decref_tmp = <optimized out>
268
        _py_xdecref_tmp = <optimized out>
269
        _py_decref_tmp = <optimized out>
270
        _py_xdecref_tmp = <optimized out>
271
        _py_decref_tmp = <optimized out>
272
        _py_xdecref_tmp = <optimized out>
273
        _py_decref_tmp = <optimized out>
274
        _py_xdecref_tmp = <optimized out>
275
        _py_decref_tmp = <optimized out>
276
        _py_xdecref_tmp = <optimized out>
277
        _py_decref_tmp = <optimized out>
278
#2  __pyx_pw_5rados_5Ioctx_101set_omap (__pyx_v_self=<optimized out>, __pyx_args=<optimized out>, __pyx_kwds=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:44785
279
        __pyx_v_write_op = <optimized out>
280
        __pyx_v_keys = <optimized out>
281
        __pyx_v_values = <optimized out>
282
        __pyx_r = 0x0
283
#3  0x00007fffef0244d2 in _PyMethodDef_RawFastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
284
No symbol table info available.
285
#4  0x00007fffef01f28b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
286
No symbol table info available.
287
#5  0x00007fffe30f2586 in __Pyx_PyObject_Call (func=0x7fffe32da5a0, arg=0x7fffceeaf590, kw=0x7fffd5a35050) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:70753
288
        result = <optimized out>
289
        call = 0x7fffef01f240
290
#6  0x00007fffe312d84e in __pyx_pf_5rados_8requires_7wrapper_validate_func (__pyx_v_kwargs=0x7fffd5a35050, __pyx_v_args=0x7fffceeaf590, __pyx_self=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:5655
291
        __pyx_t_2 = 0x0
292
        __pyx_t_7 = <optimized out>
293
        __pyx_t_11 = 0x0
294
        __pyx_v_named_args = 0x7fffcf8302d0
295
        __pyx_t_3 = 0x0
296
        __pyx_t_8 = 0x0
297
        __pyx_v_pos_args = 0x7fffcef2c960
298
        __pyx_v_arg_name = <optimized out>
299
        __pyx_v_arg_type = 0x7fffef20dd60 <PyTuple_Type>
300
        __pyx_t_4 = <optimized out>
301
        __pyx_t_9 = <optimized out>
302
        __pyx_r = 0x0
303
        __pyx_t_5 = 0x0
304
        __pyx_cur_scope = <optimized out>
305
        __pyx_v_arg_val = 0x7fffcee6b1d0
306
        __pyx_t_1 = 0x0
307
        __pyx_t_6 = <optimized out>
308
        __pyx_t_10 = 0x0
309
        __pyx_cur_scope = <optimized out>
310
        __pyx_v_pos_args = <optimized out>
311
        __pyx_v_named_args = <optimized out>
312
        __pyx_v_arg_val = <optimized out>
313
        __pyx_v_arg_name = <optimized out>
314
        __pyx_v_arg_type = <optimized out>
315
        __pyx_r = <optimized out>
316
        __pyx_t_1 = <optimized out>
317
        __pyx_t_2 = <optimized out>
318
        __pyx_t_3 = <optimized out>
319
        __pyx_t_4 = <optimized out>
320
        __pyx_t_5 = <optimized out>
321
        __pyx_t_6 = <optimized out>
322
        __pyx_t_7 = <optimized out>
323
        __pyx_t_8 = <optimized out>
324
        __pyx_t_9 = <optimized out>
325
        __pyx_t_10 = <optimized out>
326
        __pyx_t_11 = <optimized out>
327
        _py_decref_tmp = <optimized out>
328
        __pyx_dict_version = 1957547
329
        __pyx_dict_cached_value = 0x7fffef252140
330
        function = <optimized out>
331
        tmp = <optimized out>
332
        _py_decref_tmp = <optimized out>
333
        __pyx_temp = <optimized out>
334
        _py_xdecref_tmp = <optimized out>
335
        _py_decref_tmp = <optimized out>
336
        __pyx_temp = <optimized out>
337
        _py_xdecref_tmp = <optimized out>
338
        _py_decref_tmp = <optimized out>
339
        _py_decref_tmp = <optimized out>
340
        _py_decref_tmp = <optimized out>
341
        _py_decref_tmp = <optimized out>
342
        exc_type = <optimized out>
343
        sequence = <optimized out>
344
        size = <optimized out>
345
        _py_decref_tmp = <optimized out>
346
        index = <optimized out>
347
        _py_decref_tmp = <optimized out>
348
        _py_decref_tmp = <optimized out>
349
        _py_decref_tmp = <optimized out>
350
        tmp = <optimized out>
351
        _py_xdecref_tmp = <optimized out>
352
        _py_decref_tmp = <optimized out>
353
        sequence = <optimized out>
354
        size = <optimized out>
355
        _py_decref_tmp = <optimized out>
356
        index = <optimized out>
357
        _py_decref_tmp = <optimized out>
358
        _py_decref_tmp = <optimized out>
359
        _py_decref_tmp = <optimized out>
360
        tmp = <optimized out>
361
        _py_xdecref_tmp = <optimized out>
362
        _py_decref_tmp = <optimized out>
363
        tmp = <optimized out>
364
        _py_xdecref_tmp = <optimized out>
365
        _py_decref_tmp = <optimized out>
366
        _py_decref_tmp = <optimized out>
367
        _py_decref_tmp = <optimized out>
368
        _py_xdecref_tmp = <optimized out>
369
        _py_decref_tmp = <optimized out>
370
        _py_xdecref_tmp = <optimized out>
371
        _py_decref_tmp = <optimized out>
372
        _py_xdecref_tmp = <optimized out>
373
        _py_decref_tmp = <optimized out>
374
        _py_xdecref_tmp = <optimized out>
375
        _py_decref_tmp = <optimized out>
376
        _py_xdecref_tmp = <optimized out>
377
        _py_decref_tmp = <optimized out>
378
        _py_xdecref_tmp = <optimized out>
379
        _py_decref_tmp = <optimized out>
380
        _py_xdecref_tmp = <optimized out>
381
        _py_decref_tmp = <optimized out>
382
        _py_xdecref_tmp = <optimized out>
383
        _py_decref_tmp = <optimized out>
384
        _py_xdecref_tmp = <optimized out>
385
        _py_decref_tmp = <optimized out>
386
        _py_xdecref_tmp = <optimized out>
387
        _py_decref_tmp = <optimized out>
388
        _py_xdecref_tmp = <optimized out>
389
        _py_decref_tmp = <optimized out>
390
        _py_xdecref_tmp = <optimized out>
391
        _py_decref_tmp = <optimized out>
392
        _py_xdecref_tmp = <optimized out>
393
        _py_decref_tmp = <optimized out>
394
        _py_decref_tmp = <optimized out>
395
#7  __pyx_pw_5rados_8requires_7wrapper_1validate_func (__pyx_self=<optimized out>, __pyx_args=0x7fffceeaf590, __pyx_kwds=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:5102
396
        __pyx_v_args = 0x7fffceeaf590
397
        __pyx_v_kwargs = 0x7fffd5a35050
398
        __pyx_r = 0x0
399
#8  0x00007fffef025037 in _PyObject_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
400
No symbol table info available.
401
#9  0x00007fffeee34fc3 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
402
No symbol table info available.
403
#10 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
404
No symbol table info available.
405
#11 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
406
No symbol table info available.
407
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
408
No symbol table info available.
409
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
410
No symbol table info available.
411
#14 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
412
No symbol table info available.
413
#15 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
414
No symbol table info available.
415
#16 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
416
No symbol table info available.
417
#17 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
418
No symbol table info available.
419
#18 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
420
No symbol table info available.
421
#19 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
422
No symbol table info available.
423
#20 0x00007fffef02521a in _PyObject_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
424
No symbol table info available.
425
#21 0x00007fffef025f7e in PyObject_CallMethod () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
426
No symbol table info available.
427
#22 0x0000555555764b86 in PyModuleRunner::serve (this=0x5555561830c0) at ./src/mgr/PyModuleRunner.cc:47
428
        __PRETTY_FUNCTION__ = <optimized out>
429
        gil = {pThreadState = @0x555556211700, pNewThreadState = 0x55555bff4880}
430
        pValue = <optimized out>
431
        r = <optimized out>
432
#23 0x00005555557652e4 in PyModuleRunner::PyModuleRunnerThread::entry (this=0x555556183108) at ./src/mgr/PyModuleRunner.cc:106
433
        __func__ = "entry"
434
#24 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
435
        ret = <optimized out>
436
        pd = <optimized out>
437
        now = <optimized out>
438
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140736786376448, 6209634051117043540, 140736865039630, 140736865039631, 0, 140736786364928, -6209723828776448172, -6209672091407200428}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
439
        not_first_call = <optimized out>
440
#25 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
441
No locals.
442
(gdb) info registers
443
rax            0x0                 0
444
rbx            0x7fffd6286b70      140736786361200
445
rcx            0x0                 0
446
rdx            0x36ae              13998
447
rsi            0x7fffd6286a60      140736786360928
448
rdi            0x7fffd6286b70      140736786361200
449
rbp            0x36ae              0x36ae
450
rsp            0x7fffd6286ad0      0x7fffd6286ad0
451
r8             0x1                 1
452
r9             0x7fffd62866b0      140736786359984
453
r10            0x55555a4a4000      93825075396608
454
r11            0x0                 0
455
r12            0x55555bff4880      93825104038016
456
r13            0x7fffc7f1e0a0      140736547905696
457
r14            0x0                 0
458
r15            0x555556257df8      93825005878776
459
rip            0x7fffe2fb9368      0x7fffe2fb9368 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+312>
460
eflags         0x10206             [ PF IF RF ]
461
cs             0x33                51
462
ss             0x2b                43
463
ds             0x0                 0
464
es             0x0                 0
465
fs             0x0                 0
466
gs             0x0                 0
467
(gdb) x/16i $pc
468
=> 0x7fffe2fb9368 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+312>:	mov    (%rax,%r14,8),%rsi
469
   0x7fffe2fb936c <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+316>:	callq  0x7fffe2fdec00 <ceph::buffer::v14_2_0::list::append(char const*, unsigned int)>
470
   0x7fffe2fb9371 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+321>:	mov    0x30(%rsp),%rax
471
   0x7fffe2fb9376 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+326>:	mov    $0xffffffffffffffff,%rdx
472
   0x7fffe2fb937d <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+333>:	mov    (%rax,%r14,8),%rbp
473
   0x7fffe2fb9381 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+337>:	mov    0x8(%rsp),%rax
474
   0x7fffe2fb9386 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+342>:	mov    %rax,0xf0(%rsp)
475
   0x7fffe2fb938e <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+350>:	test   %rbp,%rbp
476
   0x7fffe2fb9391 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+353>:	je     0x7fffe2fb93a0 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+368>
477
   0x7fffe2fb9393 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+355>:	mov    %rbp,%rdi
478
   0x7fffe2fb9396 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+358>:	callq  0x7fffe2f9b8d0 <strlen@plt>
479
   0x7fffe2fb939b <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+363>:	lea    0x0(%rbp,%rax,1),%rdx
480
   0x7fffe2fb93a0 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+368>:	lea    0xf0(%rsp),%rax
481
   0x7fffe2fb93a8 <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+376>:	mov    %rbp,%rsi
482
   0x7fffe2fb93ab <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+379>:	mov    %rax,%rdi
483
   0x7fffe2fb93ae <_rados_write_op_omap_set(rados_write_op_t, char const* const*, char const* const*, size_t const*, size_t)+382>:	mov    %rax,0x10(%rsp)
484
(gdb) thread apply all backtrace
485

    
486
Thread 63 (Thread 0x7fffc8e30700 (LWP 3178)):
487
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95380) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
488
#1  do_futex_wait (sem=sem@entry=0x55555af95380, abstime=0x0) at sem_waitcommon.c:111
489
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95380, abstime=0x0) at sem_waitcommon.c:181
490
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
491
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
492
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
493
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
494
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
495
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
496
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
497
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
498
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
499
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
500
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
501
#14 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
502
#15 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
503
#16 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
504
#17 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
505
#18 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
506
#19 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
507
#20 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
508
#21 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
509
#22 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
510
#23 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
511
#24 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
512
#25 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
513
#26 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
514
#27 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
515

    
516
Thread 62 (Thread 0x7fffc9631700 (LWP 3177)):
517
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95660) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
518
#1  do_futex_wait (sem=sem@entry=0x55555af95660, abstime=0x0) at sem_waitcommon.c:111
519
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95660, abstime=0x0) at sem_waitcommon.c:181
520
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
521
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
522
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
523
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
524
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
525
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
526
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
527
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
528
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
529
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
530
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
531
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
532
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
533
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
534
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
535
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
536
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
537
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
538
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
539
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
540
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
541
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
542
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
543
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
544
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
545
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
546
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
547
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
548
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
549

    
550
Thread 61 (Thread 0x7fffc9e32700 (LWP 3176)):
551
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af954c0) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
552
#1  do_futex_wait (sem=sem@entry=0x55555af954c0, abstime=0x0) at sem_waitcommon.c:111
553
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af954c0, abstime=0x0) at sem_waitcommon.c:181
554
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
555
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
556
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
557
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
558
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
559
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
560
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
561
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
562
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
563
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
564
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
565
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
566
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
567
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
568
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
569
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
570
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
571
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
572
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
573
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
574
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
575
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
576
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
577
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
578
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
579
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
580
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
581
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
582
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
583

    
584
Thread 60 (Thread 0x7fffca633700 (LWP 3175)):
585
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af94aa0) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
586
#1  do_futex_wait (sem=sem@entry=0x55555af94aa0, abstime=0x0) at sem_waitcommon.c:111
587
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af94aa0, abstime=0x0) at sem_waitcommon.c:181
588
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
589
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
590
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
591
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
592
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
593
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
594
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
595
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
596
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
597
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
598
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
599
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
600
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
601
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
602
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
603
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
604
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
605
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
606
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
607
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
608
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
609
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
610
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
611
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
612
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
613
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
614
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
615
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
616
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
617

    
618
Thread 59 (Thread 0x7fffcae34700 (LWP 3174)):
619
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95e20) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
620
#1  do_futex_wait (sem=sem@entry=0x55555af95e20, abstime=0x0) at sem_waitcommon.c:111
621
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95e20, abstime=0x0) at sem_waitcommon.c:181
622
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
623
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
624
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
625
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
626
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
627
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
628
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
629
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
630
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
631
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
632
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
633
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
634
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
635
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
636
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
637
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
638
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
639
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
640
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
641
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
642
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
643
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
644
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
645
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
646
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
647
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
648
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
649
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
650
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
651

    
652
Thread 58 (Thread 0x7fffcb635700 (LWP 3173)):
653
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95340) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
654
#1  do_futex_wait (sem=sem@entry=0x55555af95340, abstime=0x0) at sem_waitcommon.c:111
655
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95340, abstime=0x0) at sem_waitcommon.c:181
656
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
657
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
658
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
659
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
660
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
661
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
662
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
663
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
664
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
665
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
666
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
667
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
668
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
669
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
670
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
671
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
672
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
673
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
674
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
675
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
676
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
677
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
678
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
679
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
680
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
681
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
682
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
683
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
684
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
685

    
686
Thread 57 (Thread 0x7fffcbe36700 (LWP 3172)):
687
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95700) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
688
#1  do_futex_wait (sem=sem@entry=0x55555af95700, abstime=0x0) at sem_waitcommon.c:111
689
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95700, abstime=0x0) at sem_waitcommon.c:181
690
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
691
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
692
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
693
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
694
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
695
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
696
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
697
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
698
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
699
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
700
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
701
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
702
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
703
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
704
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
705
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
706
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
707
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
708
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
709
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
710
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
711
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
712
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
713
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
714
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
715
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
716
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
717
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
718
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
719

    
720
Thread 56 (Thread 0x7fffcc637700 (LWP 3171)):
721
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95400) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
722
#1  do_futex_wait (sem=sem@entry=0x55555af95400, abstime=0x0) at sem_waitcommon.c:111
723
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95400, abstime=0x0) at sem_waitcommon.c:181
724
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
725
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
726
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
727
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
728
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
729
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
730
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
731
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
732
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
733
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
734
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
735
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
736
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
737
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
738
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
739
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
740
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
741
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
742
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
743
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
744
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
745
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
746
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
747
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
748
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
749
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
750
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
751
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
752
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
753

    
754
Thread 55 (Thread 0x7fffcce38700 (LWP 3170)):
755
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95900) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
756
#1  do_futex_wait (sem=sem@entry=0x55555af95900, abstime=0x0) at sem_waitcommon.c:111
757
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95900, abstime=0x0) at sem_waitcommon.c:181
758
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
759
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
760
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
761
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
762
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
763
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
764
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
765
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
766
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
767
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
768
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
769
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
770
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
771
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
772
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
773
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
774
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
775
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
776
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
777
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
778
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
779
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
780
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
781
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
782
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
783
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
784
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
785
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
786
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
787

    
788
Thread 54 (Thread 0x7fffcd639700 (LWP 3169)):
789
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95940) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
790
#1  do_futex_wait (sem=sem@entry=0x55555af95940, abstime=0x0) at sem_waitcommon.c:111
791
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95940, abstime=0x0) at sem_waitcommon.c:181
792
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
793
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
794
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
795
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
796
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
797
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
798
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
799
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
800
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
801
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
802
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
803
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
804
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
805
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
806
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
807
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
808
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
809
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
810
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
811
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
812
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
813
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
814
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
815
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
816
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
817
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
818
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
819
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
820
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
821

    
822
Thread 53 (Thread 0x7fffcde3a700 (LWP 3168)):
823
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555af95580) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
824
#1  do_futex_wait (sem=sem@entry=0x55555af95580, abstime=0x0) at sem_waitcommon.c:111
825
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555af95580, abstime=0x0) at sem_waitcommon.c:181
826
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
827
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
828
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
829
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
830
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
831
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
832
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
833
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
834
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
835
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
836
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
837
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
838
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
839
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
840
#17 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
841
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
842
#19 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
843
#20 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
844
#21 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
845
#22 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
846
#23 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
847
#24 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
848
#25 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
849
#26 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
850
#27 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
851
#28 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
852
#29 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
853
#30 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
854
#31 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
855

    
856
Thread 52 (Thread 0x7fffce63b700 (LWP 3167)):
857
#0  0x00007fffee6f4031 in __GI___poll (fds=0x7fffce637828, nfds=1, timeout=1000) at ../sysdeps/unix/sysv/linux/poll.c:29
858
#1  0x00007fffeee64e96 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
859
#2  0x00007fffef024062 in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
860
#3  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
861
#4  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
862
#5  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
863
#6  0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
864
#7  0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
865
#8  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
866
#9  0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
867
#10 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
868
#11 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
869
#12 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
870
#13 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
871
#14 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
872
#15 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
873
#16 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
874
#17 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
875
#18 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
876
#19 0x00007fffeee37e95 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
877
#20 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
878
#21 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
879
#22 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
880
#23 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
881
#24 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
882
#25 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
883
#26 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
884
#27 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
885
#28 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
886
#29 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
887
#30 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
888
#31 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
889
#32 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
890
#33 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
891

    
892
Thread 51 (Thread 0x7fffcee3c700 (LWP 3166)):
893
#0  0x00007fffee6f6a9f in __GI___select (nfds=0, readfds=0x0, writefds=0x0, exceptfds=0x0, timeout=0x7fffcee39150) at ../sysdeps/unix/sysv/linux/select.c:41
894
#1  0x00007fffeee4f498 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
895
#2  0x00007fffef024244 in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
896
#3  0x00007fffef024bf8 in _PyCFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
897
#4  0x00007fffeee35250 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
898
#5  0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
899
#6  0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
900
#7  0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
901
#8  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
902
#9  0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
903
#10 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
904
#11 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
905
#12 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
906
#13 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
907
#14 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
908
#15 0x00007fffef024e75 in PyObject_Call () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
909
#16 0x00007fffeeec1d36 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
910
#17 0x00007fffeef18797 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
911
#18 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
912
#19 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
913

    
914
Thread 50 (Thread 0x7fffcf7fd700 (LWP 3165)):
915
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55555bf9fe88) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
916
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55555bf9fe38, cond=0x55555bf9fe60) at pthread_cond_wait.c:502
917
#2  __pthread_cond_wait (cond=0x55555bf9fe60, mutex=0x55555bf9fe38) at pthread_cond_wait.c:655
918
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
919
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x55555bf9fe30) at ./src/common/Finisher.cc:86
920
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
921
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
922

    
923
Thread 49 (Thread 0x7fffd007e700 (LWP 3164)):
924
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55555bf9fce8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
925
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55555bf9fc28, cond=0x55555bf9fcc0) at pthread_cond_wait.c:502
926
#2  __pthread_cond_wait (cond=cond@entry=0x55555bf9fcc0, mutex=mutex@entry=0x55555bf9fc28) at pthread_cond_wait.c:655
927
#3  0x00007fffef66e5a5 in Cond::Wait (mutex=..., this=0x55555bf9fcb8) at ./src/common/Cond.h:49
928
#4  SafeTimer::timer_thread (this=0x55555bf9fca0) at ./src/common/Timer.cc:108
929
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
930
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
931
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
932

    
933
Thread 48 (Thread 0x7fffd097f700 (LWP 3163)):
934
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffd097c8b0, expected=0, futex_word=0x55555bf9f9e0) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
935
#1  __pthread_cond_wait_common (abstime=0x7fffd097c8b0, mutex=0x55555bf9f918, cond=0x55555bf9f9b8) at pthread_cond_wait.c:539
936
#2  __pthread_cond_timedwait (cond=cond@entry=0x55555bf9f9b8, mutex=mutex@entry=0x55555bf9f918, abstime=abstime@entry=0x7fffd097c8b0) at pthread_cond_wait.c:667
937
#3  0x00007fffef66e826 in Cond::WaitUntil (when=..., mutex=..., this=0x55555bf9f9b0) at ./src/common/Cond.h:65
938
#4  SafeTimer::timer_thread (this=0x55555bf9f998) at ./src/common/Timer.cc:110
939
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
940
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
941
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
942

    
943
Thread 47 (Thread 0x7fffd1180700 (LWP 3162)):
944
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55555bf9f4bc) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
945
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55555bf9f468, cond=0x55555bf9f490) at pthread_cond_wait.c:502
946
#2  __pthread_cond_wait (cond=0x55555bf9f490, mutex=0x55555bf9f468) at pthread_cond_wait.c:655
947
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
948
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x55555bf9f460) at ./src/common/Finisher.cc:86
949
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
950
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
951

    
952
Thread 46 (Thread 0x7fffd1981700 (LWP 3161)):
953
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffd197e8b0, expected=0, futex_word=0x55555bf9f3d8) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
954
#1  __pthread_cond_wait_common (abstime=0x7fffd197e8b0, mutex=0x55555bf9f358, cond=0x55555bf9f3b0) at pthread_cond_wait.c:539
955
#2  __pthread_cond_timedwait (cond=cond@entry=0x55555bf9f3b0, mutex=mutex@entry=0x55555bf9f358, abstime=abstime@entry=0x7fffd197e8b0) at pthread_cond_wait.c:667
956
#3  0x00007fffef66e826 in Cond::WaitUntil (when=..., mutex=..., this=0x55555bf9f3a8) at ./src/common/Cond.h:65
957
#4  SafeTimer::timer_thread (this=0x55555bf9f390) at ./src/common/Timer.cc:110
958
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
959
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
960
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
961

    
962
Thread 45 (Thread 0x7fffd2182700 (LWP 3160)):
963
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55555bb68ea8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
964
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55555bb68e40, cond=0x55555bb68e80) at pthread_cond_wait.c:502
965
#2  __pthread_cond_wait (cond=cond@entry=0x55555bb68e80, mutex=mutex@entry=0x55555bb68e40) at pthread_cond_wait.c:655
966
#3  0x00007fffef7e7bf4 in Cond::Wait (mutex=..., this=0x55555bb68e78) at ./src/common/Cond.h:49
967
#4  DispatchQueue::run_local_delivery (this=0x55555bb68c58) at ./src/msg/DispatchQueue.cc:114
968
#5  0x00007fffef8b8b51 in DispatchQueue::LocalDeliveryThread::entry (this=<optimized out>) at ./src/msg/DispatchQueue.h:116
969
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
970
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
971

    
972
Thread 44 (Thread 0x7fffd3184700 (LWP 3159)):
973
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55555bb68cf8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
974
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55555bb68c90, cond=0x55555bb68cd0) at pthread_cond_wait.c:502
975
#2  __pthread_cond_wait (cond=cond@entry=0x55555bb68cd0, mutex=mutex@entry=0x55555bb68c90) at pthread_cond_wait.c:655
976
#3  0x00007fffef7e851a in Cond::Wait (mutex=..., this=0x55555bb68cc8) at ./src/common/Cond.h:49
977
#4  DispatchQueue::entry (this=0x55555bb68c58) at ./src/msg/DispatchQueue.cc:208
978
#5  0x00007fffef8b8a41 in DispatchQueue::DispatchThread::entry (this=<optimized out>) at ./src/msg/DispatchQueue.h:102
979
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
980
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
981

    
982
Thread 43 (Thread 0x7fffd4186700 (LWP 3158)):
983
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffd41838c0, expected=0, futex_word=0x555559ec4cb4) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
984
#1  __pthread_cond_wait_common (abstime=0x7fffd41838c0, mutex=0x555559ec4c60, cond=0x555559ec4c88) at pthread_cond_wait.c:539
985
#2  __pthread_cond_timedwait (cond=0x555559ec4c88, mutex=0x555559ec4c60, abstime=0x7fffd41838c0) at pthread_cond_wait.c:667
986
#3  0x00007fffe300b3bc in __gthread_cond_timedwait (__abs_timeout=0x7fffd41838c0, __mutex=<optimized out>, __cond=0x555559ec4c88) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
987
#4  std::condition_variable::__wait_until_impl<std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> > > (__atime=<synthetic pointer>..., __lock=..., this=0x555559ec4c88) at /usr/include/c++/9/condition_variable:188
988
#5  std::condition_variable::wait_until<ceph::time_detail::coarse_mono_clock, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x555559ec4c88) at /usr/include/c++/9/condition_variable:121
989
#6  ceph::timer_detail::timer<ceph::time_detail::coarse_mono_clock>::timer_thread (this=0x555559ec4c20) at ./src/common/ceph_timer.h:146
990
#7  0x00007fffeea0ef74 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
991
#8  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
992
#9  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
993

    
994
Thread 38 (Thread 0x7fffd3985700 (LWP 3152)):
995
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x7fffd3981b20, expected=0, futex_word=0x55555afe9020) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
996
#1  do_futex_wait (sem=sem@entry=0x55555afe9020, abstime=abstime@entry=0x7fffd3981b20) at sem_waitcommon.c:111
997
#2  0x00007fffeeb40bf3 in __new_sem_wait_slow (sem=0x55555afe9020, abstime=0x7fffd3981b20) at sem_waitcommon.c:181
998
#3  0x00007fffeef204f3 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
999
#4  0x00007fffeeec2869 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1000
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1001
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1002
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1003
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1004
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1005
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1006
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1007
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1008
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1009
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1010
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1011
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1012
#17 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1013
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1014
#19 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1015
#20 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1016
#21 0x00007fffef02521a in _PyObject_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1017
#22 0x00007fffef025f7e in PyObject_CallMethod () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1018
#23 0x0000555555764b86 in PyModuleRunner::serve (this=0x5555561836c0) at ./src/mgr/PyModuleRunner.cc:47
1019
#24 0x00005555557652e4 in PyModuleRunner::PyModuleRunnerThread::entry (this=0x555556183708) at ./src/mgr/PyModuleRunner.cc:106
1020
#25 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1021
#26 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1022

    
1023
Thread 35 (Thread 0x7fffd5188700 (LWP 3149)):
1024
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x7fffd5184b20, expected=0, futex_word=0x55555afe9120) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1025
#1  do_futex_wait (sem=sem@entry=0x55555afe9120, abstime=abstime@entry=0x7fffd5184b20) at sem_waitcommon.c:111
1026
#2  0x00007fffeeb40bf3 in __new_sem_wait_slow (sem=0x55555afe9120, abstime=0x7fffd5184b20) at sem_waitcommon.c:181
1027
#3  0x00007fffeef204f3 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1028
#4  0x00007fffeeec2869 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1029
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1030
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1031
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1032
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1033
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1034
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1035
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1036
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1037
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1038
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1039
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1040
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1041
#17 0x00007fffeee37f93 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1042
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1043
#19 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1044
#20 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1045
#21 0x00007fffef02521a in _PyObject_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1046
#22 0x00007fffef025f7e in PyObject_CallMethod () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1047
#23 0x0000555555764b86 in PyModuleRunner::serve (this=0x555556183240) at ./src/mgr/PyModuleRunner.cc:47
1048
#24 0x00005555557652e4 in PyModuleRunner::PyModuleRunnerThread::entry (this=0x555556183288) at ./src/mgr/PyModuleRunner.cc:106
1049
#25 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1050
#26 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1051

    
1052
Thread 33 (Thread 0x7fffd628a700 (LWP 3147)):
1053
#0  0x00007fffe2fb9368 in _rados_write_op_omap_set (write_op=0x55555a2451e0, keys=keys@entry=0x5555562573f8, vals=vals@entry=0x0, lens=lens@entry=0x555556257df8, num=num@entry=1) at ./src/librados/librados_c.cc:3308
1054
#1  0x00007fffe3170a85 in __pyx_pf_5rados_5Ioctx_100set_omap (__pyx_v_self=<optimized out>, __pyx_v_values=<optimized out>, __pyx_v_keys=<optimized out>, __pyx_v_write_op=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:45051
1055
#2  __pyx_pw_5rados_5Ioctx_101set_omap (__pyx_v_self=<optimized out>, __pyx_args=<optimized out>, __pyx_kwds=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:44785
1056
#3  0x00007fffef0244d2 in _PyMethodDef_RawFastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1057
#4  0x00007fffef01f28b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1058
#5  0x00007fffe30f2586 in __Pyx_PyObject_Call (func=0x7fffe32da5a0, arg=0x7fffceeaf590, kw=0x7fffd5a35050) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:70753
1059
#6  0x00007fffe312d84e in __pyx_pf_5rados_8requires_7wrapper_validate_func (__pyx_v_kwargs=0x7fffd5a35050, __pyx_v_args=0x7fffceeaf590, __pyx_self=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:5655
1060
#7  __pyx_pw_5rados_8requires_7wrapper_1validate_func (__pyx_self=<optimized out>, __pyx_args=0x7fffceeaf590, __pyx_kwds=<optimized out>) at ./obj-x86_64-linux-gnu/src/pybind/rados3/pyrex/rados.c:5102
1061
#8  0x00007fffef025037 in _PyObject_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1062
#9  0x00007fffeee34fc3 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1063
#10 0x00007fffeee3bc42 in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1064
#11 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1065
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1066
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1067
#14 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1068
#15 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1069
#16 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1070
#17 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1071
#18 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1072
#19 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1073
#20 0x00007fffef02521a in _PyObject_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1074
#21 0x00007fffef025f7e in PyObject_CallMethod () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1075
#22 0x0000555555764b86 in PyModuleRunner::serve (this=0x5555561830c0) at ./src/mgr/PyModuleRunner.cc:47
1076
#23 0x00005555557652e4 in PyModuleRunner::PyModuleRunnerThread::entry (this=0x555556183108) at ./src/mgr/PyModuleRunner.cc:106
1077
#24 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1078
#25 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1079

    
1080
Thread 32 (Thread 0x7fffd758b700 (LWP 3146)):
1081
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x0, expected=0, futex_word=0x55555bb7d700) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1082
#1  do_futex_wait (sem=sem@entry=0x55555bb7d700, abstime=0x0) at sem_waitcommon.c:111
1083
#2  0x00007fffeeb409b8 in __new_sem_wait_slow (sem=0x55555bb7d700, abstime=0x0) at sem_waitcommon.c:181
1084
#3  0x00007fffeef20495 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1085
#4  0x00007fffeeec27e0 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1086
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1087
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1088
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1089
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1090
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1091
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1092
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1093
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1094
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1095
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1096
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1097
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1098
#17 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1099
#18 0x00007fffeee3e94b in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1100
#19 0x00007fffef024ae8 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1101
#20 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1102
#21 0x00007fffef02521a in _PyObject_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1103
#22 0x00007fffef025f7e in PyObject_CallMethod () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1104
#23 0x0000555555764b86 in PyModuleRunner::serve (this=0x555556183000) at ./src/mgr/PyModuleRunner.cc:47
1105
#24 0x00005555557652e4 in PyModuleRunner::PyModuleRunnerThread::entry (this=0x555556183048) at ./src/mgr/PyModuleRunner.cc:106
1106
#25 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1107
#26 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1108

    
1109
Thread 30 (Thread 0x7fffd858d700 (LWP 3144)):
1110
#0  futex_abstimed_wait_cancelable (private=0, abstime=0x7fffd8589a60, expected=0, futex_word=0x55555abc8b80) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1111
#1  do_futex_wait (sem=sem@entry=0x55555abc8b80, abstime=abstime@entry=0x7fffd8589a60) at sem_waitcommon.c:111
1112
#2  0x00007fffeeb40bf3 in __new_sem_wait_slow (sem=0x55555abc8b80, abstime=0x7fffd8589a60) at sem_waitcommon.c:181
1113
#3  0x00007fffeef204f3 in PyThread_acquire_lock_timed () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1114
#4  0x00007fffeeec2869 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1115
#5  0x00007fffeeec2b9a in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1116
#6  0x00007fffef0242ab in _PyMethodDef_RawFastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1117
#7  0x00007fffef01f7ea in _PyMethodDescr_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1118
#8  0x00007fffeee35269 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1119
#9  0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1120
#10 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1121
#11 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1122
#12 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1123
#13 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1124
#14 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1125
#15 0x00007fffef0246f9 in _PyFunction_FastCallKeywords () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1126
#16 0x00007fffeee35015 in ?? () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1127
#17 0x00007fffeee377cd in _PyEval_EvalFrameDefault () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1128
#18 0x00007fffeef5d5bd in _PyEval_EvalCodeWithName () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1129
#19 0x00007fffef0249e7 in _PyFunction_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1130
#20 0x00007fffef0263ad in _PyObject_Call_Prepend () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1131
#21 0x00007fffef02521a in _PyObject_FastCallDict () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1132
#22 0x00007fffef025f7e in PyObject_CallMethod () from /usr/lib/x86_64-linux-gnu/libpython3.7m.so.1.0
1133
#23 0x0000555555764b86 in PyModuleRunner::serve (this=0x5555561839c0) at ./src/mgr/PyModuleRunner.cc:47
1134
#24 0x00005555557652e4 in PyModuleRunner::PyModuleRunnerThread::entry (this=0x555556183a08) at ./src/mgr/PyModuleRunner.cc:106
1135
#25 0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1136
#26 0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1137

    
1138
Thread 29 (Thread 0x7fffd8d8e700 (LWP 3143)):
1139
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x555559f50114) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1140
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555559f500c0, cond=0x555559f500e8) at pthread_cond_wait.c:502
1141
#2  __pthread_cond_wait (cond=0x555559f500e8, mutex=0x555559f500c0) at pthread_cond_wait.c:655
1142
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1143
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x555559f500b8) at ./src/common/Finisher.cc:86
1144
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1145
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1146

    
1147
Thread 28 (Thread 0x7fffd958f700 (LWP 3142)):
1148
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffd958c8b0, expected=0, futex_word=0x555559e674c0) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1149
#1  __pthread_cond_wait_common (abstime=0x7fffd958c8b0, mutex=0x555559e67400, cond=0x555559e67498) at pthread_cond_wait.c:539
1150
#2  __pthread_cond_timedwait (cond=cond@entry=0x555559e67498, mutex=mutex@entry=0x555559e67400, abstime=abstime@entry=0x7fffd958c8b0) at pthread_cond_wait.c:667
1151
#3  0x00007fffef66e826 in Cond::WaitUntil (when=..., mutex=..., this=0x555559e67490) at ./src/common/Cond.h:65
1152
#4  SafeTimer::timer_thread (this=0x555559e67478) at ./src/common/Timer.cc:110
1153
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
1154
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1155
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1156

    
1157
Thread 27 (Thread 0x7fffd9d90700 (LWP 3141)):
1158
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x555556f265a8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1159
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555556f26540, cond=0x555556f26580) at pthread_cond_wait.c:502
1160
#2  __pthread_cond_wait (cond=cond@entry=0x555556f26580, mutex=mutex@entry=0x555556f26540) at pthread_cond_wait.c:655
1161
#3  0x00007fffef7e7bf4 in Cond::Wait (mutex=..., this=0x555556f26578) at ./src/common/Cond.h:49
1162
#4  DispatchQueue::run_local_delivery (this=0x555556f26358) at ./src/msg/DispatchQueue.cc:114
1163
#5  0x00007fffef8b8b51 in DispatchQueue::LocalDeliveryThread::entry (this=<optimized out>) at ./src/msg/DispatchQueue.h:116
1164
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1165
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1166

    
1167
Thread 26 (Thread 0x7fffda591700 (LWP 3140)):
1168
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x555556f263f8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1169
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555556f26390, cond=0x555556f263d0) at pthread_cond_wait.c:502
1170
#2  __pthread_cond_wait (cond=cond@entry=0x555556f263d0, mutex=mutex@entry=0x555556f26390) at pthread_cond_wait.c:655
1171
#3  0x00007fffef7e851a in Cond::Wait (mutex=..., this=0x555556f263c8) at ./src/common/Cond.h:49
1172
#4  DispatchQueue::entry (this=0x555556f26358) at ./src/msg/DispatchQueue.cc:208
1173
#5  0x00007fffef8b8a41 in DispatchQueue::DispatchThread::entry (this=<optimized out>) at ./src/msg/DispatchQueue.h:102
1174
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1175
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1176

    
1177
Thread 25 (Thread 0x7fffdad92700 (LWP 3139)):
1178
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x555559e660dc) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1179
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555559e66088, cond=0x555559e660b0) at pthread_cond_wait.c:502
1180
#2  __pthread_cond_wait (cond=0x555559e660b0, mutex=0x555559e66088) at pthread_cond_wait.c:655
1181
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1182
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x555559e66080) at ./src/common/Finisher.cc:86
1183
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1184
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1185

    
1186
Thread 24 (Thread 0x7fffe4c4f700 (LWP 3129)):
1187
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffe4c4c8b0, expected=0, futex_word=0x7fffffffdf30) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1188
#1  __pthread_cond_wait_common (abstime=0x7fffe4c4c8b0, mutex=0x7fffffffddb0, cond=0x7fffffffdf08) at pthread_cond_wait.c:539
1189
#2  __pthread_cond_timedwait (cond=cond@entry=0x7fffffffdf08, mutex=mutex@entry=0x7fffffffddb0, abstime=abstime@entry=0x7fffe4c4c8b0) at pthread_cond_wait.c:667
1190
#3  0x00007fffef66e826 in Cond::WaitUntil (when=..., mutex=..., this=0x7fffffffdf00) at ./src/common/Cond.h:65
1191
#4  SafeTimer::timer_thread (this=0x7fffffffdee8) at ./src/common/Timer.cc:110
1192
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
1193
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1194
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1195

    
1196
Thread 23 (Thread 0x7fffe5450700 (LWP 3128)):
1197
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffe544d8b0, expected=0, futex_word=0x555556dceb28) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1198
#1  __pthread_cond_wait_common (abstime=0x7fffe544d8b0, mutex=0x7fffffffcb08, cond=0x555556dceb00) at pthread_cond_wait.c:539
1199
#2  __pthread_cond_timedwait (cond=cond@entry=0x555556dceb00, mutex=mutex@entry=0x7fffffffcb08, abstime=abstime@entry=0x7fffe544d8b0) at pthread_cond_wait.c:667
1200
#3  0x000055555588686d in Cond::WaitInterval<std::chrono::duration<long, std::ratio<1l, 1l> > > (interval=..., mutex=..., this=0x555556dceaf8) at ./src/common/Mutex.h:97
1201
#4  ObjectCacher::flusher_entry (this=0x555556dce900) at ./src/osdc/ObjectCacher.cc:1972
1202
#5  0x00005555558a1591 in ObjectCacher::FlusherThread::entry (this=<optimized out>) at ./src/osdc/ObjectCacher.h:433
1203
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1204
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1205

    
1206
Thread 22 (Thread 0x7fffe5c51700 (LWP 3127)):
1207
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7fffffffca48) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1208
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7fffffffcb08, cond=0x7fffffffca20) at pthread_cond_wait.c:502
1209
#2  __pthread_cond_wait (cond=cond@entry=0x7fffffffca20, mutex=mutex@entry=0x7fffffffcb08) at pthread_cond_wait.c:655
1210
#3  0x00007fffef66e5a5 in Cond::Wait (mutex=..., this=0x7fffffffca18) at ./src/common/Cond.h:49
1211
#4  SafeTimer::timer_thread (this=0x7fffffffca00) at ./src/common/Timer.cc:108
1212
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
1213
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1214
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1215

    
1216
Thread 21 (Thread 0x7fffe6452700 (LWP 3126)):
1217
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffe644f8b0, expected=0, futex_word=0x7fffffffda84) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1218
#1  __pthread_cond_wait_common (abstime=0x7fffe644f8b0, mutex=0x7fffffffd9b8, cond=0x7fffffffda58) at pthread_cond_wait.c:539
1219
#2  __pthread_cond_timedwait (cond=cond@entry=0x7fffffffda58, mutex=mutex@entry=0x7fffffffd9b8, abstime=abstime@entry=0x7fffe644f8b0) at pthread_cond_wait.c:667
1220
#3  0x00007fffef66e826 in Cond::WaitUntil (when=..., mutex=..., this=0x7fffffffda50) at ./src/common/Cond.h:65
1221
#4  SafeTimer::timer_thread (this=0x7fffffffda38) at ./src/common/Timer.cc:110
1222
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
1223
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1224
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1225

    
1226
Thread 20 (Thread 0x7fffe6c53700 (LWP 3125)):
1227
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7fffffffc1d8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1228
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7fffffffc188, cond=0x7fffffffc1b0) at pthread_cond_wait.c:502
1229
#2  __pthread_cond_wait (cond=0x7fffffffc1b0, mutex=0x7fffffffc188) at pthread_cond_wait.c:655
1230
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1231
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x7fffffffc180) at ./src/common/Finisher.cc:86
1232
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1233
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1234

    
1235
Thread 19 (Thread 0x7fffe7454700 (LWP 3124)):
1236
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffe74518b0, expected=0, futex_word=0x7fffffffc0f8) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1237
#1  __pthread_cond_wait_common (abstime=0x7fffe74518b0, mutex=0x7fffffffc078, cond=0x7fffffffc0d0) at pthread_cond_wait.c:539
1238
#2  __pthread_cond_timedwait (cond=cond@entry=0x7fffffffc0d0, mutex=mutex@entry=0x7fffffffc078, abstime=abstime@entry=0x7fffe74518b0) at pthread_cond_wait.c:667
1239
#3  0x00007fffef66e826 in Cond::WaitUntil (when=..., mutex=..., this=0x7fffffffc0c8) at ./src/common/Cond.h:65
1240
#4  SafeTimer::timer_thread (this=0x7fffffffc0b0) at ./src/common/Timer.cc:110
1241
#5  0x00007fffef66f9b1 in SafeTimerThread::entry (this=<optimized out>) at ./src/common/Timer.cc:30
1242
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1243
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1244

    
1245
Thread 18 (Thread 0x7fffe7c55700 (LWP 3123)):
1246
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x555556216ea8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1247
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555556216e40, cond=0x555556216e80) at pthread_cond_wait.c:502
1248
#2  __pthread_cond_wait (cond=cond@entry=0x555556216e80, mutex=mutex@entry=0x555556216e40) at pthread_cond_wait.c:655
1249
#3  0x00007fffef7e7bf4 in Cond::Wait (mutex=..., this=0x555556216e78) at ./src/common/Cond.h:49
1250
#4  DispatchQueue::run_local_delivery (this=0x555556216c58) at ./src/msg/DispatchQueue.cc:114
1251
#5  0x00007fffef8b8b51 in DispatchQueue::LocalDeliveryThread::entry (this=<optimized out>) at ./src/msg/DispatchQueue.h:116
1252
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1253
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1254

    
1255
Thread 17 (Thread 0x7fffe8456700 (LWP 3122)):
1256
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x555556216cf8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1257
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555556216c90, cond=0x555556216cd0) at pthread_cond_wait.c:502
1258
#2  __pthread_cond_wait (cond=cond@entry=0x555556216cd0, mutex=mutex@entry=0x555556216c90) at pthread_cond_wait.c:655
1259
#3  0x00007fffef7e851a in Cond::Wait (mutex=..., this=0x555556216cc8) at ./src/common/Cond.h:49
1260
#4  DispatchQueue::entry (this=0x555556216c58) at ./src/msg/DispatchQueue.cc:208
1261
#5  0x00007fffef8b8a41 in DispatchQueue::DispatchThread::entry (this=<optimized out>) at ./src/msg/DispatchQueue.h:102
1262
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1263
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1264

    
1265
Thread 16 (Thread 0x7fffe8c57700 (LWP 3121)):
1266
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7fffffffde40) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1267
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7fffffffddf0, cond=0x7fffffffde18) at pthread_cond_wait.c:502
1268
#2  __pthread_cond_wait (cond=0x7fffffffde18, mutex=0x7fffffffddf0) at pthread_cond_wait.c:655
1269
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1270
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x7fffffffdde8) at ./src/common/Finisher.cc:86
1271
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1272
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1273

    
1274
Thread 15 (Thread 0x7fffe9458700 (LWP 3120)):
1275
#0  0x00007fffee6f4031 in __GI___poll (fds=fds@entry=0x7fffe9455670, nfds=nfds@entry=4, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
1276
#1  0x00007fffee712762 in __poll_chk (fds=fds@entry=0x7fffe9455670, nfds=nfds@entry=4, timeout=timeout@entry=-1, fdslen=fdslen@entry=264) at poll_chk.c:27
1277
#2  0x000055555588034b in poll (__timeout=-1, __nfds=4, __fds=0x7fffe9455670) at /usr/include/x86_64-linux-gnu/bits/poll2.h:41
1278
#3  SignalHandler::entry (this=0x5555561b6160) at ./src/global/signal_handler.cc:488
1279
#4  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1280
#5  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1281

    
1282
Thread 14 (Thread 0x7fffe9c59700 (LWP 3119)):
1283
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7fffffffd0e0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1284
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7fffffffd090, cond=0x7fffffffd0b8) at pthread_cond_wait.c:502
1285
#2  __pthread_cond_wait (cond=0x7fffffffd0b8, mutex=0x7fffffffd090) at pthread_cond_wait.c:655
1286
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1287
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x7fffffffd088) at ./src/common/Finisher.cc:86
1288
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1289
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1290

    
1291
Thread 13 (Thread 0x7fffea45a700 (LWP 3118)):
1292
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x555556dcebc0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1293
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555556dceb70, cond=0x555556dceb98) at pthread_cond_wait.c:502
1294
#2  __pthread_cond_wait (cond=0x555556dceb98, mutex=0x555556dceb70) at pthread_cond_wait.c:655
1295
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1296
#4  0x00007fffef62469f in Finisher::finisher_thread_entry (this=0x555556dceb68) at ./src/common/Finisher.cc:86
1297
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1298
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1299

    
1300
Thread 12 (Thread 0x7fffeac5b700 (LWP 3117)):
1301
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffeac588c0, expected=0, futex_word=0x7fffffffc66c) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1302
#1  __pthread_cond_wait_common (abstime=0x7fffeac588c0, mutex=0x7fffffffc618, cond=0x7fffffffc640) at pthread_cond_wait.c:539
1303
#2  __pthread_cond_timedwait (cond=0x7fffffffc640, mutex=0x7fffffffc618, abstime=0x7fffeac588c0) at pthread_cond_wait.c:667
1304
#3  0x0000555555741f9c in __gthread_cond_timedwait (__abs_timeout=0x7fffeac588c0, __mutex=<optimized out>, __cond=0x7fffffffc640) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
1305
#4  std::condition_variable::__wait_until_impl<std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> > > (__atime=<synthetic pointer>..., __lock=..., this=0x7fffffffc640) at /usr/include/c++/9/condition_variable:188
1306
#5  std::condition_variable::wait_until<ceph::time_detail::coarse_mono_clock, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x7fffffffc640) at /usr/include/c++/9/condition_variable:121
1307
#6  ceph::timer_detail::timer<ceph::time_detail::coarse_mono_clock>::timer_thread (this=0x7fffffffc5d8) at ./src/common/ceph_timer.h:146
1308
#7  0x00007fffeea0ef74 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1309
#8  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1310
#9  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1311

    
1312
Thread 11 (Thread 0x7fffeb45c700 (LWP 3116)):
1313
#0  0x00007fffee6f4031 in __GI___poll (fds=fds@entry=0x7fffeb4598a0, nfds=nfds@entry=2, timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
1314
#1  0x00007fffef69bb1f in poll (__timeout=-1, __nfds=2, __fds=0x7fffeb4598a0) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
1315
#2  AdminSocket::entry (this=0x5555561900e0) at ./src/common/admin_socket.cc:228
1316
#3  0x00007fffeea0ef74 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1317
#4  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1318
#5  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1319

    
1320
Thread 10 (Thread 0x7fffebc5d700 (LWP 3115)):
1321
#0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fffebc5a8e0, expected=0, futex_word=0x55555619b0c0) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
1322
#1  __pthread_cond_wait_common (abstime=0x7fffebc5a8e0, mutex=0x55555619b070, cond=0x55555619b098) at pthread_cond_wait.c:539
1323
#2  __pthread_cond_timedwait (cond=0x55555619b098, mutex=0x55555619b070, abstime=0x7fffebc5a8e0) at pthread_cond_wait.c:667
1324
#3  0x00007fffef6bcc10 in __gthread_cond_timedwait (__abs_timeout=0x7fffebc5a8e0, __mutex=<optimized out>, __cond=0x55555619b098) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
1325
#4  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=<synthetic pointer>..., __lock=..., this=0x55555619b098) at /usr/include/c++/9/condition_variable:188
1326
#5  std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x55555619b098) at /usr/include/c++/9/condition_variable:121
1327
#6  std::condition_variable::wait_for<unsigned long, std::ratio<1l, 1000000000l> > (__rtime=<synthetic pointer>..., __lock=..., this=0x55555619b098) at /usr/include/c++/9/condition_variable:152
1328
#7  CephContextServiceThread::entry (this=0x55555619b050) at ./src/common/ceph_context.cc:202
1329
#8  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1330
#9  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1331

    
1332
Thread 9 (Thread 0x7fffec45e700 (LWP 3114)):
1333
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55555619e7a4) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1334
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55555619e6f8, cond=0x55555619e778) at pthread_cond_wait.c:502
1335
#2  __pthread_cond_wait (cond=0x55555619e778, mutex=0x55555619e6f8) at pthread_cond_wait.c:655
1336
#3  0x00007fffeea092f0 in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1337
#4  0x00007fffef95cc00 in ceph::logging::Log::entry (this=0x55555619e6c0) at ./src/log/Log.cc:423
1338
#5  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1339
#6  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1340

    
1341
Thread 4 (Thread 0x7fffecc5f700 (LWP 3109)):
1342
#0  0x00007fffee700d27 in epoll_wait (epfd=9, events=0x555556e7e000, maxevents=5000, timeout=30000) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
1343
#1  0x00007fffef92d2e2 in EpollDriver::event_wait (this=0x5555562156e0, fired_events=std::vector of length 0, capacity 0, tvp=<optimized out>) at ./src/msg/async/EventEpoll.cc:122
1344
#2  0x00007fffef922a64 in EventCenter::process_events (this=this@entry=0x55555619e980, timeout_microseconds=<optimized out>, timeout_microseconds@entry=30000000, working_dur=working_dur@entry=0x7fffecc5c868) at ./src/msg/async/Event.cc:401
1345
#3  0x00007fffef928c12 in NetworkStack::<lambda()>::operator() (__closure=0x555556215658, __closure=0x555556215658) at ./src/msg/async/Stack.cc:53
1346
#4  std::_Function_handler<void(), NetworkStack::add_thread(unsigned int)::<lambda()> >::_M_invoke(const std::_Any_data &) (__functor=...) at /usr/include/c++/9/bits/std_function.h:300
1347
#5  0x00007fffeea0ef74 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1348
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1349
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1350

    
1351
Thread 3 (Thread 0x7fffed460700 (LWP 3107)):
1352
#0  0x00007fffee700d27 in epoll_wait (epfd=6, events=0x555556dbe000, maxevents=5000, timeout=30000) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
1353
#1  0x00007fffef92d2e2 in EpollDriver::event_wait (this=0x555556215890, fired_events=std::vector of length 0, capacity 0, tvp=<optimized out>) at ./src/msg/async/EventEpoll.cc:122
1354
#2  0x00007fffef922a64 in EventCenter::process_events (this=this@entry=0x55555619ee00, timeout_microseconds=<optimized out>, timeout_microseconds@entry=30000000, working_dur=working_dur@entry=0x7fffed45d868) at ./src/msg/async/Event.cc:401
1355
#3  0x00007fffef928c12 in NetworkStack::<lambda()>::operator() (__closure=0x555556215688, __closure=0x555556215688) at ./src/msg/async/Stack.cc:53
1356
#4  std::_Function_handler<void(), NetworkStack::add_thread(unsigned int)::<lambda()> >::_M_invoke(const std::_Any_data &) (__functor=...) at /usr/include/c++/9/bits/std_function.h:300
1357
#5  0x00007fffeea0ef74 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1358
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1359
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1360

    
1361
Thread 2 (Thread 0x7fffedc61700 (LWP 3106)):
1362
#0  0x00007fffee700d27 in epoll_wait (epfd=3, events=0x555556258000, maxevents=5000, timeout=30000) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
1363
#1  0x00007fffef92d2e2 in EpollDriver::event_wait (this=0x555556215a40, fired_events=std::vector of length 0, capacity 0, tvp=<optimized out>) at ./src/msg/async/EventEpoll.cc:122
1364
#2  0x00007fffef922a64 in EventCenter::process_events (this=this@entry=0x55555619e2c0, timeout_microseconds=<optimized out>, timeout_microseconds@entry=30000000, working_dur=working_dur@entry=0x7fffedc5e868) at ./src/msg/async/Event.cc:401
1365
#3  0x00007fffef928c12 in NetworkStack::<lambda()>::operator() (__closure=0x5555562156b8, __closure=0x5555562156b8) at ./src/msg/async/Stack.cc:53
1366
#4  std::_Function_handler<void(), NetworkStack::add_thread(unsigned int)::<lambda()> >::_M_invoke(const std::_Any_data &) (__functor=...) at /usr/include/c++/9/bits/std_function.h:300
1367
#5  0x00007fffeea0ef74 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
1368
#6  0x00007fffeeb3775a in start_thread (arg=<optimized out>) at pthread_create.c:486
1369
#7  0x00007fffee7009f3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
1370

    
1371
Thread 1 (Thread 0x7fffede98d00 (LWP 3102)):
1372
#0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x5555562171d0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
1373
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x555556217028, cond=0x5555562171a8) at pthread_cond_wait.c:502
1374
#2  __pthread_cond_wait (cond=cond@entry=0x5555562171a8, mutex=mutex@entry=0x555556217028) at pthread_cond_wait.c:655
1375
#3  0x00007fffef8cba37 in Cond::Wait (mutex=..., this=0x5555562171a0) at ./src/common/Cond.h:49
1376
#4  AsyncMessenger::wait (this=0x555556216900) at ./src/msg/async/AsyncMessenger.cc:535
1377
#5  0x00005555556359d1 in MgrStandby::main (this=this@entry=0x7fffffffbd50, args=std::vector of length 0, capacity 0) at /usr/include/c++/9/bits/unique_ptr.h:352
1378
#6  0x0000555555634606 in main (argc=10, argv=<optimized out>) at /usr/include/c++/9/bits/stl_algobase.h:465
1379
(gdb) quit
1380
A debugging session is active.
1381

    
1382
	Inferior 1 [process 3102] will be killed.
1383

    
1384
Quit anyway? (y or n) y