Project

General

Profile

Bug #41938 ยป rbd_clone_error.txt

Ricardo Marques, 09/19/2019 08:53 PM

 
ceph-dev:/ceph/build # bin/rbd clone rbd/ns1/img1@img1_2019-09-19T21:32:47.161+01:00 rbd/ns1/img2
2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
rbd: /ceph/src/cls/rbd/cls_rbd_client.cc:489: void librbd::cls_client::add_child(librados::v14_2_0::ObjectWriteOperation*, const cls::rbd::ParentImageSpec&, const string&): Assertion `pspec.pool_namespace.empty()' failed.
*** Caught signal (Aborted) **
in thread 7fb9bb7fe700 thread_name:fn-radosclient
ceph version Development (no_version) octopus (dev)
1: (()+0x76c282) [0x557a6fea9282]
2: (()+0x12810) [0x7fb9d3c48810]
3: (gsignal()+0x10b) [0x7fb9d36bbd8b]
4: (abort()+0x123) [0x7fb9d36a5549]
5: (()+0x22421) [0x7fb9d36a5421]
6: (()+0x31262) [0x7fb9d36b4262]
7: (()+0x4f3296) [0x7fb9decd4296]
8: (()+0x281144) [0x7fb9dea62144]
9: (()+0x280f2c) [0x7fb9dea61f2c]
10: (()+0x289573) [0x7fb9dea6a573]
11: (()+0x28936d) [0x7fb9dea6a36d]
12: (()+0x28dce4) [0x7fb9dea6ece4]
13: (()+0xfecdf) [0x7fb9de8dfcdf]
14: (()+0x284e19) [0x7fb9dea65e19]
15: (()+0x284c47) [0x7fb9dea65c47]
16: (()+0x284fe6) [0x7fb9dea65fe6]
17: (()+0xdcb52) [0x7fb9de64eb52]
18: (()+0x72acf) [0x7fb9de5e4acf]
19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367]
20: (()+0xeee8a) [0x7fb9de660e8a]
21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0]
22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e]
23: (()+0x7fab) [0x7fb9d3c3dfab]
24: (clone()+0x3f) [0x7fb9d377e66f]
2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) **
in thread 7fb9bb7fe700 thread_name:fn-radosclient

ceph version Development (no_version) octopus (dev)
1: (()+0x76c282) [0x557a6fea9282]
2: (()+0x12810) [0x7fb9d3c48810]
3: (gsignal()+0x10b) [0x7fb9d36bbd8b]
4: (abort()+0x123) [0x7fb9d36a5549]
5: (()+0x22421) [0x7fb9d36a5421]
6: (()+0x31262) [0x7fb9d36b4262]
7: (()+0x4f3296) [0x7fb9decd4296]
8: (()+0x281144) [0x7fb9dea62144]
9: (()+0x280f2c) [0x7fb9dea61f2c]
10: (()+0x289573) [0x7fb9dea6a573]
11: (()+0x28936d) [0x7fb9dea6a36d]
12: (()+0x28dce4) [0x7fb9dea6ece4]
13: (()+0xfecdf) [0x7fb9de8dfcdf]
14: (()+0x284e19) [0x7fb9dea65e19]
15: (()+0x284c47) [0x7fb9dea65c47]
16: (()+0x284fe6) [0x7fb9dea65fe6]
17: (()+0xdcb52) [0x7fb9de64eb52]
18: (()+0x72acf) [0x7fb9de5e4acf]
19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367]
20: (()+0xeee8a) [0x7fb9de660e8a]
21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0]
22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e]
23: (()+0x7fab) [0x7fb9d3c3dfab]
24: (clone()+0x3f) [0x7fb9d377e66f]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-336> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command assert hook 0x557a7074d4d0
-335> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command abort hook 0x557a7074d4d0
-334> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_dump hook 0x557a7074d4d0
-333> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 1 hook 0x557a7074d4d0
-332> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf dump hook 0x557a7074d4d0
-331> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_schema hook 0x557a7074d4d0
-330> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram dump hook 0x557a7074d4d0
-329> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 2 hook 0x557a7074d4d0
-328> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf schema hook 0x557a7074d4d0
-327> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram schema hook 0x557a7074d4d0
-326> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf reset hook 0x557a7074d4d0
-325> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config show hook 0x557a7074d4d0
-324> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config help hook 0x557a7074d4d0
-323> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config set hook 0x557a7074d4d0
-322> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config unset hook 0x557a7074d4d0
-321> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config get hook 0x557a7074d4d0
-320> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff hook 0x557a7074d4d0
-319> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff get hook 0x557a7074d4d0
-318> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log flush hook 0x557a7074d4d0
-317> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log dump hook 0x557a7074d4d0
-316> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log reopen hook 0x557a7074d4d0
-315> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command dump_mempools hook 0x557a7074f6b8
-314> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep start
-313> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
-312> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 0
-311> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 1
-310> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 2
-309> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
-308> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 3
-307> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 4
-306> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 5
-305> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 6
-304> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 7
-303> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 8
-302> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
-301> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) init /tmp/ceph-asok.gjJCMO/client.admin.6380.asok
-300> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) bind_and_listen /tmp/ceph-asok.gjJCMO/client.admin.6380.asok
-299> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 0 hook 0x557a70767f50
-298> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command version hook 0x557a70767f50
-297> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command git_version hook 0x557a70767f50
-296> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command help hook 0x557a70768080
-295> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command get_command_descriptions hook 0x557a70768340
-294> 2019-09-19T20:34:41.276+0000 7fb9d1a10700 5 asok(0x557a706fc3c0) entry start
-293> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 9
-292> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 10
-291> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 11
-290> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 12
-289> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 13
-288> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 14
-287> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 15
-286> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 16
-285> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config
-284> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: build_initial_monmap
-283> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: monmap:
epoch 0
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T20:34:41.280410+0000
created 2019-09-19T20:34:41.280410+0000
min_mon_release 0 (unknown)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c

-282> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-281> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-280> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-279> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-278> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-277> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-276> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-275> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-274> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-273> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-272> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-271> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-270> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-269> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-268> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-267> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-266> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 17
-265> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 18
-264> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 19
-263> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 20
-262> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 21
-261> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 22
-260> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 23
-259> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 24
-258> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 25
-257> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 26
-256> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 10 monclient: init
-255> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx
-254> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx
-253> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx
-252> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-251> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-250> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-249> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-248> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-247> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-246> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-245> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-244> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-243> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-242> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-241> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-240> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-239> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-238> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 1 lockdep using id 27
-237> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1
-236> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1]
-235> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a70804620 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0]
-234> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a70804fc0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0]
-233> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a70805cf0 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0]
-232> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-231> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-230> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-229> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs
-228> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.288407+0000
-227> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a70804620 auth_method 0
-226> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-225> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2
-224> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a70805cf0 auth_method 0
-223> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-222> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2
-221> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a70804fc0 auth_method 0
-220> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-219> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2
-218> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9
-217> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-216> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-215> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9
-214> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-213> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-212> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9
-211> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-210> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-209> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5912 payload 450
-208> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0
-207> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 1 monclient: found mon.noname-c
-206> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0
-205> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-204> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.noname-c (according to old e1)
-203> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-202> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: _finish_auth 0
-201> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5912
-200> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_config config(3 keys) v1
-199> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config success
-198> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: shutdown
-197> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-196> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.c (according to old e1)
-195> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 4 set_mon_vals no callback set
-194> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-193> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals mon_pg_warn_min_per_osd = 3
-192> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_min_size = 1
-191> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_size = 3
-190> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep using id 28
-189> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep reusing last freed id 28
-188> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: build_initial_monmap
-187> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: monmap:
epoch 0
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T20:34:41.415855+0000
created 2019-09-19T20:34:41.415855+0000
min_mon_release 0 (unknown)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c

-186> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-185> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-184> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-183> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-182> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-181> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-180> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-179> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-178> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-177> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-176> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-175> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-174> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-173> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-172> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-171> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-170> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep reusing last freed id 27
-169> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 17
-168> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 18
-167> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 19
-166> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 20
-165> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 21
-164> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 22
-163> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting msgr at
-162> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting objecter
-161> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 26
-160> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 28
-159> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 29
-158> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command objecter_requests hook 0x557a707fd5b0
-157> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: setting wanted keys
-156> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: calling monclient init
-155> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 10 monclient: init
-154> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx
-153> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx
-152> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx
-151> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-150> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-149> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-148> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-147> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-146> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-145> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-144> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-143> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-142> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-141> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-140> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-139> 2019-09-19T20:34:41.420+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-138> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-137> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 1 lockdep using id 30
-136> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1
-135> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1]
-134> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a707ff4e0 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0]
-133> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a707fdfd0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0]
-132> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a707fe420 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0]
-131> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-130> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-129> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-128> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs
-127> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.428179+0000
-126> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a707ff4e0 auth_method 0
-125> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-124> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2
-123> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a707fe420 auth_method 0
-122> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-121> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2
-120> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a707fdfd0 auth_method 0
-119> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-118> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2
-117> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9
-116> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-115> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-114> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9
-113> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-112> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-111> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9
-110> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-109> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-108> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5915 payload 995
-107> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0
-106> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 1 monclient: found mon.noname-c
-105> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0
-104> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1
-103> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1)
-102> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-101> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: _finish_auth 0
-100> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5915
-99> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_config config(3 keys) v1
-98> 2019-09-19T20:34:41.428+0000 7fb9c17fa700 4 set_mon_vals no callback set
-97> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1
-96> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.c (according to old e1)
-95> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-94> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs
-93> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0
-92> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs
-91> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0
-90> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 1 librados: init done
-89> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Got map version 4
-88> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978]
-87> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc reconnect Starting new session with [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978]
-86> 2019-09-19T20:34:41.432+0000 7fb9c3fff700 10 monclient: get_auth_request con 0x7fb9b0013bd0 auth_method 0
-85> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 31
-84> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1
-83> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 32
-82> 2019-09-19T20:34:41.432+0000 7fb9d120f700 10 monclient: get_auth_request con 0x557a70818b80 auth_method 0
-81> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1
-80> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32
-79> 2019-09-19T20:34:41.440+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32
-78> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32
-77> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep using id 33
-76> 2019-09-19T20:34:41.456+0000 7fb9d0a0e700 10 monclient: get_auth_request con 0x557a7085e1c0 auth_method 0
-75> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep reusing last freed id 33
-74> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 34
-73> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 35
-72> 2019-09-19T20:34:41.460+0000 7fb9baffd700 1 lockdep using id 36
-71> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 37
-70> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 38
-69> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 39
-68> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 40
-67> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 41
-66> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 42
-65> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 43
-64> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 44
-63> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 45
-62> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 46
-61> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 ImageRequestWQ: ictx=0x557a708611d0
-60> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 47
-59> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 48
-58> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 49
-57> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 50
-56> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 51
-55> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 52
-54> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 53
-53> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 54
-52> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 55
-51> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img1 hook 0x7fb998005c60
-50> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img1 hook 0x7fb998005c60
-49> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 56
-48> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 57
-47> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 58
-46> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 59
-45> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 60
-44> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 61
-43> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 62
-42> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 63
-41> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 64
-40> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 65
-39> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 librbd::object_map::RefreshRequest: object map larger than current object count: 256 != 0
-38> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 66
-37> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c0028f0 init:
-36> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x557a708a5920 register_object_dispatch: object_dispatch_layer=1
-35> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 block_writes: 0x557a708611d0, num=1
-34> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 67
-33> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 unblock_writes: 0x557a708611d0, num=0
-32> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: read_rbd_info:
-31> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: handle_read_rbd_info: r=0
-30> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: finish: r=0
-29> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep reusing last freed id 64
-28> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 68
-27> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 69
-26> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 70
-25> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 71
-24> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 72
-23> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 73
-22> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 74
-21> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 ImageRequestWQ: ictx=0x7fb9980136f0
-20> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 75
-19> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img2 hook 0x7fb9980526f0
-18> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img2 hook 0x7fb9980526f0
-17> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 76
-16> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 77
-15> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 78
-14> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 79
-13> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 80
-12> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 1 lockdep using id 81
-11> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 block_writes: 0x7fb9980136f0, num=1
-10> 2019-09-19T20:34:41.916+0000 7fb9baffd700 1 lockdep using id 82
-9> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c004bf0 init:
-8> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=1
-7> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 1 lockdep using id 83
-6> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 SimpleSchedulerObjectDispatch: ictx=0x7fb9980136f0
-5> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 init:
-4> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=4
-3> 2019-09-19T20:34:41.972+0000 7fb9baffd700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 attach_parent:
-2> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 handle_attach_parent:
-1> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 finish: r=0
0> 2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) **
in thread 7fb9bb7fe700 thread_name:fn-radosclient

ceph version Development (no_version) octopus (dev)
1: (()+0x76c282) [0x557a6fea9282]
2: (()+0x12810) [0x7fb9d3c48810]
3: (gsignal()+0x10b) [0x7fb9d36bbd8b]
4: (abort()+0x123) [0x7fb9d36a5549]
5: (()+0x22421) [0x7fb9d36a5421]
6: (()+0x31262) [0x7fb9d36b4262]
7: (()+0x4f3296) [0x7fb9decd4296]
8: (()+0x281144) [0x7fb9dea62144]
9: (()+0x280f2c) [0x7fb9dea61f2c]
10: (()+0x289573) [0x7fb9dea6a573]
11: (()+0x28936d) [0x7fb9dea6a36d]
12: (()+0x28dce4) [0x7fb9dea6ece4]
13: (()+0xfecdf) [0x7fb9de8dfcdf]
14: (()+0x284e19) [0x7fb9dea65e19]
15: (()+0x284c47) [0x7fb9dea65c47]
16: (()+0x284fe6) [0x7fb9dea65fe6]
17: (()+0xdcb52) [0x7fb9de64eb52]
18: (()+0x72acf) [0x7fb9de5e4acf]
19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367]
20: (()+0xeee8a) [0x7fb9de660e8a]
21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0]
22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e]
23: (()+0x7fab) [0x7fb9d3c3dfab]
24: (clone()+0x3f) [0x7fb9d377e66f]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 immutable_obj_cache
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 rgw_sync
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
1/ 5 prioritycache
0/ 5 test
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 500
max_new 1000
log_file /ceph/build/out/client.admin.6380.log
--- end dump of recent events ---
--- begin dump of recent events ---
-336> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command assert hook 0x557a7074d4d0
-335> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command abort hook 0x557a7074d4d0
-334> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_dump hook 0x557a7074d4d0
-333> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 1 hook 0x557a7074d4d0
-332> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf dump hook 0x557a7074d4d0
-331> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_schema hook 0x557a7074d4d0
-330> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram dump hook 0x557a7074d4d0
-329> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 2 hook 0x557a7074d4d0
-328> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf schema hook 0x557a7074d4d0
-327> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram schema hook 0x557a7074d4d0
-326> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf reset hook 0x557a7074d4d0
-325> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config show hook 0x557a7074d4d0
-324> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config help hook 0x557a7074d4d0
-323> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config set hook 0x557a7074d4d0
-322> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config unset hook 0x557a7074d4d0
-321> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config get hook 0x557a7074d4d0
-320> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff hook 0x557a7074d4d0
-319> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff get hook 0x557a7074d4d0
-318> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log flush hook 0x557a7074d4d0
-317> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log dump hook 0x557a7074d4d0
-316> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log reopen hook 0x557a7074d4d0
-315> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command dump_mempools hook 0x557a7074f6b8
-314> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep start
-313> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
-312> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 0
-311> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 1
-310> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 2
-309> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
-308> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 3
-307> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 4
-306> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 5
-305> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 6
-304> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 7
-303> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 8
-302> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
-301> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) init /tmp/ceph-asok.gjJCMO/client.admin.6380.asok
-300> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) bind_and_listen /tmp/ceph-asok.gjJCMO/client.admin.6380.asok
-299> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 0 hook 0x557a70767f50
-298> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command version hook 0x557a70767f50
-297> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command git_version hook 0x557a70767f50
-296> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command help hook 0x557a70768080
-295> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command get_command_descriptions hook 0x557a70768340
-294> 2019-09-19T20:34:41.276+0000 7fb9d1a10700 5 asok(0x557a706fc3c0) entry start
-293> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 9
-292> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 10
-291> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 11
-290> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 12
-289> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 13
-288> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 14
-287> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 15
-286> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 16
-285> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config
-284> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: build_initial_monmap
-283> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: monmap:
epoch 0
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T20:34:41.280410+0000
created 2019-09-19T20:34:41.280410+0000
min_mon_release 0 (unknown)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c

-282> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-281> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-280> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-279> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-278> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-277> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-276> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-275> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-274> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-273> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-272> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-271> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-270> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-269> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-268> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-267> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-266> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 17
-265> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 18
-264> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 19
-263> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 20
-262> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 21
-261> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 22
-260> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 23
-259> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 24
-258> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 25
-257> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 26
-256> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 10 monclient: init
-255> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx
-254> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx
-253> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx
-252> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-251> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-250> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-249> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-248> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-247> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-246> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-245> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-244> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-243> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-242> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc
-241> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure
-240> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-239> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-238> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 1 lockdep using id 27
-237> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1
-236> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1]
-235> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a70804620 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0]
-234> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a70804fc0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0]
-233> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a70805cf0 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0]
-232> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-231> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-230> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-229> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs
-228> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.288407+0000
-227> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a70804620 auth_method 0
-226> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-225> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2
-224> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a70805cf0 auth_method 0
-223> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-222> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2
-221> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a70804fc0 auth_method 0
-220> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-219> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2
-218> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9
-217> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-216> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-215> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9
-214> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-213> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-212> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9
-211> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-210> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-209> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5912 payload 450
-208> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0
-207> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 1 monclient: found mon.noname-c
-206> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0
-205> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-204> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.noname-c (according to old e1)
-203> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-202> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: _finish_auth 0
-201> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5912
-200> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_config config(3 keys) v1
-199> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config success
-198> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: shutdown
-197> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-196> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.c (according to old e1)
-195> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 4 set_mon_vals no callback set
-194> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-193> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals mon_pg_warn_min_per_osd = 3
-192> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_min_size = 1
-191> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_size = 3
-190> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep using id 28
-189> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep reusing last freed id 28
-188> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: build_initial_monmap
-187> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: monmap:
epoch 0
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T20:34:41.415855+0000
created 2019-09-19T20:34:41.415855+0000
min_mon_release 0 (unknown)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c

-186> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-185> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-184> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx
-183> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-182> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-181> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-180> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-179> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-178> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-177> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-176> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-175> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-174> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-173> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc
-172> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure
-171> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-170> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep reusing last freed id 27
-169> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 17
-168> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 18
-167> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 19
-166> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 20
-165> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using iceph-dev:/ceph/build # bin/rbd clone rbd/ns1/img1@img1_2019-09-19T21:32:47.161+01:00 rbd/ns1/img2
2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled.
rbd: /ceph/src/cls/rbd/cls_rbd_client.cc:489: void librbd::cls_client::add_child(librados::v14_2_0::ObjectWriteOperation*, const cls::rbd::ParentImageSpec&, const string&): Assertion `pspec.pool_namespace.empty()' failed.
*** Caught signal (Aborted) **
in thread 7fb9bb7fe700 thread_name:fn-radosclient
ceph version Development (no_version) octopus (dev)
1: (()+0x76c282) [0x557a6fea9282]
2: (()+0x12810) [0x7fb9d3c48810]
3: (gsignal()+0x10b) [0x7fb9d36bbd8b]
4: (abort()+0x123) [0x7fb9d36a5549]
5: (()+0x22421) [0x7fb9d36a5421]
6: (()+0x31262) [0x7fb9d36b4262]
7: (()+0x4f3296) [0x7fb9decd4296]
8: (()+0x281144) [0x7fb9dea62144]
9: (()+0x280f2c) [0x7fb9dea61f2c]
10: (()+0x289573) [0x7fb9dea6a573]
11: (()+0x28936d) [0x7fb9dea6a36d]
12: (()+0x28dce4) [0x7fb9dea6ece4]
13: (()+0xfecdf) [0x7fb9de8dfcdf]
14: (()+0x284e19) [0x7fb9dea65e19]
15: (()+0x284c47) [0x7fb9dea65c47]
16: (()+0x284fe6) [0x7fb9dea65fe6]
17: (()+0xdcb52) [0x7fb9de64eb52]
18: (()+0x72acf) [0x7fb9de5e4acf]
19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367]
20: (()+0xeee8a) [0x7fb9de660e8a]
21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0]
22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e]
23: (()+0x7fab) [0x7fb9d3c3dfab]
24: (clone()+0x3f) [0x7fb9d377e66f]
2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) **
in thread 7fb9bb7fe700 thread_name:fn-radosclient

ceph version Development (no_version) octopus (dev)
1: (()+0x76c282) [0x557a6fea9282]
2: (()+0x12810) [0x7fb9d3c48810]
3: (gsignal()+0x10b) [0x7fb9d36bbd8b]
4: (abort()+0x123) [0x7fb9d36a5549]
5: (()+0x22421) [0x7fb9d36a5421]
6: (()+0x31262) [0x7fb9d36b4262]
7: (()+0x4f3296) [0x7fb9decd4296]
8: (()+0x281144) [0x7fb9dea62144]
9: (()+0x280f2c) [0x7fb9dea61f2c]
10: (()+0x289573) [0x7fb9dea6a573]
11: (()+0x28936d) [0x7fb9dea6a36d]
12: (()+0x28dce4) [0x7fb9dea6ece4]
13: (()+0xfecdf) [0x7fb9de8dfcdf]
14: (()+0x284e19) [0x7fb9dea65e19]
15: (()+0x284c47) [0x7fb9dea65c47]
16: (()+0x284fe6) [0x7fb9dea65fe6]
17: (()+0xdcb52) [0x7fb9de64eb52]
18: (()+0x72acf) [0x7fb9de5e4acf]
19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367]
20: (()+0xeee8a) [0x7fb9de660e8a]
21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0]
22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e]
23: (()+0x7fab) [0x7fb9d3c3dfab]
24: (clone()+0x3f) [0x7fb9d377e66f]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-336> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command assert hook 0x557a7074d4d0
-335> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command abort hook 0x557a7074d4d0
-334> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_dump hook 0x557a7074d4d0
-333> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 1 hook 0x557a7074d4d0
-332> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf dump hook 0x557a7074d4d0
-331> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_schema hook 0x557a7074d4d0
-330> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram dump hook 0x557a7074d4d0
-329> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 2 hook 0x557a7074d4d0
-328> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf schema hook 0x557a7074d4d0
-327> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram schema hook 0x557a7074d4d0
-326> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf reset hook 0x557a7074d4d0
-325> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config show hook 0x557a7074d4d0
-324> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config help hook 0x557a7074d4d0
-323> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config set hook 0x557a7074d4d0
-322> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config unset hook 0x557a7074d4d0
-321> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config get hook 0x557a7074d4d0
-320> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff hook 0x557a7074d4d0
-319> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff get hook 0x557a7074d4d0
-318> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log flush hook 0x557a7074d4d0
-317> 2019-09-19T20:3d 21
-164> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 22
-163> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting msgr at
-162> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting objecter
-161> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 26
-160> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 28
-159> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 29
-158> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command objecter_requests hook 0x557a707fd5b0
-157> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: setting wanted keys
-156> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: calling monclient init
-155> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 10 monclient: init
-154> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx
-153> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx
-152> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx
-151> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-150> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-149> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-148> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-147> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-146> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-145> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-144> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-143> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-142> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-141> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc
-140> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure
-139> 2019-09-19T20:34:41.420+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-138> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring
-137> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 1 lockdep using id 30
-136> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1
-135> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1]
-134> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a707ff4e0 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0]
-133> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a707fdfd0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0]
-132> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a707fe420 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0]
-131> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-130> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-129> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection
-128> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs
-127> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.428179+0000
-126> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a707ff4e0 auth_method 0
-125> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-124> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2
-123> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a707fe420 auth_method 0
-122> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-121> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2
-120> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a707fdfd0 auth_method 0
-119> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-118> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2
-117> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9
-116> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-115> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-114> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9
-113> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-112> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-111> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9
-110> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-109> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-108> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5915 payload 995
-107> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0
-106> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 1 monclient: found mon.noname-c
-105> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0
-104> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1
-103> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1)
-102> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-101> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: _finish_auth 0
-100> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5915
-99> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_config config(3 keys) v1
-98> 2019-09-19T20:34:41.428+0000 7fb9c17fa700 4 set_mon_vals no callback set
-97> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1
-96> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.c (according to old e1)
-95> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump:
epoch 1
fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb
last_changed 2019-09-19T14:43:30.372552+0000
created 2019-09-19T14:43:30.372552+0000
min_mon_release 15 (octopus)
0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a
1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b
2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c

-94> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs
-93> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0
-92> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs
-91> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0
-90> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 1 librados: init done
-89> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Got map version 4
-88> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978]
-87> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc reconnect Starting new session with [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978]
-86> 2019-09-19T20:34:41.432+0000 7fb9c3fff700 10 monclient: get_auth_request con 0x7fb9b0013bd0 auth_method 0
-85> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 31
-84> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1
-83> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 32
-82> 2019-09-19T20:34:41.432+0000 7fb9d120f700 10 monclient: get_auth_request con 0x557a70818b80 auth_method 0
-81> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1
-80> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32
-79> 2019-09-19T20:34:41.440+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32
-78> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32
-77> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep using id 33
-76> 2019-09-19T20:34:41.456+0000 7fb9d0a0e700 10 monclient: get_auth_request con 0x557a7085e1c0 auth_method 0
-75> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep reusing last freed id 33
-74> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 34
-73> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 35
-72> 2019-09-19T20:34:41.460+0000 7fb9baffd700 1 lockdep using id 36
-71> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 37
-70> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 38
-69> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 39
-68> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 40
-67> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 41
-66> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 42
-65> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 43
-64> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 44
-63> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 45
-62> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 46
-61> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 ImageRequestWQ: ictx=0x557a708611d0
-60> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 47
-59> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 48
-58> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 49
-57> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 50
-56> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 51
-55> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 52
-54> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 53
-53> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 54
-52> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 55
-51> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img1 hook 0x7fb998005c60
-50> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img1 hook 0x7fb998005c60
-49> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 56
-48> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 57
-47> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 58
-46> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 59
-45> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 60
-44> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 61
-43> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 62
-42> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 63
-41> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 64
-40> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 65
-39> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 librbd::object_map::RefreshRequest: object map larger than current object count: 256 != 0
-38> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 66
-37> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c0028f0 init:
-36> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x557a708a5920 register_object_dispatch: object_dispatch_layer=1
-35> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 block_writes: 0x557a708611d0, num=1
-34> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 67
-33> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 unblock_writes: 0x557a708611d0, num=0
-32> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: read_rbd_info:
-31> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: handle_read_rbd_info: r=0
-30> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: finish: r=0
-29> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep reusing last freed id 64
-28> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 68
-27> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 69
-26> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 70
-25> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 71
-24> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 72
-23> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 73
-22> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 74
-21> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 ImageRequestWQ: ictx=0x7fb9980136f0
-20> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 75
-19> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img2 hook 0x7fb9980526f0
-18> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img2 hook 0x7fb9980526f0
-17> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 76
-16> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 77
-15> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 78
-14> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 79
-13> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 80
-12> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 1 lockdep using id 81
-11> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 block_writes: 0x7fb9980136f0, num=1
-10> 2019-09-19T20:34:41.916+0000 7fb9baffd700 1 lockdep using id 82
-9> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c004bf0 init:
-8> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=1
-7> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 1 lockdep using id 83
-6> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 SimpleSchedulerObjectDispatch: ictx=0x7fb9980136f0
-5> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 init:
-4> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=4
-3> 2019-09-19T20:34:41.972+0000 7fb9baffd700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 attach_parent:
-2> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 handle_attach_parent:
-1> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 finish: r=0
0> 2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) **
in thread 7fb9bb7fe700 thread_name:fn-radosclient

ceph version Development (no_version) octopus (dev)
1: (()+0x76c282) [0x557a6fea9282]
2: (()+0x12810) [0x7fb9d3c48810]
3: (gsignal()+0x10b) [0x7fb9d36bbd8b]
4: (abort()+0x123) [0x7fb9d36a5549]
5: (()+0x22421) [0x7fb9d36a5421]
6: (()+0x31262) [0x7fb9d36b4262]
7: (()+0x4f3296) [0x7fb9decd4296]
8: (()+0x281144) [0x7fb9dea62144]
9: (()+0x280f2c) [0x7fb9dea61f2c]
10: (()+0x289573) [0x7fb9dea6a573]
11: (()+0x28936d) [0x7fb9dea6a36d]
12: (()+0x28dce4) [0x7fb9dea6ece4]
13: (()+0xfecdf) [0x7fb9de8dfcdf]
14: (()+0x284e19) [0x7fb9dea65e19]
15: (()+0x284c47) [0x7fb9dea65c47]
16: (()+0x284fe6) [0x7fb9dea65fe6]
17: (()+0xdcb52) [0x7fb9de64eb52]
18: (()+0x72acf) [0x7fb9de5e4acf]
19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367]
20: (()+0xeee8a) [0x7fb9de660e8a]
21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0]
22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e]
23: (()+0x7fab) [0x7fb9d3c3dfab]
24: (clone()+0x3f) [0x7fb9d377e66f]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 immutable_obj_cache
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 rgw_sync
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
1/ 5 prioritycache
0/ 5 test
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 500
max_new 1000
log_file /ceph/build/out/2019-09-19T20:34:42.023233Z_d059c1f4-95d6-4a3d-a086-a418d950a039/log
--- end dump of recent events ---
Aborted (core dumped)
    (1-1/1)