ceph-dev:/ceph/build # bin/rbd clone rbd/ns1/img1@img1_2019-09-19T21:32:47.161+01:00 rbd/ns1/img2 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. rbd: /ceph/src/cls/rbd/cls_rbd_client.cc:489: void librbd::cls_client::add_child(librados::v14_2_0::ObjectWriteOperation*, const cls::rbd::ParentImageSpec&, const string&): Assertion `pspec.pool_namespace.empty()' failed. *** Caught signal (Aborted) ** in thread 7fb9bb7fe700 thread_name:fn-radosclient ceph version Development (no_version) octopus (dev) 1: (()+0x76c282) [0x557a6fea9282] 2: (()+0x12810) [0x7fb9d3c48810] 3: (gsignal()+0x10b) [0x7fb9d36bbd8b] 4: (abort()+0x123) [0x7fb9d36a5549] 5: (()+0x22421) [0x7fb9d36a5421] 6: (()+0x31262) [0x7fb9d36b4262] 7: (()+0x4f3296) [0x7fb9decd4296] 8: (()+0x281144) [0x7fb9dea62144] 9: (()+0x280f2c) [0x7fb9dea61f2c] 10: (()+0x289573) [0x7fb9dea6a573] 11: (()+0x28936d) [0x7fb9dea6a36d] 12: (()+0x28dce4) [0x7fb9dea6ece4] 13: (()+0xfecdf) [0x7fb9de8dfcdf] 14: (()+0x284e19) [0x7fb9dea65e19] 15: (()+0x284c47) [0x7fb9dea65c47] 16: (()+0x284fe6) [0x7fb9dea65fe6] 17: (()+0xdcb52) [0x7fb9de64eb52] 18: (()+0x72acf) [0x7fb9de5e4acf] 19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367] 20: (()+0xeee8a) [0x7fb9de660e8a] 21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0] 22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e] 23: (()+0x7fab) [0x7fb9d3c3dfab] 24: (clone()+0x3f) [0x7fb9d377e66f] 2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) ** in thread 7fb9bb7fe700 thread_name:fn-radosclient ceph version Development (no_version) octopus (dev) 1: (()+0x76c282) [0x557a6fea9282] 2: (()+0x12810) [0x7fb9d3c48810] 3: (gsignal()+0x10b) [0x7fb9d36bbd8b] 4: (abort()+0x123) [0x7fb9d36a5549] 5: (()+0x22421) [0x7fb9d36a5421] 6: (()+0x31262) [0x7fb9d36b4262] 7: (()+0x4f3296) [0x7fb9decd4296] 8: (()+0x281144) [0x7fb9dea62144] 9: (()+0x280f2c) [0x7fb9dea61f2c] 10: (()+0x289573) [0x7fb9dea6a573] 11: (()+0x28936d) [0x7fb9dea6a36d] 12: (()+0x28dce4) [0x7fb9dea6ece4] 13: (()+0xfecdf) [0x7fb9de8dfcdf] 14: (()+0x284e19) [0x7fb9dea65e19] 15: (()+0x284c47) [0x7fb9dea65c47] 16: (()+0x284fe6) [0x7fb9dea65fe6] 17: (()+0xdcb52) [0x7fb9de64eb52] 18: (()+0x72acf) [0x7fb9de5e4acf] 19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367] 20: (()+0xeee8a) [0x7fb9de660e8a] 21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0] 22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e] 23: (()+0x7fab) [0x7fb9d3c3dfab] 24: (clone()+0x3f) [0x7fb9d377e66f] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -336> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command assert hook 0x557a7074d4d0 -335> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command abort hook 0x557a7074d4d0 -334> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_dump hook 0x557a7074d4d0 -333> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 1 hook 0x557a7074d4d0 -332> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf dump hook 0x557a7074d4d0 -331> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_schema hook 0x557a7074d4d0 -330> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram dump hook 0x557a7074d4d0 -329> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 2 hook 0x557a7074d4d0 -328> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf schema hook 0x557a7074d4d0 -327> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram schema hook 0x557a7074d4d0 -326> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf reset hook 0x557a7074d4d0 -325> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config show hook 0x557a7074d4d0 -324> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config help hook 0x557a7074d4d0 -323> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config set hook 0x557a7074d4d0 -322> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config unset hook 0x557a7074d4d0 -321> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config get hook 0x557a7074d4d0 -320> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff hook 0x557a7074d4d0 -319> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff get hook 0x557a7074d4d0 -318> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log flush hook 0x557a7074d4d0 -317> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log dump hook 0x557a7074d4d0 -316> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log reopen hook 0x557a7074d4d0 -315> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command dump_mempools hook 0x557a7074f6b8 -314> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep start -313> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. -312> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 0 -311> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 1 -310> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 2 -309> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. -308> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 3 -307> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 4 -306> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 5 -305> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 6 -304> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 7 -303> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 8 -302> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. -301> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) init /tmp/ceph-asok.gjJCMO/client.admin.6380.asok -300> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) bind_and_listen /tmp/ceph-asok.gjJCMO/client.admin.6380.asok -299> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 0 hook 0x557a70767f50 -298> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command version hook 0x557a70767f50 -297> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command git_version hook 0x557a70767f50 -296> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command help hook 0x557a70768080 -295> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command get_command_descriptions hook 0x557a70768340 -294> 2019-09-19T20:34:41.276+0000 7fb9d1a10700 5 asok(0x557a706fc3c0) entry start -293> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 9 -292> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 10 -291> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 11 -290> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 12 -289> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 13 -288> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 14 -287> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 15 -286> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 16 -285> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config -284> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: build_initial_monmap -283> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: monmap: epoch 0 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T20:34:41.280410+0000 created 2019-09-19T20:34:41.280410+0000 min_mon_release 0 (unknown) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c -282> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -281> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -280> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -279> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -278> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -277> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -276> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -275> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -274> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -273> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -272> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -271> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -270> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -269> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -268> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -267> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -266> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 17 -265> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 18 -264> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 19 -263> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 20 -262> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 21 -261> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 22 -260> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 23 -259> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 24 -258> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 25 -257> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 26 -256> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 10 monclient: init -255> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx -254> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx -253> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx -252> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -251> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -250> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -249> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -248> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -247> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -246> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -245> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -244> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -243> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -242> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -241> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -240> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -239> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -238> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 1 lockdep using id 27 -237> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1 -236> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1] -235> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a70804620 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] -234> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a70804fc0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] -233> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a70805cf0 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] -232> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -231> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -230> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -229> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs -228> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.288407+0000 -227> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a70804620 auth_method 0 -226> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -225> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2 -224> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a70805cf0 auth_method 0 -223> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -222> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2 -221> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a70804fc0 auth_method 0 -220> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -219> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2 -218> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9 -217> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -216> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -215> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9 -214> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -213> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -212> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9 -211> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -210> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -209> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5912 payload 450 -208> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0 -207> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 1 monclient: found mon.noname-c -206> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0 -205> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 -204> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) -203> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -202> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: _finish_auth 0 -201> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5912 -200> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_config config(3 keys) v1 -199> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config success -198> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: shutdown -197> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 -196> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.c (according to old e1) -195> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 4 set_mon_vals no callback set -194> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -193> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals mon_pg_warn_min_per_osd = 3 -192> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_min_size = 1 -191> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_size = 3 -190> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep using id 28 -189> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep reusing last freed id 28 -188> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: build_initial_monmap -187> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: monmap: epoch 0 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T20:34:41.415855+0000 created 2019-09-19T20:34:41.415855+0000 min_mon_release 0 (unknown) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c -186> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -185> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -184> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -183> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -182> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -181> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -180> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -179> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -178> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -177> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -176> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -175> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -174> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -173> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -172> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -171> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -170> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep reusing last freed id 27 -169> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 17 -168> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 18 -167> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 19 -166> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 20 -165> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 21 -164> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 22 -163> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting msgr at -162> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting objecter -161> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 26 -160> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 28 -159> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 29 -158> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command objecter_requests hook 0x557a707fd5b0 -157> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: setting wanted keys -156> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: calling monclient init -155> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 10 monclient: init -154> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx -153> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx -152> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx -151> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -150> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -149> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -148> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -147> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -146> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -145> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -144> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -143> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -142> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -141> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -140> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -139> 2019-09-19T20:34:41.420+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -138> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -137> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 1 lockdep using id 30 -136> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1 -135> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1] -134> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a707ff4e0 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] -133> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a707fdfd0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] -132> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a707fe420 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] -131> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -130> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -129> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -128> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs -127> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.428179+0000 -126> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a707ff4e0 auth_method 0 -125> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -124> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2 -123> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a707fe420 auth_method 0 -122> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -121> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2 -120> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a707fdfd0 auth_method 0 -119> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -118> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2 -117> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9 -116> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -115> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -114> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9 -113> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -112> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -111> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9 -110> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -109> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -108> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5915 payload 995 -107> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0 -106> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 1 monclient: found mon.noname-c -105> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0 -104> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 -103> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) -102> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -101> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: _finish_auth 0 -100> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5915 -99> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_config config(3 keys) v1 -98> 2019-09-19T20:34:41.428+0000 7fb9c17fa700 4 set_mon_vals no callback set -97> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 -96> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.c (according to old e1) -95> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -94> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs -93> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0 -92> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs -91> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0 -90> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 1 librados: init done -89> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Got map version 4 -88> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978] -87> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc reconnect Starting new session with [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978] -86> 2019-09-19T20:34:41.432+0000 7fb9c3fff700 10 monclient: get_auth_request con 0x7fb9b0013bd0 auth_method 0 -85> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 31 -84> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1 -83> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 32 -82> 2019-09-19T20:34:41.432+0000 7fb9d120f700 10 monclient: get_auth_request con 0x557a70818b80 auth_method 0 -81> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1 -80> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32 -79> 2019-09-19T20:34:41.440+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32 -78> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32 -77> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep using id 33 -76> 2019-09-19T20:34:41.456+0000 7fb9d0a0e700 10 monclient: get_auth_request con 0x557a7085e1c0 auth_method 0 -75> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep reusing last freed id 33 -74> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 34 -73> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 35 -72> 2019-09-19T20:34:41.460+0000 7fb9baffd700 1 lockdep using id 36 -71> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 37 -70> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 38 -69> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 39 -68> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 40 -67> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 41 -66> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 42 -65> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 43 -64> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 44 -63> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 45 -62> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 46 -61> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 ImageRequestWQ: ictx=0x557a708611d0 -60> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 47 -59> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 48 -58> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 49 -57> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 50 -56> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 51 -55> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 52 -54> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 53 -53> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 54 -52> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 55 -51> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img1 hook 0x7fb998005c60 -50> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img1 hook 0x7fb998005c60 -49> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 56 -48> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 57 -47> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 58 -46> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 59 -45> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 60 -44> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 61 -43> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 62 -42> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 63 -41> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 64 -40> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 65 -39> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 librbd::object_map::RefreshRequest: object map larger than current object count: 256 != 0 -38> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 66 -37> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c0028f0 init: -36> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x557a708a5920 register_object_dispatch: object_dispatch_layer=1 -35> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 block_writes: 0x557a708611d0, num=1 -34> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 67 -33> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 unblock_writes: 0x557a708611d0, num=0 -32> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: read_rbd_info: -31> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: handle_read_rbd_info: r=0 -30> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: finish: r=0 -29> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep reusing last freed id 64 -28> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 68 -27> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 69 -26> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 70 -25> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 71 -24> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 72 -23> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 73 -22> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 74 -21> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 ImageRequestWQ: ictx=0x7fb9980136f0 -20> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 75 -19> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img2 hook 0x7fb9980526f0 -18> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img2 hook 0x7fb9980526f0 -17> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 76 -16> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 77 -15> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 78 -14> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 79 -13> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 80 -12> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 1 lockdep using id 81 -11> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 block_writes: 0x7fb9980136f0, num=1 -10> 2019-09-19T20:34:41.916+0000 7fb9baffd700 1 lockdep using id 82 -9> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c004bf0 init: -8> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=1 -7> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 1 lockdep using id 83 -6> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 SimpleSchedulerObjectDispatch: ictx=0x7fb9980136f0 -5> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 init: -4> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=4 -3> 2019-09-19T20:34:41.972+0000 7fb9baffd700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 attach_parent: -2> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 handle_attach_parent: -1> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 finish: r=0 0> 2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) ** in thread 7fb9bb7fe700 thread_name:fn-radosclient ceph version Development (no_version) octopus (dev) 1: (()+0x76c282) [0x557a6fea9282] 2: (()+0x12810) [0x7fb9d3c48810] 3: (gsignal()+0x10b) [0x7fb9d36bbd8b] 4: (abort()+0x123) [0x7fb9d36a5549] 5: (()+0x22421) [0x7fb9d36a5421] 6: (()+0x31262) [0x7fb9d36b4262] 7: (()+0x4f3296) [0x7fb9decd4296] 8: (()+0x281144) [0x7fb9dea62144] 9: (()+0x280f2c) [0x7fb9dea61f2c] 10: (()+0x289573) [0x7fb9dea6a573] 11: (()+0x28936d) [0x7fb9dea6a36d] 12: (()+0x28dce4) [0x7fb9dea6ece4] 13: (()+0xfecdf) [0x7fb9de8dfcdf] 14: (()+0x284e19) [0x7fb9dea65e19] 15: (()+0x284c47) [0x7fb9dea65c47] 16: (()+0x284fe6) [0x7fb9dea65fe6] 17: (()+0xdcb52) [0x7fb9de64eb52] 18: (()+0x72acf) [0x7fb9de5e4acf] 19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367] 20: (()+0xeee8a) [0x7fb9de660e8a] 21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0] 22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e] 23: (()+0x7fab) [0x7fb9d3c3dfab] 24: (clone()+0x3f) [0x7fb9d377e66f] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 immutable_obj_cache 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 0 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 1 reserver 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 rgw_sync 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 compressor 1/ 5 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace 1/ 5 prioritycache 0/ 5 test -2/-2 (syslog threshold) 99/99 (stderr threshold) max_recent 500 max_new 1000 log_file /ceph/build/out/client.admin.6380.log --- end dump of recent events --- --- begin dump of recent events --- -336> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command assert hook 0x557a7074d4d0 -335> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command abort hook 0x557a7074d4d0 -334> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_dump hook 0x557a7074d4d0 -333> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 1 hook 0x557a7074d4d0 -332> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf dump hook 0x557a7074d4d0 -331> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_schema hook 0x557a7074d4d0 -330> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram dump hook 0x557a7074d4d0 -329> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 2 hook 0x557a7074d4d0 -328> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf schema hook 0x557a7074d4d0 -327> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram schema hook 0x557a7074d4d0 -326> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf reset hook 0x557a7074d4d0 -325> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config show hook 0x557a7074d4d0 -324> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config help hook 0x557a7074d4d0 -323> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config set hook 0x557a7074d4d0 -322> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config unset hook 0x557a7074d4d0 -321> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config get hook 0x557a7074d4d0 -320> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff hook 0x557a7074d4d0 -319> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff get hook 0x557a7074d4d0 -318> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log flush hook 0x557a7074d4d0 -317> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log dump hook 0x557a7074d4d0 -316> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log reopen hook 0x557a7074d4d0 -315> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command dump_mempools hook 0x557a7074f6b8 -314> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep start -313> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. -312> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 0 -311> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 1 -310> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 2 -309> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. -308> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 3 -307> 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 1 lockdep using id 4 -306> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 5 -305> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 6 -304> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 7 -303> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 8 -302> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. -301> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) init /tmp/ceph-asok.gjJCMO/client.admin.6380.asok -300> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) bind_and_listen /tmp/ceph-asok.gjJCMO/client.admin.6380.asok -299> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 0 hook 0x557a70767f50 -298> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command version hook 0x557a70767f50 -297> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command git_version hook 0x557a70767f50 -296> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command help hook 0x557a70768080 -295> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command get_command_descriptions hook 0x557a70768340 -294> 2019-09-19T20:34:41.276+0000 7fb9d1a10700 5 asok(0x557a706fc3c0) entry start -293> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 9 -292> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 10 -291> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 11 -290> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 12 -289> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 13 -288> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 14 -287> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 15 -286> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 16 -285> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config -284> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: build_initial_monmap -283> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 10 monclient: monmap: epoch 0 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T20:34:41.280410+0000 created 2019-09-19T20:34:41.280410+0000 min_mon_release 0 (unknown) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c -282> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -281> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -280> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -279> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -278> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -277> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -276> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -275> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -274> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -273> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -272> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -271> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -270> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -269> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -268> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -267> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -266> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 17 -265> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 18 -264> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 19 -263> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 20 -262> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 21 -261> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 22 -260> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 23 -259> 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 1 lockdep using id 24 -258> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 25 -257> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 1 lockdep using id 26 -256> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 10 monclient: init -255> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx -254> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx -253> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding auth protocol: cephx -252> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -251> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -250> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -249> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -248> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -247> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -246> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -245> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -244> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -243> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -242> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: crc -241> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 5 AuthRegistry(0x7ffc080681f0) adding con mode: secure -240> 2019-09-19T20:34:41.280+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -239> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -238> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 1 lockdep using id 27 -237> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1 -236> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1] -235> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a70804620 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] -234> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a70804fc0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] -233> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a70805cf0 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] -232> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -231> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -230> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -229> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs -228> 2019-09-19T20:34:41.284+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.288407+0000 -227> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a70804620 auth_method 0 -226> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -225> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2 -224> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a70805cf0 auth_method 0 -223> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -222> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2 -221> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a70804fc0 auth_method 0 -220> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -219> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2 -218> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9 -217> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -216> 2019-09-19T20:34:41.284+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -215> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9 -214> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -213> 2019-09-19T20:34:41.284+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -212> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9 -211> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -210> 2019-09-19T20:34:41.284+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -209> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5912 payload 450 -208> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0 -207> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 1 monclient: found mon.noname-c -206> 2019-09-19T20:34:41.288+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0 -205> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 -204> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) -203> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -202> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: _finish_auth 0 -201> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5912 -200> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_config config(3 keys) v1 -199> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: get_monmap_and_config success -198> 2019-09-19T20:34:41.404+0000 7fb9d35dcec0 10 monclient: shutdown -197> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: handle_monmap mon_map magic: 0 v1 -196> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: got monmap 1 from mon.c (according to old e1) -195> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 4 set_mon_vals no callback set -194> 2019-09-19T20:34:41.404+0000 7fb9c37fe700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -193> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals mon_pg_warn_min_per_osd = 3 -192> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_min_size = 1 -191> 2019-09-19T20:34:41.404+0000 7fb9c1ffb700 10 set_mon_vals osd_pool_default_size = 3 -190> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep using id 28 -189> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 1 lockdep reusing last freed id 28 -188> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: build_initial_monmap -187> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 10 monclient: monmap: epoch 0 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T20:34:41.415855+0000 created 2019-09-19T20:34:41.415855+0000 min_mon_release 0 (unknown) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.noname-a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.noname-b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.noname-c -186> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -185> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -184> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding auth protocol: cephx -183> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -182> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -181> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -180> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -179> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -178> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -177> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -176> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -175> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -174> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -173> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: crc -172> 2019-09-19T20:34:41.412+0000 7fb9d35dcec0 5 AuthRegistry(0x557a7076c1b0) adding con mode: secure -171> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -170> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep reusing last freed id 27 -169> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 17 -168> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 18 -167> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 19 -166> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 20 -165> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using iceph-dev:/ceph/build # bin/rbd clone rbd/ns1/img1@img1_2019-09-19T21:32:47.161+01:00 rbd/ns1/img2 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2019-09-19T20:34:41.272+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. 2019-09-19T20:34:41.276+0000 7fb9d35dcec0 -1 WARNING: all dangerous and experimental features are enabled. rbd: /ceph/src/cls/rbd/cls_rbd_client.cc:489: void librbd::cls_client::add_child(librados::v14_2_0::ObjectWriteOperation*, const cls::rbd::ParentImageSpec&, const string&): Assertion `pspec.pool_namespace.empty()' failed. *** Caught signal (Aborted) ** in thread 7fb9bb7fe700 thread_name:fn-radosclient ceph version Development (no_version) octopus (dev) 1: (()+0x76c282) [0x557a6fea9282] 2: (()+0x12810) [0x7fb9d3c48810] 3: (gsignal()+0x10b) [0x7fb9d36bbd8b] 4: (abort()+0x123) [0x7fb9d36a5549] 5: (()+0x22421) [0x7fb9d36a5421] 6: (()+0x31262) [0x7fb9d36b4262] 7: (()+0x4f3296) [0x7fb9decd4296] 8: (()+0x281144) [0x7fb9dea62144] 9: (()+0x280f2c) [0x7fb9dea61f2c] 10: (()+0x289573) [0x7fb9dea6a573] 11: (()+0x28936d) [0x7fb9dea6a36d] 12: (()+0x28dce4) [0x7fb9dea6ece4] 13: (()+0xfecdf) [0x7fb9de8dfcdf] 14: (()+0x284e19) [0x7fb9dea65e19] 15: (()+0x284c47) [0x7fb9dea65c47] 16: (()+0x284fe6) [0x7fb9dea65fe6] 17: (()+0xdcb52) [0x7fb9de64eb52] 18: (()+0x72acf) [0x7fb9de5e4acf] 19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367] 20: (()+0xeee8a) [0x7fb9de660e8a] 21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0] 22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e] 23: (()+0x7fab) [0x7fb9d3c3dfab] 24: (clone()+0x3f) [0x7fb9d377e66f] 2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) ** in thread 7fb9bb7fe700 thread_name:fn-radosclient ceph version Development (no_version) octopus (dev) 1: (()+0x76c282) [0x557a6fea9282] 2: (()+0x12810) [0x7fb9d3c48810] 3: (gsignal()+0x10b) [0x7fb9d36bbd8b] 4: (abort()+0x123) [0x7fb9d36a5549] 5: (()+0x22421) [0x7fb9d36a5421] 6: (()+0x31262) [0x7fb9d36b4262] 7: (()+0x4f3296) [0x7fb9decd4296] 8: (()+0x281144) [0x7fb9dea62144] 9: (()+0x280f2c) [0x7fb9dea61f2c] 10: (()+0x289573) [0x7fb9dea6a573] 11: (()+0x28936d) [0x7fb9dea6a36d] 12: (()+0x28dce4) [0x7fb9dea6ece4] 13: (()+0xfecdf) [0x7fb9de8dfcdf] 14: (()+0x284e19) [0x7fb9dea65e19] 15: (()+0x284c47) [0x7fb9dea65c47] 16: (()+0x284fe6) [0x7fb9dea65fe6] 17: (()+0xdcb52) [0x7fb9de64eb52] 18: (()+0x72acf) [0x7fb9de5e4acf] 19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367] 20: (()+0xeee8a) [0x7fb9de660e8a] 21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0] 22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e] 23: (()+0x7fab) [0x7fb9d3c3dfab] 24: (clone()+0x3f) [0x7fb9d377e66f] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -336> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command assert hook 0x557a7074d4d0 -335> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command abort hook 0x557a7074d4d0 -334> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_dump hook 0x557a7074d4d0 -333> 2019-09-19T20:34:41.236+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 1 hook 0x557a7074d4d0 -332> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf dump hook 0x557a7074d4d0 -331> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perfcounters_schema hook 0x557a7074d4d0 -330> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram dump hook 0x557a7074d4d0 -329> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command 2 hook 0x557a7074d4d0 -328> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf schema hook 0x557a7074d4d0 -327> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf histogram schema hook 0x557a7074d4d0 -326> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command perf reset hook 0x557a7074d4d0 -325> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config show hook 0x557a7074d4d0 -324> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config help hook 0x557a7074d4d0 -323> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config set hook 0x557a7074d4d0 -322> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config unset hook 0x557a7074d4d0 -321> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config get hook 0x557a7074d4d0 -320> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff hook 0x557a7074d4d0 -319> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command config diff get hook 0x557a7074d4d0 -318> 2019-09-19T20:34:41.240+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command log flush hook 0x557a7074d4d0 -317> 2019-09-19T20:3d 21 -164> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 22 -163> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting msgr at -162> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: starting objecter -161> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 26 -160> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 28 -159> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 lockdep using id 29 -158> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 asok(0x557a706fc3c0) register_command objecter_requests hook 0x557a707fd5b0 -157> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: setting wanted keys -156> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 1 librados: calling monclient init -155> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 10 monclient: init -154> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx -153> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx -152> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding auth protocol: cephx -151> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -150> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -149> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -148> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -147> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -146> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -145> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -144> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -143> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -142> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -141> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: crc -140> 2019-09-19T20:34:41.416+0000 7fb9d35dcec0 5 AuthRegistry(0x557a70769788) adding con mode: secure -139> 2019-09-19T20:34:41.420+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -138> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 2 auth: KeyRing::load: loaded key file /ceph/build/keyring -137> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 1 lockdep using id 30 -136> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _reopen_session rank -1 -135> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient: _add_conns ranks=[2,0,1] -134> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-c con 0x557a707ff4e0 addr [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] -133> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-a con 0x557a707fdfd0 addr [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] -132> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): picked mon.noname-b con 0x557a707fe420 addr [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] -131> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -130> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -129> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): start opening mon connection -128> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): _renew_subs -127> 2019-09-19T20:34:41.424+0000 7fb9d35dcec0 10 monclient(hunting): authenticate will time out at 2019-09-19T20:39:41.428179+0000 -126> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request con 0x557a707ff4e0 auth_method 0 -125> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -124> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): _init_auth method 2 -123> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request con 0x557a707fe420 auth_method 0 -122> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -121> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): _init_auth method 2 -120> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request con 0x557a707fdfd0 auth_method 0 -119> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] -118> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): _init_auth method 2 -117> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload 9 -116> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -115> 2019-09-19T20:34:41.424+0000 7fb9d120f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -114> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload 9 -113> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -112> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -111> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload 9 -110> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -109> 2019-09-19T20:34:41.424+0000 7fb9c3fff700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -108> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient(hunting): handle_auth_done global_id 5915 payload 995 -107> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _finish_hunting 0 -106> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 1 monclient: found mon.noname-c -105> 2019-09-19T20:34:41.424+0000 7fb9d0a0e700 10 monclient: _send_mon_message to mon.noname-c at v2:192.168.1.102:40580/0 -104> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 -103> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) -102> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -101> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: _finish_auth 0 -100> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 5 monclient: authenticate success, global_id 5915 -99> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_config config(3 keys) v1 -98> 2019-09-19T20:34:41.428+0000 7fb9c17fa700 4 set_mon_vals no callback set -97> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: handle_monmap mon_map magic: 0 v1 -96> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: got monmap 1 from mon.c (according to old e1) -95> 2019-09-19T20:34:41.428+0000 7fb9c2ffd700 10 monclient: dump: epoch 1 fsid 728487e6-dd4f-425f-afd4-a4b79de7eefb last_changed 2019-09-19T14:43:30.372552+0000 created 2019-09-19T14:43:30.372552+0000 min_mon_release 15 (octopus) 0: [v2:192.168.1.102:40576/0,v1:192.168.1.102:40577/0] mon.a 1: [v2:192.168.1.102:40578/0,v1:192.168.1.102:40579/0] mon.b 2: [v2:192.168.1.102:40580/0,v1:192.168.1.102:40581/0] mon.c -94> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs -93> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0 -92> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _renew_subs -91> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 10 monclient: _send_mon_message to mon.c at v2:192.168.1.102:40580/0 -90> 2019-09-19T20:34:41.428+0000 7fb9d35dcec0 1 librados: init done -89> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Got map version 4 -88> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978] -87> 2019-09-19T20:34:41.432+0000 7fb9c2ffd700 4 mgrc reconnect Starting new session with [v2:192.168.1.102:6800/978,v1:192.168.1.102:6801/978] -86> 2019-09-19T20:34:41.432+0000 7fb9c3fff700 10 monclient: get_auth_request con 0x7fb9b0013bd0 auth_method 0 -85> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 31 -84> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1 -83> 2019-09-19T20:34:41.432+0000 7fb9d35dcec0 1 lockdep using id 32 -82> 2019-09-19T20:34:41.432+0000 7fb9d120f700 10 monclient: get_auth_request con 0x557a70818b80 auth_method 0 -81> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 5 librbd::api::Namespace: exists: name=ns1 -80> 2019-09-19T20:34:41.436+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32 -79> 2019-09-19T20:34:41.440+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32 -78> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep reusing last freed id 32 -77> 2019-09-19T20:34:41.456+0000 7fb9d35dcec0 1 lockdep using id 33 -76> 2019-09-19T20:34:41.456+0000 7fb9d0a0e700 10 monclient: get_auth_request con 0x557a7085e1c0 auth_method 0 -75> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep reusing last freed id 33 -74> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 34 -73> 2019-09-19T20:34:41.460+0000 7fb9d35dcec0 1 lockdep using id 35 -72> 2019-09-19T20:34:41.460+0000 7fb9baffd700 1 lockdep using id 36 -71> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 37 -70> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 38 -69> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 39 -68> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 40 -67> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 41 -66> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 42 -65> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 43 -64> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 44 -63> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 45 -62> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 46 -61> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 ImageRequestWQ: ictx=0x557a708611d0 -60> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 47 -59> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 48 -58> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 49 -57> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 50 -56> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 51 -55> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 52 -54> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 53 -53> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 54 -52> 2019-09-19T20:34:41.472+0000 7fb9d35dcec0 1 lockdep using id 55 -51> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img1 hook 0x7fb998005c60 -50> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img1 hook 0x7fb998005c60 -49> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 56 -48> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 57 -47> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 58 -46> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 59 -45> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 60 -44> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 61 -43> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 62 -42> 2019-09-19T20:34:41.492+0000 7fb9bb7fe700 1 lockdep using id 63 -41> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 64 -40> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 lockdep using id 65 -39> 2019-09-19T20:34:41.516+0000 7fb9bb7fe700 1 librbd::object_map::RefreshRequest: object map larger than current object count: 256 != 0 -38> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 66 -37> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c0028f0 init: -36> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x557a708a5920 register_object_dispatch: object_dispatch_layer=1 -35> 2019-09-19T20:34:41.516+0000 7fb9baffd700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 block_writes: 0x557a708611d0, num=1 -34> 2019-09-19T20:34:41.516+0000 7fb9baffd700 1 lockdep using id 67 -33> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x557a706ee0f0 unblock_writes: 0x557a708611d0, num=0 -32> 2019-09-19T20:34:41.520+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: read_rbd_info: -31> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: handle_read_rbd_info: r=0 -30> 2019-09-19T20:34:41.524+0000 7fb9bb7fe700 5 librbd::image::ValidatePoolRequest: finish: r=0 -29> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep reusing last freed id 64 -28> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 68 -27> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 69 -26> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 70 -25> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 71 -24> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 72 -23> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 73 -22> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 74 -21> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 ImageRequestWQ: ictx=0x7fb9980136f0 -20> 2019-09-19T20:34:41.872+0000 7fb9bb7fe700 1 lockdep using id 75 -19> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache flush rbd/img2 hook 0x7fb9980526f0 -18> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 5 asok(0x557a706fc3c0) register_command rbd cache invalidate rbd/img2 hook 0x7fb9980526f0 -17> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 76 -16> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 77 -15> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 78 -14> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 79 -13> 2019-09-19T20:34:41.896+0000 7fb9bb7fe700 1 lockdep using id 80 -12> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 1 lockdep using id 81 -11> 2019-09-19T20:34:41.916+0000 7fb9bb7fe700 5 librbd::io::ImageRequestWQ: 0x7fb98c005af0 block_writes: 0x7fb9980136f0, num=1 -10> 2019-09-19T20:34:41.916+0000 7fb9baffd700 1 lockdep using id 82 -9> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::cache::WriteAroundObjectDispatch: 0x7fb98c004bf0 init: -8> 2019-09-19T20:34:41.916+0000 7fb9baffd700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=1 -7> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 1 lockdep using id 83 -6> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 SimpleSchedulerObjectDispatch: ictx=0x7fb9980136f0 -5> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::SimpleSchedulerObjectDispatch: 0x7fb998062650 init: -4> 2019-09-19T20:34:41.972+0000 7fb9bb7fe700 5 librbd::io::ObjectDispatcher: 0x7fb998012560 register_object_dispatch: object_dispatch_layer=4 -3> 2019-09-19T20:34:41.972+0000 7fb9baffd700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 attach_parent: -2> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 handle_attach_parent: -1> 2019-09-19T20:34:42.012+0000 7fb9bb7fe700 5 librbd::image::AttachParentRequest: 0x7fb98c006350 finish: r=0 0> 2019-09-19T20:34:42.020+0000 7fb9bb7fe700 -1 *** Caught signal (Aborted) ** in thread 7fb9bb7fe700 thread_name:fn-radosclient ceph version Development (no_version) octopus (dev) 1: (()+0x76c282) [0x557a6fea9282] 2: (()+0x12810) [0x7fb9d3c48810] 3: (gsignal()+0x10b) [0x7fb9d36bbd8b] 4: (abort()+0x123) [0x7fb9d36a5549] 5: (()+0x22421) [0x7fb9d36a5421] 6: (()+0x31262) [0x7fb9d36b4262] 7: (()+0x4f3296) [0x7fb9decd4296] 8: (()+0x281144) [0x7fb9dea62144] 9: (()+0x280f2c) [0x7fb9dea61f2c] 10: (()+0x289573) [0x7fb9dea6a573] 11: (()+0x28936d) [0x7fb9dea6a36d] 12: (()+0x28dce4) [0x7fb9dea6ece4] 13: (()+0xfecdf) [0x7fb9de8dfcdf] 14: (()+0x284e19) [0x7fb9dea65e19] 15: (()+0x284c47) [0x7fb9dea65c47] 16: (()+0x284fe6) [0x7fb9dea65fe6] 17: (()+0xdcb52) [0x7fb9de64eb52] 18: (()+0x72acf) [0x7fb9de5e4acf] 19: (Finisher::finisher_thread_entry()+0x39d) [0x7fb9d5420367] 20: (()+0xeee8a) [0x7fb9de660e8a] 21: (Thread::entry_wrapper()+0x78) [0x7fb9d548daa0] 22: (Thread::_entry_func(void*)+0x18) [0x7fb9d548da1e] 23: (()+0x7fab) [0x7fb9d3c3dfab] 24: (clone()+0x3f) [0x7fb9d377e66f] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 immutable_obj_cache 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 0 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 1 reserver 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 rgw_sync 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 compressor 1/ 5 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace 1/ 5 prioritycache 0/ 5 test -2/-2 (syslog threshold) 99/99 (stderr threshold) max_recent 500 max_new 1000 log_file /ceph/build/out/2019-09-19T20:34:42.023233Z_d059c1f4-95d6-4a3d-a086-a418d950a039/log --- end dump of recent events --- Aborted (core dumped)