--- begin dump of recent events --- -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command abort hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command perfcounters_dump hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command 1 hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command perf dump hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command perfcounters_schema hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command perf histogram dump hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command 2 hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command perf schema hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command perf histogram schema hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command perf reset hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command config show hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command config help hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command config set hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command config unset hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command config get hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command config diff hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command config diff get hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command log flush hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command log dump hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command log reopen hook 0x55e8482a4460 -469> 2019-07-17 17:35:12.878 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command dump_mempools hook 0x55e8482dc2c8 -469> 2019-07-17 17:35:12.889 7ff06979bd80 10 monclient: get_monmap_and_config -469> 2019-07-17 17:35:12.940 7ff06979bd80 10 monclient: build_initial_monmap -469> 2019-07-17 17:35:12.942 7ff059482700 2 Event(0x55e8482b7c80 nevent=5000 time_id=1).set_owner idx=0 owner=140670266779392 -469> 2019-07-17 17:35:12.942 7ff059482700 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).create_file_event create event started fd=5 mask=1 original mask is 0 -469> 2019-07-17 17:35:12.942 7ff058c81700 2 Event(0x55e848600e80 nevent=5000 time_id=1).set_owner idx=1 owner=140670258386688 -469> 2019-07-17 17:35:12.942 7ff059482700 20 EpollDriver.add_event add event fd=5 cur_mask=0 add_mask=1 to 4 -469> 2019-07-17 17:35:12.942 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=1).create_file_event create event started fd=8 mask=1 original mask is 0 -469> 2019-07-17 17:35:12.942 7ff058c81700 20 EpollDriver.add_event add event fd=8 cur_mask=0 add_mask=1 to 7 -469> 2019-07-17 17:35:12.942 7ff059482700 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).create_file_event create event end fd=5 mask=1 original mask is 1 -469> 2019-07-17 17:35:12.942 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=1).create_file_event create event end fd=8 mask=1 original mask is 1 -469> 2019-07-17 17:35:12.942 7ff059482700 10 stack operator() starting -469> 2019-07-17 17:35:12.942 7ff058c81700 10 stack operator() starting -469> 2019-07-17 17:35:12.942 7ff058480700 2 Event(0x55e848601a80 nevent=5000 time_id=1).set_owner idx=2 owner=140670249993984 -469> 2019-07-17 17:35:12.942 7ff058480700 20 Event(0x55e848601a80 nevent=5000 time_id=1).create_file_event create event started fd=11 mask=1 original mask is 0 -469> 2019-07-17 17:35:12.942 7ff058480700 20 EpollDriver.add_event add event fd=11 cur_mask=0 add_mask=1 to 10 -469> 2019-07-17 17:35:12.942 7ff058480700 20 Event(0x55e848601a80 nevent=5000 time_id=1).create_file_event create event end fd=11 mask=1 original mask is 1 -469> 2019-07-17 17:35:12.942 7ff058480700 10 stack operator() starting -469> 2019-07-17 17:35:12.942 7ff06979bd80 10 -- - ready - -469> 2019-07-17 17:35:12.942 7ff06979bd80 1 Processor -- start -469> 2019-07-17 17:35:12.943 7ff06979bd80 1 -- - start start -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 monclient: init -469> 2019-07-17 17:35:12.943 7ff06979bd80 5 adding auth protocol: cephx -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 monclient: auth_supported 2 method cephx -469> 2019-07-17 17:35:12.943 7ff06979bd80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-6/keyring -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 monclient: _reopen_session rank -1 -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 -- - create_connect 129.13.170.240:6789/0, creating connection and registering -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_NONE pgs=0 cs=0 l=0)._connect csq=0 -469> 2019-07-17 17:35:12.943 7ff06979bd80 20 Event(0x55e848600e80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 -- - get_connection mon.0 129.13.170.240:6789/0 new 0x55e848308c00 -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 monclient(hunting): picked mon.noname-a con 0x55e848308c00 addr 129.13.170.240:6789/0 -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING pgs=0 cs=0 l=0).send_keepalive -469> 2019-07-17 17:35:12.943 7ff06979bd80 20 Event(0x55e848600e80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.943 7ff06979bd80 1 -- - --> 129.13.170.240:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e84829f200 con 0 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING -469> 2019-07-17 17:35:12.943 7ff06979bd80 15 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING pgs=0 cs=0 l=0).send_message inline write is denied, reschedule m=0x55e84829f200 -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 monclient(hunting): _renew_subs -469> 2019-07-17 17:35:12.943 7ff06979bd80 10 monclient(hunting): authenticate will time out at 2019-07-17 17:40:12.944214 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=1).create_file_event create event started fd=13 mask=1 original mask is 0 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 EpollDriver.add_event add event fd=13 cur_mask=0 add_mask=1 to 7 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=1).create_file_event create event end fd=13 mask=1 original mask is 1 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING -469> 2019-07-17 17:35:12.943 7ff058c81700 20 EpollDriver.del_event del event fd=13 cur_mask=1 delmask=2 to 7 -469> 2019-07-17 17:35:12.943 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=0)._process_connection connect successfully, ready to send banner -469> 2019-07-17 17:35:12.943 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=0)._try_send sent bytes 9 remaining bytes 0 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=1).create_file_event create event started fd=13 mask=2 original mask is 1 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 EpollDriver.add_event add event fd=13 cur_mask=1 add_mask=2 to 7 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=1).create_file_event create event end fd=13 mask=2 original mask is 3 -469> 2019-07-17 17:35:12.943 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect write banner done: 129.13.170.240:6789/0 -469> 2019-07-17 17:35:12.943 7ff058c81700 20 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_RE -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_write -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._try_send sent bytes 0 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_write -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._try_send sent bytes 0 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_write -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._try_send sent bytes 0 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect read peer addr 129.13.170.240:6789/0 on socket 13 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- - >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._process_connection connect peer addr for me is 129.13.170.240:54550/0 -469> 2019-07-17 17:35:12.944 7ff058c81700 1 -- 129.13.170.240:0/2259386048 learned_addr learned my addr 129.13.170.240:0/2259386048 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0)._try_send sent bytes 136 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0)._process_connection connect sent my addr 129.13.170.240:0/2259386048 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_WAIT_BANNER_AND_IDENTIFY -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0)._process_connection connect sending gseq=1 cseq=0 proto=15 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0)._try_send sent bytes 33 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=0)._process_connection connect wrote (self +) cseq, waiting for reply -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_SEND_CONNECT_MSG -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=0).handle_write -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=0)._try_send sent bytes 0 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_WAIT_CONNECT_REPLY -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY pgs=0 cs=0 l=0)._process_connection connect got reply tag 13 connect_seq 1 global_seq 144 proto 15 flags 1 features 4611087854031667195 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_WAIT_CONNECT_REPLY -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH -469> 2019-07-17 17:35:12.944 7ff058c81700 2 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0)._process_connection got newly_acked_seq 0 vs out_seq 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0).discard_requeued_up_to 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0)._try_send sent bytes 8 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=0)._process_connection send in_seq done -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_CONNECTING_READY pgs=0 cs=0 l=0).process prev state is STATE_CONNECTING_WAIT_ACK_SEQ -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1)._process_connection connect success 1, lossy = 1, features 4611087854031667195 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_CONNECTING_READY -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).handle_write -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1)._append_keepalive_or_ack -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message m auth(proto 0 26 bytes epoch 0) v1 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message encoding features 4611087854031667195 0x55e84829f200 auth(proto 0 26 bytes epoch 0) v1 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message no session security -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending message type=17 src client.? front=56 data=0 off 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 1 0x55e84829f200 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1)._try_send sent bytes 140 remaining bytes 0 -469> 2019-07-17 17:35:12.944 7ff058c81700 20 EpollDriver.del_event del event fd=13 cur_mask=3 delmask=2 to 7 -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 0x55e84829f200 done. -469> 2019-07-17 17:35:12.944 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).handle_write -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_KEEPALIVE2_ACK pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_KEEPALIVE2_ACK pgs=144 cs=1 l=1).process got KEEPALIVE_ACK -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN_KEEPALIVE2_ACK -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.944 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process begin MSG -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got MSG header -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got envelope type=4 src mon.0 front=187 data=0 off 0 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_HEADER -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_BYTES pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_MESSAGE -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_BYTES -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process got front 187 -469> 2019-07-17 17:35:12.945 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process aborted = 0 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process got 187 + 0 + 0 byte message -469> 2019-07-17 17:35:12.945 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process no session security set -469> 2019-07-17 17:35:12.945 7ff058c81700 5 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1). rx mon.0 seq 1 0x55e84829f200 mon_map magic: 0 v1 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 queue 0x55e84829f200 prio 196 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_READ_FRONT -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process begin MSG -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got MSG header -469> 2019-07-17 17:35:12.945 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 <== mon.0 129.13.170.240:6789/0 1 ==== mon_map magic: 0 v1 ==== 187+0+0 (1830997952 0 0) 0x55e84829f200 con 0x55e848308c00 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got envelope type=18 src mon.0 front=33 data=0 off 0 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_HEADER -469> 2019-07-17 17:35:12.945 7ff057c7f700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_BYTES pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_MESSAGE -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_BYTES -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE -469> 2019-07-17 17:35:12.945 7ff057c7f700 10 monclient(hunting): got monmap 3, mon.noname-a is now rank -1 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process got front 33 -469> 2019-07-17 17:35:12.945 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process aborted = 0 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process got 33 + 0 + 0 byte message -469> 2019-07-17 17:35:12.945 7ff057c7f700 10 monclient(hunting): dump: epoch 3 fsid a9493143-3e4e-450e-b3b8-28508d48d412 last_changed 2019-01-22 16:57:46.780494 created 2018-05-28 22:41:11.854539 0: 129.13.170.240:6789/0 mon.mon01 -469> 2019-07-17 17:35:12.945 7ff057c7f700 10 -- 129.13.170.240:0/2259386048 dispatch_throttle_release 187 to dispatch throttler 220/104857600 -469> 2019-07-17 17:35:12.945 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process no session security set -469> 2019-07-17 17:35:12.945 7ff057c7f700 20 -- 129.13.170.240:0/2259386048 done calling dispatch on 0x55e84829f200 -469> 2019-07-17 17:35:12.945 7ff058c81700 5 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1). rx mon.0 seq 2 0x55e84829fd40 auth_reply(proto 2 0 (0) Success) v1 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 queue 0x55e84829fd40 prio 196 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_READ_FRONT -469> 2019-07-17 17:35:12.945 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 <== mon.0 129.13.170.240:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (505910399 0 0) 0x55e84829fd40 con 0x55e848308c00 -469> 2019-07-17 17:35:12.945 7ff057c7f700 10 monclient(hunting): my global_id is 4204239 -469> 2019-07-17 17:35:12.945 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 --> 129.13.170.240:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x55e84829f200 con 0 -469> 2019-07-17 17:35:12.945 7ff057c7f700 15 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).send_message inline write is denied, reschedule m=0x55e84829f200 -469> 2019-07-17 17:35:12.945 7ff057c7f700 20 Event(0x55e848600e80 nevent=5000 time_id=2).wakeup -469> 2019-07-17 17:35:12.945 7ff057c7f700 10 -- 129.13.170.240:0/2259386048 dispatch_throttle_release 33 to dispatch throttler 33/104857600 -469> 2019-07-17 17:35:12.945 7ff057c7f700 20 -- 129.13.170.240:0/2259386048 done calling dispatch on 0x55e84829fd40 -469> 2019-07-17 17:35:12.945 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).handle_write -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message m auth(proto 2 32 bytes epoch 0) v1 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message encoding features 4611087854031667195 0x55e84829f200 auth(proto 2 32 bytes epoch 0) v1 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message no session security -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending message type=17 src client.? front=62 data=0 off 0 -469> 2019-07-17 17:35:12.945 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 2 0x55e84829f200 -469> 2019-07-17 17:35:12.945 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1)._try_send sent bytes 137 remaining bytes 0 -469> 2019-07-17 17:35:12.945 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 0x55e84829f200 done. -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process begin MSG -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got MSG header -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got envelope type=18 src mon.0 front=206 data=0 off 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_HEADER -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_BYTES pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_MESSAGE -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_BYTES -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process got front 206 -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process aborted = 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process got 206 + 0 + 0 byte message -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process no session security set -469> 2019-07-17 17:35:12.946 7ff058c81700 5 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1). rx mon.0 seq 3 0x55e84829f200 auth_reply(proto 2 0 (0) Success) v1 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 queue 0x55e84829f200 prio 196 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_READ_FRONT -469> 2019-07-17 17:35:12.946 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 <== mon.0 129.13.170.240:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2329846900 0 0) 0x55e84829f200 con 0x55e848308c00 -469> 2019-07-17 17:35:12.946 7ff057c7f700 1 monclient: found mon.mon01 -469> 2019-07-17 17:35:12.946 7ff057c7f700 10 monclient: _send_mon_message to mon.mon01 at 129.13.170.240:6789/0 -469> 2019-07-17 17:35:12.946 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 --> 129.13.170.240:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8482b6e00 con 0 -469> 2019-07-17 17:35:12.946 7ff057c7f700 15 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).send_message inline write is denied, reschedule m=0x55e8482b6e00 -469> 2019-07-17 17:35:12.946 7ff057c7f700 20 Event(0x55e848600e80 nevent=5000 time_id=2).wakeup -469> 2019-07-17 17:35:12.946 7ff057c7f700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-07-17 17:34:42.947089) -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).handle_write -469> 2019-07-17 17:35:12.946 7ff057c7f700 10 monclient: _send_mon_message to mon.mon01 at 129.13.170.240:6789/0 -469> 2019-07-17 17:35:12.946 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 --> 129.13.170.240:6789/0 -- auth(proto 2 2 bytes epoch 0) v1 -- 0x55e84829fd40 con 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message m mon_subscribe({config=0+,monmap=0+}) v3 -469> 2019-07-17 17:35:12.946 7ff057c7f700 15 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).send_message inline write is denied, reschedule m=0x55e84829fd40 -469> 2019-07-17 17:35:12.946 7ff057c7f700 20 Event(0x55e848600e80 nevent=5000 time_id=2).wakeup -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message encoding features 4611087854031667195 0x55e8482b6e00 mon_subscribe({config=0+,monmap=0+}) v3 -469> 2019-07-17 17:35:12.946 7ff057c7f700 10 -- 129.13.170.240:0/2259386048 dispatch_throttle_release 206 to dispatch throttler 206/104857600 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message no session security -469> 2019-07-17 17:35:12.946 7ff057c7f700 20 -- 129.13.170.240:0/2259386048 done calling dispatch on 0x55e84829f200 -469> 2019-07-17 17:35:12.946 7ff06979bd80 5 monclient: authenticate success, global_id 4204239 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending message type=15 src client.? front=54 data=0 off 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 3 0x55e8482b6e00 -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1)._try_send sent bytes 129 remaining bytes 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=2).create_file_event create event started fd=13 mask=2 original mask is 1 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 EpollDriver.add_event add event fd=13 cur_mask=1 add_mask=2 to 7 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 Event(0x55e848600e80 nevent=5000 time_id=2).create_file_event create event end fd=13 mask=2 original mask is 3 -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 0x55e8482b6e00 done. -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message m auth(proto 2 2 bytes epoch 0) v1 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).prepare_send_message encoding features 4611087854031667195 0x55e84829fd40 auth(proto 2 2 bytes epoch 0) v1 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message no session security -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending message type=17 src client.? front=32 data=0 off 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 4 0x55e84829fd40 -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1)._try_send sent bytes 107 remaining bytes 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 EpollDriver.del_event del event fd=13 cur_mask=3 delmask=2 to 7 -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).write_message sending 0x55e84829fd40 done. -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).handle_write -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process begin MSG -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got MSG header -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got envelope type=62 src mon.0 front=4 data=0 off 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_HEADER -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_BYTES pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_MESSAGE -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_BYTES -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process got front 4 -469> 2019-07-17 17:35:12.946 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process aborted = 0 -469> 2019-07-17 17:35:12.946 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process got 4 + 0 + 0 byte message -469> 2019-07-17 17:35:12.947 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process no session security set -469> 2019-07-17 17:35:12.947 7ff058c81700 5 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1). rx mon.0 seq 4 0x55e8486d8000 config(0 keys) v1 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 queue 0x55e8486d8000 prio 196 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_READ_FRONT -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.947 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 <== mon.0 129.13.170.240:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x55e8486d8000 con 0x55e848308c00 -469> 2019-07-17 17:35:12.947 7ff057c7f700 10 monclient: handle_config config(0 keys) v1 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process begin MSG -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got MSG header -469> 2019-07-17 17:35:12.947 7ff057c7f700 10 -- 129.13.170.240:0/2259386048 dispatch_throttle_release 4 to dispatch throttler 4/104857600 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got envelope type=4 src mon.0 front=187 data=0 off 0 -469> 2019-07-17 17:35:12.947 7ff06979bd80 10 monclient: get_monmap_and_config success -469> 2019-07-17 17:35:12.947 7ff057c7f700 20 -- 129.13.170.240:0/2259386048 done calling dispatch on 0x55e8486d8000 -469> 2019-07-17 17:35:12.947 7ff06979bd80 10 monclient: shutdown -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_HEADER -469> 2019-07-17 17:35:12.947 7ff06979bd80 1 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_BYTES pgs=144 cs=1 l=1).mark_down -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_BYTES pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_MESSAGE -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_BYTES -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE -469> 2019-07-17 17:35:12.947 7ff05647c700 4 set_mon_vals no callback set -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process got front 187 -469> 2019-07-17 17:35:12.947 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process aborted = 0 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process got 187 + 0 + 0 byte message -469> 2019-07-17 17:35:12.947 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process no session security set -469> 2019-07-17 17:35:12.947 7ff058c81700 5 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1). rx mon.0 seq 5 0x55e84829fd40 mon_map magic: 0 v1 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 queue 0x55e84829fd40 prio 196 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_READ_FRONT -469> 2019-07-17 17:35:12.947 7ff057c7f700 1 -- 129.13.170.240:0/2259386048 <== mon.0 129.13.170.240:6789/0 5 ==== mon_map magic: 0 v1 ==== 187+0+0 (1830997952 0 0) 0x55e84829fd40 con 0x55e848308c00 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process prev state is STATE_OPEN -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process begin MSG -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got MSG header -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_HEADER pgs=144 cs=1 l=1).process got envelope type=18 src mon.0 front=194 data=0 off 0 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_HEADER -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_BYTES pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_MESSAGE -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_BYTES -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_THROTTLE_DISPATCH_QUEUE -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=144 cs=1 l=1).process got front 194 -469> 2019-07-17 17:35:12.947 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process aborted = 0 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process got 194 + 0 + 0 byte message -469> 2019-07-17 17:35:12.947 7ff058c81700 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1).process no session security set -469> 2019-07-17 17:35:12.947 7ff058c81700 5 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=144 cs=1 l=1). rx mon.0 seq 6 0x55e8486e6000 auth_reply(proto 2 0 (0) Success) v1 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 queue 0x55e8486e6000 prio 196 -469> 2019-07-17 17:35:12.947 7ff058c81700 20 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).process prev state is STATE_OPEN_MESSAGE_READ_FRONT -469> 2019-07-17 17:35:12.947 7ff06979bd80 2 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1)._stop -469> 2019-07-17 17:35:12.947 7ff06979bd80 10 -- 129.13.170.240:0/2259386048 dispatch_throttle_release 194 to dispatch throttler 381/104857600 -469> 2019-07-17 17:35:12.947 7ff06979bd80 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:6789/0 conn(0x55e848308c00 :-1 s=STATE_OPEN pgs=144 cs=1 l=1).discard_out_queue started -469> 2019-07-17 17:35:12.947 7ff06979bd80 20 Event(0x55e848600e80 nevent=5000 time_id=2).wakeup -469> 2019-07-17 17:35:12.947 7ff058c81700 20 EpollDriver.del_event del event fd=13 cur_mask=1 delmask=3 to 7 -469> 2019-07-17 17:35:12.947 7ff057c7f700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 -469> 2019-07-17 17:35:12.947 7ff057c7f700 10 -- 129.13.170.240:0/2259386048 dispatch_throttle_release 187 to dispatch throttler 187/104857600 -469> 2019-07-17 17:35:12.947 7ff057c7f700 20 -- 129.13.170.240:0/2259386048 done calling dispatch on 0x55e84829fd40 -469> 2019-07-17 17:35:12.949 7ff06979bd80 10 -- 129.13.170.240:0/2259386048 shutdown 129.13.170.240:0/2259386048 -469> 2019-07-17 17:35:12.949 7ff06979bd80 10 Processor -- stop -469> 2019-07-17 17:35:12.949 7ff06979bd80 1 -- 129.13.170.240:0/2259386048 shutdown_connections -469> 2019-07-17 17:35:12.949 7ff06979bd80 5 -- 129.13.170.240:0/2259386048 shutdown_connections mark down 129.13.170.240:6789/0 0x55e848308c00 -469> 2019-07-17 17:35:12.949 7ff06979bd80 5 -- 129.13.170.240:0/2259386048 shutdown_connections delete 0x55e848308c00 -469> 2019-07-17 17:35:12.949 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.949 7ff06979bd80 20 Event(0x55e848600e80 nevent=5000 time_id=2).wakeup -469> 2019-07-17 17:35:12.949 7ff06979bd80 20 Event(0x55e848601a80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.949 7ff06979bd80 10 -- 129.13.170.240:0/2259386048 wait: waiting for dispatch queue -469> 2019-07-17 17:35:12.949 7ff06979bd80 10 -- 129.13.170.240:0/2259386048 wait: dispatch queue is stopped -469> 2019-07-17 17:35:12.949 7ff06979bd80 1 -- 129.13.170.240:0/2259386048 shutdown_connections -469> 2019-07-17 17:35:12.949 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.949 7ff06979bd80 20 Event(0x55e848600e80 nevent=5000 time_id=2).wakeup -469> 2019-07-17 17:35:12.949 7ff06979bd80 20 Event(0x55e848601a80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.949 7ff06979bd80 10 -- 129.13.170.240:0/2259386048 wait: done. -469> 2019-07-17 17:35:12.949 7ff06979bd80 1 -- 129.13.170.240:0/2259386048 wait complete. -469> 2019-07-17 17:35:12.949 7ff06979bd80 1 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:0/2259386048 conn(0x55e848308000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down -469> 2019-07-17 17:35:12.949 7ff06979bd80 2 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:0/2259386048 conn(0x55e848308000 :-1 s=STATE_NONE pgs=0 cs=0 l=0)._stop -469> 2019-07-17 17:35:12.949 7ff06979bd80 10 -- 129.13.170.240:0/2259386048 >> 129.13.170.240:0/2259386048 conn(0x55e848308000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).discard_out_queue started -469> 2019-07-17 17:35:12.949 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.951 7ff06979bd80 0 set uid:gid to 167:167 (ceph:ceph) -469> 2019-07-17 17:35:12.951 7ff06979bd80 0 ceph version 13.2.6 (7b695f835b03642f85998b2ae7b6dd093d9fbce4) mimic (stable), process ceph-osd, pid 29772 -469> 2019-07-17 17:35:12.951 7ff06979bd80 0 pidfile_write: ignore empty --pid-file -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 asok(0x55e8482ce5a0) init /var/run/ceph/ceph-osd.6.asok -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 asok(0x55e8482ce5a0) bind_and_listen /var/run/ceph/ceph-osd.6.asok -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command 0 hook 0x55e8482a3490 -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command version hook 0x55e8482a3490 -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command git_version hook 0x55e8482a3490 -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command help hook 0x55e8482a4500 -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command get_command_descriptions hook 0x55e8482a4570 -469> 2019-07-17 17:35:12.988 7ff05747e700 5 asok(0x55e8482ce5a0) entry start -469> 2019-07-17 17:35:12.988 7ff06979bd80 5 object store type is bluestore -469> 2019-07-17 17:35:12.988 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6) set_cache_shards 1 -469> 2019-07-17 17:35:12.988 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:12.989 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:12.989 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:12.989 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:12.989 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:12.990 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:12.990 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:12.990 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:12.991 7ff06979bd80 -1 Public network was set, but cluster network was not set -469> 2019-07-17 17:35:12.991 7ff06979bd80 -1 Using public network also for cluster network -469> 2019-07-17 17:35:12.993 7ff06979bd80 10 -- - bind bind 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.993 7ff06979bd80 10 Processor -- bind -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6800: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6801: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6802: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6803: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff06979bd80 10 Processor -- bind bound on random port 129.13.170.240:6804/0 -469> 2019-07-17 17:35:12.993 7ff06979bd80 10 Processor -- bind bound to 129.13.170.240:6804/0 -469> 2019-07-17 17:35:12.993 7ff06979bd80 1 -- 129.13.170.240:0/0 learned_addr learned my addr 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.993 7ff06979bd80 1 -- 129.13.170.240:6804/29772 _finish_bind bind my_inst.addr is 129.13.170.240:6804/29772 -469> 2019-07-17 17:35:12.993 7ff06979bd80 10 -- - bind bind 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.993 7ff06979bd80 10 Processor -- bind -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6800: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6801: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6802: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6803: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.993 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6804: (98) Address already in use -469> 2019-07-17 17:35:12.993 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6805: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 Processor -- bind bound on random port 129.13.170.240:6806/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 Processor -- bind bound to 129.13.170.240:6806/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 1 -- 129.13.170.240:0/0 learned_addr learned my addr 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 1 -- 129.13.170.240:6806/29772 _finish_bind bind my_inst.addr is 129.13.170.240:6806/29772 -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 -- - bind bind 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 Processor -- bind -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6800: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6801: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6802: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6803: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6804: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6805: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6806: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6807: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 Processor -- bind bound on random port 129.13.170.240:6808/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 Processor -- bind bound to 129.13.170.240:6808/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 1 -- 129.13.170.240:0/0 learned_addr learned my addr 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 1 -- 129.13.170.240:6808/29772 _finish_bind bind my_inst.addr is 129.13.170.240:6808/29772 -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 -- - bind bind 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.994 7ff06979bd80 10 Processor -- bind -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6800: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6801: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6802: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6803: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.994 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6804: (98) Address already in use -469> 2019-07-17 17:35:12.994 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.995 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6805: (98) Address already in use -469> 2019-07-17 17:35:12.995 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.995 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6806: (98) Address already in use -469> 2019-07-17 17:35:12.995 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.995 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6807: (98) Address already in use -469> 2019-07-17 17:35:12.995 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.995 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6808: (98) Address already in use -469> 2019-07-17 17:35:12.995 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.995 7ff059482700 10 PosixStack listen unable to bind to 129.13.170.240:6809: (98) Address already in use -469> 2019-07-17 17:35:12.995 7ff06979bd80 20 Event(0x55e8482b7c80 nevent=5000 time_id=1).wakeup -469> 2019-07-17 17:35:12.995 7ff06979bd80 10 Processor -- bind bound on random port 129.13.170.240:6810/0 -469> 2019-07-17 17:35:12.995 7ff06979bd80 10 Processor -- bind bound to 129.13.170.240:6810/0 -469> 2019-07-17 17:35:12.995 7ff06979bd80 1 -- 129.13.170.240:0/0 learned_addr learned my addr 129.13.170.240:0/0 -469> 2019-07-17 17:35:12.995 7ff06979bd80 1 -- 129.13.170.240:6810/29772 _finish_bind bind my_inst.addr is 129.13.170.240:6810/29772 -469> 2019-07-17 17:35:12.995 7ff06979bd80 10 monclient: build_initial_monmap -469> 2019-07-17 17:35:13.004 7ff06979bd80 0 load: jerasure load: lrc load: isa -469> 2019-07-17 17:35:13.004 7ff06979bd80 5 adding auth protocol: cephx -469> 2019-07-17 17:35:13.004 7ff06979bd80 5 adding auth protocol: cephx -469> 2019-07-17 17:35:13.004 7ff06979bd80 1 bdev create path /var/lib/ceph/osd/ceph-6/block type kernel -469> 2019-07-17 17:35:13.004 7ff06979bd80 1 bdev(0x55e848646000 /var/lib/ceph/osd/ceph-6/block) open path /var/lib/ceph/osd/ceph-6/block -469> 2019-07-17 17:35:13.005 7ff06979bd80 1 bdev(0x55e848646000 /var/lib/ceph/osd/ceph-6/block) open size 8001561821184 (0x74702400000, 7.3 TiB) block_size 4096 (4 KiB) rotational -469> 2019-07-17 17:35:13.005 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:13.005 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:13.005 7ff06979bd80 1 bluestore(/var/lib/ceph/osd/ceph-6) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2 -469> 2019-07-17 17:35:13.005 7ff06979bd80 1 bdev(0x55e848646000 /var/lib/ceph/osd/ceph-6/block) close -469> 2019-07-17 17:35:13.263 7ff06979bd80 5 asok(0x55e8482ce5a0) register_command objecter_requests hook 0x55e8482a47d0 -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 -- 129.13.170.240:6804/29772 start start -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 -- - start start -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 -- - start start -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 -- 129.13.170.240:6810/29772 start start -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 -- 129.13.170.240:6808/29772 start start -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 -- 129.13.170.240:6806/29772 start start -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 -- - start start -469> 2019-07-17 17:35:13.263 7ff06979bd80 2 osd.6 0 init /var/lib/ceph/osd/ceph-6 (looks like hdd) -469> 2019-07-17 17:35:13.263 7ff06979bd80 2 osd.6 0 journal /var/lib/ceph/osd/ceph-6/journal -469> 2019-07-17 17:35:13.263 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6) set_cache_shards 5 -469> 2019-07-17 17:35:13.263 7ff06979bd80 1 bluestore(/var/lib/ceph/osd/ceph-6) _mount path /var/lib/ceph/osd/ceph-6 -469> 2019-07-17 17:35:13.263 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:13.264 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:13.264 7ff06979bd80 1 bdev create path /var/lib/ceph/osd/ceph-6/block type kernel -469> 2019-07-17 17:35:13.264 7ff06979bd80 1 bdev(0x55e848646000 /var/lib/ceph/osd/ceph-6/block) open path /var/lib/ceph/osd/ceph-6/block -469> 2019-07-17 17:35:13.264 7ff06979bd80 1 bdev(0x55e848646000 /var/lib/ceph/osd/ceph-6/block) open size 8001561821184 (0x74702400000, 7.3 TiB) block_size 4096 (4 KiB) rotational -469> 2019-07-17 17:35:13.264 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:13.265 7ff06979bd80 1 bluestore(/var/lib/ceph/osd/ceph-6) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2 -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6) _open_db kv_backend = rocksdb -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label got bdev(osd_uuid 505e2a48-77c7-46c9-ba6a-f9c3eeaf4008, size 0x74702400000, btime 2018-05-28 22:46:07.391843, desc main, 8 meta) -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6) _open_db do_bluefs = 1 -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluestore(/var/lib/ceph/osd/ceph-6) _open_db initializing bluefs -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-6/block -469> 2019-07-17 17:35:13.265 7ff06979bd80 1 bdev create path /var/lib/ceph/osd/ceph-6/block type kernel -469> 2019-07-17 17:35:13.265 7ff06979bd80 1 bdev(0x55e848646a80 /var/lib/ceph/osd/ceph-6/block) open path /var/lib/ceph/osd/ceph-6/block -469> 2019-07-17 17:35:13.265 7ff06979bd80 1 bdev(0x55e848646a80 /var/lib/ceph/osd/ceph-6/block) open size 8001561821184 (0x74702400000, 7.3 TiB) block_size 4096 (4 KiB) rotational -469> 2019-07-17 17:35:13.265 7ff06979bd80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-6/block size 7.3 TiB -469> 2019-07-17 17:35:13.265 7ff06979bd80 1 bluefs mount -469> 2019-07-17 17:35:13.265 7ff06979bd80 10 bluefs _open_super -469> 2019-07-17 17:35:13.266 7ff06979bd80 10 bluefs _open_super superblock 51 -469> 2019-07-17 17:35:13.266 7ff06979bd80 10 bluefs _open_super log_fnode file(ino 1 size 0x100000 mtime 0.000000 bdev 0 allocated 500000 extents [1:0x38101600000+100000,1:0x38101200000+400000]) -469> 2019-07-17 17:35:13.266 7ff06979bd80 20 bluefs _init_alloc -469> 2019-07-17 17:35:13.266 7ff06979bd80 10 bluefs _replay -469> 2019-07-17 17:35:13.266 7ff06979bd80 10 bluefs _replay log_fnode file(ino 1 size 0x100000 mtime 0.000000 bdev 0 allocated 500000 extents [1:0x38101600000+100000,1:0x38101200000+400000]) -469> 2019-07-17 17:35:13.266 7ff06979bd80 10 bluefs _read h 0x55e8486ef500 0x0~1000 from file(ino 1 size 0x100000 mtime 0.000000 bdev 0 allocated 500000 extents [1:0x38101600000+100000,1:0x38101200000+400000]) -469> 2019-07-17 17:35:13.266 7ff06979bd80 20 bluefs _read fetching 0x0~100000 of 1:0x38101600000+100000 -469> 2019-07-17 17:35:13.271 7ff06979bd80 20 bluefs _read left 0x100000 len 0x1000 -469> 2019-07-17 17:35:13.271 7ff06979bd80 20 bluefs _read got 4096 -469> 2019-07-17 17:35:13.271 7ff06979bd80 10 bluefs _replay 0x0: stop: seq 1967399 != expected 1 -469> 2019-07-17 17:35:13.271 7ff06979bd80 10 bluefs _replay log file size was 0x100000 -469> 2019-07-17 17:35:13.271 7ff06979bd80 10 bluefs _replay done -469> 2019-07-17 17:35:13.271 7ff06979bd80 10 stupidalloc 0x0x55e8485ef680 init_rm_free 0x38101600000~100000 -469> 2019-07-17 17:35:13.275 7ff06979bd80 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.6/rpm/el7/BUILD/ceph-13.2.6/src/os/bluestore/StupidAllocator.cc: In function 'virtual void StupidAllocator::init_rm_free(uint64_t, uint64_t)' thread 7ff06979bd80 time 2019-07-17 17:35:13.271867 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.6/rpm/el7/BUILD/ceph-13.2.6/src/os/bluestore/StupidAllocator.cc: 336: FAILED assert(rm.empty()) ceph version 13.2.6 (7b695f835b03642f85998b2ae7b6dd093d9fbce4) mimic (stable) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7ff060b8036b] 2: (()+0x26e4f7) [0x7ff060b804f7] 3: (StupidAllocator::init_rm_free(unsigned long, unsigned long)+0x1fb6) [0x55e845ee9c46] 4: (BlueFS::mount()+0x260) [0x55e845eced60] 5: (BlueStore::_open_db(bool, bool)+0x170f) [0x55e845df093f] 6: (BlueStore::_mount(bool, bool)+0x4d1) [0x55e845e21071] 7: (OSD::init()+0x28f) [0x55e8459c8edf] 8: (main()+0x23a3) [0x55e8458a77a3] 9: (__libc_start_main()+0xf5) [0x7ff05c7003d5] 10: (()+0x385900) [0x55e84597f900] -469> 2019-07-17 17:35:13.279 7ff06979bd80 -1 *** Caught signal (Aborted) ** in thread 7ff06979bd80 thread_name:ceph-osd ceph version 13.2.6 (7b695f835b03642f85998b2ae7b6dd093d9fbce4) mimic (stable) 1: (()+0xf5d0) [0x7ff05d6f35d0] 2: (gsignal()+0x37) [0x7ff05c714207] 3: (abort()+0x148) [0x7ff05c7158f8] 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x248) [0x7ff060b80468] 5: (()+0x26e4f7) [0x7ff060b804f7] 6: (StupidAllocator::init_rm_free(unsigned long, unsigned long)+0x1fb6) [0x55e845ee9c46] 7: (BlueFS::mount()+0x260) [0x55e845eced60] 8: (BlueStore::_open_db(bool, bool)+0x170f) [0x55e845df093f] 9: (BlueStore::_mount(bool, bool)+0x4d1) [0x55e845e21071] 10: (OSD::init()+0x28f) [0x55e8459c8edf] 11: (main()+0x23a3) [0x55e8458a77a3] 12: (__libc_start_main()+0xf5) [0x7ff05c7003d5] 13: (()+0x385900) [0x55e84597f900] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 20/20 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 1 reserver 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 rgw_sync 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 20/20 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) 99/99 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/lib/ceph/crash/2019-07-17_15:35:13.279700Z_688f56e9-cafd-42eb-9338-8d1fdaa8af86/log --- end dump of recent events ---