Project

General

Profile

Bug #46445 ยป ceph-14.2.9-debug-ms-10-debug-monc-10.log

Mykola Golub, 07/10/2020 07:41 AM

 
2020-07-08 04:56:25.572 7f8535912700 10 monclient: get_monmap_and_config
2020-07-08 04:56:25.604 7f8535912700 10 monclient: build_initial_monmap
2020-07-08 04:56:25.604 7f8535912700 10 monclient: monmap:
epoch 0
fsid 14c749cf-7a81-3649-84ec-d2213594fc88
last_changed 2020-07-08 04:56:25.608332
created 2020-07-08 04:56:25.608332
min_mon_release 0 (unknown)
0: v1:172.16.1.11:6789/0 mon.noname-b-legacy
1: v1:172.16.1.12:6789/0 mon.noname-c-legacy
2: v1:172.16.1.13:6789/0 mon.noname-a-legacy
3: v2:172.16.1.11:3300/0 mon.noname-b
4: v2:172.16.1.12:3300/0 mon.noname-c
5: v2:172.16.1.13:3300/0 mon.noname-a

2020-07-08 04:56:25.604 7f852f347700 2 Event(0x7f85300e8b70 nevent=5000 time_id=1).set_owner idx=1 owner=140209999345408
2020-07-08 04:56:25.604 7f852f347700 10 stack operator() starting
2020-07-08 04:56:25.604 7f852eb46700 2 Event(0x7f85300e6850 nevent=5000 time_id=1).set_owner idx=2 owner=140209990952704
2020-07-08 04:56:25.608 7f852eb46700 10 stack operator() starting
2020-07-08 04:56:25.604 7f852fb48700 2 Event(0x7f85300e59a0 nevent=5000 time_id=1).set_owner idx=0 owner=140210007738112
2020-07-08 04:56:25.608 7f852fb48700 10 stack operator() starting
2020-07-08 04:56:25.608 7f8535912700 10 -- ready
2020-07-08 04:56:25.608 7f8535912700 1 Processor -- start
2020-07-08 04:56:25.608 7f8535912700 1 -- start start
2020-07-08 04:56:25.608 7f8535912700 10 monclient: init
2020-07-08 04:56:25.608 7f8535912700 10 monclient: _reopen_session rank -1
2020-07-08 04:56:25.608 7f8535912700 10 -- create_connect v1:172.16.1.12:6789/0, creating connection and registering
2020-07-08 04:56:25.608 7f8535912700 10 -- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_NONE l=0)._connect
2020-07-08 04:56:25.608 7f8535912700 10 -- create_connect 0x7f853008def0 v1:172.16.1.12:6789/0 v1:172.16.1.12:6789/0
2020-07-08 04:56:25.608 7f8535912700 10 -- connect_to v1:172.16.1.12:6789/0 new 0x7f853008def0
2020-07-08 04:56:25.608 7f8535912700 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f853008def0 addr v1:172.16.1.12:6789/0
2020-07-08 04:56:25.608 7f8535912700 10 -- create_connect v2:172.16.1.13:3300/0, creating connection and registering
2020-07-08 04:56:25.608 7f8535912700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 msgr2=0x7f8530098b40 unknown :-1 s=STATE_NONE l=0)._connect
2020-07-08 04:56:25.608 7f8535912700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect
2020-07-08 04:56:25.608 7f8535912700 10 -- create_connect 0x7f85300966e0 v2:172.16.1.13:3300/0 v2:172.16.1.13:3300/0
2020-07-08 04:56:25.608 7f8535912700 10 -- connect_to v2:172.16.1.13:3300/0 new 0x7f85300966e0
2020-07-08 04:56:25.608 7f8535912700 10 monclient(hunting): picked mon.noname-a con 0x7f85300966e0 addr v2:172.16.1.13:3300/0
2020-07-08 04:56:25.608 7f8535912700 10 -- create_connect v2:172.16.1.12:3300/0, creating connection and registering
2020-07-08 04:56:25.608 7f8535912700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 msgr2=0x7f853009b6a0 unknown :-1 s=STATE_NONE l=0)._connect
2020-07-08 04:56:25.608 7f8535912700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect
2020-07-08 04:56:25.608 7f8535912700 10 -- create_connect 0x7f8530099150 v2:172.16.1.12:3300/0 v2:172.16.1.12:3300/0
2020-07-08 04:56:25.608 7f8535912700 10 -- connect_to v2:172.16.1.12:3300/0 new 0x7f8530099150
2020-07-08 04:56:25.608 7f8535912700 10 monclient(hunting): picked mon.noname-c con 0x7f8530099150 addr v2:172.16.1.12:3300/0
2020-07-08 04:56:25.608 7f8535912700 10 --1- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=START_CONNECT pgs=0 cs=0 l=0).send_keepalive
2020-07-08 04:56:25.608 7f8535912700 1 -- --> v1:172.16.1.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853009bd50 con 0x7f853008def0
2020-07-08 04:56:25.608 7f8535912700 10 monclient(hunting): start opening mon connection
2020-07-08 04:56:25.608 7f8535912700 1 -- --> v2:172.16.1.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853009cfa0 con 0x7f8530099150
2020-07-08 04:56:25.608 7f8535912700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message enqueueing message m=0x7f853009cfa0 type=5 mon_getmap magic: 0 v1
2020-07-08 04:56:25.608 7f8535912700 10 monclient(hunting): start opening mon connection
2020-07-08 04:56:25.608 7f8535912700 1 -- --> v2:172.16.1.13:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853009d1a0 con 0x7f85300966e0
2020-07-08 04:56:25.608 7f8535912700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message enqueueing message m=0x7f853009d1a0 type=5 mon_getmap magic: 0 v1
2020-07-08 04:56:25.608 7f8535912700 10 monclient(hunting): _renew_subs
2020-07-08 04:56:25.608 7f8535912700 10 monclient(hunting): authenticate will time out at 2020-07-08 05:01:25.609485
2020-07-08 04:56:25.608 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.608 7f852f347700 10 -- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress
2020-07-08 04:56:25.608 7f852f347700 10 -- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTING_RE l=0).handle_write
2020-07-08 04:56:25.608 7f852f347700 10 --1- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=START_CONNECT pgs=0 cs=0 l=0).write_event
2020-07-08 04:56:25.608 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.608 7f852fb48700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 msgr2=0x7f853009b6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress
2020-07-08 04:56:25.608 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.608 7f852eb46700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 msgr2=0x7f8530098b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress
2020-07-08 04:56:25.608 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.608 7f852f347700 10 -- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTING_RE l=0).process connect successfully, ready to send banner
2020-07-08 04:56:25.608 7f852fb48700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 msgr2=0x7f853009b6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:25.608 7f852fb48700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 msgr2=0x7f853009b6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process connection refused!
2020-07-08 04:56:25.608 7f852f347700 10 -- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 9 remaining bytes 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING pgs=0 cs=0 l=0).handle_client_banner_write connect write banner done: v1:172.16.1.12:6789/0
2020-07-08 04:56:25.608 7f852fb48700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault
2020-07-08 04:56:25.608 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.608 7f852eb46700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 msgr2=0x7f8530098b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.16.1.13:3300/0
2020-07-08 04:56:25.608 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.608 7f852eb46700 2 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 msgr2=0x7f8530098b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process connection refused!
2020-07-08 04:56:25.608 7f852eb46700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault
2020-07-08 04:56:25.608 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).reset_security
2020-07-08 04:56:25.608 7f852fb48700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000
2020-07-08 04:56:25.608 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.608 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).reset_security
2020-07-08 04:56:25.608 7f852eb46700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000
2020-07-08 04:56:25.608 7f852f347700 1 --1- >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.16.1.12:6789/0 says I am v1:172.16.1.254:42332/0 (socket says 172.16.1.254:42332)
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 learned_addr had no addrs
2020-07-08 04:56:25.608 7f852f347700 1 -- 172.16.1.254:0/2274227081 learned_addr learned my addr 172.16.1.254:0/2274227081 (peer_addr_for_me v1:172.16.1.254:0/0)
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 136 remaining bytes 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_my_addr_write connect sent my addr v1:172.16.1.254:0/2274227081
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).send_connect_message connect sending gseq=1 cseq=0 proto=15
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 33 remaining bytes 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_2 got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
2020-07-08 04:56:25.608 7f852f347700 2 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_ack_seq got newly_acked_seq 0 vs out_seq 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).discard_requeued_up_to 0
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 8 remaining bytes 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_in_seq_write send in_seq done
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=1026 cs=1 l=1).client_ready connect success 1, lossy = 1, features 4611087853746454523
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=1026 cs=1 l=1).client_ready no authorizer, clearing session_security
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).write_event
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).append_keepalive_or_ack
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 144 remaining bytes 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).write_message sending 0x7f853009bd50 done.
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:25.608 7f852f347700 5 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1). rx mon.1 seq 1 0x7f8528003bd0 mon_map magic: 0 v1
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:25.608 7f852f347700 5 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1). rx mon.1 seq 2 0x7f8528003fa0 auth_reply(proto 2 0 (0) Success) v1
2020-07-08 04:56:25.608 7f852e345700 1 -- 172.16.1.254:0/2274227081 <== mon.1 v1:172.16.1.12:6789/0 1 ==== mon_map magic: 0 v1 ==== 388+0+0 (unknown 52263635 0 0) 0x7f8528003bd0 con 0x7f853008def0
2020-07-08 04:56:25.608 7f852e345700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
2020-07-08 04:56:25.608 7f852e345700 10 monclient(hunting): got monmap 1 from mon.noname-c-legacy (according to old e1)
2020-07-08 04:56:25.608 7f852e345700 10 monclient(hunting): dump:
epoch 1
fsid 14c749cf-7a81-3649-84ec-d2213594fc88
last_changed 2020-06-28 02:12:38.685392
created 2020-06-28 02:12:38.685392
min_mon_release 12 (luminous)
0: v1:172.16.1.11:6789/0 mon.mon1
1: v1:172.16.1.12:6789/0 mon.mon2
2: v1:172.16.1.13:6789/0 mon.mon3

2020-07-08 04:56:25.608 7f852e345700 10 monclient(hunting): _finish_auth 0
2020-07-08 04:56:25.608 7f852e345700 10 -- 172.16.1.254:0/2274227081 dispatch_throttle_release 388 to dispatch throttler 421/104857600
2020-07-08 04:56:25.608 7f852e345700 1 -- 172.16.1.254:0/2274227081 <== mon.1 v1:172.16.1.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731742167 0 0) 0x7f8528003fa0 con 0x7f853008def0
2020-07-08 04:56:25.608 7f852e345700 10 monclient(hunting): _init_auth method 2
2020-07-08 04:56:25.608 7f852e345700 10 monclient(hunting): my global_id is 16939
2020-07-08 04:56:25.608 7f852e345700 1 -- 172.16.1.254:0/2274227081 --> v1:172.16.1.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f851c0034f0 con 0x7f853008def0
2020-07-08 04:56:25.608 7f852e345700 10 -- 172.16.1.254:0/2274227081 dispatch_throttle_release 33 to dispatch throttler 33/104857600
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).write_event
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 141 remaining bytes 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).write_message sending 0x7f851c0034f0 done.
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:25.608 7f852f347700 5 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1026 cs=1 l=1). rx mon.1 seq 3 0x7f85280044a0 auth_reply(proto 2 0 (0) Success) v1
2020-07-08 04:56:25.608 7f852e345700 1 -- 172.16.1.254:0/2274227081 <== mon.1 v1:172.16.1.12:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 1157963179 0 0) 0x7f85280044a0 con 0x7f853008def0
2020-07-08 04:56:25.608 7f852e345700 1 -- 172.16.1.254:0/2274227081 >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 msgr2=0x7f8530098b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2020-07-08 04:56:25.608 7f852e345700 1 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop
2020-07-08 04:56:25.608 7f852e345700 5 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.608 7f852e345700 10 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).discard_out_queue started
2020-07-08 04:56:25.608 7f852eb46700 5 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers
2020-07-08 04:56:25.608 7f852eb46700 5 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).reset_security
2020-07-08 04:56:25.608 7f852e345700 1 -- 172.16.1.254:0/2274227081 >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 msgr2=0x7f853009b6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down
2020-07-08 04:56:25.608 7f852e345700 1 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop
2020-07-08 04:56:25.608 7f852e345700 5 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.608 7f852e345700 10 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).discard_out_queue started
2020-07-08 04:56:25.608 7f852e345700 10 monclient: _finish_hunting 0
2020-07-08 04:56:25.608 7f852e345700 1 monclient: found mon.mon2
2020-07-08 04:56:25.608 7f852e345700 10 monclient: _send_mon_message to mon.mon2 at v1:172.16.1.12:6789/0
2020-07-08 04:56:25.608 7f852e345700 1 -- 172.16.1.254:0/2274227081 --> v1:172.16.1.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853009d3a0 con 0x7f853008def0
2020-07-08 04:56:25.608 7f852e345700 10 monclient: _finish_auth 0
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).write_event
2020-07-08 04:56:25.608 7f852e345700 10 -- 172.16.1.254:0/2274227081 dispatch_throttle_release 206 to dispatch throttler 206/104857600
2020-07-08 04:56:25.608 7f852fb48700 5 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers
2020-07-08 04:56:25.608 7f8535912700 5 monclient: authenticate success, global_id 16939
2020-07-08 04:56:25.608 7f8535912700 10 monclient: get_monmap_and_config pre-mimic monitor, no config to fetch
2020-07-08 04:56:25.608 7f8535912700 10 monclient: shutdown
2020-07-08 04:56:25.608 7f8535912700 1 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2020-07-08 04:56:25.608 7f8535912700 2 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).stop
2020-07-08 04:56:25.608 7f8535912700 5 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).reset_recv_state
2020-07-08 04:56:25.608 7f852fb48700 5 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).reset_security
2020-07-08 04:56:25.608 7f8535912700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=OPENED pgs=1026 cs=1 l=1).discard_out_queue started
2020-07-08 04:56:25.608 7f852f347700 10 -- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 legacy=0x7f853008e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 126 remaining bytes 0
2020-07-08 04:56:25.608 7f852f347700 10 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CLOSED pgs=1026 cs=1 l=1).write_message sending 0x7f853009d3a0 done.
2020-07-08 04:56:25.608 7f852f347700 5 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CLOSED pgs=1026 cs=1 l=1).reset_recv_state (warped) reseting security handlers
2020-07-08 04:56:25.608 7f852f347700 5 --1- 172.16.1.254:0/2274227081 >> v1:172.16.1.12:6789/0 conn(0x7f853008def0 0x7f853008e340 :-1 s=CLOSED pgs=1026 cs=1 l=1).reset_security
2020-07-08 04:56:25.608 7f8535912700 10 -- 172.16.1.254:0/2274227081 shutdown 172.16.1.254:0/2274227081
2020-07-08 04:56:25.608 7f8535912700 10 Processor -- stop
2020-07-08 04:56:25.608 7f8535912700 1 -- 172.16.1.254:0/2274227081 shutdown_connections
2020-07-08 04:56:25.608 7f8535912700 5 -- 172.16.1.254:0/2274227081 shutdown_connections mark down v1:172.16.1.12:6789/0 0x7f853008def0
2020-07-08 04:56:25.608 7f8535912700 5 -- 172.16.1.254:0/2274227081 shutdown_connections mark down v2:172.16.1.12:3300/0 0x7f8530099150
2020-07-08 04:56:25.608 7f8535912700 1 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.12:3300/0 conn(0x7f8530099150 0x7f853009b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop
2020-07-08 04:56:25.608 7f8535912700 5 -- 172.16.1.254:0/2274227081 shutdown_connections mark down v2:172.16.1.13:3300/0 0x7f85300966e0
2020-07-08 04:56:25.608 7f8535912700 1 --2- 172.16.1.254:0/2274227081 >> v2:172.16.1.13:3300/0 conn(0x7f85300966e0 0x7f8530098b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop
2020-07-08 04:56:25.608 7f8535912700 5 -- 172.16.1.254:0/2274227081 shutdown_connections delete 0x7f853008def0
2020-07-08 04:56:25.608 7f8535912700 5 -- 172.16.1.254:0/2274227081 shutdown_connections delete 0x7f85300966e0
2020-07-08 04:56:25.608 7f8535912700 5 -- 172.16.1.254:0/2274227081 shutdown_connections delete 0x7f8530099150
2020-07-08 04:56:25.608 7f8535912700 1 -- 172.16.1.254:0/2274227081 >> 172.16.1.254:0/2274227081 conn(0x7f85300e7b00 msgr2=0x7f85300e4810 unknown :-1 s=STATE_NONE l=0).mark_down
2020-07-08 04:56:25.608 7f8535912700 2 --1- 172.16.1.254:0/2274227081 >> 172.16.1.254:0/2274227081 conn(0x7f85300e7b00 0x7f85300e4810 :-1 s=NONE pgs=0 cs=0 l=0).stop
2020-07-08 04:56:25.608 7f8535912700 5 --1- 172.16.1.254:0/2274227081 >> 172.16.1.254:0/2274227081 conn(0x7f85300e7b00 0x7f85300e4810 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state
2020-07-08 04:56:25.608 7f8535912700 10 --1- 172.16.1.254:0/2274227081 >> 172.16.1.254:0/2274227081 conn(0x7f85300e7b00 0x7f85300e4810 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started
2020-07-08 04:56:25.608 7f852fb48700 5 --1- 172.16.1.254:0/2274227081 >> 172.16.1.254:0/2274227081 conn(0x7f85300e7b00 0x7f85300e4810 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers
2020-07-08 04:56:25.608 7f852fb48700 5 --1- 172.16.1.254:0/2274227081 >> 172.16.1.254:0/2274227081 conn(0x7f85300e7b00 0x7f85300e4810 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security
2020-07-08 04:56:25.608 7f8535912700 10 -- 172.16.1.254:0/2274227081 wait: waiting for dispatch queue
2020-07-08 04:56:25.608 7f8535912700 10 -- 172.16.1.254:0/2274227081 wait: dispatch queue is stopped
2020-07-08 04:56:25.608 7f8535912700 1 -- 172.16.1.254:0/2274227081 shutdown_connections
2020-07-08 04:56:25.608 7f8535912700 5 -- 172.16.1.254:0/2274227081 shutdown_connections delete 0x7f85300e7b00
2020-07-08 04:56:25.608 7f8535912700 10 -- 172.16.1.254:0/2274227081 wait: done.
2020-07-08 04:56:25.608 7f8535912700 1 -- 172.16.1.254:0/2274227081 wait complete.
2020-07-08 04:56:25.624 7f8535912700 10 monclient: build_initial_monmap
2020-07-08 04:56:25.624 7f8535912700 10 monclient: monmap:
epoch 0
fsid 14c749cf-7a81-3649-84ec-d2213594fc88
last_changed 2020-07-08 04:56:25.627750
created 2020-07-08 04:56:25.627750
min_mon_release 0 (unknown)
0: v1:172.16.1.11:6789/0 mon.noname-b-legacy
1: v1:172.16.1.12:6789/0 mon.noname-c-legacy
2: v1:172.16.1.13:6789/0 mon.noname-a-legacy
3: v2:172.16.1.11:3300/0 mon.noname-b
4: v2:172.16.1.12:3300/0 mon.noname-c
5: v2:172.16.1.13:3300/0 mon.noname-a

2020-07-08 04:56:25.624 7f8535912700 10 -- ready
2020-07-08 04:56:25.624 7f8535912700 1 Processor -- start
2020-07-08 04:56:25.628 7f8535912700 1 -- start start
2020-07-08 04:56:25.628 7f8535912700 10 monclient: init
2020-07-08 04:56:25.628 7f8535912700 10 monclient: _reopen_session rank -1
2020-07-08 04:56:25.628 7f8535912700 10 -- create_connect v2:172.16.1.11:3300/0, creating connection and registering
2020-07-08 04:56:25.628 7f8535912700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_NONE l=1)._connect
2020-07-08 04:56:25.628 7f8535912700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect
2020-07-08 04:56:25.628 7f8535912700 10 -- create_connect 0x7f85300cf700 v2:172.16.1.11:3300/0 v2:172.16.1.11:3300/0
2020-07-08 04:56:25.628 7f8535912700 10 -- connect_to v2:172.16.1.11:3300/0 new 0x7f85300cf700
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): picked mon.noname-b con 0x7f85300cf700 addr v2:172.16.1.11:3300/0
2020-07-08 04:56:25.628 7f8535912700 10 -- create_connect v2:172.16.1.13:3300/0, creating connection and registering
2020-07-08 04:56:25.628 7f8535912700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_NONE l=1)._connect
2020-07-08 04:56:25.628 7f8535912700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect
2020-07-08 04:56:25.628 7f8535912700 10 -- create_connect 0x7f85300d4b90 v2:172.16.1.13:3300/0 v2:172.16.1.13:3300/0
2020-07-08 04:56:25.628 7f8535912700 10 -- connect_to v2:172.16.1.13:3300/0 new 0x7f85300d4b90
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): picked mon.noname-a con 0x7f85300d4b90 addr v2:172.16.1.13:3300/0
2020-07-08 04:56:25.628 7f8535912700 10 -- create_connect v2:172.16.1.12:3300/0, creating connection and registering
2020-07-08 04:56:25.628 7f8535912700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_NONE l=1)._connect
2020-07-08 04:56:25.628 7f8535912700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect
2020-07-08 04:56:25.628 7f8535912700 10 -- create_connect 0x7f85300d5530 v2:172.16.1.12:3300/0 v2:172.16.1.12:3300/0
2020-07-08 04:56:25.628 7f8535912700 10 -- connect_to v2:172.16.1.12:3300/0 new 0x7f85300d5530
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): picked mon.noname-c con 0x7f85300d5530 addr v2:172.16.1.12:3300/0
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): start opening mon connection
2020-07-08 04:56:25.628 7f8535912700 1 -- --> v2:172.16.1.11:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300d59b0 con 0x7f85300cf700
2020-07-08 04:56:25.628 7f8535912700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).send_message enqueueing message m=0x7f85300d59b0 type=5 mon_getmap magic: 0 v1
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): start opening mon connection
2020-07-08 04:56:25.628 7f8535912700 1 -- --> v2:172.16.1.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300d84d0 con 0x7f85300d5530
2020-07-08 04:56:25.628 7f8535912700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).send_message enqueueing message m=0x7f85300d84d0 type=5 mon_getmap magic: 0 v1
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): start opening mon connection
2020-07-08 04:56:25.628 7f8535912700 1 -- --> v2:172.16.1.13:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300d8680 con 0x7f85300d4b90
2020-07-08 04:56:25.628 7f8535912700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).send_message enqueueing message m=0x7f85300d8680 type=5 mon_getmap magic: 0 v1
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): _renew_subs
2020-07-08 04:56:25.628 7f8535912700 10 monclient(hunting): authenticate will time out at 2020-07-08 05:01:25.629517
2020-07-08 04:56:25.628 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.628 7f852f347700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:25.628 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.628 7f852eb46700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:25.628 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.628 7f852fb48700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:25.628 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.628 7f852eb46700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.13:3300/0
2020-07-08 04:56:25.628 7f852eb46700 2 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:25.628 7f852eb46700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:25.628 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.628 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:25.628 7f852eb46700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000
2020-07-08 04:56:25.628 7f852f347700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.628 7f852f347700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.11:3300/0
2020-07-08 04:56:25.628 7f852f347700 2 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:25.628 7f852f347700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:25.628 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.628 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:25.628 7f852f347700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000
2020-07-08 04:56:25.628 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.628 7f852fb48700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:25.628 7f852fb48700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:25.628 7f852fb48700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:25.628 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.628 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:25.628 7f852fb48700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000
2020-07-08 04:56:25.832 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.832 7f852f347700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:25.832 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.832 7f852fb48700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:25.832 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:25.832 7f852eb46700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:25.832 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.832 7f852fb48700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:25.832 7f852fb48700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:25.832 7f852fb48700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:25.832 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.832 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:25.832 7f852fb48700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000
2020-07-08 04:56:25.832 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.832 7f852eb46700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.13:3300/0
2020-07-08 04:56:25.832 7f852eb46700 2 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:25.832 7f852eb46700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:25.832 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.832 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:25.832 7f852eb46700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000
2020-07-08 04:56:25.832 7f852f347700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:25.832 7f852f347700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.11:3300/0
2020-07-08 04:56:25.832 7f852f347700 2 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:25.832 7f852f347700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:25.832 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:25.832 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:25.832 7f852f347700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.400000
2020-07-08 04:56:26.236 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:26.236 7f852eb46700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:26.236 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:26.236 7f852f347700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:26.236 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:26.236 7f852fb48700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:26.236 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:26.236 7f852eb46700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.13:3300/0
2020-07-08 04:56:26.236 7f852eb46700 2 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:26.236 7f852eb46700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:26.236 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:26.236 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:26.236 7f852eb46700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000
2020-07-08 04:56:26.236 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:26.236 7f852fb48700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:26.236 7f852fb48700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:26.236 7f852fb48700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:26.236 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:26.236 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:26.236 7f852fb48700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000
2020-07-08 04:56:26.236 7f852f347700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:26.236 7f852f347700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.11:3300/0
2020-07-08 04:56:26.236 7f852f347700 2 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:26.236 7f852f347700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:26.236 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:26.236 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:26.236 7f852f347700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.800000
2020-07-08 04:56:27.040 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:27.040 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:27.040 7f852f347700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:27.040 7f852fb48700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:27.040 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:27.040 7f852eb46700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:27.040 7f852f347700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:27.040 7f852f347700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.11:3300/0
2020-07-08 04:56:27.040 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:27.040 7f852f347700 2 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:27.040 7f852fb48700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:27.040 7f852f347700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:27.040 7f852fb48700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:27.040 7f852fb48700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:27.040 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:27.040 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:27.040 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:27.040 7f852f347700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000
2020-07-08 04:56:27.040 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:27.040 7f852fb48700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000
2020-07-08 04:56:27.040 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:27.040 7f852eb46700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.13:3300/0
2020-07-08 04:56:27.040 7f852eb46700 2 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:27.040 7f852eb46700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:27.040 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:27.040 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:27.040 7f852eb46700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 1.600000
2020-07-08 04:56:28.644 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:28.644 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:28.644 7f852fb48700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:28.644 7f852f347700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:28.644 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:28.644 7f852eb46700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:28.644 7f852f347700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:28.644 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:28.644 7f852f347700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.11:3300/0
2020-07-08 04:56:28.644 7f852f347700 2 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:28.644 7f852eb46700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.13:3300/0
2020-07-08 04:56:28.644 7f852f347700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:28.644 7f852eb46700 2 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:28.644 7f852eb46700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:28.644 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:28.644 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:28.644 7f852f347700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 3.200000
2020-07-08 04:56:28.644 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:28.644 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:28.644 7f852eb46700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 3.200000
2020-07-08 04:56:28.644 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:28.644 7f852fb48700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:28.644 7f852fb48700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:28.644 7f852fb48700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:28.644 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:28.644 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:28.644 7f852fb48700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 3.200000
2020-07-08 04:56:31.848 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:31.848 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:31.848 7f852eb46700 10 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:31.848 7f852f347700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:31.848 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:31.848 7f852fb48700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:31.848 7f852f347700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:31.848 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:31.848 7f852f347700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.11:3300/0
2020-07-08 04:56:31.848 7f852f347700 2 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:31.848 7f852eb46700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.13:3300/0
2020-07-08 04:56:31.848 7f852eb46700 2 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:31.848 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:31.848 7f852fb48700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:31.848 7f852fb48700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:31.848 7f852f347700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:31.848 7f852fb48700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:31.848 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:31.848 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:31.848 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:31.848 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:31.848 7f852f347700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 6.400000
2020-07-08 04:56:31.848 7f852fb48700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 6.400000
2020-07-08 04:56:31.848 7f852eb46700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:31.848 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:31.848 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:31.848 7f852eb46700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 6.400000
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): tick
2020-07-08 04:56:35.628 7f85277fe700 1 monclient(hunting): continuing hunt
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): _reopen_session rank -1
2020-07-08 04:56:35.628 7f85277fe700 1 -- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 msgr2=0x7f85300d4fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2020-07-08 04:56:35.628 7f85277fe700 1 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop
2020-07-08 04:56:35.628 7f85277fe700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:35.628 7f85277fe700 10 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).discard_out_queue started
2020-07-08 04:56:35.628 7f85277fe700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 msgr2=0x7f85300d7f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2020-07-08 04:56:35.628 7f85277fe700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop
2020-07-08 04:56:35.628 7f85277fe700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:35.628 7f85277fe700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).discard_out_queue started
2020-07-08 04:56:35.628 7f85277fe700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 msgr2=0x7f85300cfb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2020-07-08 04:56:35.628 7f85277fe700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop
2020-07-08 04:56:35.628 7f85277fe700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:35.628 7f85277fe700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).discard_out_queue started
2020-07-08 04:56:35.628 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers
2020-07-08 04:56:35.628 7f85277fe700 10 -- create_connect v1:172.16.1.13:6789/0, creating connection and registering
2020-07-08 04:56:35.628 7f852f347700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f85300cf700 0x7f85300cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:35.628 7f85277fe700 10 -- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_NONE l=1)._connect
2020-07-08 04:56:35.628 7f85277fe700 10 -- create_connect 0x7f8514003260 v1:172.16.1.13:6789/0 v1:172.16.1.13:6789/0
2020-07-08 04:56:35.628 7f85277fe700 10 -- connect_to v1:172.16.1.13:6789/0 new 0x7f8514003260
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8514003260 addr v1:172.16.1.13:6789/0
2020-07-08 04:56:35.628 7f85277fe700 10 -- create_connect v2:172.16.1.12:3300/0, creating connection and registering
2020-07-08 04:56:35.628 7f85277fe700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 msgr2=0x7f85140095f0 unknown :-1 s=STATE_NONE l=1)._connect
2020-07-08 04:56:35.628 7f85277fe700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect
2020-07-08 04:56:35.628 7f85277fe700 10 -- create_connect 0x7f85140070d0 v2:172.16.1.12:3300/0 v2:172.16.1.12:3300/0
2020-07-08 04:56:35.628 7f852f347700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:35.628 7f85277fe700 10 -- connect_to v2:172.16.1.12:3300/0 new 0x7f85140070d0
2020-07-08 04:56:35.628 7f852f347700 10 -- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): picked mon.noname-c con 0x7f85140070d0 addr v2:172.16.1.12:3300/0
2020-07-08 04:56:35.628 7f85277fe700 10 -- create_connect v2:172.16.1.11:3300/0, creating connection and registering
2020-07-08 04:56:35.628 7f85277fe700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 msgr2=0x7f851400c1e0 unknown :-1 s=STATE_NONE l=1)._connect
2020-07-08 04:56:35.628 7f85277fe700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect
2020-07-08 04:56:35.628 7f85277fe700 10 -- create_connect 0x7f8514009d00 v2:172.16.1.11:3300/0 v2:172.16.1.11:3300/0
2020-07-08 04:56:35.628 7f85277fe700 10 -- connect_to v2:172.16.1.11:3300/0 new 0x7f8514009d00
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): picked mon.noname-b con 0x7f8514009d00 addr v2:172.16.1.11:3300/0
2020-07-08 04:56:35.628 7f85277fe700 10 --1- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=START_CONNECT pgs=0 cs=0 l=1).send_keepalive
2020-07-08 04:56:35.628 7f85277fe700 1 -- --> v1:172.16.1.13:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851400c7d0 con 0x7f8514003260
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): start opening mon connection
2020-07-08 04:56:35.628 7f85277fe700 1 -- --> v2:172.16.1.11:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300d59b0 con 0x7f8514009d00
2020-07-08 04:56:35.628 7f85277fe700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).send_message enqueueing message m=0x7f85300d59b0 type=5 mon_getmap magic: 0 v1
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): start opening mon connection
2020-07-08 04:56:35.628 7f85277fe700 1 -- --> v2:172.16.1.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300d84d0 con 0x7f85140070d0
2020-07-08 04:56:35.628 7f85277fe700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).send_message enqueueing message m=0x7f85300d84d0 type=5 mon_getmap magic: 0 v1
2020-07-08 04:56:35.628 7f85277fe700 10 monclient(hunting): _renew_subs
2020-07-08 04:56:35.628 7f852f347700 10 -- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTING_RE l=1).handle_write
2020-07-08 04:56:35.628 7f852f347700 10 --1- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=START_CONNECT pgs=0 cs=0 l=1).write_event
2020-07-08 04:56:35.628 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers
2020-07-08 04:56:35.628 7f852eb46700 5 --2- >> v2:172.16.1.13:3300/0 conn(0x7f85300d4b90 0x7f85300d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:35.628 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers
2020-07-08 04:56:35.628 7f852fb48700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85300d5530 0x7f85300d7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:35.628 7f852fb48700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:35.628 7f852fb48700 10 -- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 msgr2=0x7f851400c1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:35.628 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:35.628 7f852eb46700 10 -- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 msgr2=0x7f85140095f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:35.628 7f852eb46700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:35.628 7f852eb46700 1 -- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 msgr2=0x7f85140095f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.12:3300/0
2020-07-08 04:56:35.628 7f852eb46700 2 -- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 msgr2=0x7f85140095f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:35.628 7f852eb46700 10 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:35.628 7f852eb46700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:35.628 7f852eb46700 5 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:35.628 7f852eb46700 1 --2- >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000
2020-07-08 04:56:35.628 7f852f347700 10 -- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTING_RE l=1).process connect successfully, ready to send banner
2020-07-08 04:56:35.628 7f852f347700 10 -- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 9 remaining bytes 0
2020-07-08 04:56:35.628 7f852f347700 10 --1- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING pgs=0 cs=0 l=1).handle_client_banner_write connect write banner done: v1:172.16.1.13:6789/0
2020-07-08 04:56:35.628 7f852fb48700 10 NetHandler reconnect reconnect: Connection refused
2020-07-08 04:56:35.628 7f852fb48700 1 -- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 msgr2=0x7f851400c1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.16.1.11:3300/0
2020-07-08 04:56:35.628 7f852fb48700 2 -- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 msgr2=0x7f851400c1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process connection refused!
2020-07-08 04:56:35.628 7f852fb48700 10 --2- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault
2020-07-08 04:56:35.628 7f852fb48700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:35.628 7f852fb48700 5 --2- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:35.628 7f852fb48700 1 --2- >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000
2020-07-08 04:56:35.632 7f852f347700 1 --1- >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.16.1.13:6789/0 says I am v1:172.16.1.254:40792/0 (socket says 172.16.1.254:40792)
2020-07-08 04:56:35.632 7f852f347700 10 -- 172.16.1.254:0/272251814 learned_addr had no addrs
2020-07-08 04:56:35.632 7f852f347700 1 -- 172.16.1.254:0/272251814 learned_addr learned my addr 172.16.1.254:0/272251814 (peer_addr_for_me v1:172.16.1.254:0/0)
2020-07-08 04:56:35.632 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 136 remaining bytes 0
2020-07-08 04:56:35.632 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_my_addr_write connect sent my addr v1:172.16.1.254:0/272251814
2020-07-08 04:56:35.632 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).send_connect_message connect sending gseq=19 cseq=0 proto=15
2020-07-08 04:56:35.632 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 33 remaining bytes 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_2 got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
2020-07-08 04:56:35.636 7f852f347700 2 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_ack_seq got newly_acked_seq 0 vs out_seq 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).discard_requeued_up_to 0
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 8 remaining bytes 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_in_seq_write send in_seq done
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=1077 cs=1 l=1).client_ready connect success 1, lossy = 1, features 4611087853746454523
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=1077 cs=1 l=1).client_ready no authorizer, clearing session_security
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_event
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).append_keepalive_or_ack
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 144 remaining bytes 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f851400c7d0 done.
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.636 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 1 0x7f853009d3a0 mon_map magic: 0 v1
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.636 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 2 0x7f8528003f90 auth_reply(proto 2 0 (0) Success) v1
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 1 ==== mon_map magic: 0 v1 ==== 388+0+0 (unknown 52263635 0 0) 0x7f853009d3a0 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852cb42700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
2020-07-08 04:56:35.636 7f852cb42700 10 monclient(hunting): got monmap 1 from mon.noname-a-legacy (according to old e1)
2020-07-08 04:56:35.636 7f852cb42700 10 monclient(hunting): dump:
epoch 1
fsid 14c749cf-7a81-3649-84ec-d2213594fc88
last_changed 2020-06-28 02:12:38.685392
created 2020-06-28 02:12:38.685392
min_mon_release 12 (luminous)
0: v1:172.16.1.11:6789/0 mon.mon1
1: v1:172.16.1.12:6789/0 mon.mon2
2: v1:172.16.1.13:6789/0 mon.mon3

2020-07-08 04:56:35.636 7f852cb42700 10 monclient(hunting): _finish_auth 0
2020-07-08 04:56:35.636 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 388 to dispatch throttler 421/104857600
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615761025 0 0) 0x7f8528003f90 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852cb42700 10 monclient(hunting): _init_auth method 2
2020-07-08 04:56:35.636 7f852cb42700 10 monclient(hunting): my global_id is 17105
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 --> v1:172.16.1.13:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85100034f0 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 33 to dispatch throttler 33/104857600
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_event
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 141 remaining bytes 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f85100034f0 done.
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.636 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 3 0x7f8528003ac0 auth_reply(proto 2 0 (0) Success) v1
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (unknown 374517937 0 0) 0x7f8528003ac0 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 --> v1:172.16.1.13:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8510003aa0 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 206 to dispatch throttler 206/104857600
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_event
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 270 remaining bytes 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f8510003aa0 done.
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.636 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 4 0x7f8528004bd0 auth_reply(proto 2 0 (0) Success) v1
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2578882984 0 0) 0x7f8528004bd0 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 msgr2=0x7f85140095f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2020-07-08 04:56:35.636 7f852cb42700 1 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop
2020-07-08 04:56:35.636 7f852cb42700 5 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:35.636 7f852cb42700 10 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).discard_out_queue started
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 msgr2=0x7f851400c1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down
2020-07-08 04:56:35.636 7f852cb42700 1 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop
2020-07-08 04:56:35.636 7f852cb42700 5 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state
2020-07-08 04:56:35.636 7f852eb46700 5 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers
2020-07-08 04:56:35.636 7f852eb46700 5 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.12:3300/0 conn(0x7f85140070d0 0x7f85140095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:35.636 7f852cb42700 10 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).discard_out_queue started
2020-07-08 04:56:35.636 7f852cb42700 10 monclient: _finish_hunting 0
2020-07-08 04:56:35.636 7f852cb42700 1 monclient: found mon.mon3
2020-07-08 04:56:35.636 7f852cb42700 10 monclient: _send_mon_message to mon.mon3 at v1:172.16.1.13:6789/0
2020-07-08 04:56:35.636 7f852cb42700 1 -- 172.16.1.254:0/272251814 --> v1:172.16.1.13:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300d88b0 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852cb42700 10 monclient: _finish_auth 0
2020-07-08 04:56:35.636 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 580 to dispatch throttler 580/104857600
2020-07-08 04:56:35.636 7f8535912700 5 monclient: authenticate success, global_id 17105
2020-07-08 04:56:35.636 7f8535912700 10 monclient: _renew_subs
2020-07-08 04:56:35.636 7f8535912700 10 monclient: _send_mon_message to mon.mon3 at v1:172.16.1.13:6789/0
2020-07-08 04:56:35.636 7f8535912700 1 -- 172.16.1.254:0/272251814 --> v1:172.16.1.13:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300d5590 con 0x7f8514003260
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_event
2020-07-08 04:56:35.636 7f852fb48700 5 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_recv_state (warped) reseting crypto handlers
2020-07-08 04:56:35.636 7f852fb48700 5 --2- 172.16.1.254:0/272251814 >> v2:172.16.1.11:3300/0 conn(0x7f8514009d00 0x7f851400c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).reset_security
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 126 remaining bytes 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f85300d88b0 done.
2020-07-08 04:56:35.636 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 107 remaining bytes 0
2020-07-08 04:56:35.636 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f85300d5590 done.
2020-07-08 04:56:35.636 7f8535912700 10 monclient: _renew_subs
2020-07-08 04:56:35.636 7f8535912700 10 monclient: _send_mon_message to mon.mon3 at v1:172.16.1.13:6789/0
2020-07-08 04:56:35.636 7f8535912700 1 -- 172.16.1.254:0/272251814 --> v1:172.16.1.13:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f85300cf8b0 con 0x7f8514003260
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.640 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 5 0x7f85300d5590 mon_map magic: 0 v1
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.640 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 5 ==== mon_map magic: 0 v1 ==== 388+0+0 (unknown 52263635 0 0) 0x7f85300d5590 con 0x7f8514003260
2020-07-08 04:56:35.640 7f852cb42700 10 monclient: handle_monmap mon_map magic: 0 v1
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.640 7f852cb42700 10 monclient: got monmap 1 from mon.mon3 (according to old e1)
2020-07-08 04:56:35.640 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 6 0x7f8528005270 mgrmap(e 5) v1
2020-07-08 04:56:35.640 7f852cb42700 10 monclient: dump:
epoch 1
fsid 14c749cf-7a81-3649-84ec-d2213594fc88
last_changed 2020-06-28 02:12:38.685392
created 2020-06-28 02:12:38.685392
min_mon_release 12 (luminous)
0: v1:172.16.1.11:6789/0 mon.mon1
1: v1:172.16.1.12:6789/0 mon.mon2
2: v1:172.16.1.13:6789/0 mon.mon3

2020-07-08 04:56:35.640 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:35.640 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 388 to dispatch throttler 921/104857600
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_event
2020-07-08 04:56:35.640 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 6 ==== mgrmap(e 5) v1 ==== 533+0+0 (unknown 3280036134 0 0) 0x7f8528005270 con 0x7f8514003260
2020-07-08 04:56:35.640 7f852cb42700 10 -- 172.16.1.254:0/272251814 create_connect v1:172.16.1.12:6800/1792, creating connection and registering
2020-07-08 04:56:35.640 7f852cb42700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_NONE l=1)._connect
2020-07-08 04:56:35.640 7f852cb42700 10 -- 172.16.1.254:0/272251814 create_connect 0x7f85100058a0 v1:172.16.1.12:6800/1792 v1:172.16.1.12:6800/1792
2020-07-08 04:56:35.640 7f852cb42700 10 -- 172.16.1.254:0/272251814 connect_to v1:172.16.1.12:6800/1792 new 0x7f85100058a0
2020-07-08 04:56:35.640 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 533 to dispatch throttler 533/104857600
2020-07-08 04:56:35.640 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 107 remaining bytes 0
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f85300cf8b0 done.
2020-07-08 04:56:35.640 7f852eb46700 10 NetHandler reconnect reconnect: Operation already in progress
2020-07-08 04:56:35.640 7f852eb46700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process nonblock connect inprogress
2020-07-08 04:56:35.640 7f852eb46700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process connect successfully, ready to send banner
2020-07-08 04:56:35.640 7f852eb46700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 9 remaining bytes 0
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING pgs=0 cs=0 l=1).handle_client_banner_write connect write banner done: v1:172.16.1.12:6800/1792
2020-07-08 04:56:35.640 7f8535912700 10 monclient: start_mon_command cmd=[{"prefix": "get_command_descriptions"}]
2020-07-08 04:56:35.640 7f8535912700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}]
2020-07-08 04:56:35.640 7f8535912700 10 monclient: _send_mon_message to mon.mon3 at v1:172.16.1.13:6789/0
2020-07-08 04:56:35.640 7f8535912700 1 -- 172.16.1.254:0/272251814 --> v1:172.16.1.13:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853008d5f0 con 0x7f8514003260
2020-07-08 04:56:35.640 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_event
2020-07-08 04:56:35.640 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 155 remaining bytes 0
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f853008d5f0 done.
2020-07-08 04:56:35.640 7f852eb46700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 136 remaining bytes 0
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_my_addr_write connect sent my addr v1:172.16.1.254:0/272251814
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).send_connect_message connect_msg.authorizer_len=174 protocol=2
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).send_connect_message connect sending gseq=22 cseq=0 proto=0
2020-07-08 04:56:35.640 7f852eb46700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 207 remaining bytes 0
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).wait_connect_reply_auth reply.authorizer_len=32
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_auth connect got auth challenge
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).send_connect_message connect_msg.authorizer_len=174 protocol=2
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).send_connect_message connect sending gseq=22 cseq=0 proto=0
2020-07-08 04:56:35.640 7f852eb46700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 207 remaining bytes 0
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.640 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.640 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 7 0x7f8528005e20 osd_map(112..112 src has 1..112) v3
2020-07-08 04:56:35.640 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 7 ==== osd_map(112..112 src has 1..112) v3 ==== 9331+0+0 (unknown 4231233528 0 0) 0x7f8528005e20 con 0x7f8514003260
2020-07-08 04:56:35.640 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 9331 to dispatch throttler 9331/104857600
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).wait_connect_reply_auth reply.authorizer_len=36
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_2 got CEPH_MSGR_TAG_SEQ, reading acked_seq and writing in_seq
2020-07-08 04:56:35.640 7f852eb46700 2 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_ack_seq got newly_acked_seq 0 vs out_seq 0
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).discard_requeued_up_to 0
2020-07-08 04:56:35.640 7f852eb46700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 8 remaining bytes 0
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_in_seq_write send in_seq done
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=1041 cs=1 l=1).client_ready connect success 1, lossy = 1, features 4611087853746454523
2020-07-08 04:56:35.640 7f852eb46700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=1041 cs=1 l=1).client_ready setting up session_security with auth 0x7f8518047810
2020-07-08 04:56:35.644 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.644 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.644 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 8 0x7f85300e8d50 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1
2020-07-08 04:56:35.644 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66328 (unknown 1092875540 0 1538068772) 0x7f85300e8d50 con 0x7f8514003260
2020-07-08 04:56:35.644 7f852cb42700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}]
2020-07-08 04:56:35.644 7f852cb42700 10 monclient: _finish_command 1 = 0
2020-07-08 04:56:35.644 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 66400 to dispatch throttler 66400/104857600
2020-07-08 04:56:35.740 7f8535912700 10 monclient: start_mon_command cmd=[{"prefix": "status"}]
2020-07-08 04:56:35.740 7f8535912700 10 monclient: _send_command 2 [{"prefix": "status"}]
2020-07-08 04:56:35.740 7f8535912700 10 monclient: _send_mon_message to mon.mon3 at v1:172.16.1.13:6789/0
2020-07-08 04:56:35.740 7f8535912700 1 -- 172.16.1.254:0/272251814 --> v1:172.16.1.13:6789/0 -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8530044a10 con 0x7f8514003260
2020-07-08 04:56:35.740 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
2020-07-08 04:56:35.740 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_event
2020-07-08 04:56:35.740 7f852f347700 10 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 137 remaining bytes 0
2020-07-08 04:56:35.740 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).write_message sending 0x7f8530044a10 done.
2020-07-08 04:56:35.740 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer aborted = 0
2020-07-08 04:56:35.740 7f852f347700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1).handle_message_footer no session security set
2020-07-08 04:56:35.740 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=READ_FOOTER_AND_DISPATCH pgs=1077 cs=1 l=1). rx mon.2 seq 9 0x7f8528003590 mon_command_ack([{"prefix": "status"}]=0 v0) v1
2020-07-08 04:56:35.740 7f852cb42700 1 -- 172.16.1.254:0/272251814 <== mon.2 v1:172.16.1.13:6789/0 9 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+419 (unknown 1155462804 0 1008051620) 0x7f8528003590 con 0x7f8514003260
2020-07-08 04:56:35.740 7f852cb42700 10 monclient: handle_mon_command_ack 2 [{"prefix": "status"}]
2020-07-08 04:56:35.740 7f852cb42700 10 monclient: _finish_command 2 = 0
2020-07-08 04:56:35.740 7f852cb42700 10 -- 172.16.1.254:0/272251814 dispatch_throttle_release 473 to dispatch throttler 473/104857600
cluster:
id: 14c749cf-7a81-3649-84ec-d2213594fc88
health: HEALTH_WARN
clock skew detected on mon.mon2, mon.mon3
services:
mon: 3 daemons, quorum mon1,mon2,mon3
mgr: mon2(active), standbys: mon1, mon3
osd: 30 osds: 30 up, 30 in
data:
pools: 1 pools, 1024 pgs
objects: 0 objects, 0B
usage: 30.4GiB used, 567GiB / 597GiB avail
pgs: 1024 active+clean
2020-07-08 04:56:35.740 7f8535912700 1 -- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 legacy=0x7f8510007d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2020-07-08 04:56:35.740 7f8535912700 2 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=OPENED pgs=1041 cs=1 l=1).stop
2020-07-08 04:56:35.740 7f8535912700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=OPENED pgs=1041 cs=1 l=1).reset_recv_state
2020-07-08 04:56:35.740 7f8535912700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=OPENED pgs=1041 cs=1 l=1).discard_out_queue started
2020-07-08 04:56:35.740 7f8535912700 10 monclient: shutdown
2020-07-08 04:56:35.740 7f8535912700 1 -- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 legacy=0x7f8514005770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2020-07-08 04:56:35.740 7f8535912700 2 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).stop
2020-07-08 04:56:35.740 7f8535912700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).reset_recv_state
2020-07-08 04:56:35.740 7f8535912700 10 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=OPENED pgs=1077 cs=1 l=1).discard_out_queue started
2020-07-08 04:56:35.740 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CLOSED pgs=1077 cs=1 l=1).reset_recv_state (warped) reseting security handlers
2020-07-08 04:56:35.740 7f852f347700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.13:6789/0 conn(0x7f8514003260 0x7f8514005770 :-1 s=CLOSED pgs=1077 cs=1 l=1).reset_security
2020-07-08 04:56:35.740 7f852eb46700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CLOSED pgs=1041 cs=1 l=1).reset_recv_state (warped) reseting security handlers
2020-07-08 04:56:35.740 7f852eb46700 5 --1- 172.16.1.254:0/272251814 >> v1:172.16.1.12:6800/1792 conn(0x7f85100058a0 0x7f8510007d00 :-1 s=CLOSED pgs=1041 cs=1 l=1).reset_security
2020-07-08 04:56:35.740 7f852fb48700 1 -- 172.16.1.254:0/272251814 reap_dead start
2020-07-08 04:56:35.740 7f852fb48700 5 -- 172.16.1.254:0/272251814 reap_dead delete 0x7f85100058a0
2020-07-08 04:56:35.740 7f852fb48700 5 -- 172.16.1.254:0/272251814 reap_dead delete 0x7f8514003260
2020-07-08 04:56:35.740 7f852fb48700 5 -- 172.16.1.254:0/272251814 reap_dead delete 0x7f85140070d0
2020-07-08 04:56:35.740 7f852fb48700 5 -- 172.16.1.254:0/272251814 reap_dead delete 0x7f8514009d00
2020-07-08 04:56:35.740 7f852fb48700 5 -- 172.16.1.254:0/272251814 reap_dead delete 0x7f85300d4b90
2020-07-08 04:56:35.740 7f8535912700 10 -- 172.16.1.254:0/272251814 shutdown 172.16.1.254:0/272251814
2020-07-08 04:56:35.740 7f8535912700 10 Processor -- stop
2020-07-08 04:56:35.744 7f8535912700 1 -- 172.16.1.254:0/272251814 shutdown_connections
2020-07-08 04:56:35.744 7f8535912700 1 -- 172.16.1.254:0/272251814 >> 172.16.1.254:0/272251814 conn(0x7f85300cd080 msgr2=0x7f85300cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down
2020-07-08 04:56:35.744 7f8535912700 2 --1- 172.16.1.254:0/272251814 >> 172.16.1.254:0/272251814 conn(0x7f85300cd080 0x7f85300cd4d0 :-1 s=NONE pgs=0 cs=0 l=0).stop
2020-07-08 04:56:35.744 7f8535912700 5 --1- 172.16.1.254:0/272251814 >> 172.16.1.254:0/272251814 conn(0x7f85300cd080 0x7f85300cd4d0 :-1 s=NONE pgs=0 cs=0 l=0).reset_recv_state
2020-07-08 04:56:35.744 7f8535912700 10 --1- 172.16.1.254:0/272251814 >> 172.16.1.254:0/272251814 conn(0x7f85300cd080 0x7f85300cd4d0 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started
2020-07-08 04:56:35.744 7f852fb48700 5 --1- 172.16.1.254:0/272251814 >> 172.16.1.254:0/272251814 conn(0x7f85300cd080 0x7f85300cd4d0 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_recv_state (warped) reseting security handlers
2020-07-08 04:56:35.744 7f852fb48700 5 --1- 172.16.1.254:0/272251814 >> 172.16.1.254:0/272251814 conn(0x7f85300cd080 0x7f85300cd4d0 :-1 s=CLOSED pgs=0 cs=0 l=0).reset_security
2020-07-08 04:56:35.744 7f8535912700 10 -- 172.16.1.254:0/272251814 wait: waiting for dispatch queue
2020-07-08 04:56:35.744 7f8535912700 10 -- 172.16.1.254:0/272251814 wait: dispatch queue is stopped
2020-07-08 04:56:35.744 7f8535912700 1 -- 172.16.1.254:0/272251814 shutdown_connections
2020-07-08 04:56:35.744 7f8535912700 5 -- 172.16.1.254:0/272251814 shutdown_connections delete 0x7f85300cd080
2020-07-08 04:56:35.744 7f8535912700 10 -- 172.16.1.254:0/272251814 wait: done.
2020-07-08 04:56:35.744 7f8535912700 1 -- 172.16.1.254:0/272251814 wait complete.
    (1-1/1)