2019-07-09T13:29:45.054+0800 7ff56b7e3b80 10 monclient: get_monmap_and_config 2019-07-09T13:29:45.055+0800 7ff56b7e3b80 10 monclient: build_initial_monmap 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 10 monclient: monmap: epoch 0 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:45.056887+0800 created 2019-07-09T13:29:45.056887+0800 min_mon_release 0 (unknown) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.noname-a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.noname-b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.noname-c 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 10 monclient: init 2019-07-09T13:29:45.060+0800 7ff56b7e3b80 10 monclient: _reopen_session rank -1 2019-07-09T13:29:45.060+0800 7ff56b7e3b80 10 monclient: _add_conns ranks=[1,2,0] 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-b con 0x56054a8bec00 addr [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-c con 0x56054a8bf000 addr [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-a con 0x56054a8bf400 addr [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): _renew_subs 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): authenticate will time out at 2019-07-09T13:34:45.062182+0800 2019-07-09T13:29:45.061+0800 7ff55b9ad700 10 monclient(hunting): get_auth_request con 0x56054a8bf000 auth_method 0 2019-07-09T13:29:45.061+0800 7ff55b9ad700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] 2019-07-09T13:29:45.061+0800 7ff55b9ad700 10 monclient(hunting): _init_auth method 2 2019-07-09T13:29:45.061+0800 7ff55c9af700 10 monclient(hunting): get_auth_request con 0x56054a8bf400 auth_method 0 2019-07-09T13:29:45.061+0800 7ff55c9af700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] 2019-07-09T13:29:45.061+0800 7ff55c9af700 10 monclient(hunting): _init_auth method 2 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): get_auth_request con 0x56054a8bec00 auth_method 0 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): _init_auth method 2 2019-07-09T13:29:45.062+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_reply_more payload 9 2019-07-09T13:29:45.062+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2019-07-09T13:29:45.062+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2019-07-09T13:29:45.062+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload 9 2019-07-09T13:29:45.062+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2019-07-09T13:29:45.062+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): handle_auth_reply_more payload 9 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2019-07-09T13:29:45.063+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_done global_id 4130 payload 386 2019-07-09T13:29:45.063+0800 7ff55b9ad700 10 monclient: _finish_hunting 0 2019-07-09T13:29:45.063+0800 7ff55b9ad700 1 monclient: found mon.noname-c 2019-07-09T13:29:45.063+0800 7ff55b9ad700 10 monclient: _send_mon_message to mon.noname-c at v2:127.0.0.1:40744/0 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: handle_monmap mon_map magic: 0 v1 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: dump: epoch 1 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:40.195215+0800 created 2019-07-09T13:29:40.195215+0800 min_mon_release 15 (octopus) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.c 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: _finish_auth 0 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-07-09T13:29:15.065754+0800) 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: _send_mon_message to mon.c at v2:127.0.0.1:40744/0 2019-07-09T13:29:45.065+0800 7ff56b7e3b80 5 monclient: authenticate success, global_id 4130 2019-07-09T13:29:45.065+0800 7ff55b1ac700 10 monclient: handle_config config(9 keys) v1 2019-07-09T13:29:45.065+0800 7ff56b7e3b80 10 monclient: get_monmap_and_config success 2019-07-09T13:29:45.065+0800 7ff56b7e3b80 10 monclient: shutdown 2019-07-09T13:29:45.065+0800 7ff55b1ac700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 2019-07-09T13:29:45.065+0800 7ff5599a9700 4 set_mon_vals no callback set 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_mgr = 20/20 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_mon = 20/20 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_monc = 20/20 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_ms = 1/1 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals mgr/dashboard/x/ssl_server_port = 41740 (unrecognized option) 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals mgr/restful/x/server_port = 42740 (unrecognized option) 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals mon_pg_warn_min_per_osd = 3 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals osd_pool_default_min_size = 1 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals osd_pool_default_size = 3 2019-07-09T13:29:45.071+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 shutdown_connections 2019-07-09T13:29:45.071+0800 7ff56b7e3b80 1 --2- 127.0.0.1:0/3873794671 >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bf400 0x56054b536b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 --2- 127.0.0.1:0/3873794671 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b536580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 --2- 127.0.0.1:0/3873794671 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8bec00 0x56054b536000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 shutdown_connections 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 wait complete. 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 >> 127.0.0.1:0/3873794671 conn(0x56054a8be800 msgr2=0x56054a8b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2019-07-09T13:29:45.073+0800 7ff56b7e3b80 0 ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev), process ceph-mgr, pid 3037225 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 1 Processor -- start 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 1 -- start start 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 10 monclient: build_initial_monmap 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 10 monclient: monmap: epoch 0 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:45.084528+0800 created 2019-07-09T13:29:45.084528+0800 min_mon_release 0 (unknown) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.noname-a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.noname-b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.noname-c 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 4 mgr init Registered monc callback 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 10 monclient: init 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient: _reopen_session rank -1 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient: _add_conns ranks=[2,0,1] 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 --2- >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-c con 0x56054a8bf000 addr [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 --2- >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-a con 0x56054a8bec00 addr [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 --2- >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-b con 0x56054a8be800 addr [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 -- --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- mon_getmap magic: 0 v1 -- 0x56054a858700 con 0x56054a8bec00 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 -- --> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] -- mon_getmap magic: 0 v1 -- 0x56054a858540 con 0x56054a8be800 2019-07-09T13:29:45.087+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection 2019-07-09T13:29:45.087+0800 7ff56b7e3b80 1 -- --> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] -- mon_getmap magic: 0 v1 -- 0x56054a858380 con 0x56054a8bf000 2019-07-09T13:29:45.087+0800 7ff56b7e3b80 10 monclient(hunting): _renew_subs 2019-07-09T13:29:45.086+0800 7ff55a9ab700 1 --2- >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-07-09T13:29:45.087+0800 7ff55a1aa700 1 --2- >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-07-09T13:29:45.087+0800 7ff55a9ab700 1 --2- >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:127.0.0.1:40744/0 says I am v2:127.0.0.1:42130/0 (socket says 127.0.0.1:42130) 2019-07-09T13:29:45.087+0800 7ff55c9af700 1 --2- >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-07-09T13:29:45.087+0800 7ff55a1aa700 1 --2- >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:127.0.0.1:40740/0 says I am v2:127.0.0.1:54604/0 (socket says 127.0.0.1:54604) 2019-07-09T13:29:45.087+0800 7ff55a9ab700 1 -- 127.0.0.1:0/3037234 learned_addr learned my addr 127.0.0.1:0/3037234 (peer_addr_for_me v2:127.0.0.1:0/0) 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): get_auth_request con 0x56054a8bf000 auth_method 0 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): _init_auth method 2 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): get_auth_request con 0x56054a8bec00 auth_method 0 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): _init_auth method 2 2019-07-09T13:29:45.087+0800 7ff55c9af700 10 monclient(hunting): get_auth_request con 0x56054a8be800 auth_method 0 2019-07-09T13:29:45.087+0800 7ff55c9af700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] 2019-07-09T13:29:45.087+0800 7ff55c9af700 10 monclient(hunting): _init_auth method 2 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): handle_auth_reply_more payload 9 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_reply_more payload 9 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2019-07-09T13:29:45.088+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload 9 2019-07-09T13:29:45.088+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload_len 9 2019-07-09T13:29:45.088+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2019-07-09T13:29:45.090+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_done global_id 4131 payload 1102 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 -- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 msgr2=0x56054b546000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 -- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 msgr2=0x56054b546b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-07-09T13:29:45.090+0800 7ff55a1aa700 10 monclient: _finish_hunting 0 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 monclient: found mon.noname-a 2019-07-09T13:29:45.090+0800 7ff55a1aa700 20 monclient: _un_backoff reopen_interval_multipler now 1 2019-07-09T13:29:45.090+0800 7ff55a1aa700 10 monclient: _send_mon_message to mon.noname-a at v2:127.0.0.1:40740/0 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 -- 127.0.0.1:0/3037234 --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=0+}) v3 -- 0x56054a882600 con 0x56054a8bec00 2019-07-09T13:29:45.090+0800 7ff55c9af700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-07-09T13:29:45.090+0800 7ff55a9ab700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).ready entity=mon.0 client_cookie=ff65153b8d19af74 server_cookie=0 in_seq=0 out_seq=0 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 <== mon.0 v2:127.0.0.1:40740/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (crc 0 0 0) 0x56054b53b000 con 0x56054a8bec00 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: handle_monmap mon_map magic: 0 v1 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: dump: epoch 1 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:40.195215+0800 created 2019-07-09T13:29:40.195215+0800 min_mon_release 15 (octopus) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.c 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: _finish_auth 0 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-07-09T13:29:15.092261+0800) 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: _send_mon_message to mon.a at v2:127.0.0.1:40740/0 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- auth(proto 2 2 bytes epoch 0) v1 -- 0x56054a867b00 con 0x56054a8bec00 2019-07-09T13:29:45.091+0800 7ff56b7e3b80 5 monclient: authenticate success, global_id 4131 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 <== mon.0 v2:127.0.0.1:40740/0 2 ==== config(9 keys) v1 ==== 268+0+0 (crc 0 0 0) 0x56054a85a780 con 0x56054a8bec00 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: handle_config config(9 keys) v1 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 <== mon.0 v2:127.0.0.1:40740/0 3 ==== mgrmap(e 1) v1 ==== 286+0+0 (crc 0 0 0) 0x56054b44e000 con 0x56054a8bec00 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_mgr : 20/20 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_mgr 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_mgr = 20/20 (no change) 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_mon : 20/20 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_mon 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_mon = 20/20 (no change) 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_monc : 20/20 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_monc 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_monc = 20/20 (no change) 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_ms : 1/1 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_ms 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_ms = 1/1 (no change) 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: mgr/dashboard/x/ssl_server_port : 41740 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 mgr[py] Loaded module_config entry mgr/dashboard/x/ssl_server_port:41740 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback consumed mgr/dashboard/x/ssl_server_port 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: mgr/restful/x/server_port : 42740 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 mgr[py] Loaded module_config entry mgr/restful/x/server_port:42740 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback consumed mgr/restful/x/server_port 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: mon_pg_warn_min_per_osd : 3 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback ignored mon_pg_warn_min_per_osd 2019-07-09T13:29:45.092+0800 7ff5559a1700 20 set_mon_vals mon_pg_warn_min_per_osd = 3 (no change) 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: osd_pool_default_min_size : 1 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback ignored osd_pool_default_min_size 2019-07-09T13:29:45.092+0800 7ff5559a1700 20 set_mon_vals osd_pool_default_min_size = 1 (no change) 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: osd_pool_default_size : 3 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback ignored osd_pool_default_size 2019-07-09T13:29:45.092+0800 7ff5559a1700 20 set_mon_vals osd_pool_default_size = 3 (no change) 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 20 log_channel(cluster) update_config log_to_monitors {default=true} log_to_syslog {default=false} log_channels {audit=local0,default=daemon} log_prios {default=info} 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: daemon prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 20 log_channel(audit) update_config log_to_monitors {default=true} log_to_syslog {default=false} log_channels {audit=local0,default=daemon} log_prios {default=info} 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: local0 prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 10 monclient: _renew_subs 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 10 monclient: _send_mon_message to mon.a at v2:127.0.0.1:40740/0 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3037234 --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56054b53b800 con 0x56054a8bec00 2019-07-09T13:29:45.109+0800 7ff56b7e3b80 1 mgr[py] Loading python module 'ansible' 2019-07-09T13:29:45.117+0800 7ff56b7e3b80 10 mgr[py] Computed sys.path '/home/xuxuehan/mnt/github-ceph/src/pybind:/home/xuxuehan/mnt/github-ceph/build/lib/cython_modules/lib.2:/opt/rh/devtoolset-8/root/usr/lib64/python2.7/site-packages:/opt/rh/devtoolset-8/root/usr/lib/python2.7/site-packages:/usr/lib64/python27.zip:/usr/lib64/python2.7/:/usr/lib64/python2.7/plat-linux2:/usr/lib64/python2.7/lib-tk:/usr/lib64/python2.7/lib-old:/usr/lib64/python2.7/lib-dynload:/home/xuxuehan/mnt/github-ceph/src/pybind/mgr:/usr/lib64/python2.7/site-packages:/usr/lib/python2.7/site-packages:/usr/lib/site-python' 2019-07-09T13:29:45.145+0800 7ff56b7e3b80 0 recursive lock of (4) ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev) 1: (ceph::mutex_debug_detail::mutex_debugging_base::_will_lock(bool)+0x4a) [0x7ff5624dd89c] 2: (ceph::shared_mutex_debug::lock()+0x3a) [0x7ff56257bbee] 3: (()+0x143a532) [0x7ff56241b532] 4: (CRYPTO_mem_ctrl()+0x39) [0x7ff55fdd1be9] 5: (()+0x4a60e) [0x7ff54a51b60e] 6: (SSL_COMP_get_compression_methods()+0x9) [0x7ff54a51d899] 7: (SSL_library_init()+0x179) [0x7ff54a5237b9] 8: (init_hashlib()+0x1f) [0x7ff54a74614f] 9: (_PyImport_LoadDynamicModule()+0x99) [0x7ff560d0ed69] 10: (()+0xf7e41) [0x7ff560d0ce41] 11: (()+0xf808d) [0x7ff560d0d08d] 12: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 13: (()+0xdbd1f) [0x7ff560cf0d1f] 14: (PyObject_Call()+0x43) [0x7ff560c60a63] 15: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 16: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 17: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 18: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 19: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 20: (()+0xf71a8) [0x7ff560d0c1a8] 21: (()+0xf7e41) [0x7ff560d0ce41] 22: (()+0xf808d) [0x7ff560d0d08d] 23: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 24: (()+0xdbd1f) [0x7ff560cf0d1f] 25: (PyObject_Call()+0x43) [0x7ff560c60a63] 26: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 27: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 28: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 29: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 30: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 31: (()+0xf71a8) [0x7ff560d0c1a8] 32: (()+0xf7e41) [0x7ff560d0ce41] 33: (()+0xf808d) [0x7ff560d0d08d] 34: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 35: (()+0xdbd1f) [0x7ff560cf0d1f] 36: (PyObject_Call()+0x43) [0x7ff560c60a63] 37: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 38: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 39: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 40: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 41: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 42: (()+0xf71a8) [0x7ff560d0c1a8] 43: (()+0xf7e41) [0x7ff560d0ce41] 44: (()+0xf8126) [0x7ff560d0d126] 45: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 46: (()+0xdbd1f) [0x7ff560cf0d1f] 47: (PyObject_Call()+0x43) [0x7ff560c60a63] 48: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 49: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 50: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 51: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 52: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 53: (()+0xf71a8) [0x7ff560d0c1a8] 54: (()+0xf7e41) [0x7ff560d0ce41] 55: (()+0xf808d) [0x7ff560d0d08d] 56: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 57: (()+0xdbd1f) [0x7ff560cf0d1f] 58: (PyObject_Call()+0x43) [0x7ff560c60a63] 59: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 60: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 61: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 62: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 63: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 64: (()+0xf71a8) [0x7ff560d0c1a8] 65: (()+0xf863a) [0x7ff560d0d63a] 66: (()+0xf7e41) [0x7ff560d0ce41] 67: (()+0xf808d) [0x7ff560d0d08d] 68: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 69: (()+0xdbd1f) [0x7ff560cf0d1f] 70: (PyObject_Call()+0x43) [0x7ff560c60a63] 71: (()+0x4bb45) [0x7ff560c60b45] 72: (PyObject_CallFunction()+0x8e) [0x7ff560c60c2e] 73: (PyImport_Import()+0x112) [0x7ff560d0e512] 74: (PyImport_ImportModule()+0x1a) [0x7ff560d0e68a] 75: (PyModule::load_subclass_of(char const*, _object**)+0x4c3) [0x5605495fbf51] 76: (PyModule::load(_ts*)+0x457) [0x5605495f8a59] 77: (PyModuleRegistry::init()+0x326) [0x5605496019d8] 78: (MgrStandby::init()+0x729) [0x5605495d418f] 79: (main()+0x235) [0x5605493ebaac] 80: (__libc_start_main()+0xf5) [0x7ff55e93b445] 81: (()+0x5a4245) [0x5605493eb245] 2019-07-09T13:29:45.164+0800 7ff56b7e3b80 -1 /home/xuxuehan/mnt/github-ceph/src/common/lockdep.cc: In function 'int lockdep_will_lock(const char*, int, bool, bool)' thread 7ff56b7e3b80 time 2019-07-09T13:29:45.155129+0800 /home/xuxuehan/mnt/github-ceph/src/common/lockdep.cc: 305: ceph_abort_msg("abort() called") ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev) 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xfe) [0x7ff5623ea874] 2: (lockdep_will_lock(char const*, int, bool, bool)+0x44b) [0x7ff5624d1b6f] 3: (ceph::mutex_debug_detail::mutex_debugging_base::_will_lock(bool)+0x4a) [0x7ff5624dd89c] 4: (ceph::shared_mutex_debug::lock()+0x3a) [0x7ff56257bbee] 5: (()+0x143a532) [0x7ff56241b532] 6: (CRYPTO_mem_ctrl()+0x39) [0x7ff55fdd1be9] 7: (()+0x4a60e) [0x7ff54a51b60e] 8: (SSL_COMP_get_compression_methods()+0x9) [0x7ff54a51d899] 9: (SSL_library_init()+0x179) [0x7ff54a5237b9] 10: (init_hashlib()+0x1f) [0x7ff54a74614f] 11: (_PyImport_LoadDynamicModule()+0x99) [0x7ff560d0ed69] 12: (()+0xf7e41) [0x7ff560d0ce41] 13: (()+0xf808d) [0x7ff560d0d08d] 14: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 15: (()+0xdbd1f) [0x7ff560cf0d1f] 16: (PyObject_Call()+0x43) [0x7ff560c60a63] 17: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 18: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 19: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 20: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 21: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 22: (()+0xf71a8) [0x7ff560d0c1a8] 23: (()+0xf7e41) [0x7ff560d0ce41] 24: (()+0xf808d) [0x7ff560d0d08d] 25: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 26: (()+0xdbd1f) [0x7ff560cf0d1f] 27: (PyObject_Call()+0x43) [0x7ff560c60a63] 28: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 29: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 30: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 31: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 32: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 33: (()+0xf71a8) [0x7ff560d0c1a8] 34: (()+0xf7e41) [0x7ff560d0ce41] 35: (()+0xf808d) [0x7ff560d0d08d] 36: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 37: (()+0xdbd1f) [0x7ff560cf0d1f] 38: (PyObject_Call()+0x43) [0x7ff560c60a63] 39: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 40: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 41: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 42: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 43: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 44: (()+0xf71a8) [0x7ff560d0c1a8] 45: (()+0xf7e41) [0x7ff560d0ce41] 46: (()+0xf8126) [0x7ff560d0d126] 47: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 48: (()+0xdbd1f) [0x7ff560cf0d1f] 49: (PyObject_Call()+0x43) [0x7ff560c60a63] 50: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 51: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 52: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 53: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 54: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 55: (()+0xf71a8) [0x7ff560d0c1a8] 56: (()+0xf7e41) [0x7ff560d0ce41] 57: (()+0xf808d) [0x7ff560d0d08d] 58: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 59: (()+0xdbd1f) [0x7ff560cf0d1f] 60: (PyObject_Call()+0x43) [0x7ff560c60a63] 61: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 62: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 63: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 64: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 65: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 66: (()+0xf71a8) [0x7ff560d0c1a8] 67: (()+0xf863a) [0x7ff560d0d63a] 68: (()+0xf7e41) [0x7ff560d0ce41] 69: (()+0xf808d) [0x7ff560d0d08d] 70: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 71: (()+0xdbd1f) [0x7ff560cf0d1f] 72: (PyObject_Call()+0x43) [0x7ff560c60a63] 73: (()+0x4bb45) [0x7ff560c60b45] 74: (PyObject_CallFunction()+0x8e) [0x7ff560c60c2e] 75: (PyImport_Import()+0x112) [0x7ff560d0e512] 76: (PyImport_ImportModule()+0x1a) [0x7ff560d0e68a] 77: (PyModule::load_subclass_of(char const*, _object**)+0x4c3) [0x5605495fbf51] 78: (PyModule::load(_ts*)+0x457) [0x5605495f8a59] 79: (PyModuleRegistry::init()+0x326) [0x5605496019d8] 80: (MgrStandby::init()+0x729) [0x5605495d418f] 81: (main()+0x235) [0x5605493ebaac] 82: (__libc_start_main()+0xf5) [0x7ff55e93b445] 83: (()+0x5a4245) [0x5605493eb245] 2019-07-09T13:29:45.175+0800 7ff56b7e3b80 -1 *** Caught signal (Aborted) ** in thread 7ff56b7e3b80 thread_name:ceph-mgr ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev) 1: (()+0x96a2f6) [0x5605497b12f6] 2: (()+0xf6d0) [0x7ff55fb566d0] 3: (gsignal()+0x37) [0x7ff55e94f277] 4: (abort()+0x148) [0x7ff55e950968] 5: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0x387) [0x7ff5623eaafd] 6: (lockdep_will_lock(char const*, int, bool, bool)+0x44b) [0x7ff5624d1b6f] 7: (ceph::mutex_debug_detail::mutex_debugging_base::_will_lock(bool)+0x4a) [0x7ff5624dd89c] 8: (ceph::shared_mutex_debug::lock()+0x3a) [0x7ff56257bbee] 9: (()+0x143a532) [0x7ff56241b532] 10: (CRYPTO_mem_ctrl()+0x39) [0x7ff55fdd1be9] 11: (()+0x4a60e) [0x7ff54a51b60e] 12: (SSL_COMP_get_compression_methods()+0x9) [0x7ff54a51d899] 13: (SSL_library_init()+0x179) [0x7ff54a5237b9] 14: (init_hashlib()+0x1f) [0x7ff54a74614f] 15: (_PyImport_LoadDynamicModule()+0x99) [0x7ff560d0ed69] 16: (()+0xf7e41) [0x7ff560d0ce41] 17: (()+0xf808d) [0x7ff560d0d08d] 18: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 19: (()+0xdbd1f) [0x7ff560cf0d1f] 20: (PyObject_Call()+0x43) [0x7ff560c60a63] 21: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 22: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 23: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 24: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 25: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 26: (()+0xf71a8) [0x7ff560d0c1a8] 27: (()+0xf7e41) [0x7ff560d0ce41] 28: (()+0xf808d) [0x7ff560d0d08d] 29: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 30: (()+0xdbd1f) [0x7ff560cf0d1f] 31: (PyObject_Call()+0x43) [0x7ff560c60a63] 32: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 33: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 34: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 35: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 36: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 37: (()+0xf71a8) [0x7ff560d0c1a8] 38: (()+0xf7e41) [0x7ff560d0ce41] 39: (()+0xf808d) [0x7ff560d0d08d] 40: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 41: (()+0xdbd1f) [0x7ff560cf0d1f] 42: (PyObject_Call()+0x43) [0x7ff560c60a63] 43: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 44: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 45: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 46: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 47: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 48: (()+0xf71a8) [0x7ff560d0c1a8] 49: (()+0xf7e41) [0x7ff560d0ce41] 50: (()+0xf8126) [0x7ff560d0d126] 51: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 52: (()+0xdbd1f) [0x7ff560cf0d1f] 53: (PyObject_Call()+0x43) [0x7ff560c60a63] 54: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 55: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 56: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 57: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 58: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 59: (()+0xf71a8) [0x7ff560d0c1a8] 60: (()+0xf7e41) [0x7ff560d0ce41] 61: (()+0xf808d) [0x7ff560d0d08d] 62: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 63: (()+0xdbd1f) [0x7ff560cf0d1f] 64: (PyObject_Call()+0x43) [0x7ff560c60a63] 65: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 66: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 67: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 68: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 69: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 70: (()+0xf71a8) [0x7ff560d0c1a8] 71: (()+0xf863a) [0x7ff560d0d63a] 72: (()+0xf7e41) [0x7ff560d0ce41] 73: (()+0xf808d) [0x7ff560d0d08d] 74: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 75: (()+0xdbd1f) [0x7ff560cf0d1f] 76: (PyObject_Call()+0x43) [0x7ff560c60a63] 77: (()+0x4bb45) [0x7ff560c60b45] 78: (PyObject_CallFunction()+0x8e) [0x7ff560c60c2e] 79: (PyImport_Import()+0x112) [0x7ff560d0e512] 80: (PyImport_ImportModule()+0x1a) [0x7ff560d0e68a] 81: (PyModule::load_subclass_of(char const*, _object**)+0x4c3) [0x5605495fbf51] 82: (PyModule::load(_ts*)+0x457) [0x5605495f8a59] 83: (PyModuleRegistry::init()+0x326) [0x5605496019d8] 84: (MgrStandby::init()+0x729) [0x5605495d418f] 85: (main()+0x235) [0x5605493ebaac] 86: (__libc_start_main()+0xf5) [0x7ff55e93b445] 87: (()+0x5a4245) [0x5605493eb245] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -334> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command assert hook 0x56054a83a530 -333> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command abort hook 0x56054a83a530 -332> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command perfcounters_dump hook 0x56054a83a530 -331> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command 1 hook 0x56054a83a530 -330> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command perf dump hook 0x56054a83a530 -329> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command perfcounters_schema hook 0x56054a83a530 -328> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command perf histogram dump hook 0x56054a83a530 -327> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command 2 hook 0x56054a83a530 -326> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command perf schema hook 0x56054a83a530 -325> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command perf histogram schema hook 0x56054a83a530 -324> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command perf reset hook 0x56054a83a530 -323> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command config show hook 0x56054a83a530 -322> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command config help hook 0x56054a83a530 -321> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command config set hook 0x56054a83a530 -320> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command config unset hook 0x56054a83a530 -319> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command config get hook 0x56054a83a530 -318> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command config diff hook 0x56054a83a530 -317> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command config diff get hook 0x56054a83a530 -316> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command log flush hook 0x56054a83a530 -315> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command log dump hook 0x56054a83a530 -314> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command log reopen hook 0x56054a83a530 -313> 2019-07-09T13:29:45.000+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command dump_mempools hook 0x56054a8802c8 -312> 2019-07-09T13:29:45.053+0800 7ff56b7e3b80 1 lockdep start -311> 2019-07-09T13:29:45.054+0800 7ff56b7e3b80 1 lockdep using id 0 -310> 2019-07-09T13:29:45.054+0800 7ff56b7e3b80 1 lockdep using id 1 -309> 2019-07-09T13:29:45.054+0800 7ff56b7e3b80 1 lockdep using id 2 -308> 2019-07-09T13:29:45.054+0800 7ff56b7e3b80 1 lockdep using id 3 -307> 2019-07-09T13:29:45.054+0800 7ff56b7e3b80 10 monclient: get_monmap_and_config -306> 2019-07-09T13:29:45.055+0800 7ff56b7e3b80 1 lockdep using id 4 -305> 2019-07-09T13:29:45.055+0800 7ff56b7e3b80 1 lockdep using id 5 -304> 2019-07-09T13:29:45.055+0800 7ff56b7e3b80 10 monclient: build_initial_monmap -303> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 10 monclient: monmap: epoch 0 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:45.056887+0800 created 2019-07-09T13:29:45.056887+0800 min_mon_release 0 (unknown) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.noname-a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.noname-b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.noname-c -302> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding auth protocol: cephx -301> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding auth protocol: cephx -300> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding auth protocol: cephx -299> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: secure -298> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: crc -297> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: secure -296> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: crc -295> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: secure -294> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: crc -293> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: crc -292> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: secure -291> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: crc -290> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: secure -289> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: crc -288> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fa138) adding con mode: secure -287> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 2 auth: KeyRing::load: loaded key file /home/xuxuehan/mnt/github-ceph/build/dev/mgr.x/keyring -286> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 1 lockdep using id 6 -285> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 1 lockdep using id 7 -284> 2019-07-09T13:29:45.056+0800 7ff56b7e3b80 1 lockdep using id 8 -283> 2019-07-09T13:29:45.057+0800 7ff56b7e3b80 1 lockdep using id 9 -282> 2019-07-09T13:29:45.057+0800 7ff56b7e3b80 1 lockdep using id 10 -281> 2019-07-09T13:29:45.057+0800 7ff56b7e3b80 1 lockdep using id 11 -280> 2019-07-09T13:29:45.057+0800 7ff56b7e3b80 1 lockdep using id 12 -279> 2019-07-09T13:29:45.057+0800 7ff56b7e3b80 1 lockdep using id 13 -278> 2019-07-09T13:29:45.057+0800 7ff56b7e3b80 1 lockdep using id 14 -277> 2019-07-09T13:29:45.057+0800 7ff56b7e3b80 1 lockdep using id 15 -276> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 1 lockdep using id 16 -275> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 10 monclient: init -274> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding auth protocol: cephx -273> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding auth protocol: cephx -272> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding auth protocol: cephx -271> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: secure -270> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: crc -269> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: secure -268> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: crc -267> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: secure -266> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: crc -265> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: crc -264> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: secure -263> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: crc -262> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: secure -261> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: crc -260> 2019-07-09T13:29:45.058+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328e460) adding con mode: secure -259> 2019-07-09T13:29:45.059+0800 7ff56b7e3b80 2 auth: KeyRing::load: loaded key file /home/xuxuehan/mnt/github-ceph/build/dev/mgr.x/keyring -258> 2019-07-09T13:29:45.060+0800 7ff56b7e3b80 2 auth: KeyRing::load: loaded key file /home/xuxuehan/mnt/github-ceph/build/dev/mgr.x/keyring -257> 2019-07-09T13:29:45.060+0800 7ff56b7e3b80 1 lockdep using id 17 -256> 2019-07-09T13:29:45.060+0800 7ff56b7e3b80 10 monclient: _reopen_session rank -1 -255> 2019-07-09T13:29:45.060+0800 7ff56b7e3b80 10 monclient: _add_conns ranks=[1,2,0] -254> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-b con 0x56054a8bec00 addr [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] -253> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-c con 0x56054a8bf000 addr [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] -252> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-a con 0x56054a8bf400 addr [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -251> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection -250> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection -249> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection -248> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): _renew_subs -247> 2019-07-09T13:29:45.061+0800 7ff56b7e3b80 10 monclient(hunting): authenticate will time out at 2019-07-09T13:34:45.062182+0800 -246> 2019-07-09T13:29:45.061+0800 7ff55b9ad700 10 monclient(hunting): get_auth_request con 0x56054a8bf000 auth_method 0 -245> 2019-07-09T13:29:45.061+0800 7ff55b9ad700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] -244> 2019-07-09T13:29:45.061+0800 7ff55b9ad700 10 monclient(hunting): _init_auth method 2 -243> 2019-07-09T13:29:45.061+0800 7ff55c9af700 10 monclient(hunting): get_auth_request con 0x56054a8bf400 auth_method 0 -242> 2019-07-09T13:29:45.061+0800 7ff55c9af700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] -241> 2019-07-09T13:29:45.061+0800 7ff55c9af700 10 monclient(hunting): _init_auth method 2 -240> 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): get_auth_request con 0x56054a8bec00 auth_method 0 -239> 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] -238> 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): _init_auth method 2 -237> 2019-07-09T13:29:45.062+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_reply_more payload 9 -236> 2019-07-09T13:29:45.062+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -235> 2019-07-09T13:29:45.062+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -234> 2019-07-09T13:29:45.062+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload 9 -233> 2019-07-09T13:29:45.062+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -232> 2019-07-09T13:29:45.062+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -231> 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): handle_auth_reply_more payload 9 -230> 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -229> 2019-07-09T13:29:45.062+0800 7ff55c1ae700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -228> 2019-07-09T13:29:45.063+0800 7ff55b9ad700 10 monclient(hunting): handle_auth_done global_id 4130 payload 386 -227> 2019-07-09T13:29:45.063+0800 7ff55b9ad700 10 monclient: _finish_hunting 0 -226> 2019-07-09T13:29:45.063+0800 7ff55b9ad700 1 monclient: found mon.noname-c -225> 2019-07-09T13:29:45.063+0800 7ff55b9ad700 10 monclient: _send_mon_message to mon.noname-c at v2:127.0.0.1:40744/0 -224> 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: handle_monmap mon_map magic: 0 v1 -223> 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: got monmap 1 from mon.noname-c (according to old e1) -222> 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: dump: epoch 1 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:40.195215+0800 created 2019-07-09T13:29:40.195215+0800 min_mon_release 15 (octopus) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.c -221> 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: _finish_auth 0 -220> 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-07-09T13:29:15.065754+0800) -219> 2019-07-09T13:29:45.064+0800 7ff55b1ac700 10 monclient: _send_mon_message to mon.c at v2:127.0.0.1:40744/0 -218> 2019-07-09T13:29:45.065+0800 7ff56b7e3b80 5 monclient: authenticate success, global_id 4130 -217> 2019-07-09T13:29:45.065+0800 7ff55b1ac700 10 monclient: handle_config config(9 keys) v1 -216> 2019-07-09T13:29:45.065+0800 7ff56b7e3b80 10 monclient: get_monmap_and_config success -215> 2019-07-09T13:29:45.065+0800 7ff56b7e3b80 10 monclient: shutdown -214> 2019-07-09T13:29:45.065+0800 7ff55b1ac700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 -213> 2019-07-09T13:29:45.065+0800 7ff5599a9700 4 set_mon_vals no callback set -212> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_mgr = 20/20 -211> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_mon = 20/20 -210> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_monc = 20/20 -209> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals debug_ms = 1/1 -208> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals mgr/dashboard/x/ssl_server_port = 41740 (unrecognized option) -207> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals mgr/restful/x/server_port = 42740 (unrecognized option) -206> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals mon_pg_warn_min_per_osd = 3 -205> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals osd_pool_default_min_size = 1 -204> 2019-07-09T13:29:45.065+0800 7ff5599a9700 10 set_mon_vals osd_pool_default_size = 3 -203> 2019-07-09T13:29:45.071+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 shutdown_connections -202> 2019-07-09T13:29:45.071+0800 7ff56b7e3b80 1 --2- 127.0.0.1:0/3873794671 >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bf400 0x56054b536b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop -201> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 --2- 127.0.0.1:0/3873794671 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b536580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop -200> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 --2- 127.0.0.1:0/3873794671 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8bec00 0x56054b536000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop -199> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 lockdep using id 18 -198> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 shutdown_connections -197> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 lockdep reusing last freed id 18 -196> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 wait complete. -195> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3873794671 >> 127.0.0.1:0/3873794671 conn(0x56054a8be800 msgr2=0x56054a8b3000 unknown :-1 s=STATE_NONE l=0).mark_down -194> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 lockdep reusing last freed id 1 -193> 2019-07-09T13:29:45.072+0800 7ff56b7e3b80 1 lockdep using id 2 -192> 2019-07-09T13:29:45.073+0800 7ff56b7e3b80 1 lockdep using id 3 -191> 2019-07-09T13:29:45.073+0800 7ff56b7e3b80 0 ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev), process ceph-mgr, pid 3037225 -190> 2019-07-09T13:29:45.073+0800 7ff56b7e3b80 1 lockdep using id 6 -189> 2019-07-09T13:29:45.075+0800 7ff56b7e3b80 1 finished global_init_daemonize -188> 2019-07-09T13:29:45.077+0800 7ff56b7e3b80 1 lockdep reusing last freed id 15 -187> 2019-07-09T13:29:45.077+0800 7ff56b7e3b80 1 lockdep using id 7 -186> 2019-07-09T13:29:45.077+0800 7ff56b7e3b80 1 lockdep using id 8 -185> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) init /tmp/ceph-asok.FBxmu9/mgr.x.asok -184> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) bind_and_listen /tmp/ceph-asok.FBxmu9/mgr.x.asok -183> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command 0 hook 0x56054a838568 -182> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command version hook 0x56054a838568 -181> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command git_version hook 0x56054a838568 -180> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command help hook 0x56054a83a480 -179> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command get_command_descriptions hook 0x56054a83aa60 -178> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 1 lockdep using id 9 -177> 2019-07-09T13:29:45.078+0800 7ff55c1ae700 5 asok(0x56054a8b6000) entry start -176> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 1 lockdep using id 11 -175> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 1 lockdep using id 12 -174> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding auth protocol: cephx -173> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding auth protocol: cephx -172> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding auth protocol: cephx -171> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: secure -170> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: crc -169> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: secure -168> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: crc -167> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: secure -166> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: crc -165> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: crc -164> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: secure -163> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: crc -162> 2019-07-09T13:29:45.078+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: secure -161> 2019-07-09T13:29:45.079+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: crc -160> 2019-07-09T13:29:45.079+0800 7ff56b7e3b80 5 AuthRegistry(0x56054a8fb338) adding con mode: secure -159> 2019-07-09T13:29:45.079+0800 7ff56b7e3b80 2 auth: KeyRing::load: loaded key file /home/xuxuehan/mnt/github-ceph/build/dev/mgr.x/keyring -158> 2019-07-09T13:29:45.079+0800 7ff56b7e3b80 1 lockdep using id 13 -157> 2019-07-09T13:29:45.079+0800 7ff56b7e3b80 1 lockdep using id 14 -156> 2019-07-09T13:29:45.079+0800 7ff56b7e3b80 1 lockdep using id 16 -155> 2019-07-09T13:29:45.079+0800 7ff56b7e3b80 1 lockdep using id 17 -154> 2019-07-09T13:29:45.080+0800 7ff56b7e3b80 1 lockdep using id 18 -153> 2019-07-09T13:29:45.080+0800 7ff56b7e3b80 1 lockdep using id 19 -152> 2019-07-09T13:29:45.080+0800 7ff56b7e3b80 1 lockdep using id 20 -151> 2019-07-09T13:29:45.080+0800 7ff56b7e3b80 1 lockdep using id 21 -150> 2019-07-09T13:29:45.080+0800 7ff56b7e3b80 1 lockdep using id 22 -149> 2019-07-09T13:29:45.081+0800 7ff56b7e3b80 1 lockdep using id 23 -148> 2019-07-09T13:29:45.081+0800 7ff56b7e3b80 1 lockdep using id 24 -147> 2019-07-09T13:29:45.081+0800 7ff56b7e3b80 1 lockdep using id 25 -146> 2019-07-09T13:29:45.081+0800 7ff56b7e3b80 1 lockdep using id 26 -145> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 27 -144> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 28 -143> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 29 -142> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 30 -141> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 31 -140> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 32 -139> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 33 -138> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 34 -137> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 35 -136> 2019-07-09T13:29:45.082+0800 7ff56b7e3b80 1 lockdep using id 36 -135> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 1 Processor -- start -134> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 1 -- start start -133> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 10 monclient: build_initial_monmap -132> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 10 monclient: monmap: epoch 0 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:45.084528+0800 created 2019-07-09T13:29:45.084528+0800 min_mon_release 0 (unknown) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.noname-a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.noname-b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.noname-c -131> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 4 mgr init Registered monc callback -130> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 10 monclient: init -129> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding auth protocol: cephx -128> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding auth protocol: cephx -127> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding auth protocol: cephx -126> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: secure -125> 2019-07-09T13:29:45.083+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: crc -124> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: secure -123> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: crc -122> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: secure -121> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: crc -120> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: crc -119> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: secure -118> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: crc -117> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: secure -116> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: crc -115> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 5 AuthRegistry(0x7ffd6328ff98) adding con mode: secure -114> 2019-07-09T13:29:45.084+0800 7ff56b7e3b80 2 auth: KeyRing::load: loaded key file /home/xuxuehan/mnt/github-ceph/build/dev/mgr.x/keyring -113> 2019-07-09T13:29:45.085+0800 7ff56b7e3b80 2 auth: KeyRing::load: loaded key file /home/xuxuehan/mnt/github-ceph/build/dev/mgr.x/keyring -112> 2019-07-09T13:29:45.085+0800 7ff56b7e3b80 1 lockdep using id 37 -111> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient: _reopen_session rank -1 -110> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient: _add_conns ranks=[2,0,1] -109> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 --2- >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect -108> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-c con 0x56054a8bf000 addr [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] -107> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 --2- >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect -106> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-a con 0x56054a8bec00 addr [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -105> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 --2- >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect -104> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): picked mon.noname-b con 0x56054a8be800 addr [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] -103> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection -102> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 -- --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- mon_getmap magic: 0 v1 -- 0x56054a858700 con 0x56054a8bec00 -101> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection -100> 2019-07-09T13:29:45.086+0800 7ff56b7e3b80 1 -- --> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] -- mon_getmap magic: 0 v1 -- 0x56054a858540 con 0x56054a8be800 -99> 2019-07-09T13:29:45.087+0800 7ff56b7e3b80 10 monclient(hunting): start opening mon connection -98> 2019-07-09T13:29:45.087+0800 7ff56b7e3b80 1 -- --> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] -- mon_getmap magic: 0 v1 -- 0x56054a858380 con 0x56054a8bf000 -97> 2019-07-09T13:29:45.087+0800 7ff56b7e3b80 10 monclient(hunting): _renew_subs -96> 2019-07-09T13:29:45.086+0800 7ff55a9ab700 1 --2- >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 -95> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 1 --2- >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 -94> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 1 --2- >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:127.0.0.1:40744/0 says I am v2:127.0.0.1:42130/0 (socket says 127.0.0.1:42130) -93> 2019-07-09T13:29:45.087+0800 7ff55c9af700 1 --2- >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 -92> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 1 --2- >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:127.0.0.1:40740/0 says I am v2:127.0.0.1:54604/0 (socket says 127.0.0.1:54604) -91> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 1 -- 127.0.0.1:0/3037234 learned_addr learned my addr 127.0.0.1:0/3037234 (peer_addr_for_me v2:127.0.0.1:0/0) -90> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): get_auth_request con 0x56054a8bf000 auth_method 0 -89> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] -88> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): _init_auth method 2 -87> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): get_auth_request con 0x56054a8bec00 auth_method 0 -86> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] -85> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): _init_auth method 2 -84> 2019-07-09T13:29:45.087+0800 7ff55c9af700 10 monclient(hunting): get_auth_request con 0x56054a8be800 auth_method 0 -83> 2019-07-09T13:29:45.087+0800 7ff55c9af700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2] -82> 2019-07-09T13:29:45.087+0800 7ff55c9af700 10 monclient(hunting): _init_auth method 2 -81> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): handle_auth_reply_more payload 9 -80> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -79> 2019-07-09T13:29:45.087+0800 7ff55a9ab700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -78> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_reply_more payload 9 -77> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -76> 2019-07-09T13:29:45.087+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -75> 2019-07-09T13:29:45.088+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload 9 -74> 2019-07-09T13:29:45.088+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more payload_len 9 -73> 2019-07-09T13:29:45.088+0800 7ff55c9af700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes -72> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 10 monclient(hunting): handle_auth_done global_id 4131 payload 1102 -71> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 -- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 msgr2=0x56054b546000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down -70> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop -69> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 -- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 msgr2=0x56054b546b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down -68> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop -67> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 10 monclient: _finish_hunting 0 -66> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 monclient: found mon.noname-a -65> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 20 monclient: _un_backoff reopen_interval_multipler now 1 -64> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 10 monclient: _send_mon_message to mon.noname-a at v2:127.0.0.1:40740/0 -63> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 -- 127.0.0.1:0/3037234 --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=0+}) v3 -- 0x56054a882600 con 0x56054a8bec00 -62> 2019-07-09T13:29:45.090+0800 7ff55c9af700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] conn(0x56054a8be800 0x56054b546b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! -61> 2019-07-09T13:29:45.090+0800 7ff55a9ab700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] conn(0x56054a8bf000 0x56054b546000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! -60> 2019-07-09T13:29:45.090+0800 7ff55a1aa700 1 --2- 127.0.0.1:0/3037234 >> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] conn(0x56054a8bec00 0x56054b546580 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).ready entity=mon.0 client_cookie=ff65153b8d19af74 server_cookie=0 in_seq=0 out_seq=0 -59> 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 <== mon.0 v2:127.0.0.1:40740/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (crc 0 0 0) 0x56054b53b000 con 0x56054a8bec00 -58> 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: handle_monmap mon_map magic: 0 v1 -57> 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: got monmap 1 from mon.noname-a (according to old e1) -56> 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: dump: epoch 1 fsid 1ba61572-5ae6-4849-b868-d883a6b8b832 last_changed 2019-07-09T13:29:40.195215+0800 created 2019-07-09T13:29:40.195215+0800 min_mon_release 15 (octopus) 0: [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] mon.a 1: [v2:127.0.0.1:40742/0,v1:127.0.0.1:40743/0] mon.b 2: [v2:127.0.0.1:40744/0,v1:127.0.0.1:40745/0] mon.c -55> 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: _finish_auth 0 -54> 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-07-09T13:29:15.092261+0800) -53> 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: _send_mon_message to mon.a at v2:127.0.0.1:40740/0 -52> 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- auth(proto 2 2 bytes epoch 0) v1 -- 0x56054a867b00 con 0x56054a8bec00 -51> 2019-07-09T13:29:45.091+0800 7ff56b7e3b80 5 monclient: authenticate success, global_id 4131 -50> 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 <== mon.0 v2:127.0.0.1:40740/0 2 ==== config(9 keys) v1 ==== 268+0+0 (crc 0 0 0) 0x56054a85a780 con 0x56054a8bec00 -49> 2019-07-09T13:29:45.091+0800 7ff5571a4700 10 monclient: handle_config config(9 keys) v1 -48> 2019-07-09T13:29:45.091+0800 7ff5571a4700 1 -- 127.0.0.1:0/3037234 <== mon.0 v2:127.0.0.1:40740/0 3 ==== mgrmap(e 1) v1 ==== 286+0+0 (crc 0 0 0) 0x56054b44e000 con 0x56054a8bec00 -47> 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_mgr : 20/20 -46> 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_mgr -45> 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_mgr = 20/20 (no change) -44> 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_mon : 20/20 -43> 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_mon -42> 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_mon = 20/20 (no change) -41> 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_monc : 20/20 -40> 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_monc -39> 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_monc = 20/20 (no change) -38> 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: debug_ms : 1/1 -37> 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback ignored debug_ms -36> 2019-07-09T13:29:45.091+0800 7ff5559a1700 20 set_mon_vals debug_ms = 1/1 (no change) -35> 2019-07-09T13:29:45.091+0800 7ff5559a1700 10 mgr operator() config_callback: mgr/dashboard/x/ssl_server_port : 41740 -34> 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 mgr[py] Loaded module_config entry mgr/dashboard/x/ssl_server_port:41740 -33> 2019-07-09T13:29:45.091+0800 7ff5559a1700 4 set_mon_vals callback consumed mgr/dashboard/x/ssl_server_port -32> 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: mgr/restful/x/server_port : 42740 -31> 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 mgr[py] Loaded module_config entry mgr/restful/x/server_port:42740 -30> 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback consumed mgr/restful/x/server_port -29> 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: mon_pg_warn_min_per_osd : 3 -28> 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback ignored mon_pg_warn_min_per_osd -27> 2019-07-09T13:29:45.092+0800 7ff5559a1700 20 set_mon_vals mon_pg_warn_min_per_osd = 3 (no change) -26> 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: osd_pool_default_min_size : 1 -25> 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback ignored osd_pool_default_min_size -24> 2019-07-09T13:29:45.092+0800 7ff5559a1700 20 set_mon_vals osd_pool_default_min_size = 1 (no change) -23> 2019-07-09T13:29:45.092+0800 7ff5559a1700 10 mgr operator() config_callback: osd_pool_default_size : 3 -22> 2019-07-09T13:29:45.092+0800 7ff5559a1700 4 set_mon_vals callback ignored osd_pool_default_size -21> 2019-07-09T13:29:45.092+0800 7ff5559a1700 20 set_mon_vals osd_pool_default_size = 3 (no change) -20> 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 20 log_channel(cluster) update_config log_to_monitors {default=true} log_to_syslog {default=false} log_channels {audit=local0,default=daemon} log_prios {default=info} -19> 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: daemon prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) -18> 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 20 log_channel(audit) update_config log_to_monitors {default=true} log_to_syslog {default=false} log_channels {audit=local0,default=daemon} log_prios {default=info} -17> 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: local0 prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) -16> 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 1 lockdep using id 38 -15> 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command objecter_requests hook 0x56054a83a950 -14> 2019-07-09T13:29:45.096+0800 7ff56b7e3b80 10 monclient: _renew_subs -13> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 10 monclient: _send_mon_message to mon.a at v2:127.0.0.1:40740/0 -12> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 1 -- 127.0.0.1:0/3037234 --> [v2:127.0.0.1:40740/0,v1:127.0.0.1:40741/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56054b53b800 con 0x56054a8bec00 -11> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 1 lockdep using id 39 -10> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command mds_requests hook 0x7ffd632914b8 -9> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command mds_sessions hook 0x7ffd632914b8 -8> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command dump_cache hook 0x7ffd632914b8 -7> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command kick_stale_sessions hook 0x7ffd632914b8 -6> 2019-07-09T13:29:45.097+0800 7ff56b7e3b80 5 asok(0x56054a8b6000) register_command status hook 0x7ffd632914b8 -5> 2019-07-09T13:29:45.109+0800 7ff56b7e3b80 1 mgr[py] Loading python module 'ansible' -4> 2019-07-09T13:29:45.109+0800 7ff56b7e3b80 1 lockdep using id 40 -3> 2019-07-09T13:29:45.117+0800 7ff56b7e3b80 10 mgr[py] Computed sys.path '/home/xuxuehan/mnt/github-ceph/src/pybind:/home/xuxuehan/mnt/github-ceph/build/lib/cython_modules/lib.2:/opt/rh/devtoolset-8/root/usr/lib64/python2.7/site-packages:/opt/rh/devtoolset-8/root/usr/lib/python2.7/site-packages:/usr/lib64/python27.zip:/usr/lib64/python2.7/:/usr/lib64/python2.7/plat-linux2:/usr/lib64/python2.7/lib-tk:/usr/lib64/python2.7/lib-old:/usr/lib64/python2.7/lib-dynload:/home/xuxuehan/mnt/github-ceph/src/pybind/mgr:/usr/lib64/python2.7/site-packages:/usr/lib/python2.7/site-packages:/usr/lib/site-python' -2> 2019-07-09T13:29:45.145+0800 7ff56b7e3b80 0 recursive lock of (4) ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev) 1: (ceph::mutex_debug_detail::mutex_debugging_base::_will_lock(bool)+0x4a) [0x7ff5624dd89c] 2: (ceph::shared_mutex_debug::lock()+0x3a) [0x7ff56257bbee] 3: (()+0x143a532) [0x7ff56241b532] 4: (CRYPTO_mem_ctrl()+0x39) [0x7ff55fdd1be9] 5: (()+0x4a60e) [0x7ff54a51b60e] 6: (SSL_COMP_get_compression_methods()+0x9) [0x7ff54a51d899] 7: (SSL_library_init()+0x179) [0x7ff54a5237b9] 8: (init_hashlib()+0x1f) [0x7ff54a74614f] 9: (_PyImport_LoadDynamicModule()+0x99) [0x7ff560d0ed69] 10: (()+0xf7e41) [0x7ff560d0ce41] 11: (()+0xf808d) [0x7ff560d0d08d] 12: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 13: (()+0xdbd1f) [0x7ff560cf0d1f] 14: (PyObject_Call()+0x43) [0x7ff560c60a63] 15: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 16: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 17: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 18: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 19: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 20: (()+0xf71a8) [0x7ff560d0c1a8] 21: (()+0xf7e41) [0x7ff560d0ce41] 22: (()+0xf808d) [0x7ff560d0d08d] 23: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 24: (()+0xdbd1f) [0x7ff560cf0d1f] 25: (PyObject_Call()+0x43) [0x7ff560c60a63] 26: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 27: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 28: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 29: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 30: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 31: (()+0xf71a8) [0x7ff560d0c1a8] 32: (()+0xf7e41) [0x7ff560d0ce41] 33: (()+0xf808d) [0x7ff560d0d08d] 34: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 35: (()+0xdbd1f) [0x7ff560cf0d1f] 36: (PyObject_Call()+0x43) [0x7ff560c60a63] 37: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 38: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 39: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 40: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 41: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 42: (()+0xf71a8) [0x7ff560d0c1a8] 43: (()+0xf7e41) [0x7ff560d0ce41] 44: (()+0xf8126) [0x7ff560d0d126] 45: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 46: (()+0xdbd1f) [0x7ff560cf0d1f] 47: (PyObject_Call()+0x43) [0x7ff560c60a63] 48: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 49: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 50: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 51: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 52: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 53: (()+0xf71a8) [0x7ff560d0c1a8] 54: (()+0xf7e41) [0x7ff560d0ce41] 55: (()+0xf808d) [0x7ff560d0d08d] 56: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 57: (()+0xdbd1f) [0x7ff560cf0d1f] 58: (PyObject_Call()+0x43) [0x7ff560c60a63] 59: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 60: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 61: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 62: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 63: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 64: (()+0xf71a8) [0x7ff560d0c1a8] 65: (()+0xf863a) [0x7ff560d0d63a] 66: (()+0xf7e41) [0x7ff560d0ce41] 67: (()+0xf808d) [0x7ff560d0d08d] 68: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 69: (()+0xdbd1f) [0x7ff560cf0d1f] 70: (PyObject_Call()+0x43) [0x7ff560c60a63] 71: (()+0x4bb45) [0x7ff560c60b45] 72: (PyObject_CallFunction()+0x8e) [0x7ff560c60c2e] 73: (PyImport_Import()+0x112) [0x7ff560d0e512] 74: (PyImport_ImportModule()+0x1a) [0x7ff560d0e68a] 75: (PyModule::load_subclass_of(char const*, _object**)+0x4c3) [0x5605495fbf51] 76: (PyModule::load(_ts*)+0x457) [0x5605495f8a59] 77: (PyModuleRegistry::init()+0x326) [0x5605496019d8] 78: (MgrStandby::init()+0x729) [0x5605495d418f] 79: (main()+0x235) [0x5605493ebaac] 80: (__libc_start_main()+0xf5) [0x7ff55e93b445] 81: (()+0x5a4245) [0x5605493eb245] -1> 2019-07-09T13:29:45.164+0800 7ff56b7e3b80 -1 /home/xuxuehan/mnt/github-ceph/src/common/lockdep.cc: In function 'int lockdep_will_lock(const char*, int, bool, bool)' thread 7ff56b7e3b80 time 2019-07-09T13:29:45.155129+0800 /home/xuxuehan/mnt/github-ceph/src/common/lockdep.cc: 305: ceph_abort_msg("abort() called") ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev) 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xfe) [0x7ff5623ea874] 2: (lockdep_will_lock(char const*, int, bool, bool)+0x44b) [0x7ff5624d1b6f] 3: (ceph::mutex_debug_detail::mutex_debugging_base::_will_lock(bool)+0x4a) [0x7ff5624dd89c] 4: (ceph::shared_mutex_debug::lock()+0x3a) [0x7ff56257bbee] 5: (()+0x143a532) [0x7ff56241b532] 6: (CRYPTO_mem_ctrl()+0x39) [0x7ff55fdd1be9] 7: (()+0x4a60e) [0x7ff54a51b60e] 8: (SSL_COMP_get_compression_methods()+0x9) [0x7ff54a51d899] 9: (SSL_library_init()+0x179) [0x7ff54a5237b9] 10: (init_hashlib()+0x1f) [0x7ff54a74614f] 11: (_PyImport_LoadDynamicModule()+0x99) [0x7ff560d0ed69] 12: (()+0xf7e41) [0x7ff560d0ce41] 13: (()+0xf808d) [0x7ff560d0d08d] 14: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 15: (()+0xdbd1f) [0x7ff560cf0d1f] 16: (PyObject_Call()+0x43) [0x7ff560c60a63] 17: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 18: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 19: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 20: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 21: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 22: (()+0xf71a8) [0x7ff560d0c1a8] 23: (()+0xf7e41) [0x7ff560d0ce41] 24: (()+0xf808d) [0x7ff560d0d08d] 25: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 26: (()+0xdbd1f) [0x7ff560cf0d1f] 27: (PyObject_Call()+0x43) [0x7ff560c60a63] 28: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 29: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 30: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 31: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 32: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 33: (()+0xf71a8) [0x7ff560d0c1a8] 34: (()+0xf7e41) [0x7ff560d0ce41] 35: (()+0xf808d) [0x7ff560d0d08d] 36: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 37: (()+0xdbd1f) [0x7ff560cf0d1f] 38: (PyObject_Call()+0x43) [0x7ff560c60a63] 39: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 40: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 41: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 42: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 43: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 44: (()+0xf71a8) [0x7ff560d0c1a8] 45: (()+0xf7e41) [0x7ff560d0ce41] 46: (()+0xf8126) [0x7ff560d0d126] 47: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 48: (()+0xdbd1f) [0x7ff560cf0d1f] 49: (PyObject_Call()+0x43) [0x7ff560c60a63] 50: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 51: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 52: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 53: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 54: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 55: (()+0xf71a8) [0x7ff560d0c1a8] 56: (()+0xf7e41) [0x7ff560d0ce41] 57: (()+0xf808d) [0x7ff560d0d08d] 58: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 59: (()+0xdbd1f) [0x7ff560cf0d1f] 60: (PyObject_Call()+0x43) [0x7ff560c60a63] 61: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 62: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 63: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 64: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 65: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 66: (()+0xf71a8) [0x7ff560d0c1a8] 67: (()+0xf863a) [0x7ff560d0d63a] 68: (()+0xf7e41) [0x7ff560d0ce41] 69: (()+0xf808d) [0x7ff560d0d08d] 70: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 71: (()+0xdbd1f) [0x7ff560cf0d1f] 72: (PyObject_Call()+0x43) [0x7ff560c60a63] 73: (()+0x4bb45) [0x7ff560c60b45] 74: (PyObject_CallFunction()+0x8e) [0x7ff560c60c2e] 75: (PyImport_Import()+0x112) [0x7ff560d0e512] 76: (PyImport_ImportModule()+0x1a) [0x7ff560d0e68a] 77: (PyModule::load_subclass_of(char const*, _object**)+0x4c3) [0x5605495fbf51] 78: (PyModule::load(_ts*)+0x457) [0x5605495f8a59] 79: (PyModuleRegistry::init()+0x326) [0x5605496019d8] 80: (MgrStandby::init()+0x729) [0x5605495d418f] 81: (main()+0x235) [0x5605493ebaac] 82: (__libc_start_main()+0xf5) [0x7ff55e93b445] 83: (()+0x5a4245) [0x5605493eb245] 0> 2019-07-09T13:29:45.175+0800 7ff56b7e3b80 -1 *** Caught signal (Aborted) ** in thread 7ff56b7e3b80 thread_name:ceph-mgr ceph version v15.0.0-2554-g221d976e3c (221d976e3c21e0d99c82f3d808b7bd1f7e5a406d) octopus (dev) 1: (()+0x96a2f6) [0x5605497b12f6] 2: (()+0xf6d0) [0x7ff55fb566d0] 3: (gsignal()+0x37) [0x7ff55e94f277] 4: (abort()+0x148) [0x7ff55e950968] 5: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0x387) [0x7ff5623eaafd] 6: (lockdep_will_lock(char const*, int, bool, bool)+0x44b) [0x7ff5624d1b6f] 7: (ceph::mutex_debug_detail::mutex_debugging_base::_will_lock(bool)+0x4a) [0x7ff5624dd89c] 8: (ceph::shared_mutex_debug::lock()+0x3a) [0x7ff56257bbee] 9: (()+0x143a532) [0x7ff56241b532] 10: (CRYPTO_mem_ctrl()+0x39) [0x7ff55fdd1be9] 11: (()+0x4a60e) [0x7ff54a51b60e] 12: (SSL_COMP_get_compression_methods()+0x9) [0x7ff54a51d899] 13: (SSL_library_init()+0x179) [0x7ff54a5237b9] 14: (init_hashlib()+0x1f) [0x7ff54a74614f] 15: (_PyImport_LoadDynamicModule()+0x99) [0x7ff560d0ed69] 16: (()+0xf7e41) [0x7ff560d0ce41] 17: (()+0xf808d) [0x7ff560d0d08d] 18: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 19: (()+0xdbd1f) [0x7ff560cf0d1f] 20: (PyObject_Call()+0x43) [0x7ff560c60a63] 21: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 22: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 23: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 24: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 25: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 26: (()+0xf71a8) [0x7ff560d0c1a8] 27: (()+0xf7e41) [0x7ff560d0ce41] 28: (()+0xf808d) [0x7ff560d0d08d] 29: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 30: (()+0xdbd1f) [0x7ff560cf0d1f] 31: (PyObject_Call()+0x43) [0x7ff560c60a63] 32: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 33: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 34: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 35: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 36: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 37: (()+0xf71a8) [0x7ff560d0c1a8] 38: (()+0xf7e41) [0x7ff560d0ce41] 39: (()+0xf808d) [0x7ff560d0d08d] 40: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 41: (()+0xdbd1f) [0x7ff560cf0d1f] 42: (PyObject_Call()+0x43) [0x7ff560c60a63] 43: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 44: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 45: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 46: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 47: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 48: (()+0xf71a8) [0x7ff560d0c1a8] 49: (()+0xf7e41) [0x7ff560d0ce41] 50: (()+0xf8126) [0x7ff560d0d126] 51: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 52: (()+0xdbd1f) [0x7ff560cf0d1f] 53: (PyObject_Call()+0x43) [0x7ff560c60a63] 54: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 55: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 56: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 57: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 58: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 59: (()+0xf71a8) [0x7ff560d0c1a8] 60: (()+0xf7e41) [0x7ff560d0ce41] 61: (()+0xf808d) [0x7ff560d0d08d] 62: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 63: (()+0xdbd1f) [0x7ff560cf0d1f] 64: (PyObject_Call()+0x43) [0x7ff560c60a63] 65: (PyEval_CallObjectWithKeywords()+0x47) [0x7ff560cf28f7] 66: (PyEval_EvalFrameEx()+0x46b5) [0x7ff560cf75b5] 67: (PyEval_EvalCodeEx()+0x7ed) [0x7ff560cfc03d] 68: (PyEval_EvalCode()+0x32) [0x7ff560cfc142] 69: (PyImport_ExecCodeModuleEx()+0x8c) [0x7ff560d0bf2c] 70: (()+0xf71a8) [0x7ff560d0c1a8] 71: (()+0xf863a) [0x7ff560d0d63a] 72: (()+0xf7e41) [0x7ff560d0ce41] 73: (()+0xf808d) [0x7ff560d0d08d] 74: (PyImport_ImportModuleLevel()+0x15e) [0x7ff560d0da6e] 75: (()+0xdbd1f) [0x7ff560cf0d1f] 76: (PyObject_Call()+0x43) [0x7ff560c60a63] 77: (()+0x4bb45) [0x7ff560c60b45] 78: (PyObject_CallFunction()+0x8e) [0x7ff560c60c2e] 79: (PyImport_Import()+0x112) [0x7ff560d0e512] 80: (PyImport_ImportModule()+0x1a) [0x7ff560d0e68a] 81: (PyModule::load_subclass_of(char const*, _object**)+0x4c3) [0x5605495fbf51] 82: (PyModule::load(_ts*)+0x457) [0x5605495f8a59] 83: (PyModuleRegistry::init()+0x326) [0x5605496019d8] 84: (MgrStandby::init()+0x729) [0x5605495d418f] 85: (main()+0x235) [0x5605493ebaac] 86: (__libc_start_main()+0xf5) [0x7ff55e93b445] 87: (()+0x5a4245) [0x5605493eb245] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 immutable_obj_cache 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 1/ 1 ms 20/20 mon 20/20 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 1 reserver 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 rgw_sync 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 compressor 1/ 5 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 20/20 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace 1/ 5 prioritycache -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /home/xuxuehan/mnt/github-ceph/build/out/mgr.x.log --- end dump of recent events ---