Project

General

Profile

Bug #39588 » ceph_bug.txt

伟杰 谭, 05/06/2019 03:15 AM

 
[root@server04 ~]# radosgw-admin bucket limit check
terminate called after throwing an instance of 'std::runtime_error'
what(): rados returned (110) Connection timed out
*** Caught signal (Aborted) **
in thread 7f0d6602a240 thread_name:radosgw-admin
ceph version 13.2.5 (cbff874f9007f1869bfd3821b7e33b2a6ffd4988) mimic (stable)
1: (()+0x50a9a0) [0x5581a5dbf9a0]
2: (()+0xf5d0) [0x7f0d63b1d5d0]
3: (gsignal()+0x37) [0x7f0d58ff2207]
4: (abort()+0x148) [0x7f0d58ff38f8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f0d59901ac5]
6: (()+0x5ea36) [0x7f0d598ffa36]
7: (()+0x5ea63) [0x7f0d598ffa63]
8: (()+0x5ec83) [0x7f0d598ffc83]
9: (librados::NObjectIteratorImpl::get_next()+0x215) [0x7f0d6593ffc5]
10: (librados::NObjectIteratorImpl::seek(librados::ObjectCursor const&)+0x1e) [0x7f0d6594021e]
11: (librados::IoCtx::nobjects_begin(librados::ObjectCursor const&, ceph::buffer::list const&)+0x58) [0x7f0d659402a8]
12: (librados::IoCtx::nobjects_begin(librados::ObjectCursor const&)+0x69) [0x7f0d65940349]
13: (RGWRados::pool_iterate_begin(rgw_pool const&, std::string const&, RGWPoolIterCtx&)+0xb3) [0x5581a5ba3773]
14: (RGWRados::list_raw_objects_init(rgw_pool const&, std::string const&, RGWListRawObjsCtx*)+0x2f) [0x5581a5ba385f]
15: (RGWRados::list_raw_objects(rgw_pool const&, std::string const&, int, RGWListRawObjsCtx&, std::list<std::string, std::allocator<std::string> >&, bool*)+0x55) [0x5581a5bd22b5]
16: (RGWRados::list_raw_prefixed_objs(rgw_pool const&, std::string const&, std::list<std::string, std::allocator<std::string> >&)+0xa8) [0x5581a5bd23e8]
17: (RGWRados::list_regions(std::list<std::string, std::allocator<std::string> >&)+0x1c5) [0x5581a5bd26f5]
18: (RGWRados::replace_region_with_zonegroup()+0x6fe) [0x5581a5bd3a1e]
19: (RGWRados::init_complete()+0xcf) [0x5581a5bdfd4f]
20: (RGWStoreManager::init_storage_provider(CephContext*, bool, bool, bool, bool, bool, bool)+0x86) [0x5581a5be2716]
21: (main()+0x155b) [0x5581a59e9e4b]
22: (__libc_start_main()+0xf5) [0x7f0d58fde3d5]
23: (()+0x16cd60) [0x5581a5a21d60]
2019-05-06 11:05:18.247 7f0d6602a240 -1 *** Caught signal (Aborted) **
in thread 7f0d6602a240 thread_name:radosgw-admin

ceph version 13.2.5 (cbff874f9007f1869bfd3821b7e33b2a6ffd4988) mimic (stable)
1: (()+0x50a9a0) [0x5581a5dbf9a0]
2: (()+0xf5d0) [0x7f0d63b1d5d0]
3: (gsignal()+0x37) [0x7f0d58ff2207]
4: (abort()+0x148) [0x7f0d58ff38f8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f0d59901ac5]
6: (()+0x5ea36) [0x7f0d598ffa36]
7: (()+0x5ea63) [0x7f0d598ffa63]
8: (()+0x5ec83) [0x7f0d598ffc83]
9: (librados::NObjectIteratorImpl::get_next()+0x215) [0x7f0d6593ffc5]
10: (librados::NObjectIteratorImpl::seek(librados::ObjectCursor const&)+0x1e) [0x7f0d6594021e]
11: (librados::IoCtx::nobjects_begin(librados::ObjectCursor const&, ceph::buffer::list const&)+0x58) [0x7f0d659402a8]
12: (librados::IoCtx::nobjects_begin(librados::ObjectCursor const&)+0x69) [0x7f0d65940349]
13: (RGWRados::pool_iterate_begin(rgw_pool const&, std::string const&, RGWPoolIterCtx&)+0xb3) [0x5581a5ba3773]
14: (RGWRados::list_raw_objects_init(rgw_pool const&, std::string const&, RGWListRawObjsCtx*)+0x2f) [0x5581a5ba385f]
15: (RGWRados::list_raw_objects(rgw_pool const&, std::string const&, int, RGWListRawObjsCtx&, std::list<std::string, std::allocator<std::string> >&, bool*)+0x55) [0x5581a5bd22b5]
16: (RGWRados::list_raw_prefixed_objs(rgw_pool const&, std::string const&, std::list<std::string, std::allocator<std::string> >&)+0xa8) [0x5581a5bd23e8]
17: (RGWRados::list_regions(std::list<std::string, std::allocator<std::string> >&)+0x1c5) [0x5581a5bd26f5]
18: (RGWRados::replace_region_with_zonegroup()+0x6fe) [0x5581a5bd3a1e]
19: (RGWRados::init_complete()+0xcf) [0x5581a5bdfd4f]
20: (RGWStoreManager::init_storage_provider(CephContext*, bool, bool, bool, bool, bool, bool)+0x86) [0x5581a5be2716]
21: (main()+0x155b) [0x5581a59e9e4b]
22: (__libc_start_main()+0xf5) [0x7f0d58fde3d5]
23: (()+0x16cd60) [0x5581a5a21d60]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-500> 2019-05-06 11:05:06.880 7f0d6602a240 1 librados: starting msgr at -
-499> 2019-05-06 11:05:06.880 7f0d6602a240 1 librados: starting objecter
-498> 2019-05-06 11:05:06.880 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a811ee20 EEXIST
-497> 2019-05-06 11:05:06.881 7f0d6602a240 1 librados: setting wanted keys
-496> 2019-05-06 11:05:06.881 7f0d6602a240 1 librados: calling monclient init
-495> 2019-05-06 11:05:06.881 7f0d6602a240 10 monclient: init
-494> 2019-05-06 11:05:06.881 7f0d6602a240 5 adding auth protocol: cephx
-493> 2019-05-06 11:05:06.881 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-492> 2019-05-06 11:05:06.881 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-491> 2019-05-06 11:05:06.881 7f0d6602a240 10 monclient: _reopen_session rank -1
-490> 2019-05-06 11:05:06.881 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a8126c10 addr 10.101.123.8:6789/0
-489> 2019-05-06 11:05:06.881 7f0d6602a240 10 monclient(hunting): _renew_subs
-488> 2019-05-06 11:05:06.881 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.881878
-487> 2019-05-06 11:05:06.881 7f0cf37fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-486> 2019-05-06 11:05:06.881 7f0cf37fe700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-485> 2019-05-06 11:05:06.881 7f0cf37fe700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-484> 2019-05-06 11:05:06.881 7f0cf37fe700 10 monclient(hunting): my global_id is 2084181
-483> 2019-05-06 11:05:06.883 7f0cf37fe700 1 monclient: found mon.server04
-482> 2019-05-06 11:05:06.883 7f0cf37fe700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-481> 2019-05-06 11:05:06.883 7f0d6602a240 5 monclient: authenticate success, global_id 2084181
-480> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: _renew_subs
-479> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-478> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: _renew_subs
-477> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-476> 2019-05-06 11:05:06.883 7f0d6602a240 1 librados: init done
-475> 2019-05-06 11:05:06.883 7f0cf37fe700 10 monclient: handle_config config(0 keys) v1
-474> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: get_monmap_and_config
-473> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: build_initial_monmap
-472> 2019-05-06 11:05:06.883 7f0cf37fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-471> 2019-05-06 11:05:06.883 7f0cf37fe700 10 monclient: got monmap 4, mon.server04 is now rank 0
-470> 2019-05-06 11:05:06.883 7f0cf1ffb700 4 set_mon_vals no callback set
-469> 2019-05-06 11:05:06.883 7f0cf37fe700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-468> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: init
-467> 2019-05-06 11:05:06.883 7f0d6602a240 5 adding auth protocol: cephx
-466> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-465> 2019-05-06 11:05:06.883 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-464> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient: _reopen_session rank -1
-463> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a8137190 addr 10.101.123.8:6789/0
-462> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient(hunting): _renew_subs
-461> 2019-05-06 11:05:06.883 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.884451
-460> 2019-05-06 11:05:06.883 7f0cf37fe700 4 mgrc handle_mgr_map Got map version 259
-459> 2019-05-06 11:05:06.883 7f0cf37fe700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-458> 2019-05-06 11:05:06.883 7f0cf37fe700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-457> 2019-05-06 11:05:06.887 7f0ce77fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-456> 2019-05-06 11:05:06.887 7f0ce77fe700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-455> 2019-05-06 11:05:06.887 7f0ce77fe700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-454> 2019-05-06 11:05:06.887 7f0ce77fe700 10 monclient(hunting): my global_id is 2084182
-453> 2019-05-06 11:05:06.888 7f0ce77fe700 1 monclient: found mon.server04
-452> 2019-05-06 11:05:06.888 7f0ce77fe700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-451> 2019-05-06 11:05:06.888 7f0d6602a240 5 monclient: authenticate success, global_id 2084182
-450> 2019-05-06 11:05:06.888 7f0ce77fe700 10 monclient: handle_config config(0 keys) v1
-449> 2019-05-06 11:05:06.888 7f0d6602a240 10 monclient: get_monmap_and_config success
-448> 2019-05-06 11:05:06.888 7f0d6602a240 10 monclient: shutdown
-447> 2019-05-06 11:05:06.888 7f0ce5ffb700 4 set_mon_vals no callback set
-446> 2019-05-06 11:05:06.888 7f0ce77fe700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
-445> 2019-05-06 11:05:06.891 7f0d6602a240 10 monclient: build_initial_monmap
-444> 2019-05-06 11:05:06.891 7f0d6602a240 1 librados: starting msgr at -
-443> 2019-05-06 11:05:06.891 7f0d6602a240 1 librados: starting objecter
-442> 2019-05-06 11:05:06.892 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a7f8ddb0 EEXIST
-441> 2019-05-06 11:05:06.892 7f0d6602a240 1 librados: setting wanted keys
-440> 2019-05-06 11:05:06.892 7f0d6602a240 1 librados: calling monclient init
-439> 2019-05-06 11:05:06.892 7f0d6602a240 10 monclient: init
-438> 2019-05-06 11:05:06.892 7f0d6602a240 5 adding auth protocol: cephx
-437> 2019-05-06 11:05:06.892 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-436> 2019-05-06 11:05:06.892 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-435> 2019-05-06 11:05:06.892 7f0d6602a240 10 monclient: _reopen_session rank -1
-434> 2019-05-06 11:05:06.892 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a8137ef0 addr 10.101.123.8:6789/0
-433> 2019-05-06 11:05:06.892 7f0d6602a240 10 monclient(hunting): _renew_subs
-432> 2019-05-06 11:05:06.892 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.892904
-431> 2019-05-06 11:05:06.892 7f0ce6ffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-430> 2019-05-06 11:05:06.892 7f0ce6ffd700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-429> 2019-05-06 11:05:06.892 7f0ce6ffd700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-428> 2019-05-06 11:05:06.892 7f0ce6ffd700 10 monclient(hunting): my global_id is 2084183
-427> 2019-05-06 11:05:06.894 7f0ce6ffd700 1 monclient: found mon.server04
-426> 2019-05-06 11:05:06.894 7f0ce6ffd700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-425> 2019-05-06 11:05:06.894 7f0d6602a240 5 monclient: authenticate success, global_id 2084183
-424> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: _renew_subs
-423> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-422> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: _renew_subs
-421> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-420> 2019-05-06 11:05:06.894 7f0d6602a240 1 librados: init done
-419> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: get_monmap_and_config
-418> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: build_initial_monmap
-417> 2019-05-06 11:05:06.894 7f0ce6ffd700 10 monclient: handle_config config(0 keys) v1
-416> 2019-05-06 11:05:06.894 7f0ce57fa700 4 set_mon_vals no callback set
-415> 2019-05-06 11:05:06.894 7f0ce6ffd700 10 monclient: handle_monmap mon_map magic: 0 v1
-414> 2019-05-06 11:05:06.894 7f0ce6ffd700 10 monclient: got monmap 4, mon.server04 is now rank 0
-413> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: init
-412> 2019-05-06 11:05:06.894 7f0d6602a240 5 adding auth protocol: cephx
-411> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-410> 2019-05-06 11:05:06.894 7f0ce6ffd700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-409> 2019-05-06 11:05:06.894 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-408> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient: _reopen_session rank -1
-407> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a814cc10 addr 10.101.123.8:6789/0
-406> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient(hunting): _renew_subs
-405> 2019-05-06 11:05:06.894 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.895440
-404> 2019-05-06 11:05:06.894 7f0ce6ffd700 4 mgrc handle_mgr_map Got map version 259
-403> 2019-05-06 11:05:06.894 7f0ce6ffd700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-402> 2019-05-06 11:05:06.894 7f0ce6ffd700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-401> 2019-05-06 11:05:06.898 7f0cdaffd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-400> 2019-05-06 11:05:06.898 7f0cdaffd700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-399> 2019-05-06 11:05:06.898 7f0cdaffd700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-398> 2019-05-06 11:05:06.898 7f0cdaffd700 10 monclient(hunting): my global_id is 2084184
-397> 2019-05-06 11:05:06.899 7f0cdaffd700 1 monclient: found mon.server04
-396> 2019-05-06 11:05:06.899 7f0cdaffd700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-395> 2019-05-06 11:05:06.899 7f0d6602a240 5 monclient: authenticate success, global_id 2084184
-394> 2019-05-06 11:05:06.899 7f0cdaffd700 10 monclient: handle_config config(0 keys) v1
-393> 2019-05-06 11:05:06.899 7f0d6602a240 10 monclient: get_monmap_and_config success
-392> 2019-05-06 11:05:06.899 7f0d6602a240 10 monclient: shutdown
-391> 2019-05-06 11:05:06.899 7f0cd97fa700 4 set_mon_vals no callback set
-390> 2019-05-06 11:05:06.899 7f0cdaffd700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
-389> 2019-05-06 11:05:06.902 7f0d6602a240 10 monclient: build_initial_monmap
-388> 2019-05-06 11:05:06.902 7f0d6602a240 1 librados: starting msgr at -
-387> 2019-05-06 11:05:06.902 7f0d6602a240 1 librados: starting objecter
-386> 2019-05-06 11:05:06.902 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a814c5a0 EEXIST
-385> 2019-05-06 11:05:06.902 7f0d6602a240 1 librados: setting wanted keys
-384> 2019-05-06 11:05:06.902 7f0d6602a240 1 librados: calling monclient init
-383> 2019-05-06 11:05:06.902 7f0d6602a240 10 monclient: init
-382> 2019-05-06 11:05:06.902 7f0d6602a240 5 adding auth protocol: cephx
-381> 2019-05-06 11:05:06.902 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-380> 2019-05-06 11:05:06.902 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-379> 2019-05-06 11:05:06.902 7f0d6602a240 10 monclient: _reopen_session rank -1
-378> 2019-05-06 11:05:06.903 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a814d8b0 addr 10.101.123.8:6789/0
-377> 2019-05-06 11:05:06.903 7f0d6602a240 10 monclient(hunting): _renew_subs
-376> 2019-05-06 11:05:06.903 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.903725
-375> 2019-05-06 11:05:06.903 7f0cda7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-374> 2019-05-06 11:05:06.903 7f0cda7fc700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-373> 2019-05-06 11:05:06.903 7f0cda7fc700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-372> 2019-05-06 11:05:06.903 7f0cda7fc700 10 monclient(hunting): my global_id is 2084185
-371> 2019-05-06 11:05:06.904 7f0cda7fc700 1 monclient: found mon.server04
-370> 2019-05-06 11:05:06.904 7f0cda7fc700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-369> 2019-05-06 11:05:06.905 7f0d6602a240 5 monclient: authenticate success, global_id 2084185
-368> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: _renew_subs
-367> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-366> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: _renew_subs
-365> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-364> 2019-05-06 11:05:06.905 7f0d6602a240 1 librados: init done
-363> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: get_monmap_and_config
-362> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: build_initial_monmap
-361> 2019-05-06 11:05:06.905 7f0cda7fc700 10 monclient: handle_config config(0 keys) v1
-360> 2019-05-06 11:05:06.905 7f0cda7fc700 10 monclient: handle_monmap mon_map magic: 0 v1
-359> 2019-05-06 11:05:06.905 7f0cd8ff9700 4 set_mon_vals no callback set
-358> 2019-05-06 11:05:06.905 7f0cda7fc700 10 monclient: got monmap 4, mon.server04 is now rank 0
-357> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: init
-356> 2019-05-06 11:05:06.905 7f0d6602a240 5 adding auth protocol: cephx
-355> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-354> 2019-05-06 11:05:06.905 7f0cda7fc700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-353> 2019-05-06 11:05:06.905 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-352> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient: _reopen_session rank -1
-351> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a8162a90 addr 10.101.123.8:6789/0
-350> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient(hunting): _renew_subs
-349> 2019-05-06 11:05:06.905 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.906292
-348> 2019-05-06 11:05:06.905 7f0cda7fc700 4 mgrc handle_mgr_map Got map version 259
-347> 2019-05-06 11:05:06.905 7f0cda7fc700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-346> 2019-05-06 11:05:06.905 7f0cda7fc700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-345> 2019-05-06 11:05:06.909 7f0cce7fc700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-344> 2019-05-06 11:05:06.909 7f0cce7fc700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-343> 2019-05-06 11:05:06.909 7f0cce7fc700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-342> 2019-05-06 11:05:06.909 7f0cce7fc700 10 monclient(hunting): my global_id is 2084186
-341> 2019-05-06 11:05:06.909 7f0cce7fc700 1 monclient: found mon.server04
-340> 2019-05-06 11:05:06.910 7f0cce7fc700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-339> 2019-05-06 11:05:06.910 7f0d6602a240 5 monclient: authenticate success, global_id 2084186
-338> 2019-05-06 11:05:06.910 7f0cce7fc700 10 monclient: handle_config config(0 keys) v1
-337> 2019-05-06 11:05:06.910 7f0d6602a240 10 monclient: get_monmap_and_config success
-336> 2019-05-06 11:05:06.910 7f0d6602a240 10 monclient: shutdown
-335> 2019-05-06 11:05:06.910 7f0cce7fc700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
-334> 2019-05-06 11:05:06.910 7f0cccff9700 4 set_mon_vals no callback set
-333> 2019-05-06 11:05:06.914 7f0d6602a240 10 monclient: build_initial_monmap
-332> 2019-05-06 11:05:06.914 7f0d6602a240 1 librados: starting msgr at -
-331> 2019-05-06 11:05:06.914 7f0d6602a240 1 librados: starting objecter
-330> 2019-05-06 11:05:06.914 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a808a8a0 EEXIST
-329> 2019-05-06 11:05:06.914 7f0d6602a240 1 librados: setting wanted keys
-328> 2019-05-06 11:05:06.914 7f0d6602a240 1 librados: calling monclient init
-327> 2019-05-06 11:05:06.914 7f0d6602a240 10 monclient: init
-326> 2019-05-06 11:05:06.914 7f0d6602a240 5 adding auth protocol: cephx
-325> 2019-05-06 11:05:06.914 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-324> 2019-05-06 11:05:06.914 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-323> 2019-05-06 11:05:06.914 7f0d6602a240 10 monclient: _reopen_session rank -1
-322> 2019-05-06 11:05:06.914 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a8169170 addr 10.101.123.8:6789/0
-321> 2019-05-06 11:05:06.914 7f0d6602a240 10 monclient(hunting): _renew_subs
-320> 2019-05-06 11:05:06.914 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.915570
-319> 2019-05-06 11:05:06.915 7f0ccdffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-318> 2019-05-06 11:05:06.915 7f0ccdffb700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-317> 2019-05-06 11:05:06.915 7f0ccdffb700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-316> 2019-05-06 11:05:06.915 7f0ccdffb700 10 monclient(hunting): my global_id is 2084187
-315> 2019-05-06 11:05:06.916 7f0ccdffb700 1 monclient: found mon.server04
-314> 2019-05-06 11:05:06.916 7f0ccdffb700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-313> 2019-05-06 11:05:06.916 7f0d6602a240 5 monclient: authenticate success, global_id 2084187
-312> 2019-05-06 11:05:06.916 7f0d6602a240 10 monclient: _renew_subs
-311> 2019-05-06 11:05:06.916 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-310> 2019-05-06 11:05:06.916 7f0d6602a240 10 monclient: _renew_subs
-309> 2019-05-06 11:05:06.916 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-308> 2019-05-06 11:05:06.916 7f0d6602a240 1 librados: init done
-307> 2019-05-06 11:05:06.916 7f0d6602a240 10 monclient: get_monmap_and_config
-306> 2019-05-06 11:05:06.916 7f0d6602a240 10 monclient: build_initial_monmap
-305> 2019-05-06 11:05:06.917 7f0d6602a240 10 monclient: init
-304> 2019-05-06 11:05:06.917 7f0d6602a240 5 adding auth protocol: cephx
-303> 2019-05-06 11:05:06.917 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-302> 2019-05-06 11:05:06.917 7f0ccdffb700 10 monclient: handle_config config(0 keys) v1
-301> 2019-05-06 11:05:06.917 7f0ccdffb700 10 monclient: handle_monmap mon_map magic: 0 v1
-300> 2019-05-06 11:05:06.917 7f0cc3fff700 4 set_mon_vals no callback set
-299> 2019-05-06 11:05:06.917 7f0ccdffb700 10 monclient: got monmap 4, mon.server04 is now rank 0
-298> 2019-05-06 11:05:06.917 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-297> 2019-05-06 11:05:06.917 7f0ccdffb700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-296> 2019-05-06 11:05:06.917 7f0d6602a240 10 monclient: _reopen_session rank -1
-295> 2019-05-06 11:05:06.917 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a8172e30 addr 10.101.123.8:6789/0
-294> 2019-05-06 11:05:06.917 7f0d6602a240 10 monclient(hunting): _renew_subs
-293> 2019-05-06 11:05:06.917 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.918137
-292> 2019-05-06 11:05:06.917 7f0ccdffb700 4 mgrc handle_mgr_map Got map version 259
-291> 2019-05-06 11:05:06.917 7f0ccdffb700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-290> 2019-05-06 11:05:06.917 7f0ccdffb700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-289> 2019-05-06 11:05:06.921 7f0cc1ffb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-288> 2019-05-06 11:05:06.921 7f0cc1ffb700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-287> 2019-05-06 11:05:06.921 7f0cc1ffb700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-286> 2019-05-06 11:05:06.921 7f0cc1ffb700 10 monclient(hunting): my global_id is 2084188
-285> 2019-05-06 11:05:06.921 7f0cc1ffb700 1 monclient: found mon.server04
-284> 2019-05-06 11:05:06.921 7f0cc1ffb700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-283> 2019-05-06 11:05:06.921 7f0d6602a240 5 monclient: authenticate success, global_id 2084188
-282> 2019-05-06 11:05:06.922 7f0cc1ffb700 10 monclient: handle_config config(0 keys) v1
-281> 2019-05-06 11:05:06.922 7f0d6602a240 10 monclient: get_monmap_and_config success
-280> 2019-05-06 11:05:06.922 7f0d6602a240 10 monclient: shutdown
-279> 2019-05-06 11:05:06.922 7f0cc1ffb700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
-278> 2019-05-06 11:05:06.922 7f0cbbfff700 4 set_mon_vals no callback set
-277> 2019-05-06 11:05:06.926 7f0d6602a240 10 monclient: build_initial_monmap
-276> 2019-05-06 11:05:06.926 7f0d6602a240 1 librados: starting msgr at -
-275> 2019-05-06 11:05:06.926 7f0d6602a240 1 librados: starting objecter
-274> 2019-05-06 11:05:06.926 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a816ed60 EEXIST
-273> 2019-05-06 11:05:06.926 7f0d6602a240 1 librados: setting wanted keys
-272> 2019-05-06 11:05:06.926 7f0d6602a240 1 librados: calling monclient init
-271> 2019-05-06 11:05:06.926 7f0d6602a240 10 monclient: init
-270> 2019-05-06 11:05:06.926 7f0d6602a240 5 adding auth protocol: cephx
-269> 2019-05-06 11:05:06.926 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-268> 2019-05-06 11:05:06.926 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-267> 2019-05-06 11:05:06.926 7f0d6602a240 10 monclient: _reopen_session rank -1
-266> 2019-05-06 11:05:06.926 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a817f3b0 addr 10.101.123.8:6789/0
-265> 2019-05-06 11:05:06.926 7f0d6602a240 10 monclient(hunting): _renew_subs
-264> 2019-05-06 11:05:06.926 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.927359
-263> 2019-05-06 11:05:06.927 7f0cc17fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-262> 2019-05-06 11:05:06.927 7f0cc17fa700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-261> 2019-05-06 11:05:06.927 7f0cc17fa700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-260> 2019-05-06 11:05:06.927 7f0cc17fa700 10 monclient(hunting): my global_id is 2084189
-259> 2019-05-06 11:05:06.928 7f0cc17fa700 1 monclient: found mon.server04
-258> 2019-05-06 11:05:06.928 7f0cc17fa700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-257> 2019-05-06 11:05:06.928 7f0d6602a240 5 monclient: authenticate success, global_id 2084189
-256> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: _renew_subs
-255> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-254> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: _renew_subs
-253> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-252> 2019-05-06 11:05:06.928 7f0d6602a240 1 librados: init done
-251> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: get_monmap_and_config
-250> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: build_initial_monmap
-249> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: init
-248> 2019-05-06 11:05:06.928 7f0d6602a240 5 adding auth protocol: cephx
-247> 2019-05-06 11:05:06.928 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-246> 2019-05-06 11:05:06.928 7f0cc17fa700 10 monclient: handle_config config(0 keys) v1
-245> 2019-05-06 11:05:06.929 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-244> 2019-05-06 11:05:06.928 7f0cc17fa700 10 monclient: handle_monmap mon_map magic: 0 v1
-243> 2019-05-06 11:05:06.929 7f0cc17fa700 10 monclient: got monmap 4, mon.server04 is now rank 0
-242> 2019-05-06 11:05:06.929 7f0cbb7fe700 4 set_mon_vals no callback set
-241> 2019-05-06 11:05:06.929 7f0cc17fa700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-240> 2019-05-06 11:05:06.929 7f0d6602a240 10 monclient: _reopen_session rank -1
-239> 2019-05-06 11:05:06.929 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a818eea0 addr 10.101.123.8:6789/0
-238> 2019-05-06 11:05:06.929 7f0d6602a240 10 monclient(hunting): _renew_subs
-237> 2019-05-06 11:05:06.929 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.929949
-236> 2019-05-06 11:05:06.929 7f0cc17fa700 4 mgrc handle_mgr_map Got map version 259
-235> 2019-05-06 11:05:06.929 7f0cc17fa700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-234> 2019-05-06 11:05:06.929 7f0cc17fa700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-233> 2019-05-06 11:05:06.933 7f0cb97fa700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-232> 2019-05-06 11:05:06.933 7f0cb97fa700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-231> 2019-05-06 11:05:06.933 7f0cb97fa700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-230> 2019-05-06 11:05:06.933 7f0cb97fa700 10 monclient(hunting): my global_id is 2084190
-229> 2019-05-06 11:05:06.933 7f0cb97fa700 1 monclient: found mon.server04
-228> 2019-05-06 11:05:06.933 7f0cb97fa700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-227> 2019-05-06 11:05:06.933 7f0d6602a240 5 monclient: authenticate success, global_id 2084190
-226> 2019-05-06 11:05:06.934 7f0cb97fa700 10 monclient: handle_config config(0 keys) v1
-225> 2019-05-06 11:05:06.934 7f0d6602a240 10 monclient: get_monmap_and_config success
-224> 2019-05-06 11:05:06.934 7f0d6602a240 10 monclient: shutdown
-223> 2019-05-06 11:05:06.934 7f0cb97fa700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
-222> 2019-05-06 11:05:06.934 7f0cb37fe700 4 set_mon_vals no callback set
-221> 2019-05-06 11:05:06.938 7f0d6602a240 10 monclient: build_initial_monmap
-220> 2019-05-06 11:05:06.938 7f0d6602a240 1 librados: starting msgr at -
-219> 2019-05-06 11:05:06.938 7f0d6602a240 1 librados: starting objecter
-218> 2019-05-06 11:05:06.938 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a818e760 EEXIST
-217> 2019-05-06 11:05:06.938 7f0d6602a240 1 librados: setting wanted keys
-216> 2019-05-06 11:05:06.938 7f0d6602a240 1 librados: calling monclient init
-215> 2019-05-06 11:05:06.938 7f0d6602a240 10 monclient: init
-214> 2019-05-06 11:05:06.938 7f0d6602a240 5 adding auth protocol: cephx
-213> 2019-05-06 11:05:06.938 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-212> 2019-05-06 11:05:06.938 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-211> 2019-05-06 11:05:06.938 7f0d6602a240 10 monclient: _reopen_session rank -1
-210> 2019-05-06 11:05:06.938 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a818fbf0 addr 10.101.123.8:6789/0
-209> 2019-05-06 11:05:06.938 7f0d6602a240 10 monclient(hunting): _renew_subs
-208> 2019-05-06 11:05:06.938 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.939564
-207> 2019-05-06 11:05:06.939 7f0cb8ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-206> 2019-05-06 11:05:06.939 7f0cb8ff9700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-205> 2019-05-06 11:05:06.939 7f0cb8ff9700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-204> 2019-05-06 11:05:06.939 7f0cb8ff9700 10 monclient(hunting): my global_id is 2084191
-203> 2019-05-06 11:05:06.940 7f0cb8ff9700 1 monclient: found mon.server04
-202> 2019-05-06 11:05:06.940 7f0cb8ff9700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-201> 2019-05-06 11:05:06.940 7f0d6602a240 5 monclient: authenticate success, global_id 2084191
-200> 2019-05-06 11:05:06.940 7f0d6602a240 10 monclient: _renew_subs
-199> 2019-05-06 11:05:06.940 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-198> 2019-05-06 11:05:06.940 7f0d6602a240 10 monclient: _renew_subs
-197> 2019-05-06 11:05:06.940 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-196> 2019-05-06 11:05:06.940 7f0d6602a240 1 librados: init done
-195> 2019-05-06 11:05:06.940 7f0d6602a240 10 monclient: get_monmap_and_config
-194> 2019-05-06 11:05:06.941 7f0d6602a240 10 monclient: build_initial_monmap
-193> 2019-05-06 11:05:06.941 7f0cb8ff9700 10 monclient: handle_config config(0 keys) v1
-192> 2019-05-06 11:05:06.941 7f0cb8ff9700 10 monclient: handle_monmap mon_map magic: 0 v1
-191> 2019-05-06 11:05:06.941 7f0cb8ff9700 10 monclient: got monmap 4, mon.server04 is now rank 0
-190> 2019-05-06 11:05:06.941 7f0cb2ffd700 4 set_mon_vals no callback set
-189> 2019-05-06 11:05:06.941 7f0cb8ff9700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-188> 2019-05-06 11:05:06.941 7f0d6602a240 10 monclient: init
-187> 2019-05-06 11:05:06.941 7f0d6602a240 5 adding auth protocol: cephx
-186> 2019-05-06 11:05:06.941 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-185> 2019-05-06 11:05:06.941 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-184> 2019-05-06 11:05:06.941 7f0d6602a240 10 monclient: _reopen_session rank -1
-183> 2019-05-06 11:05:06.941 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a81a4db0 addr 10.101.123.8:6789/0
-182> 2019-05-06 11:05:06.941 7f0d6602a240 10 monclient(hunting): _renew_subs
-181> 2019-05-06 11:05:06.941 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.942134
-180> 2019-05-06 11:05:06.941 7f0cb8ff9700 4 mgrc handle_mgr_map Got map version 259
-179> 2019-05-06 11:05:06.941 7f0cb8ff9700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-178> 2019-05-06 11:05:06.941 7f0cb8ff9700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-177> 2019-05-06 11:05:06.945 7f0cb0ff9700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-176> 2019-05-06 11:05:06.945 7f0cb0ff9700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-175> 2019-05-06 11:05:06.945 7f0cb0ff9700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-174> 2019-05-06 11:05:06.945 7f0cb0ff9700 10 monclient(hunting): my global_id is 2084192
-173> 2019-05-06 11:05:06.945 7f0cb0ff9700 1 monclient: found mon.server04
-172> 2019-05-06 11:05:06.945 7f0cb0ff9700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-171> 2019-05-06 11:05:06.945 7f0d6602a240 5 monclient: authenticate success, global_id 2084192
-170> 2019-05-06 11:05:06.946 7f0cb0ff9700 10 monclient: handle_config config(0 keys) v1
-169> 2019-05-06 11:05:06.946 7f0d6602a240 10 monclient: get_monmap_and_config success
-168> 2019-05-06 11:05:06.946 7f0d6602a240 10 monclient: shutdown
-167> 2019-05-06 11:05:06.946 7f0cb0ff9700 10 monclient: handle_monmap mon_map magic: 0 v1
-166> 2019-05-06 11:05:06.946 7f0cb0ff9700 10 monclient: got monmap 4, mon.server04 is now rank 0
-165> 2019-05-06 11:05:06.946 7f0ca6ffd700 4 set_mon_vals no callback set
-164> 2019-05-06 11:05:06.946 7f0cb0ff9700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-163> 2019-05-06 11:05:06.950 7f0d6602a240 10 monclient: build_initial_monmap
-162> 2019-05-06 11:05:06.950 7f0d6602a240 1 librados: starting msgr at -
-161> 2019-05-06 11:05:06.950 7f0d6602a240 1 librados: starting objecter
-160> 2019-05-06 11:05:06.950 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a81903d0 EEXIST
-159> 2019-05-06 11:05:06.950 7f0d6602a240 1 librados: setting wanted keys
-158> 2019-05-06 11:05:06.950 7f0d6602a240 1 librados: calling monclient init
-157> 2019-05-06 11:05:06.950 7f0d6602a240 10 monclient: init
-156> 2019-05-06 11:05:06.950 7f0d6602a240 5 adding auth protocol: cephx
-155> 2019-05-06 11:05:06.950 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-154> 2019-05-06 11:05:06.951 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-153> 2019-05-06 11:05:06.951 7f0d6602a240 10 monclient: _reopen_session rank -1
-152> 2019-05-06 11:05:06.951 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a81a5a50 addr 10.101.123.8:6789/0
-151> 2019-05-06 11:05:06.951 7f0d6602a240 10 monclient(hunting): _renew_subs
-150> 2019-05-06 11:05:06.951 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.951872
-149> 2019-05-06 11:05:06.951 7f0ca7fff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-148> 2019-05-06 11:05:06.951 7f0ca7fff700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-147> 2019-05-06 11:05:06.951 7f0ca7fff700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-146> 2019-05-06 11:05:06.951 7f0ca7fff700 10 monclient(hunting): my global_id is 2084193
-145> 2019-05-06 11:05:06.953 7f0ca7fff700 1 monclient: found mon.server04
-144> 2019-05-06 11:05:06.953 7f0ca7fff700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-143> 2019-05-06 11:05:06.953 7f0d6602a240 5 monclient: authenticate success, global_id 2084193
-142> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: _renew_subs
-141> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-140> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: _renew_subs
-139> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-138> 2019-05-06 11:05:06.953 7f0d6602a240 1 librados: init done
-137> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: get_monmap_and_config
-136> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: build_initial_monmap
-135> 2019-05-06 11:05:06.953 7f0ca7fff700 10 monclient: handle_config config(0 keys) v1
-134> 2019-05-06 11:05:06.953 7f0ca7fff700 10 monclient: handle_monmap mon_map magic: 0 v1
-133> 2019-05-06 11:05:06.953 7f0ca67fc700 4 set_mon_vals no callback set
-132> 2019-05-06 11:05:06.953 7f0ca7fff700 10 monclient: got monmap 4, mon.server04 is now rank 0
-131> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: init
-130> 2019-05-06 11:05:06.953 7f0d6602a240 5 adding auth protocol: cephx
-129> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-128> 2019-05-06 11:05:06.953 7f0ca7fff700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-127> 2019-05-06 11:05:06.953 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-126> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient: _reopen_session rank -1
-125> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a81bae00 addr 10.101.123.8:6789/0
-124> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient(hunting): _renew_subs
-123> 2019-05-06 11:05:06.953 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.954414
-122> 2019-05-06 11:05:06.953 7f0ca7fff700 4 mgrc handle_mgr_map Got map version 259
-121> 2019-05-06 11:05:06.953 7f0ca7fff700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-120> 2019-05-06 11:05:06.953 7f0ca7fff700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-119> 2019-05-06 11:05:06.957 7f0c9bfff700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-118> 2019-05-06 11:05:06.957 7f0c9bfff700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-117> 2019-05-06 11:05:06.957 7f0c9bfff700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-116> 2019-05-06 11:05:06.957 7f0c9bfff700 10 monclient(hunting): my global_id is 2084194
-115> 2019-05-06 11:05:06.957 7f0c9bfff700 1 monclient: found mon.server04
-114> 2019-05-06 11:05:06.957 7f0c9bfff700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-113> 2019-05-06 11:05:06.957 7f0d6602a240 5 monclient: authenticate success, global_id 2084194
-112> 2019-05-06 11:05:06.958 7f0c9bfff700 10 monclient: handle_config config(0 keys) v1
-111> 2019-05-06 11:05:06.958 7f0d6602a240 10 monclient: get_monmap_and_config success
-110> 2019-05-06 11:05:06.958 7f0d6602a240 10 monclient: shutdown
-109> 2019-05-06 11:05:06.958 7f0c9bfff700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
-108> 2019-05-06 11:05:06.958 7f0c9a7fc700 4 set_mon_vals no callback set
-107> 2019-05-06 11:05:06.962 7f0d6602a240 10 monclient: build_initial_monmap
-106> 2019-05-06 11:05:06.962 7f0d6602a240 1 librados: starting msgr at -
-105> 2019-05-06 11:05:06.962 7f0d6602a240 1 librados: starting objecter
-104> 2019-05-06 11:05:06.962 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a80eaad0 EEXIST
-103> 2019-05-06 11:05:06.963 7f0d6602a240 1 librados: setting wanted keys
-102> 2019-05-06 11:05:06.963 7f0d6602a240 1 librados: calling monclient init
-101> 2019-05-06 11:05:06.963 7f0d6602a240 10 monclient: init
-100> 2019-05-06 11:05:06.963 7f0d6602a240 5 adding auth protocol: cephx
-99> 2019-05-06 11:05:06.963 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-98> 2019-05-06 11:05:06.963 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-97> 2019-05-06 11:05:06.963 7f0d6602a240 10 monclient: _reopen_session rank -1
-96> 2019-05-06 11:05:06.963 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a81c1530 addr 10.101.123.8:6789/0
-95> 2019-05-06 11:05:06.963 7f0d6602a240 10 monclient(hunting): _renew_subs
-94> 2019-05-06 11:05:06.963 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.963883
-93> 2019-05-06 11:05:06.963 7f0c9b7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-92> 2019-05-06 11:05:06.963 7f0c9b7fe700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-91> 2019-05-06 11:05:06.963 7f0c9b7fe700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-90> 2019-05-06 11:05:06.964 7f0c9b7fe700 10 monclient(hunting): my global_id is 2084195
-89> 2019-05-06 11:05:06.965 7f0c9b7fe700 1 monclient: found mon.server04
-88> 2019-05-06 11:05:06.965 7f0c9b7fe700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-87> 2019-05-06 11:05:06.965 7f0d6602a240 5 monclient: authenticate success, global_id 2084195
-86> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: _renew_subs
-85> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-84> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: _renew_subs
-83> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-82> 2019-05-06 11:05:06.965 7f0d6602a240 1 librados: init done
-81> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: get_monmap_and_config
-80> 2019-05-06 11:05:06.965 7f0c9b7fe700 10 monclient: handle_config config(0 keys) v1
-79> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: build_initial_monmap
-78> 2019-05-06 11:05:06.965 7f0c99ffb700 4 set_mon_vals no callback set
-77> 2019-05-06 11:05:06.965 7f0c9b7fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-76> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: init
-75> 2019-05-06 11:05:06.965 7f0d6602a240 5 adding auth protocol: cephx
-74> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-73> 2019-05-06 11:05:06.965 7f0c9b7fe700 10 monclient: got monmap 4, mon.server04 is now rank 0
-72> 2019-05-06 11:05:06.965 7f0c9b7fe700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-71> 2019-05-06 11:05:06.965 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-70> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient: _reopen_session rank -1
-69> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a81d0e90 addr 10.101.123.8:6789/0
-68> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient(hunting): _renew_subs
-67> 2019-05-06 11:05:06.965 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.966647
-66> 2019-05-06 11:05:06.966 7f0c9b7fe700 4 mgrc handle_mgr_map Got map version 259
-65> 2019-05-06 11:05:06.966 7f0c9b7fe700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-64> 2019-05-06 11:05:06.966 7f0c9b7fe700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-63> 2019-05-06 11:05:06.969 7f0c8f7fe700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-62> 2019-05-06 11:05:06.969 7f0c8f7fe700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-61> 2019-05-06 11:05:06.969 7f0c8f7fe700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-60> 2019-05-06 11:05:06.969 7f0c8f7fe700 10 monclient(hunting): my global_id is 2084196
-59> 2019-05-06 11:05:06.970 7f0c8f7fe700 1 monclient: found mon.server04
-58> 2019-05-06 11:05:06.970 7f0c8f7fe700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-57> 2019-05-06 11:05:06.970 7f0d6602a240 5 monclient: authenticate success, global_id 2084196
-56> 2019-05-06 11:05:06.970 7f0c8f7fe700 10 monclient: handle_config config(0 keys) v1
-55> 2019-05-06 11:05:06.970 7f0d6602a240 10 monclient: get_monmap_and_config success
-54> 2019-05-06 11:05:06.970 7f0d6602a240 10 monclient: shutdown
-53> 2019-05-06 11:05:06.970 7f0c8f7fe700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
-52> 2019-05-06 11:05:06.970 7f0c8dffb700 4 set_mon_vals no callback set
-51> 2019-05-06 11:05:06.974 7f0d6602a240 10 monclient: build_initial_monmap
-50> 2019-05-06 11:05:06.974 7f0d6602a240 1 librados: starting msgr at -
-49> 2019-05-06 11:05:06.974 7f0d6602a240 1 librados: starting objecter
-48> 2019-05-06 11:05:06.974 7f0d6602a240 5 asok(0x5581a7f40790) register_command objecter_requests hook 0x5581a81ca730 EEXIST
-47> 2019-05-06 11:05:06.975 7f0d6602a240 1 librados: setting wanted keys
-46> 2019-05-06 11:05:06.975 7f0d6602a240 1 librados: calling monclient init
-45> 2019-05-06 11:05:06.975 7f0d6602a240 10 monclient: init
-44> 2019-05-06 11:05:06.975 7f0d6602a240 5 adding auth protocol: cephx
-43> 2019-05-06 11:05:06.975 7f0d6602a240 10 monclient: auth_supported 2 method cephx
-42> 2019-05-06 11:05:06.975 7f0d6602a240 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-41> 2019-05-06 11:05:06.975 7f0d6602a240 10 monclient: _reopen_session rank -1
-40> 2019-05-06 11:05:06.975 7f0d6602a240 10 monclient(hunting): picked mon.noname-a con 0x5581a81d7690 addr 10.101.123.8:6789/0
-39> 2019-05-06 11:05:06.975 7f0d6602a240 10 monclient(hunting): _renew_subs
-38> 2019-05-06 11:05:06.975 7f0d6602a240 10 monclient(hunting): authenticate will time out at 2019-05-06 11:10:06.975885
-37> 2019-05-06 11:05:06.976 7f0c8effd700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-36> 2019-05-06 11:05:06.976 7f0c8effd700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-35> 2019-05-06 11:05:06.976 7f0c8effd700 10 monclient(hunting): dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-34> 2019-05-06 11:05:06.977 7f0c8effd700 10 monclient(hunting): my global_id is 2084197
-33> 2019-05-06 11:05:06.977 7f0c8effd700 1 monclient: found mon.server04
-32> 2019-05-06 11:05:06.978 7f0c8effd700 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-31> 2019-05-06 11:05:06.978 7f0d6602a240 5 monclient: authenticate success, global_id 2084197
-30> 2019-05-06 11:05:06.978 7f0d6602a240 10 monclient: _renew_subs
-29> 2019-05-06 11:05:06.978 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-28> 2019-05-06 11:05:06.978 7f0d6602a240 10 monclient: _renew_subs
-27> 2019-05-06 11:05:06.978 7f0d6602a240 10 monclient: _send_mon_message to mon.server04 at 10.101.123.8:6789/0
-26> 2019-05-06 11:05:06.978 7f0d6602a240 1 librados: init done
-25> 2019-05-06 11:05:06.978 7f0c8effd700 10 monclient: handle_config config(0 keys) v1
-24> 2019-05-06 11:05:06.978 7f0c8effd700 10 monclient: handle_monmap mon_map magic: 0 v1
-23> 2019-05-06 11:05:06.978 7f0c8d7fa700 4 set_mon_vals no callback set
-22> 2019-05-06 11:05:06.978 7f0c8effd700 10 monclient: got monmap 4, mon.server04 is now rank 0
-21> 2019-05-06 11:05:06.978 7f0c8effd700 10 monclient: dump:
epoch 4
fsid 67f60ac1-70c3-4b96-a124-f5a077b473a8
last_changed 2019-04-25 09:16:53.375558
created 2019-04-25 09:11:15.168957
0: 10.101.123.8:6789/0 mon.server04

-20> 2019-05-06 11:05:06.978 7f0c8effd700 4 mgrc handle_mgr_map Got map version 259
-19> 2019-05-06 11:05:06.978 7f0c8effd700 4 mgrc handle_mgr_map Active mgr is now 10.101.123.7:6800/722388
-18> 2019-05-06 11:05:06.978 7f0c8effd700 4 mgrc reconnect Starting new session with 10.101.123.7:6800/722388
-17> 2019-05-06 11:05:06.986 7f0d6602a240 5 asok(0x5581a7f40790) register_command cr dump hook 0x5581a810f778
-16> 2019-05-06 11:05:16.800 7f0d51cbe700 10 monclient: tick
-15> 2019-05-06 11:05:16.811 7f0d497fa700 10 monclient: tick
-14> 2019-05-06 11:05:16.822 7f0d40ff9700 10 monclient: tick
-13> 2019-05-06 11:05:16.834 7f0d207f8700 10 monclient: tick
-12> 2019-05-06 11:05:16.846 7f0d17fff700 10 monclient: tick
-11> 2019-05-06 11:05:16.858 7f0d0b7fe700 10 monclient: tick
-10> 2019-05-06 11:05:16.869 7f0cfeffd700 10 monclient: tick
-9> 2019-05-06 11:05:16.881 7f0cf27fc700 10 monclient: tick
-8> 2019-05-06 11:05:16.892 7f0ce5ffb700 10 monclient: tick
-7> 2019-05-06 11:05:16.903 7f0cd97fa700 10 monclient: tick
-6> 2019-05-06 11:05:16.913 7f0cccff9700 10 monclient: tick
-5> 2019-05-06 11:05:16.926 7f0cbbfff700 10 monclient: tick
-4> 2019-05-06 11:05:16.938 7f0cb37fe700 10 monclient: tick
-3> 2019-05-06 11:05:16.950 7f0ca6ffd700 10 monclient: tick
-2> 2019-05-06 11:05:16.963 7f0c9a7fc700 10 monclient: tick
-1> 2019-05-06 11:05:16.975 7f0c8dffb700 10 monclient: tick
0> 2019-05-06 11:05:18.247 7f0d6602a240 -1 *** Caught signal (Aborted) **
in thread 7f0d6602a240 thread_name:radosgw-admin

ceph version 13.2.5 (cbff874f9007f1869bfd3821b7e33b2a6ffd4988) mimic (stable)
1: (()+0x50a9a0) [0x5581a5dbf9a0]
2: (()+0xf5d0) [0x7f0d63b1d5d0]
3: (gsignal()+0x37) [0x7f0d58ff2207]
4: (abort()+0x148) [0x7f0d58ff38f8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f0d59901ac5]
6: (()+0x5ea36) [0x7f0d598ffa36]
7: (()+0x5ea63) [0x7f0d598ffa63]
8: (()+0x5ec83) [0x7f0d598ffc83]
9: (librados::NObjectIteratorImpl::get_next()+0x215) [0x7f0d6593ffc5]
10: (librados::NObjectIteratorImpl::seek(librados::ObjectCursor const&)+0x1e) [0x7f0d6594021e]
11: (librados::IoCtx::nobjects_begin(librados::ObjectCursor const&, ceph::buffer::list const&)+0x58) [0x7f0d659402a8]
12: (librados::IoCtx::nobjects_begin(librados::ObjectCursor const&)+0x69) [0x7f0d65940349]
13: (RGWRados::pool_iterate_begin(rgw_pool const&, std::string const&, RGWPoolIterCtx&)+0xb3) [0x5581a5ba3773]
14: (RGWRados::list_raw_objects_init(rgw_pool const&, std::string const&, RGWListRawObjsCtx*)+0x2f) [0x5581a5ba385f]
15: (RGWRados::list_raw_objects(rgw_pool const&, std::string const&, int, RGWListRawObjsCtx&, std::list<std::string, std::allocator<std::string> >&, bool*)+0x55) [0x5581a5bd22b5]
16: (RGWRados::list_raw_prefixed_objs(rgw_pool const&, std::string const&, std::list<std::string, std::allocator<std::string> >&)+0xa8) [0x5581a5bd23e8]
17: (RGWRados::list_regions(std::list<std::string, std::allocator<std::string> >&)+0x1c5) [0x5581a5bd26f5]
18: (RGWRados::replace_region_with_zonegroup()+0x6fe) [0x5581a5bd3a1e]
19: (RGWRados::init_complete()+0xcf) [0x5581a5bdfd4f]
20: (RGWStoreManager::init_storage_provider(CephContext*, bool, bool, bool, bool, bool, bool)+0x86) [0x5581a5be2716]
21: (main()+0x155b) [0x5581a59e9e4b]
22: (__libc_start_main()+0xf5) [0x7f0d58fde3d5]
23: (()+0x16cd60) [0x5581a5a21d60]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
0/ 0 rgw
1/ 5 rgw_sync
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 500
max_new 1000
log_file
--- end dump of recent events ---
Aborted
    (1-1/1)