Project

General

Profile

Bug #47045 ยป radosgw-admin_pubsub_sub_pull.log

David Piper, 08/19/2020 04:32 PM

 
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: In function 'virtual int RGWUserPubSub::Sub::list_events(const string&, int)' thread 7f2a2ace86c0 time 2020-08-19 16:07:23.664313
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: 650: FAILED ceph_assert(false)
ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f2a20f0b875]
2: (()+0x253a3d) [0x7f2a20f0ba3d]
3: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
4: (main()+0x1698c) [0x559a08462bac]
5: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
6: (()+0x219430) [0x559a0848b430]
2020-08-19 16:07:23.666 7f2a2ace86c0 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: In function 'virtual int RGWUserPubSub::Sub::list_events(const string&, int)' thread 7f2a2ace86c0 time 2020-08-19 16:07:23.664313
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: 650: FAILED ceph_assert(false)

ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f2a20f0b875]
2: (()+0x253a3d) [0x7f2a20f0ba3d]
3: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
4: (main()+0x1698c) [0x559a08462bac]
5: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
6: (()+0x219430) [0x559a0848b430]

*** Caught signal (Aborted) **
in thread 7f2a2ace86c0 thread_name:radosgw-admin
ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (()+0xf5f0) [0x7f2a20aab5f0]
2: (gsignal()+0x37) [0x7f2a1d983337]
3: (abort()+0x148) [0x7f2a1d984a28]
4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f2a20f0b8c4]
5: (()+0x253a3d) [0x7f2a20f0ba3d]
6: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
7: (main()+0x1698c) [0x559a08462bac]
8: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
9: (()+0x219430) [0x559a0848b430]
2020-08-19 16:07:23.669 7f2a2ace86c0 -1 *** Caught signal (Aborted) **
in thread 7f2a2ace86c0 thread_name:radosgw-admin

ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (()+0xf5f0) [0x7f2a20aab5f0]
2: (gsignal()+0x37) [0x7f2a1d983337]
3: (abort()+0x148) [0x7f2a1d984a28]
4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f2a20f0b8c4]
5: (()+0x253a3d) [0x7f2a20f0ba3d]
6: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
7: (main()+0x1698c) [0x559a08462bac]
8: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
9: (()+0x219430) [0x559a0848b430]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-446> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command assert hook 0x559a0996f3c0
-445> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command abort hook 0x559a0996f3c0
-444> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perfcounters_dump hook 0x559a0996f3c0
-443> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command 1 hook 0x559a0996f3c0
-442> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf dump hook 0x559a0996f3c0
-441> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perfcounters_schema hook 0x559a0996f3c0
-440> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf histogram dump hook 0x559a0996f3c0
-439> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command 2 hook 0x559a0996f3c0
-438> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf schema hook 0x559a0996f3c0
-437> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf histogram schema hook 0x559a0996f3c0
-436> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf reset hook 0x559a0996f3c0
-435> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config show hook 0x559a0996f3c0
-434> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config help hook 0x559a0996f3c0
-433> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config set hook 0x559a0996f3c0
-432> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config unset hook 0x559a0996f3c0
-431> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config get hook 0x559a0996f3c0
-430> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config diff hook 0x559a0996f3c0
-429> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config diff get hook 0x559a0996f3c0
-428> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command log flush hook 0x559a0996f3c0
-427> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command log dump hook 0x559a0996f3c0
-426> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command log reopen hook 0x559a0996f3c0
-425> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command dump_mempools hook 0x559a09982e78
-424> 2020-08-19 16:07:23.300 7f2a2ace86c0 10 monclient: get_monmap_and_config
-423> 2020-08-19 16:07:23.360 7f2a2ace86c0 10 monclient: build_initial_monmap
-422> 2020-08-19 16:07:23.360 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.361753
created 2020-08-19 16:07:23.361753
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-421> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: cephx
-420> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: cephx
-419> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: cephx
-418> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: none
-417> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-416> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-415> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-414> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-413> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-412> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-411> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-410> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-409> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-408> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-407> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-406> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-405> 2020-08-19 16:07:23.362 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-404> 2020-08-19 16:07:23.366 7f2a2ace86c0 10 monclient: init
-403> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: cephx
-402> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: cephx
-401> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: cephx
-400> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: none
-399> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-398> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-397> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-396> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-395> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-394> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-393> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-392> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-391> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-390> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-389> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-388> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-387> 2020-08-19 16:07:23.367 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-386> 2020-08-19 16:07:23.367 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-385> 2020-08-19 16:07:23.367 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-384> 2020-08-19 16:07:23.368 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a09a75280 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-383> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a09a75bc0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-382> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a09a7fc80 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-381> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-380> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-379> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-378> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-377> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.370944
-376> 2020-08-19 16:07:23.369 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a09a75280 auth_method 0
-375> 2020-08-19 16:07:23.370 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-374> 2020-08-19 16:07:23.370 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-373> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): get_auth_request con 0x559a09a75bc0 auth_method 0
-372> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-371> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): _init_auth method 2
-370> 2020-08-19 16:07:23.370 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a09a7fc80 auth_method 0
-369> 2020-08-19 16:07:23.370 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-368> 2020-08-19 16:07:23.370 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-367> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload 9
-366> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-365> 2020-08-19 16:07:23.371 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-364> 2020-08-19 16:07:23.371 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-363> 2020-08-19 16:07:23.371 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-362> 2020-08-19 16:07:23.372 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-361> 2020-08-19 16:07:23.372 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload 9
-360> 2020-08-19 16:07:23.372 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-359> 2020-08-19 16:07:23.372 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-358> 2020-08-19 16:07:23.372 7f2a17ccd700 10 monclient(hunting): handle_auth_done global_id 1836438 payload 450
-357> 2020-08-19 16:07:23.372 7f2a17ccd700 10 monclient: _finish_hunting 0
-356> 2020-08-19 16:07:23.372 7f2a17ccd700 1 monclient: found mon.noname-a
-355> 2020-08-19 16:07:23.372 7f2a17ccd700 10 monclient: _send_mon_message to mon.noname-a at v2:10.225.21.213:3300/0
-354> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: handle_monmap mon_map magic: 0 v1
-353> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: got monmap 1 from mon.noname-a (according to old e1)
-352> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-351> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: _finish_auth 0
-350> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: handle_config config(0 keys) v1
-349> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: handle_monmap mon_map magic: 0 v1
-348> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: got monmap 1 from mon.albamons_sc0 (according to old e1)
-347> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-346> 2020-08-19 16:07:23.389 7f2a15cc9700 4 set_mon_vals no callback set
-345> 2020-08-19 16:07:23.391 7f2a2ace86c0 5 monclient: authenticate success, global_id 1836438
-344> 2020-08-19 16:07:23.391 7f2a2ace86c0 10 monclient: get_monmap_and_config success
-343> 2020-08-19 16:07:23.391 7f2a2ace86c0 10 monclient: shutdown
-342> 2020-08-19 16:07:23.433 7f2a2ace86c0 10 monclient: get_monmap_and_config
-341> 2020-08-19 16:07:23.433 7f2a2ace86c0 10 monclient: build_initial_monmap
-340> 2020-08-19 16:07:23.433 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.434873
created 2020-08-19 16:07:23.434873
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-339> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-338> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-337> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-336> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: none
-335> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-334> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-333> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-332> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-331> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-330> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-329> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-328> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-327> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-326> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-325> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-324> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-323> 2020-08-19 16:07:23.434 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-322> 2020-08-19 16:07:23.434 7f2a2ace86c0 10 monclient: init
-321> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: cephx
-320> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: cephx
-319> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: cephx
-318> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: none
-317> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-316> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-315> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-314> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-313> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-312> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-311> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-310> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-309> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-308> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-307> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-306> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-305> 2020-08-19 16:07:23.434 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-304> 2020-08-19 16:07:23.434 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-303> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-302> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a099c4220 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-301> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a099d50d0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-300> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a099d7a20 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-299> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-298> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-297> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-296> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-295> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.437212
-294> 2020-08-19 16:07:23.436 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a099c4220 auth_method 0
-293> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-292> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-291> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a099d7a20 auth_method 0
-290> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-289> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-288> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload 9
-287> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-286> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-285> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-284> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-283> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-282> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_done global_id 1828675 payload 450
-281> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient: _finish_hunting 0
-280> 2020-08-19 16:07:23.437 7f2a184ce700 1 monclient: found mon.noname-b
-279> 2020-08-19 16:07:23.438 7f2a184ce700 10 monclient: _send_mon_message to mon.noname-b at v2:10.225.21.214:3300/0
-278> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: handle_monmap mon_map magic: 0 v1
-277> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: got monmap 1 from mon.noname-b (according to old e1)
-276> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-275> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: _finish_auth 0
-274> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: handle_config config(0 keys) v1
-273> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: handle_monmap mon_map magic: 0 v1
-272> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: got monmap 1 from mon.albamons_sc1 (according to old e1)
-271> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-270> 2020-08-19 16:07:23.439 7f29fffff700 4 set_mon_vals no callback set
-269> 2020-08-19 16:07:23.439 7f2a2ace86c0 5 monclient: authenticate success, global_id 1828675
-268> 2020-08-19 16:07:23.439 7f2a2ace86c0 10 monclient: get_monmap_and_config success
-267> 2020-08-19 16:07:23.439 7f2a2ace86c0 10 monclient: shutdown
-266> 2020-08-19 16:07:23.441 7f2a2ace86c0 10 monclient: build_initial_monmap
-265> 2020-08-19 16:07:23.442 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.443408
created 2020-08-19 16:07:23.443408
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-264> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-263> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-262> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-261> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: none
-260> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-259> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-258> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-257> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-256> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-255> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-254> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-253> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-252> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-251> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-250> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-249> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-248> 2020-08-19 16:07:23.442 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-247> 2020-08-19 16:07:23.442 7f2a2ace86c0 1 librados: starting msgr at
-246> 2020-08-19 16:07:23.442 7f2a2ace86c0 1 librados: starting objecter
-245> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 asok(0x559a09920d60) register_command objecter_requests hook 0x559a099d3580
-244> 2020-08-19 16:07:23.443 7f2a2ace86c0 1 librados: setting wanted keys
-243> 2020-08-19 16:07:23.443 7f2a2ace86c0 1 librados: calling monclient init
-242> 2020-08-19 16:07:23.443 7f2a2ace86c0 10 monclient: init
-241> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: cephx
-240> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: cephx
-239> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: cephx
-238> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: none
-237> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-236> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-235> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-234> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-233> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-232> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-231> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-230> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-229> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-228> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-227> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-226> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-225> 2020-08-19 16:07:23.444 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-224> 2020-08-19 16:07:23.444 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-223> 2020-08-19 16:07:23.444 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-222> 2020-08-19 16:07:23.445 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a099d3d30 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-221> 2020-08-19 16:07:23.445 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a099d4670 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-220> 2020-08-19 16:07:23.445 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a099d78f0 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-219> 2020-08-19 16:07:23.446 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-218> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-217> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-216> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-215> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.448235
-214> 2020-08-19 16:07:23.447 7f2a17ccd700 10 monclient(hunting): get_auth_request con 0x559a099d4670 auth_method 0
-213> 2020-08-19 16:07:23.447 7f2a17ccd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-212> 2020-08-19 16:07:23.447 7f2a17ccd700 10 monclient(hunting): _init_auth method 2
-211> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a099d78f0 auth_method 0
-210> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-209> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-208> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-207> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-206> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-205> 2020-08-19 16:07:23.448 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload 9
-204> 2020-08-19 16:07:23.448 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-203> 2020-08-19 16:07:23.448 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-202> 2020-08-19 16:07:23.448 7f2a18ccf700 10 monclient(hunting): handle_auth_done global_id 1822430 payload 995
-201> 2020-08-19 16:07:23.448 7f2a18ccf700 10 monclient: _finish_hunting 0
-200> 2020-08-19 16:07:23.448 7f2a18ccf700 1 monclient: found mon.noname-c
-199> 2020-08-19 16:07:23.448 7f2a18ccf700 10 monclient: _send_mon_message to mon.noname-c at v2:10.225.21.215:3300/0
-198> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: handle_monmap mon_map magic: 0 v1
-197> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: got monmap 1 from mon.noname-c (according to old e1)
-196> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-195> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: _finish_auth 0
-194> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: handle_config config(0 keys) v1
-193> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: handle_monmap mon_map magic: 0 v1
-192> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: got monmap 1 from mon.albamons_sc2 (according to old e1)
-191> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-190> 2020-08-19 16:07:23.450 7f29ff7fe700 4 set_mon_vals no callback set
-189> 2020-08-19 16:07:23.450 7f2a2ace86c0 5 monclient: authenticate success, global_id 1822430
-188> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _renew_subs
-187> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc2 at v2:10.225.21.215:3300/0
-186> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _renew_subs
-185> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc2 at v2:10.225.21.215:3300/0
-184> 2020-08-19 16:07:23.451 7f2a2ace86c0 1 librados: init done
-183> 2020-08-19 16:07:23.456 7f2a154c8700 4 mgrc handle_mgr_map Got map version 67
-182> 2020-08-19 16:07:23.456 7f2a154c8700 4 mgrc handle_mgr_map Active mgr is now [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-181> 2020-08-19 16:07:23.456 7f2a154c8700 4 mgrc reconnect Starting new session with [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-180> 2020-08-19 16:07:23.458 7f2a184ce700 10 monclient: get_auth_request con 0x7f2a0001eef0 auth_method 0
-179> 2020-08-19 16:07:23.459 7f2a17ccd700 10 monclient: get_auth_request con 0x559a09aa9660 auth_method 0
-178> 2020-08-19 16:07:23.470 7f2a184ce700 10 monclient: get_auth_request con 0x559a09aadb60 auth_method 0
-177> 2020-08-19 16:07:23.524 7f2a17ccd700 10 monclient: get_auth_request con 0x559a09ab3f70 auth_method 0
-176> 2020-08-19 16:07:23.632 7f2a2ace86c0 2 all 8 watchers are set, enabling cache
-175> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache list hook 0x559a099bdbf0
-174> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache inspect hook 0x559a099bdbf0
-173> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache erase hook 0x559a099bdbf0
-172> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache zap hook 0x559a099bdbf0
-171> 2020-08-19 16:07:23.632 7f2a2ace86c0 10 monclient: get_monmap_and_config
-170> 2020-08-19 16:07:23.632 7f2a2ace86c0 10 monclient: build_initial_monmap
-169> 2020-08-19 16:07:23.632 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.634056
created 2020-08-19 16:07:23.634056
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-168> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: cephx
-167> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: cephx
-166> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: cephx
-165> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: none
-164> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-163> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-162> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-161> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-160> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-159> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-158> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-157> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-156> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-155> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-154> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-153> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-152> 2020-08-19 16:07:23.633 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-151> 2020-08-19 16:07:23.633 7f2a2ace86c0 10 monclient: init
-150> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: cephx
-149> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: cephx
-148> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: cephx
-147> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: none
-146> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-145> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-144> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-143> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-142> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-141> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-140> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-139> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-138> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-137> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-136> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-135> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-134> 2020-08-19 16:07:23.633 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-133> 2020-08-19 16:07:23.634 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-132> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-131> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a09ac3bd0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-130> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a09aca6f0 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-129> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a09acd040 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-128> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-127> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-126> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-125> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-124> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.636264
-123> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a09ac3bd0 auth_method 0
-122> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-121> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-120> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): get_auth_request con 0x559a09aca6f0 auth_method 0
-119> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-118> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): _init_auth method 2
-117> 2020-08-19 16:07:23.635 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a09acd040 auth_method 0
-116> 2020-08-19 16:07:23.635 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-115> 2020-08-19 16:07:23.635 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-114> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload 9
-113> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-112> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-111> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload 9
-110> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-109> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-108> 2020-08-19 16:07:23.636 7f2a184ce700 10 monclient(hunting): handle_auth_done global_id 1836441 payload 450
-107> 2020-08-19 16:07:23.636 7f2a184ce700 10 monclient: _finish_hunting 0
-106> 2020-08-19 16:07:23.636 7f2a184ce700 1 monclient: found mon.noname-a
-105> 2020-08-19 16:07:23.636 7f2a184ce700 10 monclient: _send_mon_message to mon.noname-a at v2:10.225.21.213:3300/0
-104> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1
-103> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: got monmap 1 from mon.noname-a (according to old e1)
-102> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-101> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: _finish_auth 0
-100> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: handle_config config(0 keys) v1
-99> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1
-98> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: got monmap 1 from mon.albamons_sc0 (according to old e1)
-97> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-96> 2020-08-19 16:07:23.637 7f2a2ace86c0 5 monclient: authenticate success, global_id 1836441
-95> 2020-08-19 16:07:23.637 7f2a2ace86c0 10 monclient: get_monmap_and_config success
-94> 2020-08-19 16:07:23.637 7f2a2ace86c0 10 monclient: shutdown
-93> 2020-08-19 16:07:23.637 7f29fbff7700 4 set_mon_vals no callback set
-92> 2020-08-19 16:07:23.639 7f2a2ace86c0 10 monclient: build_initial_monmap
-91> 2020-08-19 16:07:23.639 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.640579
created 2020-08-19 16:07:23.640579
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-90> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: cephx
-89> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: cephx
-88> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: cephx
-87> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: none
-86> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-85> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-84> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-83> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-82> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-81> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-80> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-79> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-78> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-77> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-76> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-75> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-74> 2020-08-19 16:07:23.639 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-73> 2020-08-19 16:07:23.639 7f2a2ace86c0 1 librados: starting msgr at
-72> 2020-08-19 16:07:23.639 7f2a2ace86c0 1 librados: starting objecter
-71> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 asok(0x559a09920d60) register_command objecter_requests hook 0x559a09ac1070 EEXIST
-70> 2020-08-19 16:07:23.640 7f2a2ace86c0 1 librados: setting wanted keys
-69> 2020-08-19 16:07:23.640 7f2a2ace86c0 1 librados: calling monclient init
-68> 2020-08-19 16:07:23.640 7f2a2ace86c0 10 monclient: init
-67> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: cephx
-66> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: cephx
-65> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: cephx
-64> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: none
-63> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-62> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-61> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-60> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-59> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-58> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-57> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-56> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-55> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-54> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-53> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-52> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-51> 2020-08-19 16:07:23.640 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-50> 2020-08-19 16:07:23.640 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-49> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-48> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a09acc390 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-47> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a09ac82b0 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-46> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a09ac8bf0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-45> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-44> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-43> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-42> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-41> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.642582
-40> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a09ac8bf0 auth_method 0
-39> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-38> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-37> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-36> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-35> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-34> 2020-08-19 16:07:23.642 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a09acc390 auth_method 0
-33> 2020-08-19 16:07:23.642 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-32> 2020-08-19 16:07:23.642 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-31> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_done global_id 1836444 payload 995
-30> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient: _finish_hunting 0
-29> 2020-08-19 16:07:23.642 7f2a18ccf700 1 monclient: found mon.noname-a
-28> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient: _send_mon_message to mon.noname-a at v2:10.225.21.213:3300/0
-27> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: handle_monmap mon_map magic: 0 v1
-26> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: got monmap 1 from mon.noname-a (according to old e1)
-25> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-24> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: _finish_auth 0
-23> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: handle_config config(0 keys) v1
-22> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: handle_monmap mon_map magic: 0 v1
-21> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: got monmap 1 from mon.albamons_sc0 (according to old e1)
-20> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-19> 2020-08-19 16:07:23.643 7f29fb7f6700 4 set_mon_vals no callback set
-18> 2020-08-19 16:07:23.644 7f2a2ace86c0 5 monclient: authenticate success, global_id 1836444
-17> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _renew_subs
-16> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc0 at v2:10.225.21.213:3300/0
-15> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _renew_subs
-14> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc0 at v2:10.225.21.213:3300/0
-13> 2020-08-19 16:07:23.644 7f2a2ace86c0 1 librados: init done
-12> 2020-08-19 16:07:23.644 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cr dump hook 0x559a09ad5a68
-11> 2020-08-19 16:07:23.644 7f2a2ace86c0 5 pubsub: module config (parsed representation):
{
"id": "pubsub",
"user": "pubsub",
"data_bucket_prefix": "pubsub-",
"data_oid_prefix": "",
"events_retention_days": 7,
"sync_instance": 0,
"max_id": 0,
"subs": [],
"topics": [],
"notifications": {},
"start_with_full_sync": "false"
}

-10> 2020-08-19 16:07:23.644 7f29f97f2700 2 RGWDataChangesLog::ChangesRenewThread: start
-9> 2020-08-19 16:07:23.652 7f29fcff9700 4 mgrc handle_mgr_map Got map version 67
-8> 2020-08-19 16:07:23.652 7f29fcff9700 4 mgrc handle_mgr_map Active mgr is now [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-7> 2020-08-19 16:07:23.652 7f29fcff9700 4 mgrc reconnect Starting new session with [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-6> 2020-08-19 16:07:23.653 7f2a184ce700 10 monclient: get_auth_request con 0x7f29f401eef0 auth_method 0
-5> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace show hook 0x559a09ae63b0
-4> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace history hook 0x559a09ae63b0
-3> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace active hook 0x559a09ae63b0
-2> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace active_short hook 0x559a09ae63b0
-1> 2020-08-19 16:07:23.666 7f2a2ace86c0 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: In function 'virtual int RGWUserPubSub::Sub::list_events(const string&, int)' thread 7f2a2ace86c0 time 2020-08-19 16:07:23.664313
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: 650: FAILED ceph_assert(false)

ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f2a20f0b875]
2: (()+0x253a3d) [0x7f2a20f0ba3d]
3: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
4: (main()+0x1698c) [0x559a08462bac]
5: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
6: (()+0x219430) [0x559a0848b430]

0> 2020-08-19 16:07:23.669 7f2a2ace86c0 -1 *** Caught signal (Aborted) **
in thread 7f2a2ace86c0 thread_name:radosgw-admin

ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (()+0xf5f0) [0x7f2a20aab5f0]
2: (gsignal()+0x37) [0x7f2a1d983337]
3: (abort()+0x148) [0x7f2a1d984a28]
4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f2a20f0b8c4]
5: (()+0x253a3d) [0x7f2a20f0ba3d]
6: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
7: (main()+0x1698c) [0x559a08462bac]
8: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
9: (()+0x219430) [0x559a0848b430]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
0/ 5 rgw
1/ 5 rgw_sync
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
1/ 5 prioritycache
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 500
max_new 1000
log_file
--- end dump of recent events ---
--- begin dump of recent events ---
-446> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command assert hook 0x559a0996f3c0
-445> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command abort hook 0x559a0996f3c0
-444> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perfcounters_dump hook 0x559a0996f3c0
-443> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command 1 hook 0x559a0996f3c0
-442> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf dump hook 0x559a0996f3c0
-441> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perfcounters_schema hook 0x559a0996f3c0
-440> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf histogram dump hook 0x559a0996f3c0
-439> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command 2 hook 0x559a0996f3c0
-438> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf schema hook 0x559a0996f3c0
-437> 2020-08-19 16:07:23.275 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf histogram schema hook 0x559a0996f3c0
-436> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command perf reset hook 0x559a0996f3c0
-435> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config show hook 0x559a0996f3c0
-434> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config help hook 0x559a0996f3c0
-433> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config set hook 0x559a0996f3c0
-432> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config unset hook 0x559a0996f3c0
-431> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config get hook 0x559a0996f3c0
-430> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config diff hook 0x559a0996f3c0
-429> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command config diff get hook 0x559a0996f3c0
-428> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command log flush hook 0x559a0996f3c0
-427> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command log dump hook 0x559a0996f3c0
-426> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command log reopen hook 0x559a0996f3c0
-425> 2020-08-19 16:07:23.276 7f2a2ace86c0 5 asok(0x559a09920d60) register_command dump_mempools hook 0x559a09982e78
-424> 2020-08-19 16:07:23.300 7f2a2ace86c0 10 monclient: get_monmap_and_config
-423> 2020-08-19 16:07:23.360 7f2a2ace86c0 10 monclient: build_initial_monmap
-422> 2020-08-19 16:07:23.360 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.361753
created 2020-08-19 16:07:23.361753
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-421> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: cephx
-420> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: cephx
-419> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: cephx
-418> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding auth protocol: none
-417> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-416> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-415> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-414> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-413> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-412> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-411> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-410> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-409> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-408> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-407> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: crc
-406> 2020-08-19 16:07:23.361 7f2a2ace86c0 5 AuthRegistry(0x559a099de538) adding con mode: secure
-405> 2020-08-19 16:07:23.362 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-404> 2020-08-19 16:07:23.366 7f2a2ace86c0 10 monclient: init
-403> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: cephx
-402> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: cephx
-401> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: cephx
-400> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding auth protocol: none
-399> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-398> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-397> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-396> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-395> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-394> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-393> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-392> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-391> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-390> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-389> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: crc
-388> 2020-08-19 16:07:23.366 7f2a2ace86c0 5 AuthRegistry(0x7fff85a349b8) adding con mode: secure
-387> 2020-08-19 16:07:23.367 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-386> 2020-08-19 16:07:23.367 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-385> 2020-08-19 16:07:23.367 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-384> 2020-08-19 16:07:23.368 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a09a75280 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-383> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a09a75bc0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-382> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a09a7fc80 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-381> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-380> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-379> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-378> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-377> 2020-08-19 16:07:23.369 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.370944
-376> 2020-08-19 16:07:23.369 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a09a75280 auth_method 0
-375> 2020-08-19 16:07:23.370 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-374> 2020-08-19 16:07:23.370 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-373> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): get_auth_request con 0x559a09a75bc0 auth_method 0
-372> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-371> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): _init_auth method 2
-370> 2020-08-19 16:07:23.370 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a09a7fc80 auth_method 0
-369> 2020-08-19 16:07:23.370 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-368> 2020-08-19 16:07:23.370 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-367> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload 9
-366> 2020-08-19 16:07:23.370 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-365> 2020-08-19 16:07:23.371 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-364> 2020-08-19 16:07:23.371 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-363> 2020-08-19 16:07:23.371 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-362> 2020-08-19 16:07:23.372 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-361> 2020-08-19 16:07:23.372 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload 9
-360> 2020-08-19 16:07:23.372 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-359> 2020-08-19 16:07:23.372 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-358> 2020-08-19 16:07:23.372 7f2a17ccd700 10 monclient(hunting): handle_auth_done global_id 1836438 payload 450
-357> 2020-08-19 16:07:23.372 7f2a17ccd700 10 monclient: _finish_hunting 0
-356> 2020-08-19 16:07:23.372 7f2a17ccd700 1 monclient: found mon.noname-a
-355> 2020-08-19 16:07:23.372 7f2a17ccd700 10 monclient: _send_mon_message to mon.noname-a at v2:10.225.21.213:3300/0
-354> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: handle_monmap mon_map magic: 0 v1
-353> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: got monmap 1 from mon.noname-a (according to old e1)
-352> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-351> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: _finish_auth 0
-350> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: handle_config config(0 keys) v1
-349> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: handle_monmap mon_map magic: 0 v1
-348> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: got monmap 1 from mon.albamons_sc0 (according to old e1)
-347> 2020-08-19 16:07:23.389 7f2a174cc700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-346> 2020-08-19 16:07:23.389 7f2a15cc9700 4 set_mon_vals no callback set
-345> 2020-08-19 16:07:23.391 7f2a2ace86c0 5 monclient: authenticate success, global_id 1836438
-344> 2020-08-19 16:07:23.391 7f2a2ace86c0 10 monclient: get_monmap_and_config success
-343> 2020-08-19 16:07:23.391 7f2a2ace86c0 10 monclient: shutdown
-342> 2020-08-19 16:07:23.433 7f2a2ace86c0 10 monclient: get_monmap_and_config
-341> 2020-08-19 16:07:23.433 7f2a2ace86c0 10 monclient: build_initial_monmap
-340> 2020-08-19 16:07:23.433 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.434873
created 2020-08-19 16:07:23.434873
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-339> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-338> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-337> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-336> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: none
-335> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-334> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-333> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-332> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-331> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-330> 2020-08-19 16:07:23.433 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-329> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-328> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-327> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-326> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-325> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-324> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-323> 2020-08-19 16:07:23.434 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-322> 2020-08-19 16:07:23.434 7f2a2ace86c0 10 monclient: init
-321> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: cephx
-320> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: cephx
-319> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: cephx
-318> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding auth protocol: none
-317> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-316> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-315> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-314> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-313> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-312> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-311> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-310> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-309> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-308> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-307> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: crc
-306> 2020-08-19 16:07:23.434 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35958) adding con mode: secure
-305> 2020-08-19 16:07:23.434 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-304> 2020-08-19 16:07:23.434 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-303> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-302> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a099c4220 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-301> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a099d50d0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-300> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a099d7a20 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-299> 2020-08-19 16:07:23.435 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-298> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-297> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-296> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-295> 2020-08-19 16:07:23.436 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.437212
-294> 2020-08-19 16:07:23.436 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a099c4220 auth_method 0
-293> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-292> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-291> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a099d7a20 auth_method 0
-290> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-289> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-288> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload 9
-287> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-286> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-285> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-284> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-283> 2020-08-19 16:07:23.437 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-282> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient(hunting): handle_auth_done global_id 1828675 payload 450
-281> 2020-08-19 16:07:23.437 7f2a184ce700 10 monclient: _finish_hunting 0
-280> 2020-08-19 16:07:23.437 7f2a184ce700 1 monclient: found mon.noname-b
-279> 2020-08-19 16:07:23.438 7f2a184ce700 10 monclient: _send_mon_message to mon.noname-b at v2:10.225.21.214:3300/0
-278> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: handle_monmap mon_map magic: 0 v1
-277> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: got monmap 1 from mon.noname-b (according to old e1)
-276> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-275> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: _finish_auth 0
-274> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: handle_config config(0 keys) v1
-273> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: handle_monmap mon_map magic: 0 v1
-272> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: got monmap 1 from mon.albamons_sc1 (according to old e1)
-271> 2020-08-19 16:07:23.439 7f2a15cc9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-270> 2020-08-19 16:07:23.439 7f29fffff700 4 set_mon_vals no callback set
-269> 2020-08-19 16:07:23.439 7f2a2ace86c0 5 monclient: authenticate success, global_id 1828675
-268> 2020-08-19 16:07:23.439 7f2a2ace86c0 10 monclient: get_monmap_and_config success
-267> 2020-08-19 16:07:23.439 7f2a2ace86c0 10 monclient: shutdown
-266> 2020-08-19 16:07:23.441 7f2a2ace86c0 10 monclient: build_initial_monmap
-265> 2020-08-19 16:07:23.442 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.443408
created 2020-08-19 16:07:23.443408
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-264> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-263> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-262> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: cephx
-261> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding auth protocol: none
-260> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-259> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-258> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-257> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-256> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-255> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-254> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-253> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-252> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-251> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-250> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: crc
-249> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 AuthRegistry(0x559a099c27f8) adding con mode: secure
-248> 2020-08-19 16:07:23.442 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-247> 2020-08-19 16:07:23.442 7f2a2ace86c0 1 librados: starting msgr at
-246> 2020-08-19 16:07:23.442 7f2a2ace86c0 1 librados: starting objecter
-245> 2020-08-19 16:07:23.442 7f2a2ace86c0 5 asok(0x559a09920d60) register_command objecter_requests hook 0x559a099d3580
-244> 2020-08-19 16:07:23.443 7f2a2ace86c0 1 librados: setting wanted keys
-243> 2020-08-19 16:07:23.443 7f2a2ace86c0 1 librados: calling monclient init
-242> 2020-08-19 16:07:23.443 7f2a2ace86c0 10 monclient: init
-241> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: cephx
-240> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: cephx
-239> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: cephx
-238> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding auth protocol: none
-237> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-236> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-235> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-234> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-233> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-232> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-231> 2020-08-19 16:07:23.443 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-230> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-229> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-228> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-227> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: crc
-226> 2020-08-19 16:07:23.444 7f2a2ace86c0 5 AuthRegistry(0x559a099bf8b8) adding con mode: secure
-225> 2020-08-19 16:07:23.444 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-224> 2020-08-19 16:07:23.444 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-223> 2020-08-19 16:07:23.444 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-222> 2020-08-19 16:07:23.445 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a099d3d30 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-221> 2020-08-19 16:07:23.445 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a099d4670 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-220> 2020-08-19 16:07:23.445 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a099d78f0 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-219> 2020-08-19 16:07:23.446 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-218> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-217> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-216> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-215> 2020-08-19 16:07:23.447 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.448235
-214> 2020-08-19 16:07:23.447 7f2a17ccd700 10 monclient(hunting): get_auth_request con 0x559a099d4670 auth_method 0
-213> 2020-08-19 16:07:23.447 7f2a17ccd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-212> 2020-08-19 16:07:23.447 7f2a17ccd700 10 monclient(hunting): _init_auth method 2
-211> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a099d78f0 auth_method 0
-210> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-209> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-208> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-207> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-206> 2020-08-19 16:07:23.447 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-205> 2020-08-19 16:07:23.448 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload 9
-204> 2020-08-19 16:07:23.448 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-203> 2020-08-19 16:07:23.448 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-202> 2020-08-19 16:07:23.448 7f2a18ccf700 10 monclient(hunting): handle_auth_done global_id 1822430 payload 995
-201> 2020-08-19 16:07:23.448 7f2a18ccf700 10 monclient: _finish_hunting 0
-200> 2020-08-19 16:07:23.448 7f2a18ccf700 1 monclient: found mon.noname-c
-199> 2020-08-19 16:07:23.448 7f2a18ccf700 10 monclient: _send_mon_message to mon.noname-c at v2:10.225.21.215:3300/0
-198> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: handle_monmap mon_map magic: 0 v1
-197> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: got monmap 1 from mon.noname-c (according to old e1)
-196> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-195> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: _finish_auth 0
-194> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: handle_config config(0 keys) v1
-193> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: handle_monmap mon_map magic: 0 v1
-192> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: got monmap 1 from mon.albamons_sc2 (according to old e1)
-191> 2020-08-19 16:07:23.450 7f2a154c8700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-190> 2020-08-19 16:07:23.450 7f29ff7fe700 4 set_mon_vals no callback set
-189> 2020-08-19 16:07:23.450 7f2a2ace86c0 5 monclient: authenticate success, global_id 1822430
-188> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _renew_subs
-187> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc2 at v2:10.225.21.215:3300/0
-186> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _renew_subs
-185> 2020-08-19 16:07:23.450 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc2 at v2:10.225.21.215:3300/0
-184> 2020-08-19 16:07:23.451 7f2a2ace86c0 1 librados: init done
-183> 2020-08-19 16:07:23.456 7f2a154c8700 4 mgrc handle_mgr_map Got map version 67
-182> 2020-08-19 16:07:23.456 7f2a154c8700 4 mgrc handle_mgr_map Active mgr is now [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-181> 2020-08-19 16:07:23.456 7f2a154c8700 4 mgrc reconnect Starting new session with [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-180> 2020-08-19 16:07:23.458 7f2a184ce700 10 monclient: get_auth_request con 0x7f2a0001eef0 auth_method 0
-179> 2020-08-19 16:07:23.459 7f2a17ccd700 10 monclient: get_auth_request con 0x559a09aa9660 auth_method 0
-178> 2020-08-19 16:07:23.470 7f2a184ce700 10 monclient: get_auth_request con 0x559a09aadb60 auth_method 0
-177> 2020-08-19 16:07:23.524 7f2a17ccd700 10 monclient: get_auth_request con 0x559a09ab3f70 auth_method 0
-176> 2020-08-19 16:07:23.632 7f2a2ace86c0 2 all 8 watchers are set, enabling cache
-175> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache list hook 0x559a099bdbf0
-174> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache inspect hook 0x559a099bdbf0
-173> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache erase hook 0x559a099bdbf0
-172> 2020-08-19 16:07:23.632 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cache zap hook 0x559a099bdbf0
-171> 2020-08-19 16:07:23.632 7f2a2ace86c0 10 monclient: get_monmap_and_config
-170> 2020-08-19 16:07:23.632 7f2a2ace86c0 10 monclient: build_initial_monmap
-169> 2020-08-19 16:07:23.632 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.634056
created 2020-08-19 16:07:23.634056
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-168> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: cephx
-167> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: cephx
-166> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: cephx
-165> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding auth protocol: none
-164> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-163> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-162> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-161> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-160> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-159> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-158> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-157> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-156> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-155> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-154> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: crc
-153> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x559a09abb4c8) adding con mode: secure
-152> 2020-08-19 16:07:23.633 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-151> 2020-08-19 16:07:23.633 7f2a2ace86c0 10 monclient: init
-150> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: cephx
-149> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: cephx
-148> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: cephx
-147> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding auth protocol: none
-146> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-145> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-144> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-143> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-142> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-141> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-140> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-139> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-138> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-137> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-136> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: crc
-135> 2020-08-19 16:07:23.633 7f2a2ace86c0 5 AuthRegistry(0x7fff85a35b78) adding con mode: secure
-134> 2020-08-19 16:07:23.633 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-133> 2020-08-19 16:07:23.634 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-132> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-131> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a09ac3bd0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-130> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a09aca6f0 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-129> 2020-08-19 16:07:23.634 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a09acd040 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-128> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-127> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-126> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-125> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-124> 2020-08-19 16:07:23.635 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.636264
-123> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a09ac3bd0 auth_method 0
-122> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-121> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-120> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): get_auth_request con 0x559a09aca6f0 auth_method 0
-119> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-118> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): _init_auth method 2
-117> 2020-08-19 16:07:23.635 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a09acd040 auth_method 0
-116> 2020-08-19 16:07:23.635 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-115> 2020-08-19 16:07:23.635 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-114> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload 9
-113> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-112> 2020-08-19 16:07:23.635 7f2a184ce700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-111> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload 9
-110> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-109> 2020-08-19 16:07:23.635 7f2a17ccd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-108> 2020-08-19 16:07:23.636 7f2a184ce700 10 monclient(hunting): handle_auth_done global_id 1836441 payload 450
-107> 2020-08-19 16:07:23.636 7f2a184ce700 10 monclient: _finish_hunting 0
-106> 2020-08-19 16:07:23.636 7f2a184ce700 1 monclient: found mon.noname-a
-105> 2020-08-19 16:07:23.636 7f2a184ce700 10 monclient: _send_mon_message to mon.noname-a at v2:10.225.21.213:3300/0
-104> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1
-103> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: got monmap 1 from mon.noname-a (according to old e1)
-102> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-101> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: _finish_auth 0
-100> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: handle_config config(0 keys) v1
-99> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: handle_monmap mon_map magic: 0 v1
-98> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: got monmap 1 from mon.albamons_sc0 (according to old e1)
-97> 2020-08-19 16:07:23.637 7f29fd7fa700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-96> 2020-08-19 16:07:23.637 7f2a2ace86c0 5 monclient: authenticate success, global_id 1836441
-95> 2020-08-19 16:07:23.637 7f2a2ace86c0 10 monclient: get_monmap_and_config success
-94> 2020-08-19 16:07:23.637 7f2a2ace86c0 10 monclient: shutdown
-93> 2020-08-19 16:07:23.637 7f29fbff7700 4 set_mon_vals no callback set
-92> 2020-08-19 16:07:23.639 7f2a2ace86c0 10 monclient: build_initial_monmap
-91> 2020-08-19 16:07:23.639 7f2a2ace86c0 10 monclient: monmap:
epoch 0
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-08-19 16:07:23.640579
created 2020-08-19 16:07:23.640579
min_mon_release 0 (unknown)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.noname-a
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.noname-b
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.noname-c

-90> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: cephx
-89> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: cephx
-88> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: cephx
-87> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding auth protocol: none
-86> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-85> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-84> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-83> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-82> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-81> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-80> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-79> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-78> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-77> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-76> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: crc
-75> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 AuthRegistry(0x559a09ac21b8) adding con mode: secure
-74> 2020-08-19 16:07:23.639 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-73> 2020-08-19 16:07:23.639 7f2a2ace86c0 1 librados: starting msgr at
-72> 2020-08-19 16:07:23.639 7f2a2ace86c0 1 librados: starting objecter
-71> 2020-08-19 16:07:23.639 7f2a2ace86c0 5 asok(0x559a09920d60) register_command objecter_requests hook 0x559a09ac1070 EEXIST
-70> 2020-08-19 16:07:23.640 7f2a2ace86c0 1 librados: setting wanted keys
-69> 2020-08-19 16:07:23.640 7f2a2ace86c0 1 librados: calling monclient init
-68> 2020-08-19 16:07:23.640 7f2a2ace86c0 10 monclient: init
-67> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: cephx
-66> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: cephx
-65> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: cephx
-64> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding auth protocol: none
-63> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-62> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-61> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-60> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-59> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-58> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-57> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-56> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-55> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-54> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-53> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: crc
-52> 2020-08-19 16:07:23.640 7f2a2ace86c0 5 AuthRegistry(0x559a09aba238) adding con mode: secure
-51> 2020-08-19 16:07:23.640 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-50> 2020-08-19 16:07:23.640 7f2a2ace86c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
-49> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient: _reopen_session rank -1
-48> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-c con 0x559a09acc390 addr [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0]
-47> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-b con 0x559a09ac82b0 addr [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0]
-46> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): picked mon.noname-a con 0x559a09ac8bf0 addr [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0]
-45> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-44> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-43> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): start opening mon connection
-42> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): _renew_subs
-41> 2020-08-19 16:07:23.641 7f2a2ace86c0 10 monclient(hunting): authenticate will time out at 2020-08-19 16:12:23.642582
-40> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): get_auth_request con 0x559a09ac8bf0 auth_method 0
-39> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-38> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): _init_auth method 2
-37> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload 9
-36> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-35> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-34> 2020-08-19 16:07:23.642 7f2a184ce700 10 monclient(hunting): get_auth_request con 0x559a09acc390 auth_method 0
-33> 2020-08-19 16:07:23.642 7f2a184ce700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
-32> 2020-08-19 16:07:23.642 7f2a184ce700 10 monclient(hunting): _init_auth method 2
-31> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient(hunting): handle_auth_done global_id 1836444 payload 995
-30> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient: _finish_hunting 0
-29> 2020-08-19 16:07:23.642 7f2a18ccf700 1 monclient: found mon.noname-a
-28> 2020-08-19 16:07:23.642 7f2a18ccf700 10 monclient: _send_mon_message to mon.noname-a at v2:10.225.21.213:3300/0
-27> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: handle_monmap mon_map magic: 0 v1
-26> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: got monmap 1 from mon.noname-a (according to old e1)
-25> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-24> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: _finish_auth 0
-23> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: handle_config config(0 keys) v1
-22> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: handle_monmap mon_map magic: 0 v1
-21> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: got monmap 1 from mon.albamons_sc0 (according to old e1)
-20> 2020-08-19 16:07:23.643 7f29fcff9700 10 monclient: dump:
epoch 1
fsid 58ff05a5-2d0e-4891-af0c-10484485e528
last_changed 2020-07-14 12:56:39.043203
created 2020-07-14 12:56:39.043203
min_mon_release 14 (nautilus)
0: [v2:10.225.21.213:3300/0,v1:10.225.21.213:6789/0] mon.albamons_sc0
1: [v2:10.225.21.214:3300/0,v1:10.225.21.214:6789/0] mon.albamons_sc1
2: [v2:10.225.21.215:3300/0,v1:10.225.21.215:6789/0] mon.albamons_sc2

-19> 2020-08-19 16:07:23.643 7f29fb7f6700 4 set_mon_vals no callback set
-18> 2020-08-19 16:07:23.644 7f2a2ace86c0 5 monclient: authenticate success, global_id 1836444
-17> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _renew_subs
-16> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc0 at v2:10.225.21.213:3300/0
-15> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _renew_subs
-14> 2020-08-19 16:07:23.644 7f2a2ace86c0 10 monclient: _send_mon_message to mon.albamons_sc0 at v2:10.225.21.213:3300/0
-13> 2020-08-19 16:07:23.644 7f2a2ace86c0 1 librados: init done
-12> 2020-08-19 16:07:23.644 7f2a2ace86c0 5 asok(0x559a09920d60) register_command cr dump hook 0x559a09ad5a68
-11> 2020-08-19 16:07:23.644 7f2a2ace86c0 5 pubsub: module config (parsed representation):
{
"id": "pubsub",
"user": "pubsub",
"data_bucket_prefix": "pubsub-",
"data_oid_prefix": "",
"events_retention_days": 7,
"sync_instance": 0,
"max_id": 0,
"subs": [],
"topics": [],
"notifications": {},
"start_with_full_sync": "false"
}

-10> 2020-08-19 16:07:23.644 7f29f97f2700 2 RGWDataChangesLog::ChangesRenewThread: start
-9> 2020-08-19 16:07:23.652 7f29fcff9700 4 mgrc handle_mgr_map Got map version 67
-8> 2020-08-19 16:07:23.652 7f29fcff9700 4 mgrc handle_mgr_map Active mgr is now [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-7> 2020-08-19 16:07:23.652 7f29fcff9700 4 mgrc reconnect Starting new session with [v2:10.225.21.213:6810/54,v1:10.225.21.213:6811/54]
-6> 2020-08-19 16:07:23.653 7f2a184ce700 10 monclient: get_auth_request con 0x7f29f401eef0 auth_method 0
-5> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace show hook 0x559a09ae63b0
-4> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace history hook 0x559a09ae63b0
-3> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace active hook 0x559a09ae63b0
-2> 2020-08-19 16:07:23.657 7f2a2ace86c0 5 asok(0x559a09920d60) register_command sync trace active_short hook 0x559a09ae63b0
-1> 2020-08-19 16:07:23.666 7f2a2ace86c0 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: In function 'virtual int RGWUserPubSub::Sub::list_events(const string&, int)' thread 7f2a2ace86c0 time 2020-08-19 16:07:23.664313
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/rgw/rgw_pubsub.h: 650: FAILED ceph_assert(false)

ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7f2a20f0b875]
2: (()+0x253a3d) [0x7f2a20f0ba3d]
3: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
4: (main()+0x1698c) [0x559a08462bac]
5: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
6: (()+0x219430) [0x559a0848b430]

0> 2020-08-19 16:07:23.669 7f2a2ace86c0 -1 *** Caught signal (Aborted) **
in thread 7f2a2ace86c0 thread_name:radosgw-admin

ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (()+0xf5f0) [0x7f2a20aab5f0]
2: (gsignal()+0x37) [0x7f2a1d983337]
3: (abort()+0x148) [0x7f2a1d984a28]
4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x7f2a20f0b8c4]
5: (()+0x253a3d) [0x7f2a20f0ba3d]
6: (RGWUserPubSub::Sub::remove_event(std::string const&)+0) [0x559a08495480]
7: (main()+0x1698c) [0x559a08462bac]
8: (__libc_start_main()+0xf5) [0x7f2a1d96f505]
9: (()+0x219430) [0x559a0848b430]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
0/ 5 rgw
1/ 5 rgw_sync
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
1/ 5 prioritycache
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 500
max_new 1000
log_file /var/lib/ceph/crash/2020-08-19_16:07:23.670029Z_d2365a55-f104-44db-b7d3-85bc75e7d5c2/log
--- end dump of recent events ---
    (1-1/1)