Project

General

Profile

Bug #61763 » dump_rgw_loop_restart.txt

Guillaume Morin, 06/22/2023 08:06 AM

 

--- begin dump of recent events ---
-677> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command assert hook 0x557e660d87c0
-676> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command abort hook 0x557e660d87c0
-675> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command leak_some_memory hook 0x557e660d87c0
-674> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command perfcounters_dump hook 0x557e660d87c0
-673> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command 1 hook 0x557e660d87c0
-672> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command perf dump hook 0x557e660d87c0
-671> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command perfcounters_schema hook 0x557e660d87c0
-670> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command perf histogram dump hook 0x557e660d87c0
-669> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command 2 hook 0x557e660d87c0
-668> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command perf schema hook 0x557e660d87c0
-667> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command perf histogram schema hook 0x557e660d87c0
-666> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command perf reset hook 0x557e660d87c0
-665> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command config show hook 0x557e660d87c0
-664> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command config help hook 0x557e660d87c0
-663> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command config set hook 0x557e660d87c0
-662> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command config unset hook 0x557e660d87c0
-661> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command config get hook 0x557e660d87c0
-660> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command config diff hook 0x557e660d87c0
-659> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command config diff get hook 0x557e660d87c0
-658> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command injectargs hook 0x557e660d87c0
-657> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command log flush hook 0x557e660d87c0
-656> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command log dump hook 0x557e660d87c0
-655> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command log reopen hook 0x557e660d87c0
-654> 2023-06-21T15:21:39.804+0200 7f167fa02840 5 asok(0x557e66065100) register_command dump_mempools hook 0x557e660dab28
-653> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient: get_monmap_and_config
-652> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient: build_initial_monmap
-651> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient: monmap:
epoch 0
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2023-06-21T15:21:39.812135+0200
created 2023-06-21T15:21:39.812135+0200
min_mon_release 0 (unknown)
election_strategy: 1
0: v1:10.17.66.11:6789/0 mon.noname-a-legacy
1: v1:10.17.66.13:6789/0 mon.noname-b-legacy
2: v1:10.17.66.14:6789/0 mon.noname-c-legacy
3: v1:10.17.66.23:6789/0 mon.noname-d-legacy
4: v2:10.17.66.11:3300/0 mon.noname-a
5: v2:10.17.66.13:3300/0 mon.noname-b
6: v2:10.17.66.14:3300/0 mon.noname-c
7: v2:10.17.66.23:3300/0 mon.noname-d

-650> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding auth protocol: cephx
-649> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding auth protocol: cephx
-648> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding auth protocol: cephx
-647> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: secure
-646> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: crc
-645> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: secure
-644> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: crc
-643> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: secure
-642> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: crc
-641> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: secure
-640> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: crc
-639> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: secure
-638> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: crc
-637> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x557e660eaab0) adding con mode: secure
-636> 2023-06-21T15:21:39.808+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-635> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient: init
-634> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding auth protocol: cephx
-633> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding auth protocol: cephx
-632> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding auth protocol: cephx
-631> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: secure
-630> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: crc
-629> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: secure
-628> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: crc
-627> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: secure
-626> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: crc
-625> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: secure
-624> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: crc
-623> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: secure
-622> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: crc
-621> 2023-06-21T15:21:39.808+0200 7f167fa02840 5 AuthRegistry(0x7ffed35403c0) adding con mode: secure
-620> 2023-06-21T15:21:39.808+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-619> 2023-06-21T15:21:39.808+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-618> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient: _reopen_session rank -1
-617> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient: _add_conns ranks=[0,7,6,2,3,5,4,1]
-616> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-a-legacy con 0x557e66178fd0 addr v1:10.17.66.11:6789/0
-615> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-d con 0x557e6617d6e0 addr v2:10.17.66.23:3300/0
-614> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-c con 0x557e6617ffc0 addr v2:10.17.66.14:3300/0
-613> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-612> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-611> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient(hunting): _renew_subs
-610> 2023-06-21T15:21:39.808+0200 7f167fa02840 10 monclient(hunting): authenticate will time out at 2023-06-21T15:26:39.813452+0200
-609> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): get_auth_request con 0x557e6617d6e0 auth_method 0
-608> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-607> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): _init_auth method 2
-606> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): _init_auth creating new auth
-605> 2023-06-21T15:21:39.812+0200 7f167de21700 10 monclient(hunting): get_auth_request con 0x557e6617ffc0 auth_method 0
-604> 2023-06-21T15:21:39.812+0200 7f167de21700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-603> 2023-06-21T15:21:39.812+0200 7f167de21700 10 monclient(hunting): _init_auth method 2
-602> 2023-06-21T15:21:39.812+0200 7f167de21700 10 monclient(hunting): _init_auth creating new auth
-601> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload 9
-600> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-599> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-598> 2023-06-21T15:21:39.812+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload 9
-597> 2023-06-21T15:21:39.812+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-596> 2023-06-21T15:21:39.812+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-595> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient(hunting): _init_auth method 2
-594> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient(hunting): _init_auth creating new auth
-593> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient(hunting): my global_id is 750293476
-592> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient(hunting): handle_auth_done global_id 707581627 payload 290
-591> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient: _finish_hunting 0
-590> 2023-06-21T15:21:39.812+0200 7f167ce1f700 1 monclient: found mon.noname-d
-589> 2023-06-21T15:21:39.812+0200 7f167ce1f700 10 monclient: _send_mon_message to mon.noname-d at v2:10.17.66.23:3300/0
-588> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: handle_monmap mon_map magic: 0 v1
-587> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: got monmap 4 from mon.noname-d (according to old e4)
-586> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-585> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: _finish_auth 0
-584> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 monclient: authenticate success, global_id 707581627
-583> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: handle_config config(0 keys) v1
-582> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: handle_monmap mon_map magic: 0 v1
-581> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: got monmap 4 from mon.pve-main-btw-3 (according to old e4)
-580> 2023-06-21T15:21:39.812+0200 7f166ffff700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-579> 2023-06-21T15:21:39.812+0200 7f167fa02840 10 monclient: get_monmap_and_config success
-578> 2023-06-21T15:21:39.812+0200 7f167fa02840 4 set_mon_vals no callback set
-577> 2023-06-21T15:21:39.812+0200 7f167fa02840 10 monclient: shutdown
-576> 2023-06-21T15:21:39.812+0200 7f167fa02840 0 deferred set uid:gid to 64045:64045 (ceph:ceph)
-575> 2023-06-21T15:21:39.812+0200 7f167fa02840 0 ceph version 16.2.9 (a569859f5e07da0c4c39da81d5fb5675cd95da49) pacific (stable), process radosgw, pid 3301239
-574> 2023-06-21T15:21:39.812+0200 7f167fa02840 0 framework: beast
-573> 2023-06-21T15:21:39.812+0200 7f167fa02840 0 framework conf key: ssl_port, val: 443
-572> 2023-06-21T15:21:39.812+0200 7f167fa02840 0 framework conf key: ssl_certificate, val: /etc/ceph/s3.idcheck-prod-1.axt.pem
-571> 2023-06-21T15:21:39.812+0200 7f167fa02840 0 framework conf key: ssl_private_key, val: /etc/ceph/s3.idcheck-prod-1.axt.key
-570> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 asok(0x557e66065100) init /var/run/ceph/ceph-client.idcheck-prod-1.s3-2.3301239.94001365944008.asok
-569> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 asok(0x557e66065100) bind_and_listen /var/run/ceph/ceph-client.idcheck-prod-1.s3-2.3301239.94001365944008.asok
-568> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 asok(0x557e66065100) register_command 0 hook 0x557e66179fd0
-567> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 asok(0x557e66065100) register_command version hook 0x557e66179fd0
-566> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 asok(0x557e66065100) register_command git_version hook 0x557e66179fd0
-565> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 asok(0x557e66065100) register_command help hook 0x557e660c77f0
-564> 2023-06-21T15:21:39.812+0200 7f167fa02840 5 asok(0x557e66065100) register_command get_command_descriptions hook 0x557e661793b0
-563> 2023-06-21T15:21:39.812+0200 7f166f7fe700 5 asok(0x557e66065100) entry start
-562> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient: get_monmap_and_config
-561> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient: build_initial_monmap
-560> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient: monmap:
epoch 0
fsid 00000000-0000-0000-0000-000000000000
last_changed 0.000000
created 0.000000
min_mon_release 0 (unknown)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.noname-b
1: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.noname-c
2: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.noname-d
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.noname-a

-559> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding auth protocol: cephx
-558> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding auth protocol: cephx
-557> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding auth protocol: cephx
-556> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-555> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-554> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-553> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-552> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-551> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-550> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-549> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-548> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-547> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-546> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-545> 2023-06-21T15:21:39.816+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-544> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient: init
-543> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding auth protocol: cephx
-542> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding auth protocol: cephx
-541> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding auth protocol: cephx
-540> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: secure
-539> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: crc
-538> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: secure
-537> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: crc
-536> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: secure
-535> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: crc
-534> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: secure
-533> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: crc
-532> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: secure
-531> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: crc
-530> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 AuthRegistry(0x7ffed3540db0) adding con mode: secure
-529> 2023-06-21T15:21:39.816+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-528> 2023-06-21T15:21:39.816+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-527> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient: _reopen_session rank -1
-526> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient: _add_conns ranks=[3,2,1,0]
-525> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-a con 0x557e66178fd0 addr [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0]
-524> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-d con 0x557e6617ffc0 addr [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0]
-523> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-c con 0x557e661e93c0 addr [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0]
-522> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-521> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-520> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-519> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): _renew_subs
-518> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient(hunting): authenticate will time out at 2023-06-21T15:26:39.820160+0200
-517> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): get_auth_request con 0x557e66178fd0 auth_method 0
-516> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-515> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): _init_auth method 2
-514> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): _init_auth creating new auth
-513> 2023-06-21T15:21:39.816+0200 7f167ce1f700 10 monclient(hunting): get_auth_request con 0x557e6617ffc0 auth_method 0
-512> 2023-06-21T15:21:39.816+0200 7f167ce1f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-511> 2023-06-21T15:21:39.816+0200 7f167ce1f700 10 monclient(hunting): _init_auth method 2
-510> 2023-06-21T15:21:39.816+0200 7f167ce1f700 10 monclient(hunting): _init_auth creating new auth
-509> 2023-06-21T15:21:39.816+0200 7f167de21700 10 monclient(hunting): get_auth_request con 0x557e661e93c0 auth_method 0
-508> 2023-06-21T15:21:39.816+0200 7f167de21700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-507> 2023-06-21T15:21:39.816+0200 7f167de21700 10 monclient(hunting): _init_auth method 2
-506> 2023-06-21T15:21:39.816+0200 7f167de21700 10 monclient(hunting): _init_auth creating new auth
-505> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more payload 9
-504> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-503> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-502> 2023-06-21T15:21:39.816+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload 9
-501> 2023-06-21T15:21:39.816+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-500> 2023-06-21T15:21:39.816+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-499> 2023-06-21T15:21:39.816+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload 9
-498> 2023-06-21T15:21:39.816+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-497> 2023-06-21T15:21:39.816+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-496> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient(hunting): handle_auth_done global_id 707581631 payload 290
-495> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient: _finish_hunting 0
-494> 2023-06-21T15:21:39.816+0200 7f167d620700 1 monclient: found mon.noname-a
-493> 2023-06-21T15:21:39.816+0200 7f167d620700 10 monclient: _send_mon_message to mon.noname-a at v2:10.17.66.23:3300/0
-492> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-491> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: got monmap 4 from mon.noname-a (according to old e4)
-490> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-489> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: _finish_auth 0
-488> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: handle_config config(0 keys) v1
-487> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: handle_monmap mon_map magic: 0 v1
-486> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: got monmap 4 from mon.pve-main-btw-3 (according to old e4)
-485> 2023-06-21T15:21:39.816+0200 7f16677fe700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-484> 2023-06-21T15:21:39.816+0200 7f167fa02840 5 monclient: authenticate success, global_id 707581631
-483> 2023-06-21T15:21:39.816+0200 7f167fa02840 10 monclient: get_monmap_and_config success
-482> 2023-06-21T15:21:39.816+0200 7f167fa02840 4 set_mon_vals no callback set
-481> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: shutdown
-480> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: build_initial_monmap
-479> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: monmap:
epoch 0
fsid 00000000-0000-0000-0000-000000000000
last_changed 0.000000
created 0.000000
min_mon_release 0 (unknown)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.noname-b
1: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.noname-c
2: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.noname-d
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.noname-a

-478> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding auth protocol: cephx
-477> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding auth protocol: cephx
-476> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding auth protocol: cephx
-475> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-474> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-473> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-472> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-471> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-470> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-469> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-468> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-467> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-466> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: crc
-465> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661de780) adding con mode: secure
-464> 2023-06-21T15:21:39.820+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-463> 2023-06-21T15:21:39.820+0200 7f167fa02840 1 librados: starting msgr at
-462> 2023-06-21T15:21:39.820+0200 7f167fa02840 1 librados: starting objecter
-461> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 asok(0x557e66065100) register_command objecter_requests hook 0x557e661e6bd0
-460> 2023-06-21T15:21:39.820+0200 7f167fa02840 1 librados: setting wanted keys
-459> 2023-06-21T15:21:39.820+0200 7f167fa02840 1 librados: calling monclient init
-458> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: init
-457> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding auth protocol: cephx
-456> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding auth protocol: cephx
-455> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding auth protocol: cephx
-454> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: secure
-453> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: crc
-452> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: secure
-451> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: crc
-450> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: secure
-449> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: crc
-448> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: secure
-447> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: crc
-446> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: secure
-445> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: crc
-444> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 AuthRegistry(0x557e661dd348) adding con mode: secure
-443> 2023-06-21T15:21:39.820+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-442> 2023-06-21T15:21:39.820+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-441> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: _reopen_session rank -1
-440> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: _add_conns ranks=[3,0,2,1]
-439> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-a con 0x557e66178fd0 addr [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0]
-438> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-b con 0x557e6617ffc0 addr [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0]
-437> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-d con 0x557e661e93c0 addr [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0]
-436> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-435> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-434> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-433> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): _renew_subs
-432> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient(hunting): authenticate will time out at 2023-06-21T15:26:39.823236+0200
-431> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): get_auth_request con 0x557e66178fd0 auth_method 0
-430> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-429> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): _init_auth method 2
-428> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): _init_auth creating new auth
-427> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more payload 9
-426> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-425> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-424> 2023-06-21T15:21:39.820+0200 7f167ce1f700 10 monclient(hunting): get_auth_request con 0x557e6617ffc0 auth_method 0
-423> 2023-06-21T15:21:39.820+0200 7f167ce1f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-422> 2023-06-21T15:21:39.820+0200 7f167ce1f700 10 monclient(hunting): _init_auth method 2
-421> 2023-06-21T15:21:39.820+0200 7f167ce1f700 10 monclient(hunting): _init_auth creating new auth
-420> 2023-06-21T15:21:39.820+0200 7f167de21700 10 monclient(hunting): get_auth_request con 0x557e661e93c0 auth_method 0
-419> 2023-06-21T15:21:39.820+0200 7f167de21700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-418> 2023-06-21T15:21:39.820+0200 7f167de21700 10 monclient(hunting): _init_auth method 2
-417> 2023-06-21T15:21:39.820+0200 7f167de21700 10 monclient(hunting): _init_auth creating new auth
-416> 2023-06-21T15:21:39.820+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload 9
-415> 2023-06-21T15:21:39.820+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-414> 2023-06-21T15:21:39.820+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-413> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient(hunting): handle_auth_done global_id 707581635 payload 1256
-412> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient: _finish_hunting 0
-411> 2023-06-21T15:21:39.820+0200 7f167d620700 1 monclient: found mon.noname-a
-410> 2023-06-21T15:21:39.820+0200 7f167d620700 10 monclient: _send_mon_message to mon.noname-a at v2:10.17.66.23:3300/0
-409> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: handle_monmap mon_map magic: 0 v1
-408> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: got monmap 4 from mon.noname-a (according to old e4)
-407> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-406> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: _finish_auth 0
-405> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: handle_config config(0 keys) v1
-404> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: handle_monmap mon_map magic: 0 v1
-403> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: got monmap 4 from mon.pve-main-btw-3 (according to old e4)
-402> 2023-06-21T15:21:39.820+0200 7f1665ffb700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-401> 2023-06-21T15:21:39.820+0200 7f167fa02840 5 monclient: authenticate success, global_id 707581635
-400> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: _renew_subs
-399> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: _send_mon_message to mon.pve-main-btw-3 at v2:10.17.66.23:3300/0
-398> 2023-06-21T15:21:39.820+0200 7f16677fe700 4 set_mon_vals no callback set
-397> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: _renew_subs
-396> 2023-06-21T15:21:39.820+0200 7f167fa02840 10 monclient: _send_mon_message to mon.pve-main-btw-3 at v2:10.17.66.23:3300/0
-395> 2023-06-21T15:21:39.820+0200 7f167fa02840 1 librados: init done
-394> 2023-06-21T15:21:39.828+0200 7f1665ffb700 4 mgrc handle_mgr_map Got map version 111
-393> 2023-06-21T15:21:39.828+0200 7f1665ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:10.17.66.11:6810/2110232,v1:10.17.66.11:6811/2110232]
-392> 2023-06-21T15:21:39.828+0200 7f1665ffb700 4 mgrc reconnect Starting new session with [v2:10.17.66.11:6810/2110232,v1:10.17.66.11:6811/2110232]
-391> 2023-06-21T15:21:39.828+0200 7f167ce1f700 10 monclient: get_auth_request con 0x7f165c098890 auth_method 0
-390> 2023-06-21T15:21:39.828+0200 7f167de21700 10 monclient: get_auth_request con 0x557e661f9900 auth_method 0
-389> 2023-06-21T15:21:39.828+0200 7f167d620700 10 monclient: get_auth_request con 0x557e661fcff0 auth_method 0
-388> 2023-06-21T15:21:39.832+0200 7f167ce1f700 10 monclient: get_auth_request con 0x557e66200ae0 auth_method 0
-387> 2023-06-21T15:21:39.832+0200 7f167de21700 10 monclient: get_auth_request con 0x557e662041c0 auth_method 0
-386> 2023-06-21T15:21:39.832+0200 7f167d620700 10 monclient: get_auth_request con 0x557e662087d0 auth_method 0
-385> 2023-06-21T15:21:39.836+0200 7f167ce1f700 10 monclient: get_auth_request con 0x557e6620cae0 auth_method 0
-384> 2023-06-21T15:21:39.836+0200 7f167de21700 10 monclient: get_auth_request con 0x557e66210f10 auth_method 0
-383> 2023-06-21T15:21:39.848+0200 7f167d620700 10 monclient: get_auth_request con 0x7f1670028040 auth_method 0
-382> 2023-06-21T15:21:39.848+0200 7f167ce1f700 10 monclient: get_auth_request con 0x7f1678099f90 auth_method 0
-381> 2023-06-21T15:21:39.852+0200 7f167de21700 10 monclient: get_auth_request con 0x7f1678099690 auth_method 0
-380> 2023-06-21T15:21:39.856+0200 7f167d620700 10 monclient: get_auth_request con 0x7f1670018410 auth_method 0
-379> 2023-06-21T15:21:39.856+0200 7f167ce1f700 10 monclient: get_auth_request con 0x7f1678014930 auth_method 0
-378> 2023-06-21T15:21:39.860+0200 7f167de21700 10 monclient: get_auth_request con 0x7f167403f040 auth_method 0
-377> 2023-06-21T15:21:39.864+0200 7f167d620700 10 monclient: get_auth_request con 0x7f1670027a90 auth_method 0
-376> 2023-06-21T15:21:39.864+0200 7f167ce1f700 10 monclient: get_auth_request con 0x557e6617d6e0 auth_method 0
-375> 2023-06-21T15:21:39.868+0200 7f167de21700 10 monclient: get_auth_request con 0x7f167801f8e0 auth_method 0
-374> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding auth protocol: cephx
-373> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding auth protocol: cephx
-372> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding auth protocol: cephx
-371> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: secure
-370> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: crc
-369> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: secure
-368> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: crc
-367> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: secure
-366> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: crc
-365> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: secure
-364> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: crc
-363> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: secure
-362> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: crc
-361> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed35416d0) adding con mode: secure
-360> 2023-06-21T15:21:39.908+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-359> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 asok(0x557e66065100) register_command cache list hook 0x557e661d0f20
-358> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 asok(0x557e66065100) register_command cache inspect hook 0x557e661d0f20
-357> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 asok(0x557e66065100) register_command cache erase hook 0x557e661d0f20
-356> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 asok(0x557e66065100) register_command cache zap hook 0x557e661d0f20
-355> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient: get_monmap_and_config
-354> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient: build_initial_monmap
-353> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient: monmap:
epoch 0
fsid 00000000-0000-0000-0000-000000000000
last_changed 0.000000
created 0.000000
min_mon_release 0 (unknown)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.noname-b
1: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.noname-c
2: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.noname-d
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.noname-a

-352> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding auth protocol: cephx
-351> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding auth protocol: cephx
-350> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding auth protocol: cephx
-349> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-348> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-347> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-346> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-345> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-344> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-343> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-342> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-341> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-340> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-339> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-338> 2023-06-21T15:21:39.908+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-337> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient: init
-336> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding auth protocol: cephx
-335> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding auth protocol: cephx
-334> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding auth protocol: cephx
-333> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: secure
-332> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: crc
-331> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: secure
-330> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: crc
-329> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: secure
-328> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: crc
-327> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: secure
-326> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: crc
-325> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: secure
-324> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: crc
-323> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541240) adding con mode: secure
-322> 2023-06-21T15:21:39.908+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-321> 2023-06-21T15:21:39.908+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-320> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient: _reopen_session rank -1
-319> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient: _add_conns ranks=[0,3,2,1]
-318> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-b con 0x557e66239530 addr [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0]
-317> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-a con 0x557e66239ed0 addr [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0]
-316> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-d con 0x557e6623f2b0 addr [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0]
-315> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-314> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-313> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-312> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): _renew_subs
-311> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient(hunting): authenticate will time out at 2023-06-21T15:26:39.911418+0200
-310> 2023-06-21T15:21:39.908+0200 7f167ce1f700 10 monclient(hunting): get_auth_request con 0x557e66239530 auth_method 0
-309> 2023-06-21T15:21:39.908+0200 7f167ce1f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-308> 2023-06-21T15:21:39.908+0200 7f167ce1f700 10 monclient(hunting): _init_auth method 2
-307> 2023-06-21T15:21:39.908+0200 7f167ce1f700 10 monclient(hunting): _init_auth creating new auth
-306> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): get_auth_request con 0x557e66239ed0 auth_method 0
-305> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-304> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): _init_auth method 2
-303> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): _init_auth creating new auth
-302> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload 9
-301> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-300> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-299> 2023-06-21T15:21:39.908+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload 9
-298> 2023-06-21T15:21:39.908+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-297> 2023-06-21T15:21:39.908+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-296> 2023-06-21T15:21:39.908+0200 7f167d620700 10 monclient(hunting): get_auth_request con 0x557e6623f2b0 auth_method 0
-295> 2023-06-21T15:21:39.908+0200 7f167d620700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-294> 2023-06-21T15:21:39.908+0200 7f167d620700 10 monclient(hunting): _init_auth method 2
-293> 2023-06-21T15:21:39.908+0200 7f167d620700 10 monclient(hunting): _init_auth creating new auth
-292> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient(hunting): handle_auth_done global_id 707581639 payload 290
-291> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient: _finish_hunting 0
-290> 2023-06-21T15:21:39.908+0200 7f167de21700 1 monclient: found mon.noname-a
-289> 2023-06-21T15:21:39.908+0200 7f167de21700 10 monclient: _send_mon_message to mon.noname-a at v2:10.17.66.23:3300/0
-288> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: handle_monmap mon_map magic: 0 v1
-287> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: got monmap 4 from mon.noname-a (according to old e4)
-286> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-285> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: _finish_auth 0
-284> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: handle_config config(0 keys) v1
-283> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: handle_monmap mon_map magic: 0 v1
-282> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: got monmap 4 from mon.pve-main-btw-3 (according to old e4)
-281> 2023-06-21T15:21:39.908+0200 7f16467e4700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-280> 2023-06-21T15:21:39.908+0200 7f167fa02840 5 monclient: authenticate success, global_id 707581639
-279> 2023-06-21T15:21:39.908+0200 7f167fa02840 10 monclient: get_monmap_and_config success
-278> 2023-06-21T15:21:39.908+0200 7f167fa02840 4 set_mon_vals no callback set
-277> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: shutdown
-276> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: build_initial_monmap
-275> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: monmap:
epoch 0
fsid 00000000-0000-0000-0000-000000000000
last_changed 0.000000
created 0.000000
min_mon_release 0 (unknown)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.noname-b
1: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.noname-c
2: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.noname-d
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.noname-a

-274> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding auth protocol: cephx
-273> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding auth protocol: cephx
-272> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding auth protocol: cephx
-271> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-270> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-269> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-268> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-267> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-266> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-265> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-264> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-263> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-262> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: crc
-261> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e662336f0) adding con mode: secure
-260> 2023-06-21T15:21:39.912+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-259> 2023-06-21T15:21:39.912+0200 7f167fa02840 1 librados: starting msgr at
-258> 2023-06-21T15:21:39.912+0200 7f167fa02840 1 librados: starting objecter
-257> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 asok(0x557e66065100) register_command objecter_requests cmddesc objecter_requests hook 0x557e66241c10 EEXIST
-256> 2023-06-21T15:21:39.912+0200 7f167fa02840 1 librados: setting wanted keys
-255> 2023-06-21T15:21:39.912+0200 7f167fa02840 1 librados: calling monclient init
-254> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: init
-253> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding auth protocol: cephx
-252> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding auth protocol: cephx
-251> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding auth protocol: cephx
-250> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: secure
-249> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: crc
-248> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: secure
-247> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: crc
-246> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: secure
-245> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: crc
-244> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: secure
-243> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: crc
-242> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: secure
-241> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: crc
-240> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 AuthRegistry(0x557e66230ab8) adding con mode: secure
-239> 2023-06-21T15:21:39.912+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-238> 2023-06-21T15:21:39.912+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-237> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: _reopen_session rank -1
-236> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: _add_conns ranks=[1,0,3,2]
-235> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-c con 0x557e66239530 addr [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0]
-234> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-b con 0x557e66239ed0 addr [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0]
-233> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-a con 0x557e6623f2b0 addr [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0]
-232> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-231> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-230> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-229> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): _renew_subs
-228> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient(hunting): authenticate will time out at 2023-06-21T15:26:39.915156+0200
-227> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): get_auth_request con 0x557e66239530 auth_method 0
-226> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-225> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): _init_auth method 2
-224> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): _init_auth creating new auth
-223> 2023-06-21T15:21:39.912+0200 7f167de21700 10 monclient(hunting): get_auth_request con 0x557e66239ed0 auth_method 0
-222> 2023-06-21T15:21:39.912+0200 7f167de21700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-221> 2023-06-21T15:21:39.912+0200 7f167de21700 10 monclient(hunting): _init_auth method 2
-220> 2023-06-21T15:21:39.912+0200 7f167de21700 10 monclient(hunting): _init_auth creating new auth
-219> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload 9
-218> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-217> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-216> 2023-06-21T15:21:39.912+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload 9
-215> 2023-06-21T15:21:39.912+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-214> 2023-06-21T15:21:39.912+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-213> 2023-06-21T15:21:39.912+0200 7f167d620700 10 monclient(hunting): get_auth_request con 0x557e6623f2b0 auth_method 0
-212> 2023-06-21T15:21:39.912+0200 7f167d620700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-211> 2023-06-21T15:21:39.912+0200 7f167d620700 10 monclient(hunting): _init_auth method 2
-210> 2023-06-21T15:21:39.912+0200 7f167d620700 10 monclient(hunting): _init_auth creating new auth
-209> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient(hunting): handle_auth_done global_id 751165974 payload 1256
-208> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient: _finish_hunting 0
-207> 2023-06-21T15:21:39.912+0200 7f167ce1f700 1 monclient: found mon.noname-c
-206> 2023-06-21T15:21:39.912+0200 7f167ce1f700 10 monclient: _send_mon_message to mon.noname-c at v2:10.17.66.13:3300/0
-205> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: handle_monmap mon_map magic: 0 v1
-204> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: got monmap 4 from mon.noname-c (according to old e4)
-203> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-202> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: _finish_auth 0
-201> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: handle_config config(0 keys) v1
-200> 2023-06-21T15:21:39.912+0200 7f16467e4700 4 set_mon_vals no callback set
-199> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: handle_monmap mon_map magic: 0 v1
-198> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: got monmap 4 from mon.pve-main-ia-3 (according to old e4)
-197> 2023-06-21T15:21:39.912+0200 7f1644fe1700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-196> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 monclient: authenticate success, global_id 751165974
-195> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: _renew_subs
-194> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: _send_mon_message to mon.pve-main-ia-3 at v2:10.17.66.13:3300/0
-193> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: _renew_subs
-192> 2023-06-21T15:21:39.912+0200 7f167fa02840 10 monclient: _send_mon_message to mon.pve-main-ia-3 at v2:10.17.66.13:3300/0
-191> 2023-06-21T15:21:39.912+0200 7f167fa02840 1 librados: init done
-190> 2023-06-21T15:21:39.912+0200 7f167fa02840 5 asok(0x557e66065100) register_command cr dump hook 0x557e66249548
-189> 2023-06-21T15:21:39.916+0200 7f1644fe1700 4 mgrc handle_mgr_map Got map version 111
-188> 2023-06-21T15:21:39.916+0200 7f1644fe1700 4 mgrc handle_mgr_map Active mgr is now [v2:10.17.66.11:6810/2110232,v1:10.17.66.11:6811/2110232]
-187> 2023-06-21T15:21:39.916+0200 7f1644fe1700 4 mgrc reconnect Starting new session with [v2:10.17.66.11:6810/2110232,v1:10.17.66.11:6811/2110232]
-186> 2023-06-21T15:21:39.916+0200 7f167de21700 10 monclient: get_auth_request con 0x7f160c0969f0 auth_method 0
-185> 2023-06-21T15:21:39.920+0200 7f167d620700 10 monclient: get_auth_request con 0x557e66250d30 auth_method 0
-184> 2023-06-21T15:21:39.920+0200 7f167ce1f700 10 monclient: get_auth_request con 0x557e66254320 auth_method 0
-183> 2023-06-21T15:21:39.924+0200 7f167de21700 10 monclient: get_auth_request con 0x557e66257bf0 auth_method 0
-182> 2023-06-21T15:21:39.924+0200 7f167d620700 10 monclient: get_auth_request con 0x557e6625b540 auth_method 0
-181> 2023-06-21T15:21:39.928+0200 7f167ce1f700 10 monclient: get_auth_request con 0x557e6625fa80 auth_method 0
-180> 2023-06-21T15:21:39.932+0200 7f167de21700 10 monclient: get_auth_request con 0x557e66263160 auth_method 0
-179> 2023-06-21T15:21:39.932+0200 7f167d620700 10 monclient: get_auth_request con 0x557e662668d0 auth_method 0
-178> 2023-06-21T15:21:39.940+0200 7f167ce1f700 10 monclient: get_auth_request con 0x557e6626a610 auth_method 0
-177> 2023-06-21T15:21:39.960+0200 7f167fa02840 5 asok(0x557e66065100) register_command sync trace show hook 0x7f1670026960
-176> 2023-06-21T15:21:39.960+0200 7f167fa02840 5 asok(0x557e66065100) register_command sync trace history hook 0x7f1670026960
-175> 2023-06-21T15:21:39.960+0200 7f167fa02840 5 asok(0x557e66065100) register_command sync trace active hook 0x7f1670026960
-174> 2023-06-21T15:21:39.960+0200 7f167fa02840 5 asok(0x557e66065100) register_command sync trace active_short hook 0x7f1670026960
-173> 2023-06-21T15:21:39.972+0200 7f167fa02840 0 framework: beast
-172> 2023-06-21T15:21:39.972+0200 7f167fa02840 0 framework conf key: ssl_certificate, val: config://rgw/cert/$realm/$zone.crt
-171> 2023-06-21T15:21:39.972+0200 7f167fa02840 0 framework conf key: ssl_private_key, val: config://rgw/cert/$realm/$zone.key
-170> 2023-06-21T15:21:39.972+0200 7f167fa02840 0 starting handler: beast
-169> 2023-06-21T15:21:39.972+0200 7f167fa02840 0 set uid:gid to 64045:64045 (ceph:ceph)
-168> 2023-06-21T15:21:40.000+0200 7f167fa02840 1 mgrc service_daemon_register rgw.751165974 metadata {arch=x86_64,ceph_release=pacific,ceph_version=ceph version 16.2.9 (a569859f5e07da0c4c39da81d5fb5675cd95da49) pacific (stable),ceph_version_short=16.2.9,cpu=Common KVM processor,distro=debian,distro_description=Debian GNU/Linux 11 (bullseye),distro_version=11,frontend_config#0=beast ssl_port=443 ssl_certificate=/etc/ceph/s3.idcheck-prod-1.axt.pem ssl_private_key=/etc/ceph/s3.idcheck-prod-1.axt.key,frontend_type#0=beast,hostname=s3-2,id=idcheck-prod-1.s3-2,kernel_description=#1 SMP Debian 5.10.92-1 (2022-01-18),kernel_version=5.10.0-11-amd64,mem_swap_kb=884732,mem_total_kb=2024064,num_handles=1,os=Linux,pid=3301239,realm_id=70cf8e43-8bd5-40f8-825f-94ca663c8fde,realm_name=ariadnext-idcheck-prod,zone_id=e9012183-dea4-4264-9518-21472e5665a5,zone_name=idcheck-prod-1.s3,zonegroup_id=3c2965ff-d7d5-486a-be73-21420d91c898,zonegroup_name=idcheck-prod-1.s3}
-167> 2023-06-21T15:21:40.004+0200 7f1644fe1700 4 mgrc handle_mgr_configure stats_period=5
-166> 2023-06-21T15:21:40.004+0200 7f1644fe1700 4 mgrc handle_mgr_configure updated stats threshold: 5
-165> 2023-06-21T15:21:40.008+0200 7f167fa02840 10 monclient: get_monmap_and_config
-164> 2023-06-21T15:21:40.008+0200 7f167fa02840 10 monclient: build_initial_monmap
-163> 2023-06-21T15:21:40.008+0200 7f167fa02840 10 monclient: monmap:
epoch 0
fsid 00000000-0000-0000-0000-000000000000
last_changed 0.000000
created 0.000000
min_mon_release 0 (unknown)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.noname-b
1: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.noname-c
2: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.noname-d
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.noname-a

-162> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding auth protocol: cephx
-161> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding auth protocol: cephx
-160> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding auth protocol: cephx
-159> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-158> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-157> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-156> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-155> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-154> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-153> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-152> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-151> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-150> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-149> 2023-06-21T15:21:40.008+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-148> 2023-06-21T15:21:40.008+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-147> 2023-06-21T15:21:40.012+0200 7f167fa02840 10 monclient: init
-146> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding auth protocol: cephx
-145> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding auth protocol: cephx
-144> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding auth protocol: cephx
-143> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: secure
-142> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: crc
-141> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: secure
-140> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: crc
-139> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: secure
-138> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: crc
-137> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: secure
-136> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: crc
-135> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: secure
-134> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: crc
-133> 2023-06-21T15:21:40.012+0200 7f167fa02840 5 AuthRegistry(0x7ffed3541220) adding con mode: secure
-132> 2023-06-21T15:21:40.016+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-131> 2023-06-21T15:21:40.016+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-130> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient: _reopen_session rank -1
-129> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient: _add_conns ranks=[3,0,2,1]
-128> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-a con 0x557e66368060 addr [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0]
-127> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-b con 0x557e66368990 addr [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0]
-126> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-d con 0x557e6636d970 addr [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0]
-125> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-124> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-123> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-122> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): _renew_subs
-121> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient(hunting): authenticate will time out at 2023-06-21T15:26:40.018497+0200
-120> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): get_auth_request con 0x557e6636d970 auth_method 0
-119> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-118> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): _init_auth method 2
-117> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): _init_auth creating new auth
-116> 2023-06-21T15:21:40.016+0200 7f167d620700 10 monclient(hunting): get_auth_request con 0x557e66368060 auth_method 0
-115> 2023-06-21T15:21:40.016+0200 7f167d620700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-114> 2023-06-21T15:21:40.016+0200 7f167d620700 10 monclient(hunting): _init_auth method 2
-113> 2023-06-21T15:21:40.016+0200 7f167d620700 10 monclient(hunting): _init_auth creating new auth
-112> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload 9
-111> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-110> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-109> 2023-06-21T15:21:40.016+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more payload 9
-108> 2023-06-21T15:21:40.016+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-107> 2023-06-21T15:21:40.016+0200 7f167d620700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-106> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient(hunting): handle_auth_done global_id 733986541 payload 290
-105> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient: _finish_hunting 0
-104> 2023-06-21T15:21:40.016+0200 7f167de21700 1 monclient: found mon.noname-d
-103> 2023-06-21T15:21:40.016+0200 7f167de21700 10 monclient: _send_mon_message to mon.noname-d at v2:10.17.66.14:3300/0
-102> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: handle_monmap mon_map magic: 0 v1
-101> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: got monmap 4 from mon.noname-d (according to old e4)
-100> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-99> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: _finish_auth 0
-98> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: handle_config config(0 keys) v1
-97> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: handle_monmap mon_map magic: 0 v1
-96> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: got monmap 4 from mon.pve-main-ia-4 (according to old e4)
-95> 2023-06-21T15:21:40.016+0200 7f14cd5da700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-94> 2023-06-21T15:21:40.016+0200 7f167fa02840 5 monclient: authenticate success, global_id 733986541
-93> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient: get_monmap_and_config success
-92> 2023-06-21T15:21:40.016+0200 7f167fa02840 4 set_mon_vals no callback set
-91> 2023-06-21T15:21:40.016+0200 7f167fa02840 10 monclient: shutdown
-90> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: build_initial_monmap
-89> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: monmap:
epoch 0
fsid 00000000-0000-0000-0000-000000000000
last_changed 0.000000
created 0.000000
min_mon_release 0 (unknown)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.noname-b
1: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.noname-c
2: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.noname-d
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.noname-a

-88> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding auth protocol: cephx
-87> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding auth protocol: cephx
-86> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding auth protocol: cephx
-85> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-84> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-83> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-82> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-81> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-80> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-79> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-78> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-77> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-76> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: crc
-75> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e66361420) adding con mode: secure
-74> 2023-06-21T15:21:40.020+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-73> 2023-06-21T15:21:40.020+0200 7f167fa02840 1 librados: starting msgr at
-72> 2023-06-21T15:21:40.020+0200 7f167fa02840 1 librados: starting objecter
-71> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 asok(0x557e66065100) register_command objecter_requests cmddesc objecter_requests hook 0x557e66370230 EEXIST
-70> 2023-06-21T15:21:40.020+0200 7f167fa02840 1 librados: setting wanted keys
-69> 2023-06-21T15:21:40.020+0200 7f167fa02840 1 librados: calling monclient init
-68> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: init
-67> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding auth protocol: cephx
-66> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding auth protocol: cephx
-65> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding auth protocol: cephx
-64> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: secure
-63> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: crc
-62> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: secure
-61> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: crc
-60> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: secure
-59> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: crc
-58> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: secure
-57> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: crc
-56> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: secure
-55> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: crc
-54> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 AuthRegistry(0x557e6635e398) adding con mode: secure
-53> 2023-06-21T15:21:40.020+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-52> 2023-06-21T15:21:40.020+0200 7f167fa02840 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.radosgw.keyring
-51> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: _reopen_session rank -1
-50> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: _add_conns ranks=[2,1,3,0]
-49> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-d con 0x557e66368060 addr [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0]
-48> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-c con 0x557e66368990 addr [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0]
-47> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): picked mon.noname-a con 0x557e6636d970 addr [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0]
-46> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-45> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-44> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): start opening mon connection
-43> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): _renew_subs
-42> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient(hunting): authenticate will time out at 2023-06-21T15:26:40.022811+0200
-41> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): get_auth_request con 0x557e6636d970 auth_method 0
-40> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-39> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): _init_auth method 2
-38> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): _init_auth creating new auth
-37> 2023-06-21T15:21:40.020+0200 7f167ce1f700 10 monclient(hunting): get_auth_request con 0x557e66368990 auth_method 0
-36> 2023-06-21T15:21:40.020+0200 7f167ce1f700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2]
-35> 2023-06-21T15:21:40.020+0200 7f167ce1f700 10 monclient(hunting): _init_auth method 2
-34> 2023-06-21T15:21:40.020+0200 7f167ce1f700 10 monclient(hunting): _init_auth creating new auth
-33> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload 9
-32> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-31> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-30> 2023-06-21T15:21:40.020+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload 9
-29> 2023-06-21T15:21:40.020+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-28> 2023-06-21T15:21:40.020+0200 7f167ce1f700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-27> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient(hunting): handle_auth_done global_id 707581659 payload 1256
-26> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient: _finish_hunting 0
-25> 2023-06-21T15:21:40.020+0200 7f167de21700 1 monclient: found mon.noname-a
-24> 2023-06-21T15:21:40.020+0200 7f167de21700 10 monclient: _send_mon_message to mon.noname-a at v2:10.17.66.23:3300/0
-23> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: handle_monmap mon_map magic: 0 v1
-22> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: got monmap 4 from mon.noname-a (according to old e4)
-21> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-20> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: _finish_auth 0
-19> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: handle_config config(0 keys) v1
-18> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: handle_monmap mon_map magic: 0 v1
-17> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: got monmap 4 from mon.pve-main-btw-3 (according to old e4)
-16> 2023-06-21T15:21:40.020+0200 7f14cc5d8700 10 monclient: dump:
epoch 4
fsid 7bf002a6-47a8-434b-acf4-79fc8fb6fe82
last_changed 2022-03-06T15:31:48.919246+0100
created 2022-02-18T10:42:36.245884+0100
min_mon_release 16 (pacific)
election_strategy: 1
0: [v2:10.17.66.11:3300/0,v1:10.17.66.11:6789/0] mon.pve-main-ia-1
1: [v2:10.17.66.14:3300/0,v1:10.17.66.14:6789/0] mon.pve-main-ia-4
2: [v2:10.17.66.13:3300/0,v1:10.17.66.13:6789/0] mon.pve-main-ia-3
3: [v2:10.17.66.23:3300/0,v1:10.17.66.23:6789/0] mon.pve-main-btw-3

-15> 2023-06-21T15:21:40.020+0200 7f14cd5da700 4 set_mon_vals no callback set
-14> 2023-06-21T15:21:40.020+0200 7f167fa02840 5 monclient: authenticate success, global_id 707581659
-13> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: _renew_subs
-12> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: _send_mon_message to mon.pve-main-btw-3 at v2:10.17.66.23:3300/0
-11> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: _renew_subs
-10> 2023-06-21T15:21:40.020+0200 7f167fa02840 10 monclient: _send_mon_message to mon.pve-main-btw-3 at v2:10.17.66.23:3300/0
-9> 2023-06-21T15:21:40.020+0200 7f167fa02840 1 librados: init done
-8> 2023-06-21T15:21:40.028+0200 7f14cc5d8700 4 mgrc handle_mgr_map Got map version 111
-7> 2023-06-21T15:21:40.028+0200 7f14cc5d8700 4 mgrc handle_mgr_map Active mgr is now [v2:10.17.66.11:6810/2110232,v1:10.17.66.11:6811/2110232]
-6> 2023-06-21T15:21:40.028+0200 7f14cc5d8700 4 mgrc reconnect Starting new session with [v2:10.17.66.11:6810/2110232,v1:10.17.66.11:6811/2110232]
-5> 2023-06-21T15:21:40.028+0200 7f167d620700 10 monclient: get_auth_request con 0x7f15fc0a20d0 auth_method 0
-4> 2023-06-21T15:21:40.028+0200 7f167ce1f700 10 monclient: get_auth_request con 0x557e66374330 auth_method 0
-3> 2023-06-21T15:21:42.820+0200 7f1664ff9700 10 monclient: tick
-2> 2023-06-21T15:21:42.912+0200 7f15e77fe700 10 monclient: tick
-1> 2023-06-21T15:21:43.020+0200 7f14cb5d6700 10 monclient: tick
0> 2023-06-21T15:21:43.712+0200 7f157df3b700 -1 *** Caught signal (Aborted) **
in thread 7f157df3b700 thread_name:radosgw

ceph version 16.2.9 (a569859f5e07da0c4c39da81d5fb5675cd95da49) pacific (stable)
1: /lib/x86_64-linux-gnu/libc.so.6(+0x3bd60) [0x7f168bc06d60]
2: gsignal()
3: abort()
4: /lib/x86_64-linux-gnu/libstdc++.so.6(+0x9a7ec) [0x7f168223b7ec]
5: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xa5966) [0x7f1682246966]
6: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xa59d1) [0x7f16822469d1]
7: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xa595b) [0x7f168224695b]
8: (spawn::detail::continuation_context::resume()+0x87) [0x7f168c1b3917]
9: (boost::asio::detail::executor_op<ceph::async::ForwardingHandler<ceph::async::CompletionHandler<spawn::detail::coro_handler<boost::asio::executor_binder<void (*)(), boost::asio::strand<boost::asio::io_context::executor_type> >, std::shared_lock<ceph::async::SharedMutex<boost::asio::io_context::executor_type> > >, std::tuple<boost::system::error_code, std::shared_lock<ceph::async::SharedMutex<boost::asio::io_context::executor_type> > > > >, std::allocator<void>, boost::asio::detail::scheduler_operation>::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x2ba) [0x7f168c1c0e6a]
10: (boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::executor_type const>::operator()()+0x85) [0x7f168c1c3005]
11: (boost::asio::detail::executor_op<boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::executor_type const>, boost::asio::detail::recycling_allocator<void, boost::asio::detail::thread_info_base::default_tag>, boost::asio::detail::scheduler_operation>::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long)+0x80) [0x7f168c1c3340]
12: (boost::asio::detail::scheduler::do_run_one(boost::asio::detail::conditionally_enabled_mutex::scoped_lock&, boost::asio::detail::scheduler_thread_info&, boost::system::error_code const&)+0x403) [0x7f168c1b28d3]
13: /lib/libradosgw.so.2(+0x408ba9) [0x7f168c198ba9]
14: /lib/libradosgw.so.2(+0x408d52) [0x7f168c198d52]
15: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xceed0) [0x7f168226fed0]
16: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8ea7) [0x7f1682376ea7]
17: clone()
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 rbd_pwl
0/ 5 journaler
0/ 5 objectcacher
0/ 5 immutable_obj_cache
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
0/ 0 rgw
4/ 4 rgw_sync
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 fuse
2/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
1/ 5 prioritycache
0/ 5 test
0/ 5 cephfs_mirror
0/ 5 cephsqlite
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
--- pthread ID / name mapping for recent threads ---
139727287969536 / safe_timer
139727304754944 / ms_dispatch
139727321540352 / io_context_pool
139730284164864 / radosgw
139732054959872 / safe_timer
139733623510784 / ms_dispatch
139733648688896 / io_context_pool
139734160480000 / safe_timer
139734177265408 / ms_dispatch
139734202443520 / io_context_pool
139734336661248 / admin_socket
139734345053952 / service
139734561191680 / msgr-worker-2
139734569584384 / msgr-worker-1
139734577977088 / msgr-worker-0
139734607210560 / radosgw
max_recent 10000
max_new 10000
log_file /var/log/ceph/client.radosgw.s3-2.idcheck-prod-1.axt.log
--- end dump of recent events ---
(1-1/2)