Project

General

Profile

Bug #51866 » ceph-mds-newbrunswick2.container.log

Container logs from MDS that was active before the outage - David Piper, 07/27/2021 09:48 AM

 
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27 08:14:25 /opt/ceph-container/bin/entrypoint.sh: static: does not generate config
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27 08:14:25 /opt/ceph-container/bin/entrypoint.sh: SUCCESS
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:25.299+0000 7f48759c1600 0 set uid:gid to 167:167 (ceph:ceph)
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:25.299+0000 7f48759c1600 0 ceph version 15.2.13 (c44bc49e7a57a87d84dfff2a077a2058aa2172e2) octopus (stable), process ceph-mds, pid 49
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:25.300+0000 7f48759c1600 1 main not setting numa affinity
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:25.301+0000 7f48759c1600 0 pidfile_write: ignore empty --pid-file
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: starting mds.newbrunswick2 at
Jul 27 08:14:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:25.716+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 268 from mon.0
Jul 27 08:14:31 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:31.672+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 269 from mon.0
Jul 27 08:14:34 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:34.047+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 270 from mon.0
Jul 27 08:14:34 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:34.047+0000 7f4864b70700 1 mds.newbrunswick2 Monitors have assigned me to become a standby.
Jul 27 08:14:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:35.886+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 271 from mon.0
Jul 27 08:14:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:35.888+0000 7f4864b70700 1 mds.0.271 handle_mds_map i am now mds.0.271
Jul 27 08:14:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:35.888+0000 7f4864b70700 1 mds.0.271 handle_mds_map state change up:boot --> up:replay
Jul 27 08:14:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:35.888+0000 7f4864b70700 1 mds.0.271 replay_start
Jul 27 08:14:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:35.888+0000 7f4864b70700 1 mds.0.271 waiting for osdmap 87586 (which blacklists prior instance)
Jul 27 08:14:46 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:46.041+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 273 from mon.0
Jul 27 08:14:48 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:48.620+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 274 from mon.0
Jul 27 08:14:48 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:48.870+0000 7f485e363700 0 mds.0.cache creating system inode with ino:0x100
Jul 27 08:14:48 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:48.871+0000 7f485e363700 0 mds.0.cache creating system inode with ino:0x1
Jul 27 08:14:57 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:57.136+0000 7f485cb60700 1 mds.0.journal EResetJournal
Jul 27 08:14:57 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:57.136+0000 7f485cb60700 1 mds.0.sessionmap wipe start
Jul 27 08:14:57 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:57.136+0000 7f485cb60700 1 mds.0.sessionmap wipe result
Jul 27 08:14:57 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:57.136+0000 7f485cb60700 1 mds.0.sessionmap wipe done
Jul 27 08:14:57 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:57.138+0000 7f485cb60700 1 mds.0.271 Finished replaying journal
Jul 27 08:14:57 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:57.138+0000 7f485cb60700 1 mds.0.271 making mds journal writeable
Jul 27 08:14:58 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:58.714+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 275 from mon.0
Jul 27 08:14:58 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:58.714+0000 7f4864b70700 1 mds.0.271 handle_mds_map i am now mds.0.271
Jul 27 08:14:58 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:58.714+0000 7f4864b70700 1 mds.0.271 handle_mds_map state change up:replay --> up:reconnect
Jul 27 08:14:58 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:58.714+0000 7f4864b70700 1 mds.0.271 reconnect_start
Jul 27 08:14:58 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:58.714+0000 7f4864b70700 1 mds.0.271 reopen_log
Jul 27 08:14:58 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:14:58.715+0000 7f4864b70700 1 mds.0.271 reconnect_done
Jul 27 08:15:00 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:00.786+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 276 from mon.0
Jul 27 08:15:00 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:00.787+0000 7f4864b70700 1 mds.0.271 handle_mds_map i am now mds.0.271
Jul 27 08:15:00 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:00.787+0000 7f4864b70700 1 mds.0.271 handle_mds_map state change up:reconnect --> up:rejoin
Jul 27 08:15:00 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:00.787+0000 7f4864b70700 1 mds.0.271 rejoin_start
Jul 27 08:15:00 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:00.787+0000 7f4864b70700 1 mds.0.271 rejoin_joint_start
Jul 27 08:15:00 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:00.787+0000 7f4864b70700 1 mds.0.271 rejoin_done
Jul 27 08:15:02 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:02.993+0000 7f4864b70700 1 mds.newbrunswick2 Updating MDS map to version 277 from mon.0
Jul 27 08:15:02 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:02.993+0000 7f4864b70700 1 mds.0.271 handle_mds_map i am now mds.0.271
Jul 27 08:15:02 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:02.993+0000 7f4864b70700 1 mds.0.271 handle_mds_map state change up:rejoin --> up:active
Jul 27 08:15:02 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:02.993+0000 7f4864b70700 1 mds.0.271 recovery_done -- successful recovery!
Jul 27 08:15:02 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:02.993+0000 7f4864b70700 1 mds.0.271 active_start
Jul 27 08:15:02 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:15:02.993+0000 7f4864b70700 1 mds.0.271 cluster recovered.
Jul 27 08:43:30 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27 08:43:30 /opt/ceph-container/bin/entrypoint.sh: static: does not generate config
Jul 27 08:43:30 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27 08:43:30 /opt/ceph-container/bin/entrypoint.sh: SUCCESS
Jul 27 08:43:52 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:43:52.696+0000 7ff60818c600 0 set uid:gid to 167:167 (ceph:ceph)
Jul 27 08:43:52 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:43:52.696+0000 7ff60818c600 0 ceph version 15.2.13 (c44bc49e7a57a87d84dfff2a077a2058aa2172e2) octopus (stable), process ceph-mds, pid 49
Jul 27 08:43:52 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: starting mds.newbrunswick2 at
Jul 27 08:43:52 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:43:52.696+0000 7ff60818c600 1 main not setting numa affinity
Jul 27 08:43:52 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:43:52.696+0000 7ff60818c600 0 pidfile_write: ignore empty --pid-file
Jul 27 08:43:55 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:43:55.036+0000 7ff5f733b700 1 mds.newbrunswick2 Updating MDS map to version 277 from mon.0
Jul 27 08:44:03 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:03.256+0000 7ff5f733b700 1 mds.newbrunswick2 Updating MDS map to version 278 from mon.0
Jul 27 08:44:03 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:03.256+0000 7ff5f733b700 1 mds.newbrunswick2 Monitors have assigned me to become a standby.
Jul 27 08:44:04 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:04.318+0000 7ff5f733b700 1 mds.newbrunswick2 Updating MDS map to version 279 from mon.0
Jul 27 08:44:04 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:04.320+0000 7ff5f733b700 1 mds.0.279 handle_mds_map i am now mds.0.279
Jul 27 08:44:04 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:04.320+0000 7ff5f733b700 1 mds.0.279 handle_mds_map state change up:boot --> up:replay
Jul 27 08:44:04 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:04.320+0000 7ff5f733b700 1 mds.0.279 replay_start
Jul 27 08:44:04 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:04.320+0000 7ff5f733b700 1 mds.0.279 waiting for osdmap 87615 (which blacklists prior instance)
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.154+0000 7ff5f032d700 0 mds.0.cache creating system inode with ino:0x100
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.156+0000 7ff5f032d700 0 mds.0.cache creating system inode with ino:0x1
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.181+0000 7ff5ef32b700 1 mds.0.journal EResetJournal
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.182+0000 7ff5ef32b700 1 mds.0.sessionmap wipe start
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.182+0000 7ff5ef32b700 1 mds.0.sessionmap wipe result
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.182+0000 7ff5ef32b700 1 mds.0.sessionmap wipe done
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.182+0000 7ff5ef32b700 1 mds.0.279 Finished replaying journal
Jul 27 08:44:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:11.182+0000 7ff5ef32b700 1 mds.0.279 making mds journal writeable
Jul 27 08:44:13 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:13.973+0000 7ff5f733b700 1 mds.newbrunswick2 Updating MDS map to version 280 from mon.0
Jul 27 08:44:13 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:13.973+0000 7ff5f733b700 1 mds.0.279 handle_mds_map i am now mds.0.279
Jul 27 08:44:13 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:13.973+0000 7ff5f733b700 1 mds.0.279 handle_mds_map state change up:replay --> up:reconnect
Jul 27 08:44:13 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:13.974+0000 7ff5f733b700 1 mds.0.279 reconnect_start
Jul 27 08:44:13 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:13.974+0000 7ff5f733b700 1 mds.0.279 reopen_log
Jul 27 08:44:13 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:13.976+0000 7ff5f733b700 1 mds.0.279 reconnect_done
Jul 27 08:44:17 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:17.552+0000 7ff5f733b700 1 mds.newbrunswick2 Updating MDS map to version 281 from mon.0
Jul 27 08:44:17 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:17.552+0000 7ff5f733b700 1 mds.0.279 handle_mds_map i am now mds.0.279
Jul 27 08:44:17 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:17.552+0000 7ff5f733b700 1 mds.0.279 handle_mds_map state change up:reconnect --> up:rejoin
Jul 27 08:44:17 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:17.552+0000 7ff5f733b700 1 mds.0.279 rejoin_start
Jul 27 08:44:17 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:17.553+0000 7ff5f733b700 1 mds.0.279 rejoin_joint_start
Jul 27 08:44:17 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:17.553+0000 7ff5f733b700 1 mds.0.279 rejoin_done
Jul 27 08:44:20 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:20.219+0000 7ff5f733b700 1 mds.newbrunswick2 Updating MDS map to version 282 from mon.0
Jul 27 08:44:20 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:20.219+0000 7ff5f733b700 1 mds.0.279 handle_mds_map i am now mds.0.279
Jul 27 08:44:20 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:20.219+0000 7ff5f733b700 1 mds.0.279 handle_mds_map state change up:rejoin --> up:active
Jul 27 08:44:20 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:20.219+0000 7ff5f733b700 1 mds.0.279 recovery_done -- successful recovery!
Jul 27 08:44:20 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:20.219+0000 7ff5f733b700 1 mds.0.279 active_start
Jul 27 08:44:20 newbrunswick2 container_name/ceph-mds-newbrunswick2[858]: 2021-07-27T08:44:20.219+0000 7ff5f733b700 1 mds.0.279 cluster recovered.
Jul 27 08:46:51 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27 08:46:51 /opt/ceph-container/bin/entrypoint.sh: static: does not generate config
Jul 27 08:46:51 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27 08:46:51 /opt/ceph-container/bin/entrypoint.sh: SUCCESS
Jul 27 08:47:07 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:07.947+0000 7f4457a1a600 0 set uid:gid to 167:167 (ceph:ceph)
Jul 27 08:47:07 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:07.947+0000 7f4457a1a600 0 ceph version 15.2.13 (c44bc49e7a57a87d84dfff2a077a2058aa2172e2) octopus (stable), process ceph-mds, pid 50
Jul 27 08:47:07 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:07.948+0000 7f4457a1a600 1 main not setting numa affinity
Jul 27 08:47:07 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:07.948+0000 7f4457a1a600 0 pidfile_write: ignore empty --pid-file
Jul 27 08:47:07 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: starting mds.newbrunswick2 at
Jul 27 08:47:09 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:09.522+0000 7f4446bc9700 1 mds.newbrunswick2 Updating MDS map to version 282 from mon.1
Jul 27 08:47:24 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:24.342+0000 7f4446bc9700 1 mds.newbrunswick2 Updating MDS map to version 283 from mon.1
Jul 27 08:47:24 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:24.342+0000 7f4446bc9700 1 mds.newbrunswick2 Monitors have assigned me to become a standby.
Jul 27 08:47:24 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:24.814+0000 7f4446bc9700 1 mds.newbrunswick2 Updating MDS map to version 284 from mon.1
Jul 27 08:47:24 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:24.816+0000 7f4446bc9700 1 mds.0.284 handle_mds_map i am now mds.0.284
Jul 27 08:47:24 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:24.816+0000 7f4446bc9700 1 mds.0.284 handle_mds_map state change up:boot --> up:replay
Jul 27 08:47:24 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:24.816+0000 7f4446bc9700 1 mds.0.284 replay_start
Jul 27 08:47:24 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:24.816+0000 7f4446bc9700 1 mds.0.284 waiting for osdmap 87639 (which blacklists prior instance)
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.838+0000 7f443fbbb700 0 mds.0.cache creating system inode with ino:0x100
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.839+0000 7f443fbbb700 0 mds.0.cache creating system inode with ino:0x1
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.841+0000 7f443ebb9700 1 mds.0.journal EResetJournal
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.841+0000 7f443ebb9700 1 mds.0.sessionmap wipe start
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.841+0000 7f443ebb9700 1 mds.0.sessionmap wipe result
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.841+0000 7f443ebb9700 1 mds.0.sessionmap wipe done
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.844+0000 7f443ebb9700 1 mds.0.284 Finished replaying journal
Jul 27 08:47:35 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:35.844+0000 7f443ebb9700 1 mds.0.284 making mds journal writeable
Jul 27 08:47:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:38.594+0000 7f4446bc9700 1 mds.newbrunswick2 Updating MDS map to version 285 from mon.1
Jul 27 08:47:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:38.594+0000 7f4446bc9700 1 mds.0.284 handle_mds_map i am now mds.0.284
Jul 27 08:47:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:38.594+0000 7f4446bc9700 1 mds.0.284 handle_mds_map state change up:replay --> up:reconnect
Jul 27 08:47:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:38.594+0000 7f4446bc9700 1 mds.0.284 reconnect_start
Jul 27 08:47:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:38.594+0000 7f4446bc9700 1 mds.0.284 reopen_log
Jul 27 08:47:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:38.596+0000 7f4446bc9700 1 mds.0.284 reconnect_done
Jul 27 08:47:40 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:40.099+0000 7f4446bc9700 1 mds.newbrunswick2 Updating MDS map to version 286 from mon.1
Jul 27 08:47:40 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:40.099+0000 7f4446bc9700 1 mds.0.284 handle_mds_map i am now mds.0.284
Jul 27 08:47:40 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:40.099+0000 7f4446bc9700 1 mds.0.284 handle_mds_map state change up:reconnect --> up:rejoin
Jul 27 08:47:40 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:40.099+0000 7f4446bc9700 1 mds.0.284 rejoin_start
Jul 27 08:47:40 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:40.100+0000 7f4446bc9700 1 mds.0.284 rejoin_joint_start
Jul 27 08:47:40 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:40.100+0000 7f4446bc9700 1 mds.0.284 rejoin_done
Jul 27 08:47:42 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:42.992+0000 7f4446bc9700 1 mds.newbrunswick2 Updating MDS map to version 287 from mon.1
Jul 27 08:47:42 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:42.992+0000 7f4446bc9700 1 mds.0.284 handle_mds_map i am now mds.0.284
Jul 27 08:47:42 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:42.992+0000 7f4446bc9700 1 mds.0.284 handle_mds_map state change up:rejoin --> up:active
Jul 27 08:47:42 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:42.992+0000 7f4446bc9700 1 mds.0.284 recovery_done -- successful recovery!
Jul 27 08:47:42 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:42.992+0000 7f4446bc9700 1 mds.0.284 active_start
Jul 27 08:47:42 newbrunswick2 container_name/ceph-mds-newbrunswick2[859]: 2021-07-27T08:47:42.992+0000 7f4446bc9700 1 mds.0.284 cluster recovered.
Jul 27 09:29:01 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27 09:29:01 /opt/ceph-container/bin/entrypoint.sh: static: does not generate config
Jul 27 09:29:01 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27 09:29:01 /opt/ceph-container/bin/entrypoint.sh: SUCCESS
Jul 27 09:29:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:25.362+0000 7f76f2792600 0 set uid:gid to 167:167 (ceph:ceph)
Jul 27 09:29:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:25.362+0000 7f76f2792600 0 ceph version 15.2.13 (c44bc49e7a57a87d84dfff2a077a2058aa2172e2) octopus (stable), process ceph-mds, pid 49
Jul 27 09:29:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: starting mds.newbrunswick2 at
Jul 27 09:29:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:25.363+0000 7f76f2792600 1 main not setting numa affinity
Jul 27 09:29:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:25.363+0000 7f76f2792600 0 pidfile_write: ignore empty --pid-file
Jul 27 09:29:25 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:25.368+0000 7f76e1941700 1 mds.newbrunswick2 Updating MDS map to version 287 from mon.1
Jul 27 09:29:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:38.502+0000 7f76e1941700 1 mds.newbrunswick2 Updating MDS map to version 288 from mon.1
Jul 27 09:29:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 handle_mds_map i am now mds.0.288
Jul 27 09:29:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 handle_mds_map state change up:boot --> up:replay
Jul 27 09:29:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 replay_start
Jul 27 09:29:38 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 waiting for osdmap 87650 (which blacklists prior instance)
Jul 27 09:30:08 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:08.590+0000 7f76db134700 -1 mds.0.inotable: load_2 could not read table: -110
Jul 27 09:30:08 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:08.590+0000 7f76db134700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -110 ((110) Connection timed out)
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.858+0000 7f76db134700 1 mds.newbrunswick2 respawn!
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: --- begin dump of recent events ---
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -706> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command assert hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -705> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command abort hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -704> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command leak_some_memory hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -703> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command perfcounters_dump hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -702> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command 1 hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -701> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command perf dump hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -700> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command perfcounters_schema hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -699> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command perf histogram dump hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -698> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command 2 hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -697> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command perf schema hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -696> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command perf histogram schema hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -695> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command perf reset hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -694> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command config show hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -693> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command config help hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -692> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command config set hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -691> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command config unset hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -690> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command config get hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -689> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command config diff hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -688> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command config diff get hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -687> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command injectargs hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -686> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command log flush hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -685> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command log dump hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -684> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command log reopen hook 0x5610ff0705d0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -683> 2021-07-27T09:29:01.267+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump_mempools hook 0x5610ff14c068
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -682> 2021-07-27T09:29:01.308+0000 7f76f2792600 10 monclient: get_monmap_and_config
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -681> 2021-07-27T09:29:01.308+0000 7f76f2792600 10 monclient: build_initial_monmap
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -680> 2021-07-27T09:29:01.308+0000 7f76f2792600 10 monclient: monmap:
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: epoch 0
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: fsid 7a4265b6-605a-4dbc-9eaa-ec5d9ff62c2a
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: last_changed 2021-07-27T09:29:01.310192+0000
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: created 2021-07-27T09:29:01.310192+0000
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: min_mon_release 0 (unknown)
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0: [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0] mon.noname-a
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1: [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0] mon.noname-b
Jul 27 09:30:10 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2: [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0] mon.noname-c
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -679> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -678> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -677> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -676> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding auth protocol: none
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -675> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -674> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -673> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -672> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -671> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -670> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -669> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -668> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -667> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -666> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -665> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -664> 2021-07-27T09:29:01.308+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd2140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -663> 2021-07-27T09:29:01.348+0000 7f76f2792600 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-newbrunswick2/keyring
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -662> 2021-07-27T09:29:01.351+0000 7f76f2792600 10 monclient: init
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -661> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -660> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -659> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -658> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding auth protocol: none
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -657> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -656> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -655> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -654> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -653> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -652> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -651> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -650> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -649> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -648> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -647> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -646> 2021-07-27T09:29:01.351+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5d650) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -645> 2021-07-27T09:29:01.351+0000 7f76f2792600 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-newbrunswick2/keyring
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -644> 2021-07-27T09:29:01.351+0000 7f76f2792600 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-newbrunswick2/keyring
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -643> 2021-07-27T09:29:01.351+0000 7f76f2792600 10 monclient: _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -642> 2021-07-27T09:29:01.351+0000 7f76f2792600 10 monclient: _add_conns ranks=[2,0,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -641> 2021-07-27T09:29:01.352+0000 7f76f2792600 10 monclient(hunting): picked mon.noname-c con 0x5610ff0f6800 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -640> 2021-07-27T09:29:01.352+0000 7f76f2792600 10 monclient(hunting): picked mon.noname-a con 0x5610ff0f6c00 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -639> 2021-07-27T09:29:01.352+0000 7f76f2792600 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f7000 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -638> 2021-07-27T09:29:01.352+0000 7f76f2792600 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -637> 2021-07-27T09:29:01.353+0000 7f76f2792600 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -636> 2021-07-27T09:29:01.353+0000 7f76f2792600 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -635> 2021-07-27T09:29:01.353+0000 7f76f2792600 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -634> 2021-07-27T09:29:01.353+0000 7f76f2792600 10 monclient(hunting): authenticate will time out at 2021-07-27T09:34:01.354706+0000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -633> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -632> 2021-07-27T09:29:04.354+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -631> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -630> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient: _add_conns ranks=[1,0,2]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -629> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f7000 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -628> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ff0f7800 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -627> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ff0f6800 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -626> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -625> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -624> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -623> 2021-07-27T09:29:04.354+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -622> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -621> 2021-07-27T09:29:07.357+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -620> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -619> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient: _add_conns ranks=[0,1,2]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -618> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ff0f7c00 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -617> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f7000 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -616> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ff0f6800 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -615> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -614> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -613> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -612> 2021-07-27T09:29:07.357+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -611> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -610> 2021-07-27T09:29:10.357+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -609> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -608> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient: _add_conns ranks=[2,0,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -607> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ff0f6800 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -606> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ff0f7c00 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -605> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f6c00 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -604> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -603> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -602> 2021-07-27T09:29:10.357+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -601> 2021-07-27T09:29:10.358+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -600> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -599> 2021-07-27T09:29:13.358+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -598> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -597> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient: _add_conns ranks=[2,0,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -596> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ff0f7800 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -595> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ffd82000 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -594> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f6c00 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -593> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -592> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -591> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -590> 2021-07-27T09:29:13.358+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -589> 2021-07-27T09:29:13.358+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -588> 2021-07-27T09:29:13.358+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -587> 2021-07-27T09:29:13.358+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -586> 2021-07-27T09:29:13.358+0000 7f76e4146700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -585> 2021-07-27T09:29:13.558+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -584> 2021-07-27T09:29:13.558+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -583> 2021-07-27T09:29:13.558+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -582> 2021-07-27T09:29:13.558+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -581> 2021-07-27T09:29:13.960+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -580> 2021-07-27T09:29:13.960+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -579> 2021-07-27T09:29:13.960+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -578> 2021-07-27T09:29:13.960+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -577> 2021-07-27T09:29:14.761+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -576> 2021-07-27T09:29:14.761+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -575> 2021-07-27T09:29:14.761+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -574> 2021-07-27T09:29:14.761+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -573> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -572> 2021-07-27T09:29:16.358+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -571> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -570> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient: _add_conns ranks=[1,2,0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -569> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f6c00 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -568> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ff0f7800 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -567> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ffd82400 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -566> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -565> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -564> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -563> 2021-07-27T09:29:16.358+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -562> 2021-07-27T09:29:16.358+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -561> 2021-07-27T09:29:16.358+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -560> 2021-07-27T09:29:16.358+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -559> 2021-07-27T09:29:16.358+0000 7f76e3945700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -558> 2021-07-27T09:29:16.559+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -557> 2021-07-27T09:29:16.559+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -556> 2021-07-27T09:29:16.559+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -555> 2021-07-27T09:29:16.559+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -554> 2021-07-27T09:29:16.959+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -553> 2021-07-27T09:29:16.959+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -552> 2021-07-27T09:29:16.959+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -551> 2021-07-27T09:29:16.959+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -550> 2021-07-27T09:29:17.760+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f7800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -549> 2021-07-27T09:29:17.760+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -548> 2021-07-27T09:29:17.760+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -547> 2021-07-27T09:29:17.760+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -546> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -545> 2021-07-27T09:29:19.359+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -544> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -543> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient: _add_conns ranks=[1,0,2]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -542> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ffd82800 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -541> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ffd82400 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -540> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ffd82c00 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -539> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -538> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -537> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -536> 2021-07-27T09:29:19.359+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -535> 2021-07-27T09:29:19.359+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -534> 2021-07-27T09:29:19.359+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -533> 2021-07-27T09:29:19.359+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -532> 2021-07-27T09:29:19.359+0000 7f76e4947700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -531> 2021-07-27T09:29:19.360+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -530> 2021-07-27T09:29:19.360+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -529> 2021-07-27T09:29:19.360+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -528> 2021-07-27T09:29:19.360+0000 7f76e4146700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -527> 2021-07-27T09:29:19.360+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ffd82400 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -526> 2021-07-27T09:29:19.360+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -525> 2021-07-27T09:29:19.360+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -524> 2021-07-27T09:29:19.360+0000 7f76e3945700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -523> 2021-07-27T09:29:19.560+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -522> 2021-07-27T09:29:19.560+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -521> 2021-07-27T09:29:19.560+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -520> 2021-07-27T09:29:19.560+0000 7f76e4947700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -519> 2021-07-27T09:29:19.561+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -518> 2021-07-27T09:29:19.561+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -517> 2021-07-27T09:29:19.561+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -516> 2021-07-27T09:29:19.561+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -515> 2021-07-27T09:29:19.561+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ffd82400 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -514> 2021-07-27T09:29:19.561+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -513> 2021-07-27T09:29:19.561+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -512> 2021-07-27T09:29:19.561+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -511> 2021-07-27T09:29:19.961+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -510> 2021-07-27T09:29:19.961+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -509> 2021-07-27T09:29:19.961+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -508> 2021-07-27T09:29:19.961+0000 7f76e4947700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -507> 2021-07-27T09:29:19.962+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -506> 2021-07-27T09:29:19.962+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -505> 2021-07-27T09:29:19.962+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -504> 2021-07-27T09:29:19.962+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -503> 2021-07-27T09:29:19.962+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ffd82400 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -502> 2021-07-27T09:29:19.962+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -501> 2021-07-27T09:29:19.962+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -500> 2021-07-27T09:29:19.962+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -499> 2021-07-27T09:29:20.763+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -498> 2021-07-27T09:29:20.763+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -497> 2021-07-27T09:29:20.763+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -496> 2021-07-27T09:29:20.763+0000 7f76e4947700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -495> 2021-07-27T09:29:20.763+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ffd82400 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -494> 2021-07-27T09:29:20.763+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -493> 2021-07-27T09:29:20.763+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -492> 2021-07-27T09:29:20.763+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -491> 2021-07-27T09:29:20.763+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -490> 2021-07-27T09:29:20.763+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -489> 2021-07-27T09:29:20.763+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -488> 2021-07-27T09:29:20.763+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -487> 2021-07-27T09:29:22.359+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -486> 2021-07-27T09:29:22.359+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -485> 2021-07-27T09:29:22.359+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -484> 2021-07-27T09:29:22.359+0000 7f76e2142700 10 monclient: _add_conns ranks=[1,0,2]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -483> 2021-07-27T09:29:22.359+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ffd82000 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -482> 2021-07-27T09:29:22.359+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ff0f6800 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -481> 2021-07-27T09:29:22.359+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ffd82c00 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -480> 2021-07-27T09:29:22.359+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -479> 2021-07-27T09:29:22.360+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -478> 2021-07-27T09:29:22.360+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -477> 2021-07-27T09:29:22.360+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -476> 2021-07-27T09:29:22.360+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -475> 2021-07-27T09:29:22.360+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -474> 2021-07-27T09:29:22.360+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -473> 2021-07-27T09:29:22.360+0000 7f76e4947700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -472> 2021-07-27T09:29:22.360+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82000 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -471> 2021-07-27T09:29:22.360+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -470> 2021-07-27T09:29:22.360+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -469> 2021-07-27T09:29:22.360+0000 7f76e4146700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -468> 2021-07-27T09:29:22.360+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f6800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -467> 2021-07-27T09:29:22.360+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -466> 2021-07-27T09:29:22.360+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -465> 2021-07-27T09:29:22.360+0000 7f76e3945700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -464> 2021-07-27T09:29:22.561+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -463> 2021-07-27T09:29:22.561+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -462> 2021-07-27T09:29:22.561+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -461> 2021-07-27T09:29:22.561+0000 7f76e4947700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -460> 2021-07-27T09:29:22.561+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82000 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -459> 2021-07-27T09:29:22.561+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -458> 2021-07-27T09:29:22.561+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -457> 2021-07-27T09:29:22.561+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -456> 2021-07-27T09:29:22.562+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f6800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -455> 2021-07-27T09:29:22.562+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -454> 2021-07-27T09:29:22.562+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -453> 2021-07-27T09:29:22.562+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -452> 2021-07-27T09:29:22.962+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -451> 2021-07-27T09:29:22.962+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -450> 2021-07-27T09:29:22.962+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -449> 2021-07-27T09:29:22.962+0000 7f76e4947700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -448> 2021-07-27T09:29:22.962+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82000 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -447> 2021-07-27T09:29:22.962+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -446> 2021-07-27T09:29:22.962+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -445> 2021-07-27T09:29:22.962+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -444> 2021-07-27T09:29:22.963+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f6800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -443> 2021-07-27T09:29:22.963+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -442> 2021-07-27T09:29:22.963+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -441> 2021-07-27T09:29:22.963+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -440> 2021-07-27T09:29:23.763+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ffd82000 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -439> 2021-07-27T09:29:23.763+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -438> 2021-07-27T09:29:23.763+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -437> 2021-07-27T09:29:23.763+0000 7f76e4146700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -436> 2021-07-27T09:29:23.763+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -435> 2021-07-27T09:29:23.763+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -434> 2021-07-27T09:29:23.763+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -433> 2021-07-27T09:29:23.763+0000 7f76e4947700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -432> 2021-07-27T09:29:23.764+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f6800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -431> 2021-07-27T09:29:23.764+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -430> 2021-07-27T09:29:23.764+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -429> 2021-07-27T09:29:23.764+0000 7f76e3945700 10 monclient(hunting): _init_auth already have auth, reseting
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -428> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -427> 2021-07-27T09:29:25.360+0000 7f76e2142700 1 monclient(hunting): continuing hunt
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -426> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -425> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient: _add_conns ranks=[0,2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -424> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-a con 0x5610ff0f6c00 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -423> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-c con 0x5610ffd82c00 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -422> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f7000 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -421> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -420> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -419> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -418> 2021-07-27T09:29:25.360+0000 7f76e2142700 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -417> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ffd82c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -416> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -415> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -414> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -413> 2021-07-27T09:29:25.360+0000 7f76e4146700 10 monclient(hunting): get_auth_request con 0x5610ff0f6c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -412> 2021-07-27T09:29:25.360+0000 7f76e4146700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -411> 2021-07-27T09:29:25.360+0000 7f76e4146700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -410> 2021-07-27T09:29:25.360+0000 7f76e4146700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -409> 2021-07-27T09:29:25.360+0000 7f76e4947700 10 monclient(hunting): get_auth_request con 0x5610ff0f7000 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -408> 2021-07-27T09:29:25.360+0000 7f76e4947700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -407> 2021-07-27T09:29:25.360+0000 7f76e4947700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -406> 2021-07-27T09:29:25.360+0000 7f76e4947700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -405> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): handle_auth_reply_more payload 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -404> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): handle_auth_reply_more payload_len 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -403> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -402> 2021-07-27T09:29:25.360+0000 7f76e4146700 10 monclient(hunting): handle_auth_reply_more payload 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -401> 2021-07-27T09:29:25.360+0000 7f76e4146700 10 monclient(hunting): handle_auth_reply_more payload_len 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -400> 2021-07-27T09:29:25.360+0000 7f76e4146700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -399> 2021-07-27T09:29:25.360+0000 7f76e4947700 10 monclient(hunting): handle_auth_reply_more payload 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -398> 2021-07-27T09:29:25.360+0000 7f76e4947700 10 monclient(hunting): handle_auth_reply_more payload_len 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -397> 2021-07-27T09:29:25.360+0000 7f76e4947700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -396> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient(hunting): handle_auth_done global_id 3364112 payload 290
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -395> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient: _finish_hunting 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -394> 2021-07-27T09:29:25.360+0000 7f76e3945700 1 monclient: found mon.noname-c
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -393> 2021-07-27T09:29:25.360+0000 7f76e3945700 10 monclient: _send_mon_message to mon.noname-c at v2:10.245.0.42:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -392> 2021-07-27T09:29:25.360+0000 7f76e3144700 10 monclient: handle_monmap mon_map magic: 0 v1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -391> 2021-07-27T09:29:25.360+0000 7f76e3144700 10 monclient: got monmap 2 from mon.noname-c (according to old e2)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -390> 2021-07-27T09:29:25.360+0000 7f76e3144700 10 monclient: dump:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: epoch 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: fsid 7a4265b6-605a-4dbc-9eaa-ec5d9ff62c2a
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: last_changed 2021-05-06T10:44:39.381308+0000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: created 2021-04-21T13:16:37.667662+0000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: min_mon_release 15 (octopus)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0: [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0] mon.newbrunswick0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1: [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0] mon.newbrunswick1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2: [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0] mon.newbrunswick2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -389> 2021-07-27T09:29:25.360+0000 7f76e3144700 10 monclient: _finish_auth 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -388> 2021-07-27T09:29:25.360+0000 7f76e3144700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2021-07-27T09:28:55.362408+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -387> 2021-07-27T09:29:25.360+0000 7f76e3144700 10 monclient: _send_mon_message to mon.newbrunswick2 at v2:10.245.0.42:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -386> 2021-07-27T09:29:25.360+0000 7f76f2792600 5 monclient: authenticate success, global_id 3364112
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -385> 2021-07-27T09:29:25.361+0000 7f76e3144700 10 monclient: handle_config config(0 keys) v1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -384> 2021-07-27T09:29:25.361+0000 7f76f2792600 10 monclient: get_monmap_and_config success
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -383> 2021-07-27T09:29:25.361+0000 7f76f2792600 10 monclient: shutdown
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -382> 2021-07-27T09:29:25.361+0000 7f76e1941700 4 set_mon_vals no callback set
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -381> 2021-07-27T09:29:25.361+0000 7f76e3144700 10 monclient: discarding stray monitor message mon_map magic: 0 v1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -380> 2021-07-27T09:29:25.362+0000 7f76f2792600 0 set uid:gid to 167:167 (ceph:ceph)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -379> 2021-07-27T09:29:25.362+0000 7f76f2792600 0 ceph version 15.2.13 (c44bc49e7a57a87d84dfff2a077a2058aa2172e2) octopus (stable), process ceph-mds, pid 49
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -378> 2021-07-27T09:29:25.363+0000 7f76f2792600 1 main not setting numa affinity
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -377> 2021-07-27T09:29:25.363+0000 7f76f2792600 0 pidfile_write: ignore empty --pid-file
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -376> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 asok(0x5610ff0f2000) init /var/run/ceph/ceph-mds.newbrunswick2.asok
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -375> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 asok(0x5610ff0f2000) bind_and_listen /var/run/ceph/ceph-mds.newbrunswick2.asok
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -374> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command 0 hook 0x5610ff075330
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -373> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command version hook 0x5610ff075330
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -372> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command git_version hook 0x5610ff075330
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -371> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command help hook 0x5610ff0703c0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -370> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command get_command_descriptions hook 0x5610ff070580
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -369> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -368> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -367> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -366> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding auth protocol: none
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -365> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -364> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -363> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -362> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -361> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -360> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -359> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -358> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -357> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -356> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -355> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -354> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x5610ffcd3140) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -353> 2021-07-27T09:29:25.363+0000 7f76f2792600 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-newbrunswick2/keyring
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -352> 2021-07-27T09:29:25.363+0000 7f76f2792600 10 monclient: build_initial_monmap
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -351> 2021-07-27T09:29:25.363+0000 7f76f2792600 10 monclient: monmap:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: epoch 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: fsid 00000000-0000-0000-0000-000000000000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: last_changed 0.000000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: created 0.000000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: min_mon_release 0 (unknown)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0: [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0] mon.noname-a
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1: [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0] mon.noname-b
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2: [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0] mon.noname-c
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -350> 2021-07-27T09:29:25.363+0000 7f76f2792600 10 monclient: init
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -349> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -348> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -347> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding auth protocol: cephx
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -346> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding auth protocol: none
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -345> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -344> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -343> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -342> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -341> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -340> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -339> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -338> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -337> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -336> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -335> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: crc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -334> 2021-07-27T09:29:25.363+0000 7f76f2792600 5 AuthRegistry(0x7fff3fd5f020) adding con mode: secure
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -333> 2021-07-27T09:29:25.364+0000 7f76f2792600 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-newbrunswick2/keyring
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -332> 2021-07-27T09:29:25.364+0000 7f76f2792600 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mds/ceph-newbrunswick2/keyring
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -331> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient: _reopen_session rank -1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -330> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient: _add_conns ranks=[0,1,2]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -329> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient(hunting): picked mon.noname-a con 0x5610ff0f7000 addr [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -328> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient(hunting): picked mon.noname-b con 0x5610ff0f6c00 addr [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -327> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient(hunting): picked mon.noname-c con 0x5610ff0f6400 addr [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -326> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -325> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -324> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient(hunting): start opening mon connection
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -323> 2021-07-27T09:29:25.364+0000 7f76f2792600 10 monclient(hunting): _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -322> 2021-07-27T09:29:25.364+0000 7f76e2943700 5 asok(0x5610ff0f2000) entry start
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -321> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): get_auth_request con 0x5610ff0f6c00 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -320> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -319> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): _init_auth method 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -318> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): _init_auth creating new auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -317> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): handle_auth_reply_more payload 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -316> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): handle_auth_reply_more payload_len 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -315> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -314> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient(hunting): handle_auth_done global_id 3364108 payload 1059
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -313> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient: _finish_hunting 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -312> 2021-07-27T09:29:25.365+0000 7f76e3945700 1 monclient: found mon.noname-b
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -311> 2021-07-27T09:29:25.365+0000 7f76e3945700 10 monclient: _send_mon_message to mon.noname-b at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -310> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: handle_monmap mon_map magic: 0 v1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -309> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: got monmap 2 from mon.noname-b (according to old e2)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -308> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: dump:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: epoch 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: fsid 7a4265b6-605a-4dbc-9eaa-ec5d9ff62c2a
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: last_changed 2021-05-06T10:44:39.381308+0000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: created 2021-04-21T13:16:37.667662+0000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: min_mon_release 15 (octopus)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0: [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0] mon.newbrunswick0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1: [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0] mon.newbrunswick1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2: [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0] mon.newbrunswick2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -307> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: _finish_auth 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -306> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2021-07-27T09:28:55.368119+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -305> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -304> 2021-07-27T09:29:25.366+0000 7f76f2792600 5 monclient: authenticate success, global_id 3364108
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -303> 2021-07-27T09:29:25.366+0000 7f76f2792600 10 monclient: wait_auth_rotating waiting for 30
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -302> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: handle_config config(0 keys) v1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -301> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: handle_monmap mon_map magic: 0 v1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -300> 2021-07-27T09:29:25.366+0000 7f76e013e700 4 set_mon_vals no callback set
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -299> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: got monmap 2 from mon.newbrunswick1 (according to old e2)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -298> 2021-07-27T09:29:25.366+0000 7f76e1941700 10 monclient: dump:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: epoch 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: fsid 7a4265b6-605a-4dbc-9eaa-ec5d9ff62c2a
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: last_changed 2021-05-06T10:44:39.381308+0000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: created 2021-04-21T13:16:37.667662+0000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: min_mon_release 15 (octopus)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0: [v2:10.245.0.40:3300/0,v1:10.245.0.40:6789/0] mon.newbrunswick0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1: [v2:10.245.0.41:3300/0,v1:10.245.0.41:6789/0] mon.newbrunswick1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2: [v2:10.245.0.42:3300/0,v1:10.245.0.42:6789/0] mon.newbrunswick2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]:
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -297> 2021-07-27T09:29:25.367+0000 7f76e1941700 10 monclient: _finish_auth 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -296> 2021-07-27T09:29:25.367+0000 7f76e1941700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:28:55.369015+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -295> 2021-07-27T09:29:25.367+0000 7f76f2792600 10 monclient: wait_auth_rotating done
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -294> 2021-07-27T09:29:25.367+0000 7f76f2792600 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -293> 2021-07-27T09:29:25.367+0000 7f76f2792600 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -292> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command status hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -291> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump_ops_in_flight hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -290> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command ops hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -289> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump_blocked_ops hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -288> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump_historic_ops hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -287> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump_historic_ops_by_duration hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -286> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command scrub_path hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -285> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command scrub start hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -284> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command scrub abort hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -283> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command scrub pause hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -282> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command scrub resume hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -281> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command scrub status hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -280> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command tag path hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -279> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command flush_path hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -278> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command export dir hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -277> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump cache hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -276> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command cache drop hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -275> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command cache status hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -274> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump tree hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -273> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump loads hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -272> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump snaps hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -271> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command session ls hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -270> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command client ls hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -269> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command session evict hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -268> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command client evict hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -267> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command session kill hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -266> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command session ls hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -265> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command session config hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -264> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command client config hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -263> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command damage ls hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -262> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command damage rm hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -261> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command osdmap barrier hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -260> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command flush journal hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -259> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command force_readonly hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -258> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command get subtrees hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -257> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dirfrag split hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -256> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dirfrag merge hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -255> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dirfrag ls hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -254> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command openfiles ls hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -253> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command dump inode hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -252> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command exit hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -251> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command respawn hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -250> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command heap hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -249> 2021-07-27T09:29:25.367+0000 7f76f2792600 5 asok(0x5610ff0f2000) register_command cpu_profiler hook 0x5610ff070340
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -248> 2021-07-27T09:29:25.367+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:boot seq 1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -247> 2021-07-27T09:29:25.368+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -246> 2021-07-27T09:29:25.368+0000 7f76e1941700 1 mds.newbrunswick2 Updating MDS map to version 287 from mon.1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -245> 2021-07-27T09:29:28.366+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -244> 2021-07-27T09:29:28.366+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:28:58.367594+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -243> 2021-07-27T09:29:29.366+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -242> 2021-07-27T09:29:29.366+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:28:59.367742+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -241> 2021-07-27T09:29:29.368+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:boot seq 2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -240> 2021-07-27T09:29:29.368+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -239> 2021-07-27T09:29:30.368+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -238> 2021-07-27T09:29:30.368+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:00.369291+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -237> 2021-07-27T09:29:31.368+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -236> 2021-07-27T09:29:31.368+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:01.369413+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -235> 2021-07-27T09:29:32.368+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -234> 2021-07-27T09:29:32.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:02.369555+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -233> 2021-07-27T09:29:33.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -232> 2021-07-27T09:29:33.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:03.369679+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -231> 2021-07-27T09:29:33.369+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:boot seq 3
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -230> 2021-07-27T09:29:33.370+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -229> 2021-07-27T09:29:34.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -228> 2021-07-27T09:29:34.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:04.369797+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -227> 2021-07-27T09:29:35.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -226> 2021-07-27T09:29:35.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:05.369916+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -225> 2021-07-27T09:29:36.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -224> 2021-07-27T09:29:36.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:06.370050+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -223> 2021-07-27T09:29:37.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -222> 2021-07-27T09:29:37.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:07.370187+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -221> 2021-07-27T09:29:37.370+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:boot seq 4
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -220> 2021-07-27T09:29:37.370+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -219> 2021-07-27T09:29:38.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -218> 2021-07-27T09:29:38.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:08.370307+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -217> 2021-07-27T09:29:38.502+0000 7f76e1941700 1 mds.newbrunswick2 Updating MDS map to version 288 from mon.1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -216> 2021-07-27T09:29:38.502+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -215> 2021-07-27T09:29:38.502+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -214> 2021-07-27T09:29:38.504+0000 7f76e1941700 4 mds.0.purge_queue operator(): data pool 1 not found in OSDMap
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -213> 2021-07-27T09:29:38.504+0000 7f76e1941700 5 asok(0x5610ff0f2000) register_command objecter_requests hook 0x5610ff070670
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -212> 2021-07-27T09:29:38.504+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -211> 2021-07-27T09:29:38.504+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -210> 2021-07-27T09:29:38.504+0000 7f76e1941700 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: daemon prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -209> 2021-07-27T09:29:38.505+0000 7f76e1941700 4 mds.0.purge_queue operator(): data pool 1 not found in OSDMap
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -208> 2021-07-27T09:29:38.505+0000 7f76e1941700 4 mds.0.0 handle_osd_map epoch 0, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -207> 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 handle_mds_map i am now mds.0.288
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -206> 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 handle_mds_map state change up:boot --> up:replay
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -205> 2021-07-27T09:29:38.505+0000 7f76e1941700 5 mds.beacon.newbrunswick2 set_want_state: up:boot -> up:replay
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -204> 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 replay_start
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -203> 2021-07-27T09:29:38.505+0000 7f76e1941700 1 mds.0.288 waiting for osdmap 87650 (which blacklists prior instance)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -202> 2021-07-27T09:29:38.507+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:boot seq 2 rtt 9.13879
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -201> 2021-07-27T09:29:38.507+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:boot seq 3 rtt 5.13844
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -200> 2021-07-27T09:29:38.508+0000 7f76dd138700 2 mds.0.cache Memory usage: total 419804, rss 28272, heap 307424, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -199> 2021-07-27T09:29:38.586+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:boot seq 4 rtt 1.2161
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -198> 2021-07-27T09:29:38.588+0000 7f76e1941700 4 mgrc handle_mgr_map Got map version 435
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -197> 2021-07-27T09:29:38.588+0000 7f76e1941700 4 mgrc handle_mgr_map Active mgr is now [v2:10.245.0.40:6808/56,v1:10.245.0.40:6809/56]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -196> 2021-07-27T09:29:38.588+0000 7f76e1941700 4 mgrc reconnect Starting new session with [v2:10.245.0.40:6808/56,v1:10.245.0.40:6809/56]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -195> 2021-07-27T09:29:38.589+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87650, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -194> 2021-07-27T09:29:38.589+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -193> 2021-07-27T09:29:38.589+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -192> 2021-07-27T09:29:38.589+0000 7f76db134700 2 mds.0.288 Booting: 0: opening inotable
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -191> 2021-07-27T09:29:38.590+0000 7f76db134700 2 mds.0.288 Booting: 0: opening sessionmap
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -190> 2021-07-27T09:29:38.590+0000 7f76db134700 2 mds.0.288 Booting: 0: opening mds log
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -189> 2021-07-27T09:29:38.590+0000 7f76db134700 5 mds.0.log open discovering log bounds
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -188> 2021-07-27T09:29:38.590+0000 7f76db134700 2 mds.0.288 Booting: 0: opening purge queue (async)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -187> 2021-07-27T09:29:38.590+0000 7f76da933700 4 mds.0.journalpointer Reading journal pointer '400.00000000'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -186> 2021-07-27T09:29:38.590+0000 7f76db134700 4 mds.0.purge_queue open: opening
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -185> 2021-07-27T09:29:38.590+0000 7f76db134700 1 mds.0.journaler.pq(ro) recover start
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -184> 2021-07-27T09:29:38.590+0000 7f76db134700 1 mds.0.journaler.pq(ro) read_head
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -183> 2021-07-27T09:29:38.590+0000 7f76db134700 2 mds.0.288 Booting: 0: loading open file table (async)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -182> 2021-07-27T09:29:38.590+0000 7f76db134700 2 mds.0.288 Booting: 0: opening snap table
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -181> 2021-07-27T09:29:38.590+0000 7f76e4947700 10 monclient: get_auth_request con 0x5610ffd83000 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -180> 2021-07-27T09:29:39.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -179> 2021-07-27T09:29:39.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:09.370453+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -178> 2021-07-27T09:29:39.509+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30128, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -177> 2021-07-27T09:29:40.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -176> 2021-07-27T09:29:40.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:10.370575+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -175> 2021-07-27T09:29:40.509+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30128, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -174> 2021-07-27T09:29:41.369+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -173> 2021-07-27T09:29:41.369+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:11.370699+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -172> 2021-07-27T09:29:41.369+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:replay seq 5
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -171> 2021-07-27T09:29:41.369+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -170> 2021-07-27T09:29:41.509+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30128, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -169> 2021-07-27T09:29:41.911+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87651, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -168> 2021-07-27T09:29:41.911+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -167> 2021-07-27T09:29:41.911+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -166> 2021-07-27T09:29:41.917+0000 7f76e1941700 4 mgrc handle_mgr_map Got map version 436
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -165> 2021-07-27T09:29:41.917+0000 7f76e1941700 4 mgrc handle_mgr_map Active mgr is now [v2:10.245.0.40:6808/56,v1:10.245.0.40:6809/56]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -164> 2021-07-27T09:29:42.162+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:replay seq 5 rtt 0.792068
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -163> 2021-07-27T09:29:42.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -162> 2021-07-27T09:29:42.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:12.370823+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -161> 2021-07-27T09:29:42.511+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -160> 2021-07-27T09:29:42.925+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87652, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -159> 2021-07-27T09:29:42.925+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -158> 2021-07-27T09:29:42.925+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -157> 2021-07-27T09:29:43.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -156> 2021-07-27T09:29:43.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:13.370942+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -155> 2021-07-27T09:29:43.511+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -154> 2021-07-27T09:29:44.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -153> 2021-07-27T09:29:44.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:14.371059+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -152> 2021-07-27T09:29:44.511+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -151> 2021-07-27T09:29:45.273+0000 7f76e1941700 4 mgrc handle_mgr_map Got map version 437
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -150> 2021-07-27T09:29:45.273+0000 7f76e1941700 4 mgrc handle_mgr_map Active mgr is now
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -149> 2021-07-27T09:29:45.273+0000 7f76e1941700 4 mgrc reconnect Terminating session with v2:10.245.0.40:6808/56
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -148> 2021-07-27T09:29:45.273+0000 7f76e1941700 4 mgrc reconnect No active mgr available yet
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -147> 2021-07-27T09:29:45.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -146> 2021-07-27T09:29:45.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:15.371174+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -145> 2021-07-27T09:29:45.370+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:replay seq 6
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -144> 2021-07-27T09:29:45.370+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -143> 2021-07-27T09:29:45.512+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -142> 2021-07-27T09:29:46.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -141> 2021-07-27T09:29:46.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:16.371293+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -140> 2021-07-27T09:29:46.512+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -139> 2021-07-27T09:29:46.712+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87653, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -138> 2021-07-27T09:29:46.712+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -137> 2021-07-27T09:29:46.712+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -136> 2021-07-27T09:29:46.713+0000 7f76e4146700 10 monclient: get_auth_request con 0x5610ffd83400 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -135> 2021-07-27T09:29:47.296+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87653, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -134> 2021-07-27T09:29:47.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -133> 2021-07-27T09:29:47.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:17.371414+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -132> 2021-07-27T09:29:47.489+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:replay seq 6 rtt 2.11918
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -131> 2021-07-27T09:29:47.512+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -130> 2021-07-27T09:29:48.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -129> 2021-07-27T09:29:48.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:18.371541+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -128> 2021-07-27T09:29:48.512+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -127> 2021-07-27T09:29:48.598+0000 7f76e1941700 4 mgrc handle_mgr_map Got map version 438
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -126> 2021-07-27T09:29:48.598+0000 7f76e1941700 4 mgrc handle_mgr_map Active mgr is now [v2:10.245.0.40:6808/55,v1:10.245.0.40:6809/55]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -125> 2021-07-27T09:29:48.598+0000 7f76e1941700 4 mgrc reconnect Starting new session with [v2:10.245.0.40:6808/55,v1:10.245.0.40:6809/55]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -124> 2021-07-27T09:29:48.598+0000 7f76e4146700 10 monclient: get_auth_request con 0x5610ffd83800 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -123> 2021-07-27T09:29:48.599+0000 7f76e1941700 4 mgrc handle_mgr_configure stats_period=5
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -122> 2021-07-27T09:29:48.599+0000 7f76e1941700 4 mgrc handle_mgr_configure updated stats threshold: 5
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -121> 2021-07-27T09:29:49.370+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:replay seq 7
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -120> 2021-07-27T09:29:49.370+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -119> 2021-07-27T09:29:49.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -118> 2021-07-27T09:29:49.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:19.371654+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -117> 2021-07-27T09:29:49.444+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87654, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -116> 2021-07-27T09:29:49.444+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -115> 2021-07-27T09:29:49.444+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -114> 2021-07-27T09:29:49.444+0000 7f76e3945700 10 monclient: get_auth_request con 0x5610ffd82000 auth_method 0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -113> 2021-07-27T09:29:49.456+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87654, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -112> 2021-07-27T09:29:49.513+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -111> 2021-07-27T09:29:50.007+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87654, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -110> 2021-07-27T09:29:50.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -109> 2021-07-27T09:29:50.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:20.371787+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -108> 2021-07-27T09:29:50.377+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:replay seq 7 rtt 1.00709
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -107> 2021-07-27T09:29:50.513+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -106> 2021-07-27T09:29:51.371+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -105> 2021-07-27T09:29:51.371+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:21.371936+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -104> 2021-07-27T09:29:51.513+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -103> 2021-07-27T09:29:52.371+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -102> 2021-07-27T09:29:52.371+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:22.372085+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -101> 2021-07-27T09:29:52.514+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -100> 2021-07-27T09:29:52.832+0000 7f76e1941700 4 mgrc handle_mgr_map Got map version 439
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -99> 2021-07-27T09:29:52.832+0000 7f76e1941700 4 mgrc handle_mgr_map Active mgr is now [v2:10.245.0.40:6808/55,v1:10.245.0.40:6809/55]
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -98> 2021-07-27T09:29:53.370+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:replay seq 8
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -97> 2021-07-27T09:29:53.370+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -96> 2021-07-27T09:29:53.370+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -95> 2021-07-27T09:29:53.370+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:23.372189+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -94> 2021-07-27T09:29:53.515+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30656, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -93> 2021-07-27T09:29:54.334+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87655, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -92> 2021-07-27T09:29:54.334+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -91> 2021-07-27T09:29:54.334+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -90> 2021-07-27T09:29:54.344+0000 7f76da933700 1 mds.0.journaler.mdlog(ro) recover start
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -89> 2021-07-27T09:29:54.344+0000 7f76da933700 1 mds.0.journaler.mdlog(ro) read_head
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -88> 2021-07-27T09:29:54.344+0000 7f76da933700 4 mds.0.log Waiting for journal 0x200 to recover...
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -87> 2021-07-27T09:29:54.346+0000 7f76db134700 1 mds.0.journaler.mdlog(ro) _finish_read_head loghead(trim 12582912, expire 12582912, write 12586011, stream_format 1). probing for end of log (from 12586011)...
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -86> 2021-07-27T09:29:54.346+0000 7f76db134700 1 mds.0.journaler.mdlog(ro) probing for end of the log
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -85> 2021-07-27T09:29:54.346+0000 7f76db134700 1 mds.0.journaler.mdlog(ro) _finish_probe_end write_pos = 12586152 (header had 12586011). recovered.
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -84> 2021-07-27T09:29:54.347+0000 7f76da933700 4 mds.0.log Journal 0x200 recovered.
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -83> 2021-07-27T09:29:54.347+0000 7f76da933700 4 mds.0.log Recovered journal 0x200 in format 1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -82> 2021-07-27T09:29:54.372+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -81> 2021-07-27T09:29:54.372+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:24.372330+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -80> 2021-07-27T09:29:54.515+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30676, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -79> 2021-07-27T09:29:54.696+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87655, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -78> 2021-07-27T09:29:54.746+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:replay seq 8 rtt 1.37512
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -77> 2021-07-27T09:29:55.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -76> 2021-07-27T09:29:55.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:25.375560+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -75> 2021-07-27T09:29:55.515+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30676, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -74> 2021-07-27T09:29:56.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -73> 2021-07-27T09:29:56.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:26.375675+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -72> 2021-07-27T09:29:56.516+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30676, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -71> 2021-07-27T09:29:57.371+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:replay seq 9
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -70> 2021-07-27T09:29:57.371+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -69> 2021-07-27T09:29:57.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -68> 2021-07-27T09:29:57.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:27.375782+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -67> 2021-07-27T09:29:57.516+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -66> 2021-07-27T09:29:58.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -65> 2021-07-27T09:29:58.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:28.375899+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -64> 2021-07-27T09:29:58.517+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -63> 2021-07-27T09:29:59.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -62> 2021-07-27T09:29:59.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:29.376024+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -61> 2021-07-27T09:29:59.517+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -60> 2021-07-27T09:29:59.609+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87656, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -59> 2021-07-27T09:29:59.609+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -58> 2021-07-27T09:29:59.609+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -57> 2021-07-27T09:29:59.638+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87656, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -56> 2021-07-27T09:29:59.655+0000 7f76dc136700 1 mds.0.journaler.pq(ro) _finish_read_head loghead(trim 4194304, expire 4194304, write 4194304, stream_format 1). probing for end of log (from 4194304)...
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -55> 2021-07-27T09:29:59.655+0000 7f76dc136700 1 mds.0.journaler.pq(ro) probing for end of the log
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -54> 2021-07-27T09:29:59.661+0000 7f76dc136700 1 mds.0.journaler.pq(ro) _finish_probe_end write_pos = 4194304 (header had 4194304). recovered.
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -53> 2021-07-27T09:29:59.661+0000 7f76dc136700 4 mds.0.purge_queue operator(): open complete
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -52> 2021-07-27T09:29:59.661+0000 7f76dc136700 1 mds.0.journaler.pq(ro) set_writeable
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -51> 2021-07-27T09:29:59.934+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87656, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -50> 2021-07-27T09:30:00.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -49> 2021-07-27T09:30:00.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:30.376156+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -48> 2021-07-27T09:30:00.420+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:replay seq 9 rtt 3.04926
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -47> 2021-07-27T09:30:00.517+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -46> 2021-07-27T09:30:01.371+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:replay seq 10
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -45> 2021-07-27T09:30:01.371+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -44> 2021-07-27T09:30:01.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -43> 2021-07-27T09:30:01.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:31.376268+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -42> 2021-07-27T09:30:01.517+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -41> 2021-07-27T09:30:02.027+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:replay seq 10 rtt 0.656056
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -40> 2021-07-27T09:30:02.374+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -39> 2021-07-27T09:30:02.374+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:32.376386+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -38> 2021-07-27T09:30:02.518+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -37> 2021-07-27T09:30:02.918+0000 7f76e1941700 4 mds.0.288 handle_osd_map epoch 87657, 0 new blacklist entries
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -36> 2021-07-27T09:30:02.918+0000 7f76e1941700 10 monclient: _renew_subs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -35> 2021-07-27T09:30:02.918+0000 7f76e1941700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -34> 2021-07-27T09:30:03.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -33> 2021-07-27T09:30:03.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:33.376536+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -32> 2021-07-27T09:30:03.518+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -31> 2021-07-27T09:30:04.375+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -30> 2021-07-27T09:30:04.375+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:34.376660+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -29> 2021-07-27T09:30:04.518+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -28> 2021-07-27T09:30:05.372+0000 7f76df13c700 5 mds.beacon.newbrunswick2 Sending beacon up:replay seq 11
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -27> 2021-07-27T09:30:05.372+0000 7f76df13c700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -26> 2021-07-27T09:30:05.376+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -25> 2021-07-27T09:30:05.376+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:35.376760+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -24> 2021-07-27T09:30:05.520+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30652, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -23> 2021-07-27T09:30:06.376+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -22> 2021-07-27T09:30:06.376+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:36.376872+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -21> 2021-07-27T09:30:06.520+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30644, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -20> 2021-07-27T09:30:06.836+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply up:replay seq 11 rtt 1.46413
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -19> 2021-07-27T09:30:07.376+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -18> 2021-07-27T09:30:07.376+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:37.376988+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -17> 2021-07-27T09:30:07.520+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30644, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -16> 2021-07-27T09:30:08.376+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -15> 2021-07-27T09:30:08.376+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:38.377101+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -14> 2021-07-27T09:30:08.521+0000 7f76dd138700 2 mds.0.cache Memory usage: total 437220, rss 30644, heap 323808, baseline 307424, 0 / 0 inodes have caps, 0 caps, 0 caps per inode
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -13> 2021-07-27T09:30:08.590+0000 7f76db134700 -1 mds.0.inotable: load_2 could not read table: -110
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -12> 2021-07-27T09:30:08.590+0000 7f76db134700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -110 ((110) Connection timed out)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -11> 2021-07-27T09:30:08.590+0000 7f76db134700 5 mds.beacon.newbrunswick2 set_want_state: up:replay -> down:damaged
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -10> 2021-07-27T09:30:08.590+0000 7f76db134700 10 log_client log_queue is 1 last_log 1 sent 0 num 1 unsent 1 sending 1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -9> 2021-07-27T09:30:08.590+0000 7f76db134700 10 log_client will send 2021-07-27T09:30:08.591116+0000 mds.newbrunswick2 (mds.0) 1 : cluster [ERR] error reading table object 'mds0_inotable' -110 ((110) Connection timed out)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -8> 2021-07-27T09:30:08.590+0000 7f76db134700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -7> 2021-07-27T09:30:08.590+0000 7f76db134700 5 mds.beacon.newbrunswick2 Sending beacon down:damaged seq 12
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -6> 2021-07-27T09:30:08.590+0000 7f76db134700 10 monclient: _send_mon_message to mon.newbrunswick1 at v2:10.245.0.41:3300/0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -5> 2021-07-27T09:30:09.376+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -4> 2021-07-27T09:30:09.376+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:39.377241+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -3> 2021-07-27T09:30:10.376+0000 7f76e093f700 10 monclient: tick
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -2> 2021-07-27T09:30:10.376+0000 7f76e093f700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2021-07-27T09:29:40.377358+0000)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -1> 2021-07-27T09:30:10.858+0000 7f76e3945700 5 mds.beacon.newbrunswick2 received beacon reply down:damaged seq 12 rtt 2.2682
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0> 2021-07-27T09:30:10.858+0000 7f76db134700 1 mds.newbrunswick2 respawn!
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: --- logging levels ---
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 none
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 1 lockdep
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 1 context
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 1 crush
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mds
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mds_balancer
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mds_locker
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mds_log
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mds_log_expire
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mds_migrator
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 1 buffer
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 1 timer
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 1 filer
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 1 striper
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 1 objecter
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 rados
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 rbd
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 rbd_mirror
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 rbd_replay
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 rbd_rwl
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 journaler
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 objectcacher
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 immutable_obj_cache
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 client
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 osd
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 optracker
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 objclass
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 3 filestore
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 3 journal
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 0 ms
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mon
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/10 monc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 paxos
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 tp
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 auth
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 crypto
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 1 finisher
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 1 reserver
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 heartbeatmap
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 perfcounter
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 rgw
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 rgw_sync
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/10 civetweb
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 javaclient
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 asok
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 1 throttle
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 0 refs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 compressor
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 bluestore
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 bluefs
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 3 bdev
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 kstore
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 4/ 5 rocksdb
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 4/ 5 leveldb
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 4/ 5 memdb
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 fuse
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mgr
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 mgrc
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 dpdk
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 eventtrace
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 1/ 5 prioritycache
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 0/ 5 test
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: -2/-2 (syslog threshold)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 99/99 (stderr threshold)
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: --- pthread ID / name mapping for recent threads ---
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76da933700 /
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76db134700 / MR_Finisher
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76dc136700 / PQ_Finisher
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76dd138700 / ms_dispatch
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76df13c700 / ceph-mds
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e013e700 / fn_anonymous
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e093f700 / safe_timer
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e1941700 / ms_dispatch
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e2142700 / signal_handler
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e2943700 / admin_socket
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e3144700 / service
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e3945700 / msgr-worker-2
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e4146700 / msgr-worker-1
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76e4947700 / msgr-worker-0
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 7f76f2792600 / ceph-mds
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: max_recent 10000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: max_new 1000
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: log_file
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: --- end dump of recent events ---
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.870+0000 7f76db134700 1 mds.newbrunswick2 e: '/usr/bin/ceph-mds'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.870+0000 7f76db134700 1 mds.newbrunswick2 0: '/usr/bin/ceph-mds'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.870+0000 7f76db134700 1 mds.newbrunswick2 1: '--cluster'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.870+0000 7f76db134700 1 mds.newbrunswick2 2: 'ceph'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.871+0000 7f76db134700 1 mds.newbrunswick2 3: '--setuser'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.871+0000 7f76db134700 1 mds.newbrunswick2 4: 'ceph'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.871+0000 7f76db134700 1 mds.newbrunswick2 5: '--setgroup'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.871+0000 7f76db134700 1 mds.newbrunswick2 6: 'ceph'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.871+0000 7f76db134700 1 mds.newbrunswick2 7: '--default-log-to-stderr=true'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.871+0000 7f76db134700 1 mds.newbrunswick2 8: '--err-to-stderr=true'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.872+0000 7f76db134700 1 mds.newbrunswick2 9: '--default-log-to-file=false'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.872+0000 7f76db134700 1 mds.newbrunswick2 10: '--foreground'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.872+0000 7f76db134700 1 mds.newbrunswick2 11: '-i'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.872+0000 7f76db134700 1 mds.newbrunswick2 12: 'newbrunswick2'
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.872+0000 7f76db134700 1 mds.newbrunswick2 respawning with exe /usr/bin/ceph-mds
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.872+0000 7f76db134700 1 mds.newbrunswick2 exe_path /proc/self/exe
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: ignoring --setuser ceph since I am not root
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: ignoring --setgroup ceph since I am not root
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: starting mds.newbrunswick2 at
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.958+0000 7fc4ff171600 0 ceph version 15.2.13 (c44bc49e7a57a87d84dfff2a077a2058aa2172e2) octopus (stable), process ceph-mds, pid 49
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.959+0000 7fc4ff171600 1 main not setting numa affinity
Jul 27 09:30:11 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:10.959+0000 7fc4ff171600 0 pidfile_write: ignore empty --pid-file
Jul 27 09:30:15 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:15.467+0000 7fc4ee533700 1 mds.newbrunswick2 Updating MDS map to version 288 from mon.2
Jul 27 09:30:16 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:16.524+0000 7fc4ee533700 1 mds.newbrunswick2 Updating MDS map to version 289 from mon.2
Jul 27 09:30:23 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:23.059+0000 7fc4ee533700 1 mds.newbrunswick2 Updating MDS map to version 290 from mon.2
Jul 27 09:30:23 newbrunswick2 container_name/ceph-mds-newbrunswick2[861]: 2021-07-27T09:30:23.063+0000 7fc4ee533700 1 mds.newbrunswick2 Monitors have assigned me to become a standby.
(1-1/12)