2022-10-02T19:18:21.667222+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112036 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:19:32.069000+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112101 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:19:32.257111+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112102 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T19:19:42.580446+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112113 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:20:59.316822+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112184 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:21:03.942049+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112189 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:22:14.582601+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112255 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:22:24.672477+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112265 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:23:35.214289+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112330 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:23:44.806448+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112339 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:24:55.374474+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112404 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:25:03.074405+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112412 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:26:13.678293+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112477 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:26:21.437678+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112485 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:27:32.143241+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112550 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:27:39.578354+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112558 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:27:39.925529+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112559 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T19:28:50.305586+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112623 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:29:01.933701+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112635 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:30:12.598454+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112700 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:30:12.967175+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112702 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T19:30:19.762756+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112709 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:31:37.347344+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112781 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:31:37.455631+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112782 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:32:47.980771+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112847 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:32:54.381414+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112854 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:34:02.030800+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112917 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:34:08.768570+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112924 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:34:10.082626+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112933 : cephadm [INF] osd.1 now down 2022-10-02T19:34:10.083191+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112934 : cephadm [INF] Removing daemon osd.1 from ceph01.domain.local -- ports [] 2022-10-02T19:34:16.767737+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112942 : cephadm [INF] Removing key for osd.1 2022-10-02T19:34:16.799865+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112943 : cephadm [INF] Successfully removed osd.1 on ceph01.domain.local 2022-10-02T19:34:16.915838+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112944 : cephadm [INF] Successfully purged osd.1 on ceph01.domain.local 2022-10-02T19:34:17.949225+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112947 : cephadm [INF] osd.2 now down 2022-10-02T19:34:17.949353+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112948 : cephadm [INF] Removing daemon osd.2 from ceph01.domain.local -- ports [] 2022-10-02T19:34:24.960147+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112956 : cephadm [INF] Removing key for osd.2 2022-10-02T19:34:25.069103+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112957 : cephadm [INF] Successfully removed osd.2 on ceph01.domain.local 2022-10-02T19:34:25.168631+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112958 : cephadm [INF] Successfully purged osd.2 on ceph01.domain.local 2022-10-02T19:34:26.194519+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112961 : cephadm [INF] osd.3 now down 2022-10-02T19:34:26.195111+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112962 : cephadm [INF] Removing daemon osd.3 from ceph01.domain.local -- ports [] 2022-10-02T19:34:32.319774+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112969 : cephadm [INF] Removing key for osd.3 2022-10-02T19:34:32.493469+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112970 : cephadm [INF] Successfully removed osd.3 on ceph01.domain.local 2022-10-02T19:34:32.596072+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112971 : cephadm [INF] Successfully purged osd.3 on ceph01.domain.local 2022-10-02T19:34:33.640854+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112975 : cephadm [INF] osd.4 now down 2022-10-02T19:34:33.641584+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112976 : cephadm [INF] Removing daemon osd.4 from ceph01.domain.local -- ports [] 2022-10-02T19:34:40.221148+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112983 : cephadm [INF] Removing key for osd.4 2022-10-02T19:34:40.794796+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112985 : cephadm [INF] Successfully removed osd.4 on ceph01.domain.local 2022-10-02T19:34:40.901852+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112986 : cephadm [INF] Successfully purged osd.4 on ceph01.domain.local 2022-10-02T19:34:41.933958+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112990 : cephadm [INF] osd.5 now down 2022-10-02T19:34:41.934165+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112991 : cephadm [INF] Removing daemon osd.5 from ceph01.domain.local -- ports [] 2022-10-02T19:34:48.893523+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 112999 : cephadm [INF] Removing key for osd.5 2022-10-02T19:34:48.933760+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113000 : cephadm [INF] Successfully removed osd.5 on ceph01.domain.local 2022-10-02T19:34:49.060259+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113001 : cephadm [INF] Successfully purged osd.5 on ceph01.domain.local 2022-10-02T19:35:06.398852+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113016 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:35:10.755187+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113020 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:36:27.714123+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113091 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:36:31.285122+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113096 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:37:47.611178+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113165 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:37:53.238783+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113171 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:37:53.402321+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113172 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T19:39:09.648442+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113243 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:39:22.153749+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113255 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:40:38.406323+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113326 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:40:38.433251+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113327 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 20181M 2022-10-02T19:40:43.497017+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113333 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:41:53.524736+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113398 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:42:00.516832+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113405 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:43:10.785516+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113469 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:43:17.361092+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113476 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:44:07.400750+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113525 : cephadm [INF] Zap device ceph01.domain.local:/dev/sdc 2022-10-02T19:44:14.049886+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113532 : cephadm [INF] zap successful for /dev/sdc on ceph01.domain.local 2022-10-02T19:44:24.179381+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113542 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:44:30.405824+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113548 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:44:30.451900+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113550 : cephadm [INF] Zap device ceph01.domain.local:/dev/sdd 2022-10-02T19:44:50.583481+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113569 : cephadm [INF] zap successful for /dev/sdd on ceph01.domain.local 2022-10-02T19:44:55.334815+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113575 : cephadm [INF] Deploying daemon osd.1 on ceph01.domain.local 2022-10-02T19:44:57.261027+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113579 : cephadm [INF] Zap device ceph01.domain.local:/dev/sde 2022-10-02T19:45:06.270581+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113588 : cephadm [INF] zap successful for /dev/sde on ceph01.domain.local 2022-10-02T19:45:11.490131+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113595 : cephadm [INF] Zap device ceph01.domain.local:/dev/sdf 2022-10-02T19:45:17.812393+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113601 : cephadm [INF] zap successful for /dev/sdf on ceph01.domain.local 2022-10-02T19:45:20.882988+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113605 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:45:20.920370+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113606 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 10090M 2022-10-02T19:45:21.015110+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113608 : cephadm [INF] Zap device ceph01.domain.local:/dev/sdg 2022-10-02T19:45:25.829068+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113614 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:45:27.361414+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113616 : cephadm [INF] zap successful for /dev/sdg on ceph01.domain.local 2022-10-02T19:46:14.018620+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113660 : cephadm [INF] Deploying daemon osd.2 on ceph01.domain.local 2022-10-02T19:46:15.625350+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113662 : cephadm [INF] Deploying daemon osd.3 on ceph01.domain.local 2022-10-02T19:46:17.095062+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113665 : cephadm [INF] Deploying daemon osd.4 on ceph01.domain.local 2022-10-02T19:46:46.404474+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113689 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:46:48.407492+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113692 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:46:48.468292+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113693 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 4036M 2022-10-02T19:47:19.709841+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113719 : cephadm [INF] Deploying daemon osd.5 on ceph01.domain.local 2022-10-02T19:47:51.077245+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113744 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:47:54.634102+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113748 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:47:54.787965+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113750 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T19:49:10.827347+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113812 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:49:10.942507+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113813 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T19:49:13.433345+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113817 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:50:35.223768+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113887 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:50:35.362274+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113888 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:51:48.077701+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113948 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:51:50.808163+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113951 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:52:18.573491+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113975 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:52:22.679757+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 113980 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:53:31.743502+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114044 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:53:36.739714+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114049 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:54:47.264485+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114115 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:54:52.261379+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114120 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:56:04.747468+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114173 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:56:08.200620+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114176 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:57:21.121437+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114223 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:57:22.862682+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114225 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:58:31.982553+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114287 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:58:32.110124+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114288 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T19:58:37.169368+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114293 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:59:46.475434+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114357 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T19:59:52.061761+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114363 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T19:59:52.311203+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114365 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T20:01:09.242914+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114429 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:01:13.624632+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114433 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:02:24.084225+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114469 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:02:29.255576+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114472 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:03:40.298687+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114509 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:03:44.564306+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114512 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:04:55.524775+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114549 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:04:59.864295+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114552 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:06:11.141893+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114588 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:06:20.023672+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114594 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:07:30.917047+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114630 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:07:35.731174+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114634 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:08:46.728949+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114670 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:08:46.885780+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114671 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T20:08:50.878810+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114674 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:10:02.078300+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114711 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:10:07.012409+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114714 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:10:07.150131+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114715 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T20:11:24.561504+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114755 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:11:28.402542+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114758 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:12:39.321867+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114794 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:12:44.188835+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114798 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:13:55.244099+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114834 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:13:59.404478+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114837 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:15:10.687943+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114874 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:15:14.918453+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114877 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:16:26.047963+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114914 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:16:30.541778+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114917 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:17:41.443460+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114953 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:17:45.967216+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114957 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:18:56.977056+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114993 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:18:57.034209+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114994 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T20:19:01.334703+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 114997 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:20:12.355329+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115034 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:20:17.244046+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115037 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:20:17.366434+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115038 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T20:21:34.563321+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115078 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:21:38.681260+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115081 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:22:49.605438+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115117 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:22:54.149247+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115121 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:24:05.151914+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115157 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:24:09.276681+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115160 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:25:20.029090+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115196 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:25:24.253330+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115200 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:26:35.320600+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115236 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:26:40.429761+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115240 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:27:51.149570+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115276 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:27:56.879884+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115280 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:29:08.200447+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115316 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:29:08.256218+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115317 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T20:29:12.920202+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115321 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:30:24.017695+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115357 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:30:28.530214+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115361 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:30:28.765545+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115362 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T20:31:45.711619+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115401 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:31:50.028749+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115404 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:33:01.116049+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115441 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:33:05.612399+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115444 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:34:16.134721+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115498 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:34:21.022994+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115504 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:35:31.473674+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115568 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:35:37.082938+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115575 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:36:48.005993+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115640 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:36:53.112734+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115646 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:38:04.237035+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115697 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:38:09.523106+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115701 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:39:20.052629+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115739 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:39:20.096213+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115740 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T20:39:25.141274+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115746 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:40:35.920386+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115811 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:40:42.297085+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115818 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:40:42.429651+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115819 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T20:41:59.000405+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115890 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:42:05.099096+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115896 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:43:16.076568+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115952 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:43:21.228551+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 115956 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:44:31.952717+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116020 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:44:36.882721+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116026 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:44:47.100611+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116036 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:44:52.503669+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116041 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:45:03.150949+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116053 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:45:08.456506+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116058 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:45:18.715338+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116068 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:45:23.724041+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116074 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:45:34.301591+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116084 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:45:39.896111+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116091 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:45:50.233571+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116101 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:45:55.319272+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116107 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:46:05.817507+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116117 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:46:14.288774+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116126 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:46:24.511537+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116136 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:46:29.587974+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116142 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:46:40.197289+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116152 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:46:46.315212+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116159 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:46:57.014651+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116170 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:47:03.214737+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116177 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:47:13.651186+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116187 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:47:21.176665+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116195 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:47:31.490940+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116205 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:47:39.685778+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116214 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:47:50.190537+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116224 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:47:55.723109+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116230 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:48:06.053179+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116240 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:48:11.653925+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116247 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:48:22.112882+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116257 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:48:27.102916+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116263 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:48:37.077280+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116273 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:48:43.009824+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116280 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:48:53.695889+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116290 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:48:58.814282+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116295 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:49:09.182710+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116306 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:49:14.512363+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116312 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:49:24.233056+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116322 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:49:24.319397+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116323 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T20:49:30.042515+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116329 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:49:40.316738+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116339 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:49:45.516834+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116345 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:49:56.002536+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116356 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:50:01.186423+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116362 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:50:11.523700+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116372 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:50:16.764999+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116377 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:50:27.303336+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116388 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:50:32.081574+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116393 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:50:42.824039+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116404 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:50:48.542418+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116410 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:50:48.608004+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116411 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T20:50:58.924785+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116421 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:51:04.470907+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116428 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:51:14.332771+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116438 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:51:20.132397+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116444 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:51:29.567240+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116454 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:51:36.043411+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116460 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:51:46.476967+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116471 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:51:52.302463+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116477 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:52:08.736565+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116493 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:52:14.047008+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116499 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:52:24.564591+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116509 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:52:29.468980+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116515 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:52:39.745836+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116526 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:52:45.047487+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116532 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:52:55.402350+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116542 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:53:00.555789+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116547 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:53:11.090900+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116558 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:53:16.497659+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116564 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:53:26.593769+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116574 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:53:32.675710+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116580 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:53:43.051420+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116591 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:53:49.184501+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116598 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:53:59.582444+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116608 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:54:04.478260+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116613 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:54:15.012097+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116624 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:54:20.506494+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116630 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:54:30.358771+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116640 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:54:36.189358+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116646 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:54:46.201938+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116656 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:54:52.002401+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116662 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:55:01.674621+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116672 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:55:07.586412+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116679 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:55:17.949587+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116689 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:55:23.357464+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116695 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:55:33.228888+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116705 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:55:39.195341+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116712 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:55:48.719165+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116721 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:55:55.339843+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116728 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:56:05.420997+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116738 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:56:14.070248+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116747 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:56:23.956628+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116757 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:56:30.306729+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116764 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:56:39.830471+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116773 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:56:46.308922+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116780 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:56:56.112173+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116790 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:57:02.482653+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116797 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:57:13.166640+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116808 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:57:19.612823+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116815 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:57:29.975118+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116825 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:57:36.265650+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116831 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:57:46.344065+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116842 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:57:51.812154+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116848 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:58:01.389152+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116858 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:58:07.830923+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116864 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:58:17.425887+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116874 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:58:23.316047+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116881 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:58:33.642977+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116891 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:58:40.378688+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116898 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:58:50.361937+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 1Unknown8 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:58:55.875162+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116914 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:59:06.084013+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116924 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:59:12.445182+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116931 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:59:22.066243+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116941 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:59:27.962189+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116947 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:59:37.970787+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116957 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:59:38.058116+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116958 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T20:59:44.005850+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116965 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T20:59:53.918527+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116975 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T20:59:59.953471+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116981 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:00:11.474668+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116993 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:00:18.186972+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 116999 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:00:27.783506+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117009 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:00:34.920219+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117016 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:00:44.781649+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117026 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:00:51.511419+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117034 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:00:51.594521+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117035 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T21:01:00.905152+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117044 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:01:07.534867+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117051 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:01:17.061194+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117060 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:01:22.833930+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117067 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:01:32.360015+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117076 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:01:39.878579+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117084 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:01:49.824144+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117094 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:01:56.366012+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117101 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:02:05.810061+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117111 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:02:12.520011+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117118 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:02:28.024531+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117133 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:02:35.052690+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117140 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:02:44.469724+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117150 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:02:51.509182+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117157 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:04:01.278491+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117221 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:04:08.109758+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117228 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:05:18.585951+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117293 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:05:24.281389+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117299 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:06:34.513852+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117364 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:06:41.612680+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117371 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:07:51.588699+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117436 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:07:58.002699+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117442 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:09:07.820635+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117506 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:09:14.087297+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117513 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:09:36.954205+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117534 : cephadm [INF] Deploying cephadm binary to ceph02.oldname.local 2022-10-02T21:09:38.677672+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117537 : cephadm [INF] Added host ceph02.oldname.local 2022-10-02T21:09:48.203349+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117547 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:09:48.611164+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117548 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-02T21:09:54.633331+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117554 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:09:55.078084+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117556 : cephadm [INF] Deploying daemon crash.ceph02 on ceph02.oldname.local 2022-10-02T21:10:23.249040+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117583 : cephadm [INF] Added label _admin to host ceph02.oldname.local 2022-10-02T21:12:15.768839+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117685 : cephadm [INF] Deploying daemon mon.ceph02 on ceph02.oldname.local 2022-10-02T21:13:51.649983+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117772 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-02T21:13:58.374522+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117779 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-02T21:13:58.437268+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 117780 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-02T22:24:30.066074+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 121569 : cephadm [INF] Saving service rgw.rgw-default spec with placement count:2 2022-10-02T22:57:06.819078+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 123326 : cephadm [INF] Added label rgw to host ceph01.domain.local 2022-10-02T22:57:19.875047+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 123338 : cephadm [INF] Added label rbd to host ceph03.domain.local 2022-10-02T22:57:58.715146+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 123375 : cephadm [INF] Saving service rgw.rgw-default spec with placement count:2;label:rgw 2022-10-03T14:24:06.219Unknown+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 172867 : cephadm [INF] Added label grafana to host ceph01.domain.local 2022-10-03T14:24:06.482990+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 172868 : cephadm [INF] Added label mds to host ceph01.domain.local 2022-10-04T11:01:49.924278+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 230962 : cephadm [ERR] host ceph02.oldname.local `cephadm ceph-volume` failed: Cannot decode JSON: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/serve.py", line 1247, in _run_cephadm_json return json.loads(''.join(out)) File "/lib64/python3.6/json/__init__.py", line 354, in loads return _default_decoder.decode(s) File "/lib64/python3.6/json/decoder.py", line 339, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/lib64/python3.6/json/decoder.py", line 357, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) 2022-10-04T11:02:27.709390+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 230982 : cephadm [INF] Updating ceph02.oldname.local:/etc/ceph/ceph.conf 2022-10-04T11:02:27.732525+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 230983 : cephadm [ERR] Unable to write ceph02.oldname.local:/etc/ceph/ceph.conf: Unable to reach remote host ceph02.oldname.local. SSH connection closed Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 143, in _execute_command r = await conn.run('sudo true', check=True, timeout=5) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3635, in run process = await self.create_process(*args, **kwargs) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3532, in create_process *args, **kwargs) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3443, in create_session window, max_pktsize) File "/lib/python3.6/site-packages/asyncssh/channel.py", line 1002, in __init__ super().__init__(conn, loop, encoding, errors, window, max_pktsize) File "/lib/python3.6/site-packages/asyncssh/channel.py", line 111, in __init__ self._recv_chan = conn.add_channel(self) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 1076, in add_channel 'SSH connection closed') asyncssh.misc.ChannelOpenError: SSH connection closed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 209, in _write_remote_file await self._check_execute_command(host, ['mkdir', '-p', dirname], addr=addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 183, in _check_execute_command out, err, code = await self._execute_command(host, cmd, stdin, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 151, in _execute_command raise OrchestratorError(f'Unable to reach remote host {host}. {str(e)}') orchestrator._interface.OrchestratorError: Unable to reach remote host ceph02.oldname.local. SSH connection closed 2022-10-04T11:02:27.735986+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 230984 : cephadm [ERR] executing refresh((['ceph01.domain.local', 'ceph03.domain.local', 'ceph02.oldname.local'],)) failed. Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 143, in _execute_command r = await conn.run('sudo true', check=True, timeout=5) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3635, in run process = await self.create_process(*args, **kwargs) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3532, in create_process *args, **kwargs) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3443, in create_session window, max_pktsize) File "/lib/python3.6/site-packages/asyncssh/channel.py", line 1002, in __init__ super().__init__(conn, loop, encoding, errors, window, max_pktsize) File "/lib/python3.6/site-packages/asyncssh/channel.py", line 111, in __init__ self._recv_chan = conn.add_channel(self) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 1076, in add_channel 'SSH connection closed') asyncssh.misc.ChannelOpenError: SSH connection closed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 209, in _write_remote_file await self._check_execute_command(host, ['mkdir', '-p', dirname], addr=addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 183, in _check_execute_command out, err, code = await self._execute_command(host, cmd, stdin, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 151, in _execute_command raise OrchestratorError(f'Unable to reach remote host {host}. {str(e)}') orchestrator._interface.OrchestratorError: Unable to reach remote host ceph02.oldname.local. SSH connection closed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/utils.py", line 78, in do_work return f(*arg) File "/usr/share/ceph/mgr/cephadm/serve.py", line 266, in refresh self._write_client_files(client_files, host) File "/usr/share/ceph/mgr/cephadm/serve.py", line 1064, in _write_client_files self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 243, in write_remote_file host, path, content, mode, uid, gid, addr)) File "/usr/share/ceph/mgr/cephadm/module.py", line 590, in wait_async return self.event_loop.get_result(coro) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result return asyncio.run_coroutine_threadsafe(coro, self._loop).result() File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result return self.__get_result() File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/ssh.py", line 231, in _write_remote_file raise OrchestratorError(msg) orchestrator._interface.OrchestratorError: Unable to write ceph02.oldname.local:/etc/ceph/ceph.conf: Unable to reach remote host ceph02.oldname.local. SSH connection closed 2022-10-04T11:02:28.599848+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 230985 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-04T11:02:29.642477+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 230987 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-07T01:59:43.933447+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 433928 : cephadm [INF] Saving service mds.mds-default spec with placement count:3 2022-10-08T20:41:10.456473+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 571508 : cephadm [INF] Upgrade: Started with target quay.io/ceph/ceph:v17.2.4 2022-10-09T00:03:51.821500+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 587419 : cephadm [ERR] check-host failed for 'ceph02.domain.local' Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/module.py", line 1042, in check_host error_ok=True, no_fsid=True)) File "/usr/share/ceph/mgr/cephadm/module.py", line 590, in wait_async return self.event_loop.get_result(coro) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result return asyncio.run_coroutine_threadsafe(coro, self._loop).result() File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result return self.__get_result() File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/serve.py", line 1273, in _run_cephadm await self.mgr.ssh._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 66, in _remote_connection raise OrchestratorError("host address is empty") orchestrator._interface.OrchestratorError: host address is empty 2022-10-09T00:52:53.678083+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 590222 : cephadm [INF] Upgrade: Stopped 2022-10-09T00:55:35.879186+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 59Unknown4 : cephadm [INF] Upgrade: Started with target quay.io/ceph/ceph:v17.2.4 2022-10-09T01:08:20.542854+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 590839 : cephadm [INF] Saving service mgr spec with placement count:3 2022-10-09T01:08:36.029601+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 590847 : cephadm [INF] Saving service rgw.rgw-default spec with placement count:3;label:rgw 2022-10-10T16:20:37.170537+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 684094 : cephadm [INF] Schedule restart daemon osd.6 2022-10-10T23:26:13.282698+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 696862 : cephadm [INF] Schedule restart daemon grafana.ceph01 2022-10-11T01:53:59.600894+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 701302 : cephadm [INF] Added label _no_schedule to host ceph02.oldname.local 2022-10-11T02:03:05.419054+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 701580 : cephadm [INF] Upgrade: Stopped 2022-10-11T02:03:16.722040+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 701588 : cephadm [INF] Upgrade: Started with target quay.io/ceph/ceph:v17.2.4 2022-10-11T02:11:11.273377+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 701828 : cephadm [INF] Removed label _no_schedule to host ceph02.oldname.local 2022-10-11T02:11:47.635081+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 701849 : cephadm [INF] Upgrade: Stopped 2022-10-11T02:11:49.260681+0000 mgr.ceph01.domain.local.miydsy (mgr.14186) 701852 : cephadm [INF] Upgrade: Started with target quay.io/ceph/ceph:v17.2.4 2022-10-11T03:40:13.665860+0000 mgr.ceph03.haayqy (mgr.5537070) 1 : cephadm [INF] [11/Oct/2022:03:40:13] ENGINE Bus STARTING 2022-10-11T03:40:13.815572+0000 mgr.ceph03.haayqy (mgr.5537070) 2 : cephadm [INF] [11/Oct/2022:03:40:13] ENGINE Serving on https://192.168.10.80:7150 2022-10-11T03:40:13.816288+0000 mgr.ceph03.haayqy (mgr.5537070) 3 : cephadm [INF] [11/Oct/2022:03:40:13] ENGINE Bus STARTED 2022-10-11T03:40:19.616708+0000 mgr.ceph03.haayqy (mgr.5537070) 8 : cephadm [ERR] Can't communicate with remote host `192.168.10.210`, possibly because python3 is not installed there. [Errno 113] Connect call failed ('192.168.10.210', 22) Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 103, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 82, in _remote_connection preferred_auth=['publickey'], options=ssh_options) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 6804, in connect 'Opening SSH connection to') File "/lib/python3.6/site-packages/asyncssh/connection.py", line 299, in _connect local_addr=local_addr) File "/lib64/python3.6/asyncio/base_events.py", line 794, in create_connection raise exceptions[0] File "/lib64/python3.6/asyncio/base_events.py", line 781, in create_connection yield from self.sock_connect(sock, address) File "/lib64/python3.6/asyncio/selector_events.py", line 439, in sock_connect return (yield from fut) File "/lib64/python3.6/asyncio/selector_events.py", line 469, in _sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) OSError: [Errno 113] Connect call failed ('192.168.10.210', 22) 2022-10-11T03:40:19.617779+0000 mgr.ceph03.haayqy (mgr.5537070) 9 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-11T03:40:22.381215+0000 mgr.ceph03.haayqy (mgr.5537070) 11 : cephadm [ERR] Can't communicate with remote host `192.168.10.210`, possibly because python3 is not installed there. [Errno 113] Connect call failed ('192.168.10.210', 22) Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 103, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 82, in _remote_connection preferred_auth=['publickey'], options=ssh_options) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 6804, in connect 'Opening SSH connection to') File "/lib/python3.6/site-packages/asyncssh/connection.py", line 299, in _connect local_addr=local_addr) File "/lib64/python3.6/asyncio/base_events.py", line 794, in create_connection raise exceptions[0] File "/lib64/python3.6/asyncio/base_events.py", line 781, in create_connection yield from self.sock_connect(sock, address) File "/lib64/python3.6/asyncio/selector_events.py", line 439, in sock_connect return (yield from fut) File "/lib64/python3.6/asyncio/selector_events.py", line 469, in _sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) OSError: [Errno 113] Connect call failed ('192.168.10.210', 22) 2022-10-11T03:40:22.39Unknown+0000 mgr.ceph03.haayqy (mgr.5537070) 12 : cephadm [ERR] Unable to write ceph01.domain.local:/etc/ceph/ceph.conf: Can't communicate with remote host `192.168.10.210`, possibly because python3 is not installed there. [Errno 113] Connect call failed ('192.168.10.210', 22) Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 103, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 82, in _remote_connection preferred_auth=['publickey'], options=ssh_options) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 6804, in connect 'Opening SSH connection to') File "/lib/python3.6/site-packages/asyncssh/connection.py", line 299, in _connect local_addr=local_addr) File "/lib64/python3.6/asyncio/base_events.py", line 794, in create_connection raise exceptions[0] File "/lib64/python3.6/asyncio/base_events.py", line 781, in create_connection yield from self.sock_connect(sock, address) File "/lib64/python3.6/asyncio/selector_events.py", line 439, in sock_connect return (yield from fut) File "/lib64/python3.6/asyncio/selector_events.py", line 469, in _sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) OSError: [Errno 113] Connect call failed ('192.168.10.210', 22) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 209, in _write_remote_file await self._check_execute_command(host, ['mkdir', '-p', dirname], addr=addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 183, in _check_execute_command out, err, code = await self._execute_command(host, cmd, stdin, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 138, in _execute_command conn = await self._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 88, in _remote_connection raise File "/lib64/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 109, in redirect_log raise OrchestratorError(msg) orchestrator._interface.OrchestratorError: Can't communicate with remote host `192.168.10.210`, possibly because python3 is not installed there. [Errno 113] Connect call failed ('192.168.10.210', 22) 2022-10-11T03:40:22.400502+0000 mgr.ceph03.haayqy (mgr.5537070) 13 : cephadm [ERR] executing refresh((['ceph03.domain.local', 'ceph01.domain.local', 'ceph02.oldname.local'],)) failed. Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 103, in redirect_log yield File "/usr/share/ceph/mgr/cephadm/ssh.py", line 82, in _remote_connection preferred_auth=['publickey'], options=ssh_options) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 6804, in connect 'Opening SSH connection to') File "/lib/python3.6/site-packages/asyncssh/connection.py", line 299, in _connect local_addr=local_addr) File "/lib64/python3.6/asyncio/base_events.py", line 794, in create_connection raise exceptions[0] File "/lib64/python3.6/asyncio/base_events.py", line 781, in create_connection yield from self.sock_connect(sock, address) File "/lib64/python3.6/asyncio/selector_events.py", line 439, in sock_connect return (yield from fut) File "/lib64/python3.6/asyncio/selector_events.py", line 469, in _sock_connect_cb raise OSError(err, 'Connect call failed %s' % (address,)) OSError: [Errno 113] Connect call failed ('192.168.10.210', 22) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 209, in _write_remote_file await self._check_execute_command(host, ['mkdir', '-p', dirname], addr=addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 183, in _check_execute_command out, err, code = await self._execute_command(host, cmd, stdin, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 138, in _execute_command conn = await self._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 88, in _remote_connection raise File "/lib64/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 109, in redirect_log raise OrchestratorError(msg) orchestrator._interface.OrchestratorError: Can't communicate with remote host `192.168.10.210`, possibly because python3 is not installed there. [Errno 113] Connect call failed ('192.168.10.210', 22) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/utils.py", line 78, in do_work return f(*arg) File "/usr/share/ceph/mgr/cephadm/serve.py", line 266, in refresh self._write_client_files(client_files, host) File "/usr/share/ceph/mgr/cephadm/serve.py", line 1064, in _write_client_files self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 243, in write_remote_file host, path, content, mode, uid, gid, addr)) File "/usr/share/ceph/mgr/cephadm/module.py", line 590, in wait_async return self.event_loop.get_result(coro) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result return asyncio.run_coroutine_threadsafe(coro, self._loop).result() File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result return self.__get_result() File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/ssh.py", line 231, in _write_remote_file raise OrchestratorError(msg) orchestrator._interface.OrchestratorError: Unable to write ceph01.domain.local:/etc/ceph/ceph.conf: Can't communicate with remote host `192.168.10.210`, possibly because python3 is not installed there. [Errno 113] Connect call failed ('192.168.10.210', 22) 2022-10-11T03:40:42.750318+0000 mgr.ceph03.haayqy (mgr.5537070) 24 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-11T03:40:42.919482+0000 mgr.ceph03.haayqy (mgr.5537070) 26 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-11T04:10:01.525401+0000 mgr.ceph03.haayqy (mgr.5537070) 908 : cephadm [INF] Upgrade: Stopped 2022-10-11T04:10:17.231082+0000 mgr.ceph03.haayqy (mgr.5537070) 917 : cephadm [INF] Upgrade: Started with target quay.io/ceph/ceph:v17.2.4 2022-10-11T04:23:59.481304+0000 mgr.ceph03.haayqy (mgr.5537070) 1331 : cephadm [ERR] check-host failed for '192.168.10.210' Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/module.py", line 1042, in check_host error_ok=True, no_fsid=True)) File "/usr/share/ceph/mgr/cephadm/module.py", line 590, in wait_async return self.event_loop.get_result(coro) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result return asyncio.run_coroutine_threadsafe(coro, self._loop).result() File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result return self.__get_result() File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/serve.py", line 1273, in _run_cephadm await self.mgr.ssh._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 66, in _remote_connection raise OrchestratorError("host address is empty") orchestrator._interface.OrchestratorError: host address is empty 2022-10-11T04:24:02.845383+0000 mgr.ceph03.haayqy (mgr.5537070) 1335 : cephadm [ERR] check-host failed for 'ls' Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/module.py", line 1042, in check_host error_ok=True, no_fsid=True)) File "/usr/share/ceph/mgr/cephadm/module.py", line 590, in wait_async return self.event_loop.get_result(coro) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result return asyncio.run_coroutine_threadsafe(coro, self._loop).result() File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result return self.__get_result() File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/serve.py", line 1273, in _run_cephadm await self.mgr.ssh._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 66, in _remote_connection raise OrchestratorError("host address is empty") orchestrator._interface.OrchestratorError: host address is empty 2022-10-14T15:38:57.517067+0000 mgr.ceph03.haayqy (mgr.5537070) 153461 : cephadm [INF] Upgrade: Stopped 2022-10-14T15:39:06.095974+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 1 : cephadm [INF] [14/Oct/2022:15:39:06] ENGINE Bus STARTING 2022-10-14T15:39:06.210090+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 2 : cephadm [INF] [14/Oct/2022:15:39:06] ENGINE Serving on https://192.168.10.210:7150 2022-10-14T15:39:06.210163+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 3 : cephadm [INF] [14/Oct/2022:15:39:06] ENGINE Bus STARTED 2022-10-14T15:39:26.176368+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 23 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-14T15:39:26.934146+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 24 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-14T15:39:26.937829+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 25 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-14T15:39:27.166617+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 26 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-14T15:39:27.270893+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 27 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.client.admin.keyring 2022-10-14T15:39:27.378633+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 29 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring 2022-10-14T15:39:27.402792+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 31 : cephadm [INF] Upgrade: Started with target quay.io/ceph/ceph:v17.2.4 2022-10-14T15:39:50.278265+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 53 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-14T15:39:50.415266+0000 mgr.ceph01.domain.local.miydsy (mgr.5550448) 54 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-16T16:22:25.401531+0000 mgr.ceph03.haayqy (mgr.5821063) 48 : cephadm [INF] [16/Oct/2022:16:22:25] ENGINE Bus STARTING 2022-10-16T16:22:38.268661+0000 mgr.ceph03.haayqy (mgr.5821063) 60 : cephadm [INF] [16/Oct/2022:16:22:38] ENGINE Serving on https://192.168.10.80:7150 2022-10-16T16:22:38.285905+0000 mgr.ceph03.haayqy (mgr.5821063) 61 : cephadm [INF] [16/Oct/2022:16:22:38] ENGINE Bus STARTED 2022-10-16T16:23:43.891219+0000 mgr.ceph03.haayqy (mgr.5821063) 121 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-16T16:23:45.510284+0000 mgr.ceph03.haayqy (mgr.5821063) 123 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-16T16:23:45.513667+0000 mgr.ceph03.haayqy (mgr.5821063) 124 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-16T16:23:48.481970+0000 mgr.ceph03.haayqy (mgr.5821063) 127 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-16T16:23:48.810454+0000 mgr.ceph03.haayqy (mgr.5821063) 129 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.client.admin.keyring 2022-10-16T16:23:49.116113+0000 mgr.ceph03.haayqy (mgr.5821063) 130 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring 2022-10-16T16:24:28.302882+0000 mgr.ceph03.haayqy (mgr.5821063) 167 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-16T16:24:28.390903+0000 mgr.ceph03.haayqy (mgr.5821063) 168 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-16T16:44:57.093227+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 1 : cephadm [INF] [16/Oct/2022:16:44:57] ENGINE Bus STARTING 2022-10-16T16:44:57.239599+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 2 : cephadm [INF] [16/Oct/2022:16:44:57] ENGINE Serving on https://192.168.10.210:7150 2022-10-16T16:44:57.239683+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 3 : cephadm [INF] [16/Oct/2022:16:44:57] ENGINE Bus STARTED 2022-10-16T16:45:07.247095+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 14 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-16T16:45:07.247956+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 15 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-16T16:45:07.616912+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 16 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-16T16:45:07.865201+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 17 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.client.admin.keyring 2022-10-16T16:45:08.076844+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 18 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring 2022-10-16T16:45:15.643085+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 25 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-19T18:14:02.219816+0000 mgr.ceph01.domain.local.miydsy (mgr.7540740) 233582 : cephadm [ERR] check-host failed for 'ceph01.oldname.local' Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/module.py", line 1042, in check_host error_ok=True, no_fsid=True)) File "/usr/share/ceph/mgr/cephadm/module.py", line 590, in wait_async return self.event_loop.get_result(coro) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result return asyncio.run_coroutine_threadsafe(coro, self._loop).result() File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result return self.__get_result() File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/serve.py", line 1273, in _run_cephadm await self.mgr.ssh._remote_connection(host, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 66, in _remote_connection raise OrchestratorError("host address is empty") orchestrator._interface.OrchestratorError: host address is empty 2022-10-21T18:53:27.773631+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 1 : cephadm [INF] [21/Oct/2022:18:53:27] ENGINE Bus STARTING 2022-10-21T18:53:27.886181+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 2 : cephadm [INF] [21/Oct/2022:18:53:27] ENGINE Serving on https://192.168.10.210:7150 2022-10-21T18:53:27.886463+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 3 : cephadm [INF] [21/Oct/2022:18:53:27] ENGINE Bus STARTED 2022-10-21T18:53:45.399678+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 14 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-21T18:53:45.681227+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 15 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-21T18:53:45.783318+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 16 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-21T18:53:45.884616+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 17 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.client.admin.keyring 2022-10-21T18:53:45.984772+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 18 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring 2022-10-21T18:54:19.272747+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 36 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-21T18:54:19.343528+0000 mgr.ceph01.domain.local.miydsy (mgr.8880020) 37 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-21T19:43:34.350671+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 1 : cephadm [INF] [21/Oct/2022:19:43:34] ENGINE Bus STARTING 2022-10-21T19:43:34.462890+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 2 : cephadm [INF] [21/Oct/2022:19:43:34] ENGINE Serving on https://192.168.10.210:7150 2022-10-21T19:43:34.463124+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 3 : cephadm [INF] [21/Oct/2022:19:43:34] ENGINE Bus STARTED 2022-10-21T19:43:50.102086+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 13 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-21T19:43:50.184843+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 14 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 3363M 2022-10-21T19:43:50.186086+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 15 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-21T19:43:50.290258+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 16 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-21T19:43:50.392595+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 17 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.client.admin.keyring 2022-10-21T19:43:50.491166+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 18 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring 2022-10-21T19:44:11.714333+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 29 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-21T19:44:11.942991+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 31 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-21T19:48:42.257620+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 200 : cephadm [INF] Marking host: ceph01.domain.local for OSDSpec preview refresh. 2022-10-21T19:48:42.257814+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 201 : cephadm [INF] Saving service osd.dashboard-admin-1666381718250 spec with placement ceph01.domain.local 2022-10-21T19:57:19.459262+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 465 : cephadm [INF] Deploying daemon osd.11 on ceph01.domain.local 2022-10-21T22:45:14.884185+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8661 : cephadm [DBG] mgr option ssh_config_file = None 2022-10-21T22:45:14.884260+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8662 : cephadm [DBG] mgr option device_cache_timeout = 1800 2022-10-21T22:45:14.884307+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8663 : cephadm [DBG] mgr option device_enhanced_scan = False 2022-10-21T22:45:14.884350+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8664 : cephadm [DBG] mgr option daemon_cache_timeout = 600 2022-10-21T22:45:14.884392+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8665 : cephadm [DBG] mgr option facts_cache_timeout = 60 2022-10-21T22:45:14.884434+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8666 : cephadm [DBG] mgr option host_check_interval = 600 2022-10-21T22:45:14.884474+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8667 : cephadm [DBG] mgr option mode = root 2022-10-21T22:45:14.884516+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8668 : cephadm [DBG] mgr option container_image_base = quay.io/ceph/ceph 2022-10-21T22:45:14.884557+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8669 : cephadm [DBG] mgr option container_image_prometheus = quay.io/prometheus/prometheus:v2.33.4 2022-10-21T22:45:14.884597+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8670 : cephadm [DBG] mgr option container_image_grafana = quay.io/ceph/ceph-grafana:8.3.5 2022-10-21T22:45:14.884636+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8671 : cephadm [DBG] mgr option container_image_alertmanager = quay.io/prometheus/alertmanager:v0.23.0 2022-10-21T22:45:14.884675+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8672 : cephadm [DBG] mgr option container_image_node_exporter = quay.io/prometheus/node-exporter:v1.3.1 2022-10-21T22:45:14.884714+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8673 : cephadm [DBG] mgr option container_image_loki = docker.io/grafana/loki:2.4.0 2022-10-21T22:45:14.884753+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8674 : cephadm [DBG] mgr option container_image_promtail = docker.io/grafana/promtail:2.4.0 2022-10-21T22:45:14.884793+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8675 : cephadm [DBG] mgr option container_image_haproxy = docker.io/library/haproxy:2.3 2022-10-21T22:45:14.884832+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8676 : cephadm [DBG] mgr option container_image_keepalived = docker.io/arcts/keepalived 2022-10-21T22:45:14.884871+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8677 : cephadm [DBG] mgr option container_image_snmp_gateway = docker.io/maxwo/snmp-notifier:v1.2.1 2022-10-21T22:45:14.884911+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8678 : cephadm [DBG] mgr option warn_on_stray_hosts = True 2022-10-21T22:45:14.884950+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8679 : cephadm [DBG] mgr option warn_on_stray_daemons = True 2022-10-21T22:45:14.884989+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8680 : cephadm [DBG] mgr option warn_on_failed_host_check = True 2022-10-21T22:45:14.885028+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8681 : cephadm [DBG] mgr option log_to_cluster = True 2022-10-21T22:45:14.885066+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8682 : cephadm [DBG] mgr option allow_ptrace = False 2022-10-21T22:45:14.885108+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8683 : cephadm [DBG] mgr option container_init = True 2022-10-21T22:45:14.885149+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8684 : cephadm [DBG] mgr option prometheus_alerts_path = /etc/prometheus/ceph/ceph_default_alerts.yml 2022-10-21T22:45:14.885190+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8685 : cephadm [DBG] mgr option migration_current = 5 2022-10-21T22:45:14.885230+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8686 : cephadm [DBG] mgr option config_dashboard = True 2022-10-21T22:45:14.885270+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8687 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf = False 2022-10-21T22:45:14.885309+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8688 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf_hosts = * 2022-10-21T22:45:14.885349+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8689 : cephadm [DBG] mgr option registry_url = None 2022-10-21T22:45:14.885389+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8690 : cephadm [DBG] mgr option registry_username = None 2022-10-21T22:45:14.885428+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8691 : cephadm [DBG] mgr option registry_password = None 2022-10-21T22:45:14.885467+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8692 : cephadm [DBG] mgr option registry_insecure = False 2022-10-21T22:45:14.885506+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8693 : cephadm [DBG] mgr option use_repo_digest = True 2022-10-21T22:45:14.885545+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8694 : cephadm [DBG] mgr option config_checks_enabled = False 2022-10-21T22:45:14.885588+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8695 : cephadm [DBG] mgr option default_registry = docker.io 2022-10-21T22:45:14.885629+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8696 : cephadm [DBG] mgr option max_count_per_host = 10 2022-10-21T22:45:14.885673+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8697 : cephadm [DBG] mgr option autotune_memory_target_ratio = 0.7 2022-10-21T22:45:14.885715+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8698 : cephadm [DBG] mgr option autotune_interval = 600 2022-10-21T22:45:14.885756+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8699 : cephadm [DBG] mgr option use_agent = False 2022-10-21T22:45:14.885795+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8700 : cephadm [DBG] mgr option agent_refresh_rate = 20 2022-10-21T22:45:14.885834+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8701 : cephadm [DBG] mgr option agent_starting_port = 4721 2022-10-21T22:45:14.885875+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8702 : cephadm [DBG] mgr option agent_down_multiplier = 3.0 2022-10-21T22:45:14.885915+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8703 : cephadm [DBG] mgr option max_osd_draining_count = 10 2022-10-21T22:45:14.885955+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8704 : cephadm [DBG] mgr option log_level = 2022-10-21T22:45:14.885995+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8705 : cephadm [DBG] mgr option log_to_file = False 2022-10-21T22:45:14.886036+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 8706 : cephadm [DBG] mgr option log_to_cluster_level = debug 2022-10-21T22:51:09.306208+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 9031 : cephadm [INF] Upgrade: Stopped 2022-10-21T22:51:26.531006+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 9050 : cephadm [INF] Upgrade: Started with target quay.io/ceph/ceph:v17.2.4 2022-10-22T16:54:52.007172+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69277 : cephadm [DBG] mgr option ssh_config_file = None 2022-10-22T16:54:52.007241+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69278 : cephadm [DBG] mgr option device_cache_timeout = 1800 2022-10-22T16:54:52.007289+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69279 : cephadm [DBG] mgr option device_enhanced_scan = False 2022-10-22T16:54:52.007332+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69280 : cephadm [DBG] mgr option daemon_cache_timeout = 600 2022-10-22T16:54:52.007549+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69281 : cephadm [DBG] mgr option facts_cache_timeout = 60 2022-10-22T16:54:52.007604+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69282 : cephadm [DBG] mgr option host_check_interval = 600 2022-10-22T16:54:52.007824+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69283 : cephadm [DBG] mgr option mode = root 2022-10-22T16:54:52.008242+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69284 : cephadm [DBG] mgr option container_image_base = quay.io/ceph/ceph 2022-10-22T16:54:52.008303+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69285 : cephadm [DBG] mgr option container_image_prometheus = quay.io/prometheus/prometheus:v2.33.4 2022-10-22T16:54:52.008558+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69286 : cephadm [DBG] mgr option container_image_grafana = quay.io/ceph/ceph-grafana:8.3.5 2022-10-22T16:54:52.008614+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69287 : cephadm [DBG] mgr option container_image_alertmanager = quay.io/prometheus/alertmanager:v0.23.0 2022-10-22T16:54:52.008658+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69288 : cephadm [DBG] mgr option container_image_node_exporter = quay.io/prometheus/node-exporter:v1.3.1 2022-10-22T16:54:52.008700+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69289 : cephadm [DBG] mgr option container_image_loki = docker.io/grafana/loki:2.4.0 2022-10-22T16:54:52.008948+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69290 : cephadm [DBG] mgr option container_image_promtail = docker.io/grafana/promtail:2.4.0 2022-10-22T16:54:52.008996+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69291 : cephadm [DBG] mgr option container_image_haproxy = docker.io/library/haproxy:2.3 2022-10-22T16:54:52.009041+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69292 : cephadm [DBG] mgr option container_image_keepalived = docker.io/arcts/keepalived 2022-10-22T16:54:52.009081+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69293 : cephadm [DBG] mgr option container_image_snmp_gateway = docker.io/maxwo/snmp-notifier:v1.2.1 2022-10-22T16:54:52.009121+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69294 : cephadm [DBG] mgr option warn_on_stray_hosts = True 2022-10-22T16:54:52.009163+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69295 : cephadm [DBG] mgr option warn_on_stray_daemons = True 2022-10-22T16:54:52.009201+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69296 : cephadm [DBG] mgr option warn_on_failed_host_check = True 2022-10-22T16:54:52.009240+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69297 : cephadm [DBG] mgr option log_to_cluster = True 2022-10-22T16:54:52.009655+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69298 : cephadm [DBG] mgr option allow_ptrace = False 2022-10-22T16:54:52.010154+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69299 : cephadm [DBG] mgr option container_init = True 2022-10-22T16:54:52.010419+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69300 : cephadm [DBG] mgr option prometheus_alerts_path = /etc/prometheus/ceph/ceph_default_alerts.yml 2022-10-22T16:54:52.010476+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69301 : cephadm [DBG] mgr option migration_current = 5 2022-10-22T16:54:52.010520+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69302 : cephadm [DBG] mgr option config_dashboard = True 2022-10-22T16:54:52.010561+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69303 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf = False 2022-10-22T16:54:52.010602+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69304 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf_hosts = * 2022-10-22T16:54:52.010642+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69305 : cephadm [DBG] mgr option registry_url = None 2022-10-22T16:54:52.010681+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69306 : cephadm [DBG] mgr option registry_username = None 2022-10-22T16:54:52.010973+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69307 : cephadm [DBG] mgr option registry_password = None 2022-10-22T16:54:52.011033+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69308 : cephadm [DBG] mgr option registry_insecure = False 2022-10-22T16:54:52.011252+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69309 : cephadm [DBG] mgr option use_repo_digest = True 2022-10-22T16:54:52.011308+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69310 : cephadm [DBG] mgr option config_checks_enabled = False 2022-10-22T16:54:52.011543+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69311 : cephadm [DBG] mgr option default_registry = docker.io 2022-10-22T16:54:52.011599+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69312 : cephadm [DBG] mgr option max_count_per_host = 10 2022-10-22T16:54:52.011648+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69313 : cephadm [DBG] mgr option autotune_memory_target_ratio = 0.7 2022-10-22T16:54:52.01Unknown+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69314 : cephadm [DBG] mgr option autotune_interval = 600 2022-10-22T16:54:52.011733+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69315 : cephadm [DBG] mgr option use_agent = False 2022-10-22T16:54:52.011778+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69316 : cephadm [DBG] mgr option agent_refresh_rate = 20 2022-10-22T16:54:52.011820+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69317 : cephadm [DBG] mgr option agent_starting_port = 4721 2022-10-22T16:54:52.011865+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69318 : cephadm [DBG] mgr option agent_down_multiplier = 3.0 2022-10-22T16:54:52.0Unknown6+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69319 : cephadm [DBG] mgr option max_osd_draining_count = 10 2022-10-22T16:54:52.011952+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69320 : cephadm [DBG] mgr option log_level = 2022-10-22T16:54:52.011993+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69321 : cephadm [DBG] mgr option log_to_file = False 2022-10-22T16:54:52.012212+0000 mgr.ceph01.domain.local.miydsy (mgr.8880077) 69322 : cephadm [DBG] mgr option log_to_cluster_level = debug 2022-10-24T20:33:19.115620+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 1 : cephadm [DBG] setting log level based on debug_mgr: INFO (2/5) 2022-10-24T20:33:19.120549+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 2 : cephadm [DBG] mgr option ssh_config_file = None 2022-10-24T20:33:19.120596+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 3 : cephadm [DBG] mgr option device_cache_timeout = 1800 2022-10-24T20:33:19.120637+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 4 : cephadm [DBG] mgr option device_enhanced_scan = False 2022-10-24T20:33:19.120701+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 5 : cephadm [DBG] mgr option daemon_cache_timeout = 600 2022-10-24T20:33:19.120752+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 6 : cephadm [DBG] mgr option facts_cache_timeout = 60 2022-10-24T20:33:19.120816+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 7 : cephadm [DBG] mgr option host_check_interval = 600 2022-10-24T20:33:19.120885+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 8 : cephadm [DBG] mgr option mode = root 2022-10-24T20:33:19.120923+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 9 : cephadm [DBG] mgr option container_image_base = quay.io/ceph/ceph 2022-10-24T20:33:19.120981+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 10 : cephadm [DBG] mgr option container_image_prometheus = quay.io/prometheus/prometheus:v2.33.4 2022-10-24T20:33:19.121038+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 11 : cephadm [DBG] mgr option container_image_grafana = quay.io/ceph/ceph-grafana:8.3.5 2022-10-24T20:33:19.121074+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 12 : cephadm [DBG] mgr option container_image_alertmanager = quay.io/prometheus/alertmanager:v0.23.0 2022-10-24T20:33:19.121110+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 13 : cephadm [DBG] mgr option container_image_node_exporter = quay.io/prometheus/node-exporter:v1.3.1 2022-10-24T20:33:19.121146+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 14 : cephadm [DBG] mgr option container_image_loki = docker.io/grafana/loki:2.4.0 2022-10-24T20:33:19.121182+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 15 : cephadm [DBG] mgr option container_image_promtail = docker.io/grafana/promtail:2.4.0 2022-10-24T20:33:19.121217+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 16 : cephadm [DBG] mgr option container_image_haproxy = docker.io/library/haproxy:2.3 2022-10-24T20:33:19.121253+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 17 : cephadm [DBG] mgr option container_image_keepalived = docker.io/arcts/keepalived 2022-10-24T20:33:19.121287+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 18 : cephadm [DBG] mgr option container_image_snmp_gateway = docker.io/maxwo/snmp-notifier:v1.2.1 2022-10-24T20:33:19.121322+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 19 : cephadm [DBG] mgr option warn_on_stray_hosts = True 2022-10-24T20:33:19.121373+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 20 : cephadm [DBG] mgr option warn_on_stray_daemons = True 2022-10-24T20:33:19.121426+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 21 : cephadm [DBG] mgr option warn_on_failed_host_check = True 2022-10-24T20:33:19.121461+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 22 : cephadm [DBG] mgr option log_to_cluster = True 2022-10-24T20:33:19.121498+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 23 : cephadm [DBG] mgr option allow_ptrace = False 2022-10-24T20:33:19.121551+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 24 : cephadm [DBG] mgr option container_init = True 2022-10-24T20:33:19.121606+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 25 : cephadm [DBG] mgr option prometheus_alerts_path = /etc/prometheus/ceph/ceph_default_alerts.yml 2022-10-24T20:33:19.121658+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 26 : cephadm [DBG] mgr option migration_current = 5 2022-10-24T20:33:19.121712+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 27 : cephadm [DBG] mgr option config_dashboard = True 2022-10-24T20:33:19.121748+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 28 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf = False 2022-10-24T20:33:19.121783+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 29 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf_hosts = * 2022-10-24T20:33:19.121818+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 30 : cephadm [DBG] mgr option registry_url = None 2022-10-24T20:33:19.121852+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 31 : cephadm [DBG] mgr option registry_username = None 2022-10-24T20:33:19.121887+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 32 : cephadm [DBG] mgr option registry_password = None 2022-10-24T20:33:19.121922+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 33 : cephadm [DBG] mgr option registry_insecure = False 2022-10-24T20:33:19.121957+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 34 : cephadm [DBG] mgr option use_repo_digest = True 2022-10-24T20:33:19.121992+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 35 : cephadm [DBG] mgr option config_checks_enabled = False 2022-10-24T20:33:19.122027+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 36 : cephadm [DBG] mgr option default_registry = docker.io 2022-10-24T20:33:19.122063+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 37 : cephadm [DBG] mgr option max_count_per_host = 10 2022-10-24T20:33:19.122099+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 38 : cephadm [DBG] mgr option autotune_memory_target_ratio = 0.7 2022-10-24T20:33:19.122135+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 39 : cephadm [DBG] mgr option autotune_interval = 600 2022-10-24T20:33:19.122179+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 40 : cephadm [DBG] mgr option use_agent = False 2022-10-24T20:33:19.122215+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 41 : cephadm [DBG] mgr option agent_refresh_rate = 20 2022-10-24T20:33:19.122251+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 42 : cephadm [DBG] mgr option agent_starting_port = 4721 2022-10-24T20:33:19.122286+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 43 : cephadm [DBG] mgr option agent_down_multiplier = 3.0 2022-10-24T20:33:19.122320+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 44 : cephadm [DBG] mgr option max_osd_draining_count = 10 2022-10-24T20:33:19.122355+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 45 : cephadm [DBG] mgr option log_level = 2022-10-24T20:33:19.122389+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 46 : cephadm [DBG] mgr option log_to_file = False 2022-10-24T20:33:19.122426+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 47 : cephadm [DBG] mgr option log_to_cluster_level = debug 2022-10-24T20:33:19.129291+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 48 : cephadm [DBG] Loaded inventory {'ceph01.domain.local': {'hostname': 'ceph01.domain.local', 'addr': '192.168.10.210', 'labels': ['_admin', 'rgw', 'grafana', 'mds'], 'status': ''}, 'ceph03.domain.local': {'hostname': 'ceph03.domain.local', 'addr': '192.168.10.80', 'labels': ['rbd'], 'status': ''}, 'ceph02.oldname.local': {'hostname': 'ceph02.oldname.local', 'addr': '192.168.10.51', 'labels': ['mon', 'mgr', 'mds', '_admin'], 'status': ''}} 2022-10-24T20:33:19.131380+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 49 : cephadm [DBG] HostCache.load: host ceph03.domain.local has 11 daemons, 8 devices, 4 networks 2022-10-24T20:33:19.133778+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 50 : cephadm [DBG] HostCache.load: host ceph01.domain.local has 15 daemons, 10 devices, 4 networks 2022-10-24T20:33:19.134261+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 51 : cephadm [DBG] HostCache.load: host ceph02.oldname.local has 3 daemons, 0 devices, 7 networks 2022-10-24T20:33:19.134495+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 52 : cephadm [DBG] SpecStore: loaded spec for alertmanager 2022-10-24T20:33:19.134608+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 53 : cephadm [DBG] SpecStore: loaded spec for crash 2022-10-24T20:33:19.134720+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 54 : cephadm [DBG] SpecStore: loaded spec for grafana 2022-10-24T20:33:19.134984+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 55 : cephadm [DBG] SpecStore: loaded spec for mds.mds-default 2022-10-24T20:33:19.135160+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 56 : cephadm [DBG] SpecStore: loaded spec for mgr 2022-10-24T20:33:19.135301+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 57 : cephadm [DBG] SpecStore: loaded spec for mon 2022-10-24T20:33:19.135408+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 58 : cephadm [DBG] SpecStore: loaded spec for node-exporter 2022-10-24T20:33:19.135689+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 59 : cephadm [DBG] SpecStore: loaded spec for osd.all-available-devices 2022-10-24T20:33:19.135845+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 60 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664591400232 2022-10-24T20:33:19.136020+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 61 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664591518471 2022-10-24T20:33:19.136161+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 62 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664593093131 2022-10-24T20:33:19.136300+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 63 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664664Unknown04 2022-10-24T20:33:19.136515+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 64 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1666381718250 2022-10-24T20:33:19.136651+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 65 : cephadm [DBG] SpecStore: loaded spec for prometheus 2022-10-24T20:33:19.136769+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 66 : cephadm [DBG] SpecStore: loaded spec for rgw.rgw-default 2022-10-24T20:33:19.137177+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 67 : cephadm [DBG] config_checks match module definition 2022-10-24T20:33:19.138634+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 68 : cephadm [DBG] Using selector: EpollSelector 2022-10-24T20:33:19.142779+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 69 : cephadm [DBG] serve starting 2022-10-24T20:33:19.144948+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 70 : cephadm [DBG] mon_command: 'config dump' -> 0 in 0.002s 2022-10-24T20:33:19.145235+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 71 : cephadm [DBG] public networks ['192.168.10.0/24', '192.168.10.1/32'] 2022-10-24T20:33:19.146620+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 72 : cephadm [DBG] cluster networks [] 2022-10-24T20:33:19.146661+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 73 : cephadm [DBG] serve loop start 2022-10-24T20:33:19.147731+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 74 : cephadm [DBG] mon_command: 'config dump' -> 0 in 0.001s 2022-10-24T20:33:19.147838+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 75 : cephadm [DBG] refreshing hosts and daemons 2022-10-24T20:33:19.147880+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 76 : cephadm [DBG] _refresh_hosts_and_daemons 2022-10-24T20:33:19.148794+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 77 : cephadm [DBG] mon_command: 'config generate-minimal-conf' -> 0 in 0.001s 2022-10-24T20:33:19.149428+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 78 : cephadm [DBG] mon_command: 'auth get' -> 0 in 0.000s 2022-10-24T20:33:19.149835+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 79 : cephadm [DBG] Provided hosts: [DaemonPlacement(daemon_type='mon', hostname='ceph01.domain.local', network='', name='', ip=None, ports=[], rank=None, rank_generation=None), DaemonPlacement(daemon_type='mon', hostname='ceph02.oldname.local', network='', name='', ip=None, ports=[], rank=None, rank_generation=None)] 2022-10-24T20:33:19.150127+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 80 : cephadm [DBG] checking ceph03.domain.local 2022-10-24T20:33:19.150441+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 81 : cephadm [DBG] checking ceph01.domain.local 2022-10-24T20:33:19.150512+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 82 : cephadm [DBG] checking ceph02.oldname.local 2022-10-24T20:33:19.150885+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 83 : cephadm [DBG] Opening connection to root@192.168.10.80 with ssh options '-F /tmp/cephadm-conf-ar991dr5 -i /tmp/cephadm-identity-6eptxulo' 2022-10-24T20:33:19.171959+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 84 : cephadm [DBG] Opening connection to root@192.168.10.210 with ssh options '-F /tmp/cephadm-conf-ar991dr5 -i /tmp/cephadm-identity-6eptxulo' 2022-10-24T20:33:19.187428+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 85 : cephadm [DBG] Opening connection to root@192.168.10.51 with ssh options '-F /tmp/cephadm-conf-ar991dr5 -i /tmp/cephadm-identity-6eptxulo' 2022-10-24T20:33:19.241298+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 86 : cephadm [DBG] _run_cephadm : command = check-host 2022-10-24T20:33:19.241342+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 87 : cephadm [DBG] _run_cephadm : args = [] 2022-10-24T20:33:19.241386+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 88 : cephadm [DBG] args: check-host 2022-10-24T20:33:19.241443+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 89 : cephadm [DBG] Running command: which python3 2022-10-24T20:33:19.439377+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 90 : cephadm [DBG] _run_cephadm : command = check-host 2022-10-24T20:33:19.439421+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 91 : cephadm [DBG] _run_cephadm : args = [] 2022-10-24T20:33:19.439462+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 92 : cephadm [DBG] args: check-host 2022-10-24T20:33:19.439511+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 93 : cephadm [DBG] Running command: which python3 2022-10-24T20:33:19.780760+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 94 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde check-host 2022-10-24T20:33:20.170043+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 95 : cephadm [DBG] Starting cherrypy engine... 2022-10-24T20:33:20.170214+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 96 : cephadm [INF] [24/Oct/2022:20:33:20] ENGINE Bus STARTING 2022-10-24T20:33:20.281220+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 97 : cephadm [INF] [24/Oct/2022:20:33:20] ENGINE Serving on https://192.168.10.210:7150 2022-10-24T20:33:20.281313+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 98 : cephadm [INF] [24/Oct/2022:20:33:20] ENGINE Bus STARTED 2022-10-24T20:33:20.281656+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 99 : cephadm [DBG] Cephadm endpoint connected to port 7150 2022-10-24T20:33:20.281695+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 100 : cephadm [DBG] Cherrypy engine started. 2022-10-24T20:33:20.763588+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 101 : cephadm [DBG] code: 0 2022-10-24T20:33:20.763629+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 102 : cephadm [DBG] err: docker (/usr/bin/docker) is present systemctl is present lvcreate is present Unit chrony.service is enabled and running Host looks OK 2022-10-24T20:33:21.211329+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 103 : cephadm [DBG] _run_cephadm : command = check-host 2022-10-24T20:33:21.211529+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 104 : cephadm [DBG] _run_cephadm : args = [] 2022-10-24T20:33:21.211609+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 105 : cephadm [DBG] args: check-host 2022-10-24T20:33:21.211694+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 106 : cephadm [DBG] Running command: which python3 2022-10-24T20:33:21.314399+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 107 : cephadm [DBG] _kick_serve_loop 2022-10-24T20:33:22.388412+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 108 : cephadm [DBG] host ceph02.oldname.local (192.168.10.51) ok 2022-10-24T20:33:22.389738+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 109 : cephadm [DBG] refreshing ceph02.oldname.local daemons 2022-10-24T20:33:22.390078+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 110 : cephadm [DBG] _run_cephadm : command = ls 2022-10-24T20:33:22.390362+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 111 : cephadm [DBG] _run_cephadm : args = [] 2022-10-24T20:33:22.397187+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 112 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-24T20:33:22.397339+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 113 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-24T20:33:22.397448+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 114 : cephadm [DBG] Running command: which python3 2022-10-24T20:33:22.420038+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 115 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-24T20:33:24.662286+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 116 : cephadm [DBG] Connection to ceph01.domain.local failed. 2022-10-24T20:33:24.662383+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 117 : cephadm [DBG] _reset_con close ceph01.domain.local 2022-10-24T20:33:24.664393+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 118 : cephadm [DBG] host ceph01.domain.local (192.168.10.210) failed check 2022-10-24T20:33:24.664449+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 119 : cephadm [DBG] Host "ceph01.domain.local" marked as offline. Skipping daemon refresh 2022-10-24T20:33:24.664487+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 120 : cephadm [DBG] Host "ceph01.domain.local" marked as offline. Skipping gather facts refresh 2022-10-24T20:33:24.664516+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 121 : cephadm [DBG] Host "ceph01.domain.local" marked as offline. Skipping network refresh 2022-10-24T20:33:24.664544+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 122 : cephadm [DBG] Host "ceph01.domain.local" marked as offline. Skipping device refresh 2022-10-24T20:33:24.664573+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 123 : cephadm [DBG] Host "ceph01.domain.local" marked as offline. Skipping osdspec preview refresh 2022-10-24T20:33:24.664599+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 124 : cephadm [DBG] Host "ceph01.domain.local" marked as offline. Skipping autotune 2022-10-24T20:33:24.664649+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 125 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-24T20:33:24.665941+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 126 : cephadm [DBG] Opening connection to root@192.168.10.210 with ssh options '-F /tmp/cephadm-conf-ar991dr5 -i /tmp/cephadm-identity-6eptxulo' 2022-10-24T20:33:24.711386+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 127 : cephadm [DBG] Running command: mkdir -p /etc/ceph 2022-10-24T20:33:29.770222+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 128 : cephadm [DBG] code: 0 2022-10-24T20:33:29.770265+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 129 : cephadm [DBG] out: [ { "style": "cephadm:v1", "name": "crash.ceph02", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@crash.ceph02", "enabled": true, "state": "running", "service_name": "crash", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "a24e3c222e351f76fd00705944957a5972a445df8a5f98bfd85373d095116bb4", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 14522777, "cpu_percentage": "0.00%", "version": "17.2.3", "started": "2022-10-02T21:12:15.823128Z", "created": "2022-10-02T21:12:15.709536Z", "deployed": "2022-10-02T21:10:14.544171Z", "configured": "2022-10-02T21:12:15.709536Z" }, { "style": "cephadm:v1", "name": "mon.ceph02", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mon.ceph02", "enabled": true, "state": "running", "service_name": "mon", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "88d7bfbcd9f5e4a689ecf5346b3200307999ed2aa548d2fc61efce707f91606c", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 1838246002, "cpu_percentage": "1.28%", "version": "17.2.3", "started": "2022-10-02T21:13:29.037176Z", "created": "2022-10-02T21:13:28.954362Z", "deployed": "2022-10-02T21:12:28.249678Z", "configured": "2022-10-02T21:13:28.954362Z" }, { "style": "cephadm:v1", "name": "node-exporter.ceph02", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@node-exporter.ceph02", "enabled": true, "state": "running", "service_name": "node-exporter", "ports": [ 9100 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "fa2b469308804ea41ae9e9abfeeaf9d5f0bd7249d68273a7bb29f8d2237c2060", "container_image_name": "quay.io/prometheus/node-exporter:v1.3.1", "container_image_id": "1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26", "container_image_digests": [ "quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd" ], "memory_usage": 7520387, "cpu_percentage": "0.00%", "version": "", "started": "2022-10-02T21:13:29.826081Z", "created": "2022-10-02T21:13:29.762371Z", "deployed": "2022-10-02T21:13:29.230365Z", "configured": "2022-10-02T21:13:29.762371Z" } ] 2022-10-24T20:33:29.770870+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 130 : cephadm [DBG] Refreshed host ceph02.oldname.local daemons (3) 2022-10-24T20:33:29.934896+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 131 : cephadm [DBG] Refreshing ceph02.oldname.local facts 2022-10-24T20:33:29.935213+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 132 : cephadm [DBG] _run_cephadm : command = gather-facts 2022-10-24T20:33:29.935252+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 133 : cephadm [DBG] _run_cephadm : args = [] 2022-10-24T20:33:29.935307+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 134 : cephadm [DBG] args: gather-facts 2022-10-24T20:33:29.935368+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 135 : cephadm [DBG] Running command: which python3 2022-10-24T20:33:29.956022+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 136 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde gather-facts 2022-10-24T20:33:30.045696+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 137 : cephadm [DBG] Connection to ceph01.domain.local failed. 2022-10-24T20:33:30.045738+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 138 : cephadm [DBG] _reset_con close ceph01.domain.local 2022-10-24T20:33:30.050203+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 139 : cephadm [ERR] Unable to write ceph01.domain.local:/etc/ceph/ceph.conf: Unable to reach remote host ceph01.domain.local. Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 143, in _execute_command r = await conn.run('sudo true', check=True, timeout=5) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3637, in run return await process.wait(check, timeout) File "/lib/python3.6/site-packages/asyncssh/process.py", line 1252, in wait stderr_data) from None asyncssh.process.TimeoutError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 209, in _write_remote_file await self._check_execute_command(host, ['mkdir', '-p', dirname], addr=addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 183, in _check_execute_command out, err, code = await self._execute_command(host, cmd, stdin, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 151, in _execute_command raise OrchestratorError(f'Unable to reach remote host {host}. {str(e)}') orchestrator._interface.OrchestratorError: Unable to reach remote host ceph01.domain.local. 2022-10-24T20:33:30.052153+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 140 : cephadm [ERR] executing refresh((['ceph03.domain.local', 'ceph01.domain.local', 'ceph02.oldname.local'],)) failed. Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 143, in _execute_command r = await conn.run('sudo true', check=True, timeout=5) File "/lib/python3.6/site-packages/asyncssh/connection.py", line 3637, in run return await process.wait(check, timeout) File "/lib/python3.6/site-packages/asyncssh/process.py", line 1252, in wait stderr_data) from None asyncssh.process.TimeoutError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/ssh.py", line 209, in _write_remote_file await self._check_execute_command(host, ['mkdir', '-p', dirname], addr=addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 183, in _check_execute_command out, err, code = await self._execute_command(host, cmd, stdin, addr) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 151, in _execute_command raise OrchestratorError(f'Unable to reach remote host {host}. {str(e)}') orchestrator._interface.OrchestratorError: Unable to reach remote host ceph01.domain.local. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/cephadm/utils.py", line 78, in do_work return f(*arg) File "/usr/share/ceph/mgr/cephadm/serve.py", line 266, in refresh self._write_client_files(client_files, host) File "/usr/share/ceph/mgr/cephadm/serve.py", line 1064, in _write_client_files self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 243, in write_remote_file host, path, content, mode, uid, gid, addr)) File "/usr/share/ceph/mgr/cephadm/module.py", line 590, in wait_async return self.event_loop.get_result(coro) File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result return asyncio.run_coroutine_threadsafe(coro, self._loop).result() File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result return self.__get_result() File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/share/ceph/mgr/cephadm/ssh.py", line 231, in _write_remote_file raise OrchestratorError(msg) orchestrator._interface.OrchestratorError: Unable to write ceph01.domain.local:/etc/ceph/ceph.conf: Unable to reach remote host ceph01.domain.local. 2022-10-24T20:33:30.227305+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 141 : cephadm [DBG] code: 0 2022-10-24T20:33:30.227349+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 142 : cephadm [DBG] out: { "arch": "x86_64", "bios_date": "04/27/2022", "bios_version": "4403", "cpu_cores": 12, "cpu_count": 1, "cpu_load": { "15min": 5.19, "1min": 5.59, "5min": 5.3 }, "cpu_model": "AMD Ryzen 9 3900X 12-Core Processor", "cpu_threads": 24, "flash_capacity": "1.0TB", "flash_capacity_bytes": 1014608125952, "flash_count": 3, "flash_list": [ { "description": "Unknown INTEL OptaneDisk (14.4GB)", "dev_name": "nvme0n1", "disk_size_bytes": 144Unknown39936, "model": "INTEL OptaneDisk", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop0", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "ATA SSDDisk (1.0TB)", "dev_name": "sda", "disk_size_bytes": 1000204886016, "model": "SSDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.500a0751e28eb438" } ], "hdd_capacity": "0.0", "hdd_capacity_bytes": 0, "hdd_count": 8, "hdd_list": [ { "description": "Unknown Unknown (0.0)", "dev_name": "loop1", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Generic Ultra HS-SD/MMC (0.0)", "dev_name": "sdb", "disk_size_bytes": 0, "model": "Ultra HS-SD/MMC", "rev": "Unknown", "vendor": "Generic", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop6", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop4", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop2", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop7", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop5", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop3", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" } ], "hostname": "ceph02.oldname.local", "interfaces": { "LanBridge": { "driver": "", "iftype": "logical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "docker0": { "driver": "", "iftype": "logical", "ipv4_address": "172.17.0.1/16", "ipv6_address": "fe80::42:6fff:fecc:f20a/64", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "enp6s0": { "driver": "r8169", "iftype": "physical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "eth10": { "driver": "mlx4_core", "iftype": "physical", "ipv4_address": "192.168.10.51/24", "ipv6_address": "fe80::a710:c7ff:834f:fdd9/64", "lower_devs_list": [], "mtu": 9000, "nic_type": "ethernet", "operstate": "up", "speed": 10000, "upper_devs_list": [] }, "lxcbr0": { "driver": "", "iftype": "logical", "ipv4_address": "10.0.3.1/24", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "tun0": { "driver": "", "iftype": "logical", "ipv4_address": "10.4.18.6/24", "ipv6_address": "fe80::f984:182b:8561:3b38/64", "lower_devs_list": [], "mtu": 1448, "nic_type": "Unknown", "operstate": "unknown", "speed": 10, "upper_devs_list": [] }, "virbr0": { "driver": "", "iftype": "logical", "ipv4_address": "192.168.122.1/24", "ipv6_address": "", "lower_devs_list": [ "virbr0-nic" ], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "virbr0-nic": { "driver": "", "iftype": "logical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [ "virbr0" ] }, "wlp5s0": { "driver": "iwlwifi", "iftype": "physical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [] } }, "kernel": "5.4.0-125-generic", "kernel_parameters": { "net.ipv4.ip_nonlocal_bind": "0" }, "kernel_security": { "complain": 1, "description": "AppArmor: Enabled(35 enforce,1 complain)", "enforce": 35, "type": "AppArmor" }, "memory_available_kb": 16375488, "memory_free_kb": 7227620, "memory_total_kb": 32850368, "model": "To be filled by O.E.M. (System Product Name)", "nic_count": 3, "operating_system": "Linux Mint 20 (Ulyana)", "selinux_enabled": false, "subscribed": "Unknown", "system_uptime": 3533808.39, "tcp6_ports_used": [ 9100, 111, 1716, 22, 631 ], "tcp_ports_used": [ 33785, 27036, 46365, 57343, 3300, 6789, 111, 9425, 36051, 5939, 27060, 53, 53, 53, 22, 631, 5432 ], "timestamp": 1666643609.9010384, "udp6_ports_used": [ 5353, 60807, 111, 323, 1716 ], "udp_ports_used": [ 5353, 5353, 5353, 5353, 5353, 58322, 42658, 27036, 53, 53, 53, 67, 67, 68, 111, 323, 631 ], "vendor": "System manufacturer" } 2022-10-24T20:33:30.233542+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 143 : cephadm [DBG] Refreshing ceph02.oldname.local networks 2022-10-24T20:33:30.233803+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 144 : cephadm [DBG] _run_cephadm : command = list-networks 2022-10-24T20:33:30.233847+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 145 : cephadm [DBG] _run_cephadm : args = [] 2022-10-24T20:33:30.233917+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 146 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-24T20:33:30.233953+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 147 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-24T20:33:30.234001+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 148 : cephadm [DBG] Running command: which python3 2022-10-24T20:33:30.255539+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 149 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-24T20:33:30.411537+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 150 : cephadm [DBG] code: 0 2022-10-24T20:33:30.411596+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 151 : cephadm [DBG] out: { "10.0.3.0/24": { "lxcbr0": [ "10.0.3.1" ] }, "10.4.18.0/24": { "tun0": [ "10.4.18.6" ] }, "172.17.0.0/16": { "docker0": [ "172.17.0.1" ] }, "192.168.10.0/24": { "eth10": [ "192.168.10.51" ] }, "192.168.10.1/32": { "eth10": [ "192.168.10.51" ] }, "192.168.122.0/24": { "virbr0": [ "192.168.122.1" ] }, "fe80::/64": { "eth10": [ "fe80::a710:c7ff:834f:fdd9" ], "tun0": [ "fe80::f984:182b:8561:3b38" ], "docker0": [ "fe80::42:6fff:fecc:f20a" ] } } 2022-10-24T20:33:30.412022+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 152 : cephadm [DBG] Refreshed host ceph02.oldname.local networks (7) 2022-10-24T20:33:31.803588+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 153 : cephadm [DBG] refreshing ceph02.oldname.local devices 2022-10-24T20:33:31.803864+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 154 : cephadm [DBG] _run_cephadm : command = ceph-volume 2022-10-24T20:33:31.803906+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 155 : cephadm [DBG] _run_cephadm : args = ['--', 'inventory', '--format=json-pretty', '--filter-for-batch'] 2022-10-24T20:33:31.803975+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 156 : cephadm [DBG] osd container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-24T20:33:31.804012+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 157 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-24T20:33:31.804057+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 158 : cephadm [DBG] Running command: which python3 2022-10-24T20:33:31.826221+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 159 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-24T20:33:41.874790+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 163 : cephadm [DBG] Connection to ceph03.domain.local failed. 2022-10-24T20:33:41.874838+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 164 : cephadm [DBG] _reset_con close ceph03.domain.local 2022-10-24T20:33:41.876193+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 165 : cephadm [DBG] host ceph03.domain.local (192.168.10.80) failed check 2022-10-24T20:33:41.876234+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 166 : cephadm [DBG] Host "ceph03.domain.local" marked as offline. Skipping daemon refresh 2022-10-24T20:33:41.876265+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 167 : cephadm [DBG] Host "ceph03.domain.local" marked as offline. Skipping gather facts refresh 2022-10-24T20:33:41.876292+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 168 : cephadm [DBG] Host "ceph03.domain.local" marked as offline. Skipping network refresh 2022-10-24T20:33:41.876319+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 169 : cephadm [DBG] Host "ceph03.domain.local" marked as offline. Skipping device refresh 2022-10-24T20:33:41.876377+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 170 : cephadm [DBG] Host "ceph03.domain.local" marked as offline. Skipping osdspec preview refresh 2022-10-24T20:33:41.876442+0000 mgr.ceph01.domain.local.miydsy (mgr.12454107) 171 : cephadm [DBG] Host "ceph03.domain.local" marked as offline. Skipping autotune 2022-10-25T04:49:22.137343+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 1 : cephadm [DBG] setting log level based on debug_mgr: INFO (2/5) 2022-10-25T04:49:22.142422+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 2 : cephadm [DBG] mgr option ssh_config_file = None 2022-10-25T04:49:22.142484+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 3 : cephadm [DBG] mgr option device_cache_timeout = 1800 2022-10-25T04:49:22.142526+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 4 : cephadm [DBG] mgr option device_enhanced_scan = False 2022-10-25T04:49:22.142565+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 5 : cephadm [DBG] mgr option daemon_cache_timeout = 600 2022-10-25T04:49:22.142603+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 6 : cephadm [DBG] mgr option facts_cache_timeout = 60 2022-10-25T04:49:22.142685+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 7 : cephadm [DBG] mgr option host_check_interval = 600 2022-10-25T04:49:22.142725+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 8 : cephadm [DBG] mgr option mode = root 2022-10-25T04:49:22.142765+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 9 : cephadm [DBG] mgr option container_image_base = quay.io/ceph/ceph 2022-10-25T04:49:22.142802+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 10 : cephadm [DBG] mgr option container_image_prometheus = quay.io/prometheus/prometheus:v2.33.4 2022-10-25T04:49:22.142839+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 11 : cephadm [DBG] mgr option container_image_grafana = quay.io/ceph/ceph-grafana:8.3.5 2022-10-25T04:49:22.142877+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 12 : cephadm [DBG] mgr option container_image_alertmanager = quay.io/prometheus/alertmanager:v0.23.0 2022-10-25T04:49:22.142913+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 13 : cephadm [DBG] mgr option container_image_node_exporter = quay.io/prometheus/node-exporter:v1.3.1 2022-10-25T04:49:22.142949+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 14 : cephadm [DBG] mgr option container_image_loki = docker.io/grafana/loki:2.4.0 2022-10-25T04:49:22.142985+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 15 : cephadm [DBG] mgr option container_image_promtail = docker.io/grafana/promtail:2.4.0 2022-10-25T04:49:22.143019+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 16 : cephadm [DBG] mgr option container_image_haproxy = docker.io/library/haproxy:2.3 2022-10-25T04:49:22.143056+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 17 : cephadm [DBG] mgr option container_image_keepalived = docker.io/arcts/keepalived 2022-10-25T04:49:22.143091+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 18 : cephadm [DBG] mgr option container_image_snmp_gateway = docker.io/maxwo/snmp-notifier:v1.2.1 2022-10-25T04:49:22.143125+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 19 : cephadm [DBG] mgr option warn_on_stray_hosts = True 2022-10-25T04:49:22.143161+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 20 : cephadm [DBG] mgr option warn_on_stray_daemons = True 2022-10-25T04:49:22.143196+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 21 : cephadm [DBG] mgr option warn_on_failed_host_check = True 2022-10-25T04:49:22.143235+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 22 : cephadm [DBG] mgr option log_to_cluster = True 2022-10-25T04:49:22.143275+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 23 : cephadm [DBG] mgr option allow_ptrace = False 2022-10-25T04:49:22.143315+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 24 : cephadm [DBG] mgr option container_init = True 2022-10-25T04:49:22.143351+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 25 : cephadm [DBG] mgr option prometheus_alerts_path = /etc/prometheus/ceph/ceph_default_alerts.yml 2022-10-25T04:49:22.143389+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 26 : cephadm [DBG] mgr option migration_current = 5 2022-10-25T04:49:22.143426+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 27 : cephadm [DBG] mgr option config_dashboard = True 2022-10-25T04:49:22.143462+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 28 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf = False 2022-10-25T04:49:22.143498+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 29 : cephadm [DBG] mgr option manage_etc_ceph_ceph_conf_hosts = * 2022-10-25T04:49:22.143534+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 30 : cephadm [DBG] mgr option registry_url = None 2022-10-25T04:49:22.143570+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 31 : cephadm [DBG] mgr option registry_username = None 2022-10-25T04:49:22.143606+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 32 : cephadm [DBG] mgr option registry_password = None 2022-10-25T04:49:22.143643+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 33 : cephadm [DBG] mgr option registry_insecure = False 2022-10-25T04:49:22.143678+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 34 : cephadm [DBG] mgr option use_repo_digest = True 2022-10-25T04:49:22.143713+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 35 : cephadm [DBG] mgr option config_checks_enabled = False 2022-10-25T04:49:22.143747+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 36 : cephadm [DBG] mgr option default_registry = docker.io 2022-10-25T04:49:22.143781+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 37 : cephadm [DBG] mgr option max_count_per_host = 10 2022-10-25T04:49:22.143817+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 38 : cephadm [DBG] mgr option autotune_memory_target_ratio = 0.7 2022-10-25T04:49:22.143863+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 39 : cephadm [DBG] mgr option autotune_interval = 600 2022-10-25T04:49:22.143899+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 40 : cephadm [DBG] mgr option use_agent = False 2022-10-25T04:49:22.143933+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 41 : cephadm [DBG] mgr option agent_refresh_rate = 20 2022-10-25T04:49:22.143968+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 42 : cephadm [DBG] mgr option agent_starting_port = 4721 2022-10-25T04:49:22.144008+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 43 : cephadm [DBG] mgr option agent_down_multiplier = 3.0 2022-10-25T04:49:22.144042+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 44 : cephadm [DBG] mgr option max_osd_draining_count = 10 2022-10-25T04:49:22.144076+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 45 : cephadm [DBG] mgr option log_level = 2022-10-25T04:49:22.144110+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 46 : cephadm [DBG] mgr option log_to_file = False 2022-10-25T04:49:22.144146+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 47 : cephadm [DBG] mgr option log_to_cluster_level = debug 2022-10-25T04:49:22.150990+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 48 : cephadm [DBG] Loaded inventory {'ceph01.domain.local': {'hostname': 'ceph01.domain.local', 'addr': '192.168.10.210', 'labels': ['_admin', 'rgw', 'grafana', 'mds'], 'status': ''}, 'ceph03.domain.local': {'hostname': 'ceph03.domain.local', 'addr': '192.168.10.80', 'labels': ['rbd'], 'status': ''}, 'ceph02.oldname.local': {'hostname': 'ceph02.oldname.local', 'addr': '192.168.10.51', 'labels': ['mon', 'mgr', 'mds', '_admin'], 'status': ''}} 2022-10-25T04:49:22.153034+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 49 : cephadm [DBG] HostCache.load: host ceph03.domain.local has 11 daemons, 8 devices, 4 networks 2022-10-25T04:49:22.155267+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 50 : cephadm [DBG] HostCache.load: host ceph01.domain.local has 15 daemons, 10 devices, 4 networks 2022-10-25T04:49:22.155746+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 51 : cephadm [DBG] HostCache.load: host ceph02.oldname.local has 3 daemons, 0 devices, 7 networks 2022-10-25T04:49:22.156023+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 52 : cephadm [DBG] SpecStore: loaded spec for alertmanager 2022-10-25T04:49:22.156140+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 53 : cephadm [DBG] SpecStore: loaded spec for crash 2022-10-25T04:49:22.156251+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 54 : cephadm [DBG] SpecStore: loaded spec for grafana 2022-10-25T04:49:22.156502+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 55 : cephadm [DBG] SpecStore: loaded spec for mds.mds-default 2022-10-25T04:49:22.156612+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 56 : cephadm [DBG] SpecStore: loaded spec for mgr 2022-10-25T04:49:22.156730+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 57 : cephadm [DBG] SpecStore: loaded spec for mon 2022-10-25T04:49:22.156837+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 58 : cephadm [DBG] SpecStore: loaded spec for node-exporter 2022-10-25T04:49:22.157086+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 59 : cephadm [DBG] SpecStore: loaded spec for osd.all-available-devices 2022-10-25T04:49:22.157231+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 60 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664591400232 2022-10-25T04:49:22.157373+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 61 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664591518471 2022-10-25T04:49:22.157513+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 62 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664593093131 2022-10-25T04:49:22.157653+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 63 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1664664Unknown04 2022-10-25T04:49:22.157787+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 64 : cephadm [DBG] SpecStore: loaded spec for osd.dashboard-admin-1666381718250 2022-10-25T04:49:22.157892+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 65 : cephadm [DBG] SpecStore: loaded spec for prometheus 2022-10-25T04:49:22.158008+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 66 : cephadm [DBG] SpecStore: loaded spec for rgw.rgw-default 2022-10-25T04:49:22.158425+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 67 : cephadm [DBG] config_checks match module definition 2022-10-25T04:49:22.161036+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 68 : cephadm [DBG] Using selector: EpollSelector 2022-10-25T04:49:22.163449+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 69 : cephadm [DBG] serve starting 2022-10-25T04:49:22.170271+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 70 : cephadm [DBG] mon_command: 'config dump' -> 0 in 0.006s 2022-10-25T04:49:22.172498+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 71 : cephadm [DBG] public networks ['192.168.10.0/24', '192.168.10.1/32'] 2022-10-25T04:49:22.172816+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 72 : cephadm [DBG] cluster networks [] 2022-10-25T04:49:22.173244+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 73 : cephadm [DBG] serve loop start 2022-10-25T04:49:22.180990+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 74 : cephadm [DBG] mon_command: 'config dump' -> 0 in 0.008s 2022-10-25T04:49:22.181189+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 75 : cephadm [DBG] refreshing hosts and daemons 2022-10-25T04:49:22.181228+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 76 : cephadm [DBG] _refresh_hosts_and_daemons 2022-10-25T04:49:22.187673+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 77 : cephadm [DBG] mon_command: 'config generate-minimal-conf' -> 0 in 0.005s 2022-10-25T04:49:22.190433+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 78 : cephadm [DBG] mon_command: 'auth get' -> 0 in 0.003s 2022-10-25T04:49:22.190972+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 79 : cephadm [DBG] Provided hosts: [DaemonPlacement(daemon_type='mon', hostname='ceph01.domain.local', network='', name='', ip=None, ports=[], rank=None, rank_generation=None), DaemonPlacement(daemon_type='mon', hostname='ceph02.oldname.local', network='', name='', ip=None, ports=[], rank=None, rank_generation=None)] 2022-10-25T04:49:22.191816+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 80 : cephadm [DBG] checking ceph03.domain.local 2022-10-25T04:49:22.192206+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 81 : cephadm [DBG] checking ceph01.domain.local 2022-10-25T04:49:22.195596+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 82 : cephadm [DBG] checking ceph02.oldname.local 2022-10-25T04:49:22.195954+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 83 : cephadm [DBG] Opening connection to root@192.168.10.80 with ssh options '-F /tmp/cephadm-conf-vbfekm_g -i /tmp/cephadm-identity-7q5ascu0' 2022-10-25T04:49:22.211947+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 84 : cephadm [DBG] Opening connection to root@192.168.10.210 with ssh options '-F /tmp/cephadm-conf-vbfekm_g -i /tmp/cephadm-identity-7q5ascu0' 2022-10-25T04:49:22.246127+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 85 : cephadm [DBG] Opening connection to root@192.168.10.51 with ssh options '-F /tmp/cephadm-conf-vbfekm_g -i /tmp/cephadm-identity-7q5ascu0' 2022-10-25T04:49:22.323173+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 86 : cephadm [DBG] _run_cephadm : command = check-host 2022-10-25T04:49:22.323253+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 87 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:22.323431+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 88 : cephadm [DBG] args: check-host 2022-10-25T04:49:22.323607+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 89 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:22.324587+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 90 : cephadm [DBG] _run_cephadm : command = check-host 2022-10-25T04:49:22.324647+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 91 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:22.324687+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 92 : cephadm [DBG] args: check-host 2022-10-25T04:49:22.324732+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 93 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:22.502867+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 94 : cephadm [DBG] Starting cherrypy engine... 2022-10-25T04:49:22.502993+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 95 : cephadm [INF] [25/Oct/2022:04:49:22] ENGINE Bus STARTING 2022-10-25T04:49:22.563801+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 96 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde check-host 2022-10-25T04:49:22.615341+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 97 : cephadm [INF] [25/Oct/2022:04:49:22] ENGINE Serving on https://192.168.10.210:7150 2022-10-25T04:49:22.615425+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 98 : cephadm [INF] [25/Oct/2022:04:49:22] ENGINE Bus STARTED 2022-10-25T04:49:22.615472+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 99 : cephadm [DBG] Cephadm endpoint connected to port 7150 2022-10-25T04:49:22.615635+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 100 : cephadm [DBG] Cherrypy engine started. 2022-10-25T04:49:22.634628+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 101 : cephadm [DBG] _kick_serve_loop 2022-10-25T04:49:22.782695+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 102 : cephadm [DBG] code: 0 2022-10-25T04:49:22.782753+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 103 : cephadm [DBG] err: docker (/usr/bin/docker) is present systemctl is present lvcreate is present Unit chrony.service is enabled and running Host looks OK 2022-10-25T04:49:22.796970+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 104 : cephadm [DBG] host ceph02.oldname.local (192.168.10.51) ok 2022-10-25T04:49:22.797038+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 105 : cephadm [DBG] refreshing ceph02.oldname.local daemons 2022-10-25T04:49:22.797330+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 106 : cephadm [DBG] _run_cephadm : command = ls 2022-10-25T04:49:22.797383+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 107 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:22.797481+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 108 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:49:22.797522+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 109 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-25T04:49:22.797568+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 110 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:22.818417+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 111 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-25T04:49:23.000491+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 112 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde check-host 2022-10-25T04:49:23.147172+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 113 : cephadm [DBG] code: 0 2022-10-25T04:49:23.147225+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 114 : cephadm [DBG] err: docker (/usr/bin/docker) is present systemctl is present lvcreate is present Unit chrony.service is enabled and running Host looks OK 2022-10-25T04:49:23.348554+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 115 : cephadm [DBG] host ceph01.domain.local (192.168.10.210) ok 2022-10-25T04:49:23.348651+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 116 : cephadm [DBG] refreshing ceph01.domain.local daemons 2022-10-25T04:49:23.348909+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 117 : cephadm [DBG] _run_cephadm : command = ls 2022-10-25T04:49:23.348983+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 118 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:23.349073+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 119 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:49:23.349110+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 120 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-25T04:49:23.349205+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 121 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:23.366004+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 123 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-25T04:49:25.773038+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 124 : cephadm [DBG] _run_cephadm : command = check-host 2022-10-25T04:49:25.773072+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 125 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:25.773110+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 126 : cephadm [DBG] args: check-host 2022-10-25T04:49:25.773154+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 127 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:28.544142+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 129 : cephadm [DBG] code: 0 2022-10-25T04:49:28.544227+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 130 : cephadm [DBG] out: [ { "style": "cephadm:v1", "name": "crash.ceph02", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@crash.ceph02", "enabled": true, "state": "running", "service_name": "crash", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "a24e3c222e351f76fd00705944957a5972a445df8a5f98bfd85373d095116bb4", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 13757317, "cpu_percentage": "0.00%", "version": "17.2.3", "started": "2022-10-02T21:12:15.823128Z", "created": "2022-10-02T21:12:15.709536Z", "deployed": "2022-10-02T21:10:14.544171Z", "configured": "2022-10-02T21:12:15.709536Z" }, { "style": "cephadm:v1", "name": "mon.ceph02", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mon.ceph02", "enabled": true, "state": "running", "service_name": "mon", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "88d7bfbcd9f5e4a689ecf5346b3200307999ed2aa548d2fc61efce707f91606c", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 869793792, "cpu_percentage": "0.86%", "version": "17.2.3", "started": "2022-10-02T21:13:29.037176Z", "created": "2022-10-02T21:13:28.954362Z", "deployed": "2022-10-02T21:12:28.249678Z", "configured": "2022-10-02T21:13:28.954362Z" }, { "style": "cephadm:v1", "name": "node-exporter.ceph02", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@node-exporter.ceph02", "enabled": true, "state": "running", "service_name": "node-exporter", "ports": [ 9100 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "fa2b469308804ea41ae9e9abfeeaf9d5f0bd7249d68273a7bb29f8d2237c2060", "container_image_name": "quay.io/prometheus/node-exporter:v1.3.1", "container_image_id": "1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26", "container_image_digests": [ "quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd" ], "memory_usage": 8113881, "cpu_percentage": "0.00%", "version": "", "started": "2022-10-02T21:13:29.826081Z", "created": "2022-10-02T21:13:29.762371Z", "deployed": "2022-10-02T21:13:29.230365Z", "configured": "2022-10-02T21:13:29.762371Z" } ] 2022-10-25T04:49:28.544731+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 131 : cephadm [DBG] Refreshed host ceph02.oldname.local daemons (3) 2022-10-25T04:49:28.568939+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 132 : cephadm [DBG] Refreshing ceph02.oldname.local facts 2022-10-25T04:49:28.569319+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 133 : cephadm [DBG] _run_cephadm : command = gather-facts 2022-10-25T04:49:28.569374+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 134 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:28.569432+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 135 : cephadm [DBG] args: gather-facts 2022-10-25T04:49:28.569536+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 136 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:28.589444+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 137 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde gather-facts 2022-10-25T04:49:28.785357+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 138 : cephadm [DBG] code: 0 2022-10-25T04:49:28.785396+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 139 : cephadm [DBG] out: { "arch": "x86_64", "bios_date": "04/27/2022", "bios_version": "4403", "cpu_cores": 12, "cpu_count": 1, "cpu_load": { "15min": 5.74, "1min": 4.02, "5min": 4.47 }, "cpu_model": "AMD Ryzen 9 3900X 12-Core Processor", "cpu_threads": 24, "flash_capacity": "1.0TB", "flash_capacity_bytes": 1014608125952, "flash_count": 3, "flash_list": [ { "description": "Unknown INTEL OptaneDisk (14.4GB)", "dev_name": "nvme0n1", "disk_size_bytes": 144Unknown39936, "model": "INTEL OptaneDisk", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop0", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "ATA SSDDisk (1.0TB)", "dev_name": "sda", "disk_size_bytes": 1000204886016, "model": "SSDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.500a0751e28eb438" } ], "hdd_capacity": "0.0", "hdd_capacity_bytes": 0, "hdd_count": 8, "hdd_list": [ { "description": "Unknown Unknown (0.0)", "dev_name": "loop1", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Generic Ultra HS-SD/MMC (0.0)", "dev_name": "sdb", "disk_size_bytes": 0, "model": "Ultra HS-SD/MMC", "rev": "Unknown", "vendor": "Generic", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop6", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop4", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop2", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop7", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop5", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop3", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" } ], "hostname": "ceph02.oldname.local", "interfaces": { "LanBridge": { "driver": "", "iftype": "logical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "docker0": { "driver": "", "iftype": "logical", "ipv4_address": "172.17.0.1/16", "ipv6_address": "fe80::42:6fff:fecc:f20a/64", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "enp6s0": { "driver": "r8169", "iftype": "physical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "eth10": { "driver": "mlx4_core", "iftype": "physical", "ipv4_address": "192.168.10.51/24", "ipv6_address": "fe80::a710:c7ff:834f:fdd9/64", "lower_devs_list": [], "mtu": 9000, "nic_type": "ethernet", "operstate": "up", "speed": 10000, "upper_devs_list": [] }, "lxcbr0": { "driver": "", "iftype": "logical", "ipv4_address": "10.0.3.1/24", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "tun0": { "driver": "", "iftype": "logical", "ipv4_address": "10.4.18.6/24", "ipv6_address": "fe80::f984:182b:8561:3b38/64", "lower_devs_list": [], "mtu": 1448, "nic_type": "Unknown", "operstate": "unknown", "speed": 10, "upper_devs_list": [] }, "virbr0": { "driver": "", "iftype": "logical", "ipv4_address": "192.168.122.1/24", "ipv6_address": "", "lower_devs_list": [ "virbr0-nic" ], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "virbr0-nic": { "driver": "", "iftype": "logical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [ "virbr0" ] }, "wlp5s0": { "driver": "iwlwifi", "iftype": "physical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [] } }, "kernel": "5.4.0-125-generic", "kernel_parameters": { "net.ipv4.ip_nonlocal_bind": "0" }, "kernel_security": { "complain": 1, "description": "AppArmor: Enabled(35 enforce,1 complain)", "enforce": 35, "type": "AppArmor" }, "memory_available_kb": 18185164, "memory_free_kb": 14308980, "memory_total_kb": 32850368, "model": "To be filled by O.E.M. (System Product Name)", "nic_count": 3, "operating_system": "Linux Mint 20 (Ulyana)", "selinux_enabled": false, "subscribed": "Unknown", "system_uptime": 3563567.27, "tcp6_ports_used": [ 9100, 111, 1716, 22, 631 ], "tcp_ports_used": [ 33785, 27036, 27197, 46365, 57343, 3300, 6789, 111, 9425, 36051, 5939, 27060, 53, 53, 53, 22, 631, 5432 ], "timestamp": 1666673368.7772639, "udp6_ports_used": [ 5353, 60807, 111, 323, 1716 ], "udp_ports_used": [ 5353, 5353, 5353, 58322, 42658, 27036, 27197, 53, 53, 53, 67, 67, 68, 111, 323, 631 ], "vendor": "System manufacturer" } 2022-10-25T04:49:28.785653+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 140 : cephadm [DBG] Refreshing ceph02.oldname.local networks 2022-10-25T04:49:28.785824+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 141 : cephadm [DBG] _run_cephadm : command = list-networks 2022-10-25T04:49:28.785860+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 142 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:28.785931+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 143 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:49:28.785965+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 144 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-25T04:49:28.786180+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 145 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:28.807396+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 146 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-25T04:49:28.960735+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 147 : cephadm [DBG] code: 0 2022-10-25T04:49:28.960771+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 148 : cephadm [DBG] out: { "10.0.3.0/24": { "lxcbr0": [ "10.0.3.1" ] }, "10.4.18.0/24": { "tun0": [ "10.4.18.6" ] }, "172.17.0.0/16": { "docker0": [ "172.17.0.1" ] }, "192.168.10.0/24": { "eth10": [ "192.168.10.51" ] }, "192.168.10.1/32": { "eth10": [ "192.168.10.51" ] }, "192.168.122.0/24": { "virbr0": [ "192.168.122.1" ] }, "fe80::/64": { "eth10": [ "fe80::a710:c7ff:834f:fdd9" ], "tun0": [ "fe80::f984:182b:8561:3b38" ], "docker0": [ "fe80::42:6fff:fecc:f20a" ] } } 2022-10-25T04:49:28.960966+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 149 : cephadm [DBG] Refreshed host ceph02.oldname.local networks (7) 2022-10-25T04:49:28.989232+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 150 : cephadm [DBG] refreshing ceph02.oldname.local devices 2022-10-25T04:49:28.990114+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 151 : cephadm [DBG] _run_cephadm : command = ceph-volume 2022-10-25T04:49:28.990427+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 152 : cephadm [DBG] _run_cephadm : args = ['--', 'inventory', '--format=json-pretty', '--filter-for-batch'] 2022-10-25T04:49:28.990854+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 153 : cephadm [DBG] osd container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:49:28.991043+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 154 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-25T04:49:28.991223+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 155 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:29.016238+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 156 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-25T04:49:29.104613+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 157 : cephadm [DBG] code: 0 2022-10-25T04:49:29.104653+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 158 : cephadm [DBG] out: [ { "style": "cephadm:v1", "name": "osd.4", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.4", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664591518471", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "10d542be0050734b8ebc8f1dcc581d477f1c08895a79254fd3eaa5ff072c0923", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 662595174, "cpu_percentage": "43.45%", "version": "17.2.3", "started": "2022-10-25T04:48:59.539221Z", "created": "2022-10-02T19:46:18.677148Z", "deployed": "2022-10-02T19:46:18.153137Z", "configured": "2022-10-02T19:46:18.677148Z" }, { "style": "cephadm:v1", "name": "osd.5", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.5", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664591518471", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "0ec44b1608d03b37938d2bd3d56dd1cc7dd1604d64e6ba1b6f0bf4426ba81495", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 464414310, "cpu_percentage": "43.94%", "version": "17.2.3", "started": "2022-10-25T04:48:59.557985Z", "created": "2022-10-02T19:47:23.Unknown92Z", "deployed": "2022-10-02T19:47:22.218468Z", "configured": "2022-10-02T19:47:23.Unknown92Z" }, { "style": "cephadm:v1", "name": "osd.2", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.2", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664591518471", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "ddb7e1fa513aa637cd33a3daa290774c991ddf6656e78b1585d820bbb2f41359", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 706425651, "cpu_percentage": "34.05%", "version": "17.2.3", "started": "2022-10-25T04:48:59.525412Z", "created": "2022-10-02T19:46:15.385079Z", "deployed": "2022-10-02T19:46:14.905069Z", "configured": "2022-10-02T19:46:15.385079Z" }, { "style": "cephadm:v1", "name": "osd.3", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.3", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664591518471", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "010bca92c9dec730b4c0c569863ff022b5523c2a9ef5be7eb78226f797a5e5ee", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 800168345, "cpu_percentage": "43.53%", "version": "17.2.3", "started": "2022-10-25T04:48:59.573439Z", "created": "2022-10-02T19:46:17.045114Z", "deployed": "2022-10-02T19:46:16.561104Z", "configured": "2022-10-02T19:46:17.045114Z" }, { "style": "cephadm:v1", "name": "crash.ceph01", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@crash.ceph01", "enabled": true, "state": "running", "service_name": "crash", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "16cd38edf3cd37f70fef38aa3908686de1ccb5205a156a09c158f7b6f02cb523", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 8986296, "cpu_percentage": "0.00%", "version": "17.2.3", "started": "2022-10-25T04:48:55.857110Z", "created": "2022-10-01T02:16:03.568275Z", "deployed": "2022-10-01T02:16:02.992264Z", "configured": "2022-10-01T02:38:54.104282Z" }, { "style": "cephadm:v1", "name": "osd.0", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.0", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664591400232", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "c540e59e7c9a3971aa3ba35fa8d54f3f80836e1b04eb7d52547f6d3e8139eea9", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 222507827, "cpu_percentage": "0.15%", "version": "17.2.3", "started": "2022-10-25T04:48:59.565648Z", "created": "2022-10-01T02:30:20.701784Z", "deployed": "2022-10-01T02:30:20.145772Z", "configured": "2022-10-01T02:38:54.876298Z" }, { "style": "cephadm:v1", "name": "alertmanager.ceph01", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@alertmanager.ceph01", "enabled": true, "state": "running", "service_name": "alertmanager", "ports": [ 9093, 9094 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "e213f8ca0ecdc897b9dcc4ef28447e82df9bae4aaf513997b9ee172f2e79ac0f", "container_image_name": "quay.io/prometheus/alertmanager:v0.23.0", "container_image_id": "ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4", "container_image_digests": [ "quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a" ], "memory_usage": 16672358, "cpu_percentage": "0.07%", "version": "", "started": "2022-10-25T04:48:55.839356Z", "created": "2022-10-01T02:16:02.352250Z", "deployed": "2022-10-01T02:16:01.792239Z", "configured": "2022-10-01T02:38:56.688335Z" }, { "style": "cephadm:v1", "name": "prometheus.ceph01", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@prometheus.ceph01", "enabled": true, "state": "running", "service_name": "prometheus", "ports": [ 9095 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "9f1efb00d7c59d7f4dae37bda71665c9d7852dbf1da38e6575528d1d926d4f1b", "container_image_name": "quay.io/prometheus/prometheus:v2.33.4", "container_image_id": "514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d", "container_image_digests": [ "quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c" ], "memory_usage": 71156367, "cpu_percentage": "0.26%", "version": "", "started": "2022-10-25T04:48:55.849387Z", "created": "2022-10-01T02:16:37.208962Z", "deployed": "2022-10-01T02:16:36.652951Z", "configured": "2022-10-01T02:38:58.404370Z" }, { "style": "cephadm:v1", "name": "mon.ceph01.domain.local", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mon.ceph01.domain.local", "enabled": true, "state": "running", "service_name": "mon", "memory_request": null, "memory_limit": null, "ports": [], "container_id": "4d0347b327a6ba71a5db4d61d0e80776dea5fd9b9df83689365d15c9638bd5d7", "container_image_name": "quay.io/ceph/ceph:v17.2.3", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 38136709, "cpu_percentage": "1.26%", "version": "17.2.3", "started": "2022-10-25T04:48:55.841787Z", "created": "2022-10-01T02:15:01.703012Z", "deployed": "2022-10-01T02:15:00.694992Z", "configured": "2022-10-01T02:38:59.392390Z" }, { "style": "cephadm:v1", "name": "osd.11", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.11", "enabled": true, "state": "running", "service_name": "osd", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "0d57e0db3a5e0a82e62df7ed1fe2536a64759917f1bf7c65658ef57537223f3b", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 9610Unknown4, "cpu_percentage": "62.91%", "version": "17.2.3", "started": "2022-10-25T04:48:59.535348Z", "created": "2022-10-21T19:57:20.895173Z", "deployed": "2022-10-21T19:57:20.411163Z", "configured": "2022-10-21T19:57:20.895173Z" }, { "style": "cephadm:v1", "name": "mds.mds-default.ceph01.zrrptd", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mds.mds-default.ceph01.zrrptd", "enabled": true, "state": "running", "service_name": "mds.mds-default", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "e368133ce95d05728b067a23dd4d4821a456ccad5e54f61458acb1a763397905", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 223346688, "cpu_percentage": "0.08%", "version": "17.2.3", "started": "2022-10-25T04:48:55.835273Z", "created": "2022-10-01T02:52:42.157222Z", "deployed": "2022-10-01T02:52:41.497209Z", "configured": "2022-10-01T02:52:42.157222Z" }, { "style": "cephadm:v1", "name": "osd.1", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.1", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664591518471", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "ef4a1d282223b4768975e87624703e7549bc190fd8f319cf0595bfa28eff5ab2", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 422995558, "cpu_percentage": "40.30%", "version": "17.2.3", "started": "2022-10-25T04:48:59.558348Z", "created": "2022-10-02T19:44:57.659465Z", "deployed": "2022-10-02T19:44:56.415439Z", "configured": "2022-10-02T19:44:57.659465Z" }, { "style": "cephadm:v1", "name": "mgr.ceph01.domain.local.miydsy", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mgr.ceph01.domain.local.miydsy", "enabled": true, "state": "running", "service_name": "mgr", "memory_request": null, "memory_limit": null, "ports": [ 9283 ], "container_id": "f4cb58ed8db3368c241523215ac886c09d9a2054a12dacae1e49ea53b387a452", "container_image_name": "quay.io/ceph/ceph:v17.2.3", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": 490314137, "cpu_percentage": "1.85%", "version": "17.2.3", "started": "2022-10-25T04:48:55.838861Z", "created": "2022-10-01T02:15:05.647093Z", "deployed": "2022-10-01T02:15:05.231084Z", "configured": "2022-10-01T02:39:01.516434Z" }, { "style": "cephadm:v1", "name": "grafana.ceph01", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@grafana.ceph01", "enabled": true, "state": "running", "service_name": "grafana", "ports": [ 3000 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "914f73af50ff838b2db94f1afd2865e17ef5a272780b3bde1e9531e28abc0844", "container_image_name": "quay.io/ceph/ceph-grafana:8.3.5", "container_image_id": "dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01", "container_image_digests": [ "quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00" ], "memory_usage": 50100961, "cpu_percentage": "0.01%", "version": "8.3.5", "started": "2022-10-25T04:48:55.850017Z", "created": "2022-10-01T02:16:15.876527Z", "deployed": "2022-10-01T02:16:15.348516Z", "configured": "2022-10-01T02:16:47.177166Z" }, { "style": "cephadm:v1", "name": "node-exporter.ceph01", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@node-exporter.ceph01", "enabled": true, "state": "running", "service_name": "node-exporter", "ports": [ 9100 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "ea321ea13258676eae05c146f722f526e4a29ce8685194beae17cbb674d43c6e", "container_image_name": "quay.io/prometheus/node-exporter:v1.3.1", "container_image_id": "1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26", "container_image_digests": [ "quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd" ], "memory_usage": 11681136, "cpu_percentage": "6.82%", "version": "", "started": "2022-10-25T04:48:55.849506Z", "created": "2022-10-01T02:16:16.688543Z", "deployed": "2022-10-01T02:16:16.084531Z", "configured": "2022-10-01T02:16:16.688543Z" }, { "style": "legacy", "name": "osd.5", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@5", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.2", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@2", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.4", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@4", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.11", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@11", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.1", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@1", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.3", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@3", "enabled": false, "state": "stopped", "host_version": "17.2.4" } ] 2022-10-25T04:49:29.106067+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 159 : cephadm [DBG] Refreshed host ceph01.domain.local daemons (15) 2022-10-25T04:49:29.129137+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 160 : cephadm [DBG] Refreshing ceph01.domain.local facts 2022-10-25T04:49:29.129537+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 161 : cephadm [DBG] _run_cephadm : command = gather-facts 2022-10-25T04:49:29.129578+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 162 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:29.129653+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 163 : cephadm [DBG] args: gather-facts 2022-10-25T04:49:29.129717+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 164 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:29.144277+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 165 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde gather-facts 2022-10-25T04:49:29.317666+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 166 : cephadm [DBG] code: 0 2022-10-25T04:49:29.317703+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 167 : cephadm [DBG] out: { "arch": "x86_64", "bios_date": "07/08/2022", "bios_version": "1.1.24", "cpu_cores": 8, "cpu_count": 1, "cpu_load": { "15min": 0.81, "1min": 7.92, "5min": 2.28 }, "cpu_model": "Intel(R) Core(TM) i7-9700 CPU @ 3.00GHz", "cpu_threads": 8, "flash_capacity": "1.9TB", "flash_capacity_bytes": 1900019703808, "flash_count": 13, "flash_list": [ { "description": "Unknown Unknown (58.3MB)", "dev_name": "loop1", "disk_size_bytes": 58261504, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown INTEL OptaneDisk (14.4GB)", "dev_name": "nvme0n1", "disk_size_bytes": 144Unknown39936, "model": "INTEL OptaneDisk", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (71.1MB)", "dev_name": "loop6", "disk_size_bytes": 71106560, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (50.3MB)", "dev_name": "loop4", "disk_size_bytes": 50315264, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown INTEL OptaneDisk (14.4GB)", "dev_name": "nvme2n1", "disk_size_bytes": 144Unknown39936, "model": "INTEL OptaneDisk", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (66.3MB)", "dev_name": "loop2", "disk_size_bytes": 66293760, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (58.1MB)", "dev_name": "loop0", "disk_size_bytes": 58130432, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop7", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown INTEL OptaneDisk (14.4GB)", "dev_name": "nvme1n1", "disk_size_bytes": 144Unknown39936, "model": "INTEL OptaneDisk", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "SSDBrand SSDDisk (1.6TB)", "dev_name": "sda", "disk_size_bytes": 160Unknown1314816, "model": "SSDDisk", "rev": "Unknown", "vendor": "SSDBrand", "wwid": "naa.50011731001f6768" }, { "description": "Unknown Unknown (50.3MB)", "dev_name": "loop5", "disk_size_bytes": 50319360, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (73.7MB)", "dev_name": "loop3", "disk_size_bytes": 73728000, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "ATA SSDDisk (256.1GB)", "dev_name": "sdh", "disk_size_bytes": 256060514304, "model": "SSDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.500a075109102ad4" } ], "hdd_capacity": "195.8TB", "hdd_capacity_bytes": 195812959805440, "hdd_count": 6, "hdd_list": [ { "description": "HDDBrand HDDDisk (9.8TB)", "dev_name": "sdf", "disk_size_bytes": 9796820402176, "model": "HDDDisk", "rev": "Unknown", "vendor": "HDDBrand", "wwid": "naa.5000cca2680d87e8" }, { "description": "HDDBrand HDDDisk (80.0TB)", "dev_name": "sdd", "disk_size_bytes": 80006650789888, "model": "HDDDisk", "rev": "Unknown", "vendor": "HDDBrand", "wwid": "naa.5000cca25142d78c" }, { "description": "HDDBrand HDDDisk (6.0TB)", "dev_name": "sdb", "disk_size_bytes": 6001175126016, "model": "HDDDisk", "rev": "Unknown", "vendor": "HDDBrand", "wwid": "naa.5000cca23250914c" }, { "description": "HDDBrand HDDDisk (10.0TB)", "dev_name": "sdg", "disk_size_bytes": 10000831348736, "model": "HDDDisk", "rev": "Unknown", "vendor": "HDDBrand", "wwid": "naa.5000cca26603bf54" }, { "description": "HDDBrand HDDDisk (80.0TB)", "dev_name": "sde", "disk_size_bytes": 80006650789888, "model": "HDDDisk", "rev": "Unknown", "vendor": "HDDBrand", "wwid": "naa.5000cca27312f758" }, { "description": "HDDBrand HDDDisk (10.0TB)", "dev_name": "sdc", "disk_size_bytes": 10000831348736, "model": "HDDDisk", "rev": "Unknown", "vendor": "HDDBrand", "wwid": "naa.5000cca26603edf0" } ], "hostname": "ceph01.domain.local", "interfaces": { "docker0": { "driver": "", "iftype": "logical", "ipv4_address": "172.17.0.1/16", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "enp4s0": { "driver": "alx", "iftype": "physical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "enp5s0": { "driver": "mlx4_core", "iftype": "physical", "ipv4_address": "192.168.10.210/24", "ipv6_address": "fe80::e61d:2dff:fe7e:8f30/64", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "up", "speed": 10000, "upper_devs_list": [] } }, "kernel": "5.4.0-131-generic", "kernel_parameters": { "net.ipv4.ip_nonlocal_bind": "0" }, "kernel_security": { "description": "AppArmor: Enabled(31 enforce)", "enforce": 31, "type": "AppArmor" }, "memory_available_kb": 41976572, "memory_free_kb": 36887372, "memory_total_kb": 49183252, "model": "XPS (XPS 8930)", "nic_count": 2, "operating_system": "Ubuntu 20.04.5 LTS (Focal Fossa)", "selinux_enabled": false, "subscribed": "Unknown", "system_uptime": 181.37, "tcp6_ports_used": [ 9094, 9095, 9100, 22, 3000, 8443, 9283, 9093 ], "tcp_ports_used": [ 6854, 6822, 6855, 6823, 6856, 6824, 6857, 6825, 6858, 6826, 6859, 6827, 6828, 6829, 7150, 6830, 6831, 6832, 6800, 6833, 6801, 6834, 6802, 6835, 6803, 6836, 6804, 6837, 6805, 53, 6838, 6806, 22, 6839, 6807, 6840, 6808, 6841, 6809, 6842, 6810, 6843, 6811, 6844, 6812, 6845, 6813, 6846, 6814, 6847, 6815, 6848, 6816, 6849, 6817, 6850, 6818, 6851, 6819, 6852, 6820, 3300, 6853, 6821, 6789 ], "timestamp": 1666673369.3036141, "udp6_ports_used": [ 9094, 323 ], "udp_ports_used": [ 53, 68, 323 ], "vendor": "Dell Inc." } 2022-10-25T04:49:29.318000+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 168 : cephadm [DBG] Refreshing ceph01.domain.local networks 2022-10-25T04:49:29.318223+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 169 : cephadm [DBG] _run_cephadm : command = list-networks 2022-10-25T04:49:29.318280+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 170 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:29.318390+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 171 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:49:29.318424+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 172 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-25T04:49:29.318509+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 173 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:29.333722+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 174 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-25T04:49:29.467154+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 176 : cephadm [DBG] code: 0 2022-10-25T04:49:29.467192+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 177 : cephadm [DBG] out: { "172.17.0.0/16": { "docker0": [ "172.17.0.1" ] }, "192.168.10.0/24": { "enp5s0": [ "192.168.10.210" ] }, "192.168.10.1/32": { "enp5s0": [ "192.168.10.210" ] }, "fe80::/64": { "enp5s0": [ "fe80::e61d:2dff:fe7e:8f30" ] } } 2022-10-25T04:49:29.467410+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 178 : cephadm [DBG] Refreshed host ceph01.domain.local networks (4) 2022-10-25T04:49:29.490571+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 179 : cephadm [DBG] refreshing ceph01.domain.local devices 2022-10-25T04:49:29.490886+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 180 : cephadm [DBG] _run_cephadm : command = ceph-volume 2022-10-25T04:49:29.490962+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 181 : cephadm [DBG] _run_cephadm : args = ['--', 'inventory', '--format=json-pretty', '--filter-for-batch'] 2022-10-25T04:49:29.491047+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 182 : cephadm [DBG] osd container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:49:29.491084+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 183 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-25T04:49:29.491131+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 184 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:29.506747+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 185 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-25T04:49:38.260257+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 188 : cephadm [DBG] code: 0 2022-10-25T04:49:38.260296+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 189 : cephadm [DBG] out: [ { "available": false, "ceph_device": null, "device_id": "INTEL_OptaneDisk_001", "lsm_data": {}, "lvs": [ { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-01-01", "osd_fsid": "8419be1d-235f-42b7-bec3-33256b88a2d4", "osd_id": "1", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "wal", "wal_uuid": "y1ETB1-Ahf1-1mIF-VnQ0-aITP-fhrd-90lGXZ" }, { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-01-02", "osd_fsid": "45fc4ace-e22a-4ae3-bbe8-82d980d7a097", "osd_id": "2", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "wal", "wal_uuid": "RvAwob-fYX3-hcT8-rDBr-N3a1-i0MV-izCQBR" } ], "path": "/dev/nvme0n1", "rejected_reasons": [ "locked", "LVM detected" ], "sys_api": { "human_readable_size": "13.41 GB", "locked": 1, "model": "INTEL OptaneDisk", "nr_requests": "127", "partitions": {}, "path": "/dev/nvme0n1", "removable": "0", "rev": "", "ro": "0", "rotational": "0", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "none", "sectors": 0, "sectorsize": "512", "size": 144Unknown39936.0, "support_discard": "512", "vendor": "" } }, { "available": false, "ceph_device": null, "device_id": "INTEL_OptaneDisk_003", "lsm_data": {}, "lvs": [ { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-02-01", "osd_fsid": "fbf747ec-5209-485c-a346-be4156095432", "osd_id": "3", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "wal", "wal_uuid": "0d5H7K-QHiP-AM5r-LTjD-VLOq-PteJ-degc8L" }, { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-02-02", "osd_fsid": "2dbc70d6-f927-4f29-8ab7-80e7b8501c34", "osd_id": "4", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "wal", "wal_uuid": "VLnK8i-Omwq-pc6e-HLVL-iL0e-6W6L-lFLbzT" } ], "path": "/dev/nvme1n1", "rejected_reasons": [ "locked", "LVM detected" ], "sys_api": { "human_readable_size": "13.41 GB", "locked": 1, "model": "INTEL OptaneDisk", "nr_requests": "127", "partitions": {}, "path": "/dev/nvme1n1", "removable": "0", "rev": "", "ro": "0", "rotational": "0", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "none", "sectors": 0, "sectorsize": "512", "size": 144Unknown39936.0, "support_discard": "512", "vendor": "" } }, { "available": false, "ceph_device": null, "device_id": "INTEL_OptaneDisk_004", "lsm_data": {}, "lvs": [ { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-03-01", "osd_fsid": "7b866a65-297b-4bed-92a1-bc89f1dd1aab", "osd_id": "5", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "wal", "wal_uuid": "q62676-QwIG-XqPl-wmdJ-lleN-d0Zw-9VA2QH" }, { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-03-02", "osd_fsid": "e8d50c20-9a02-491c-8739-94f504daa728", "osd_id": "11", "osdspec_affinity": "None", "type": "wal", "wal_uuid": "YAeaY4-y1mG-uutT-nr9P-wWzu-QWjo-pfhbcQ" } ], "path": "/dev/nvme2n1", "rejected_reasons": [ "locked", "LVM detected" ], "sys_api": { "human_readable_size": "13.41 GB", "locked": 1, "model": "INTEL OptaneDisk", "nr_requests": "127", "partitions": {}, "path": "/dev/nvme2n1", "removable": "0", "rev": "", "ro": "0", "rotational": "0", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "none", "sectors": 0, "sectorsize": "512", "size": 144Unknown39936.0, "support_discard": "512", "vendor": "" } }, { "available": false, "ceph_device": null, "device_id": "SSDDisk_50011731001f6768", "lsm_data": {}, "lvs": [ { "block_uuid": "iGX1wl-GX3R-9z9z-RTT7-br3A-5GMe-RIR7e4", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-58b5eff9-8af5-4a18-8572-551b854808b1", "osd_fsid": "58b5eff9-8af5-4a18-8572-551b854808b1", "osd_id": "0", "osdspec_affinity": "dashboard-admin-1664591400232", "type": "block" } ], "path": "/dev/sda", "rejected_reasons": [ "locked", "Insufficient space (<10 extents) on vgs", "LVM detected" ], "sys_api": { "human_readable_size": "1.46 TB", "locked": 1, "model": "SSDDisk", "nr_requests": "256", "partitions": {}, "path": "/dev/sda", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "0", "sas_address": "0x50011731001f6769", "sas_device_handle": "0x000e", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 160Unknown1314816.0, "support_discard": "4096", "vendor": "SSDBrand" } }, { "available": false, "ceph_device": null, "device_id": "HDDDisk_5000cca23250914c", "lsm_data": {}, "lvs": [ { "block_uuid": "GQrDIs-vZ5H-dSPx-nCam-T900-RZpW-Hhurs5", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-e8d50c20-9a02-491c-8739-94f504daa728", "osd_fsid": "e8d50c20-9a02-491c-8739-94f504daa728", "osd_id": "11", "osdspec_affinity": "None", "type": "block" } ], "path": "/dev/sdb", "rejected_reasons": [ "locked", "Insufficient space (<10 extents) on vgs", "LVM detected" ], "sys_api": { "human_readable_size": "5.46 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "256", "partitions": {}, "path": "/dev/sdb", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "0x5000cca23250914d", "sas_device_handle": "0x0009", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 6001175126016.0, "support_discard": "0", "vendor": "HDDBrand" } }, { "available": false, "ceph_device": null, "device_id": "HDDDisk_5000cca26603edf0", "lsm_data": {}, "lvs": [ { "block_uuid": "eKLxSe-t2i6-d35O-XjLy-4MIC-SBYq-0KiErG", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-45fc4ace-e22a-4ae3-bbe8-82d980d7a097", "osd_fsid": "45fc4ace-e22a-4ae3-bbe8-82d980d7a097", "osd_id": "2", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "block" } ], "path": "/dev/sdc", "rejected_reasons": [ "locked", "Insufficient space (<10 extents) on vgs", "LVM detected" ], "sys_api": { "human_readable_size": "9.10 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "256", "partitions": {}, "path": "/dev/sdc", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "0x5000cca26603edf1", "sas_device_handle": "0x000a", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 10000831348736.0, "support_discard": "0", "vendor": "HDDBrand" } }, { "available": false, "ceph_device": null, "device_id": "HDDDisk_5000cca25142d78c", "lsm_data": {}, "lvs": [ { "block_uuid": "TkDATS-gDeZ-y0Cu-9CIp-7zd0-SGuf-T2OY2w", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-fbf747ec-5209-485c-a346-be4156095432", "osd_fsid": "fbf747ec-5209-485c-a346-be4156095432", "osd_id": "3", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "block" } ], "path": "/dev/sdd", "rejected_reasons": [ "locked", "Insufficient space (<10 extents) on vgs", "LVM detected" ], "sys_api": { "human_readable_size": "9.10 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "256", "partitions": {}, "path": "/dev/sdd", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "0x5000cca25142d78d", "sas_device_handle": "0x000b", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "4096", "size": 10000831348736.0, "support_discard": "0", "vendor": "HDDBrand" } }, { "available": false, "ceph_device": null, "device_id": "HDDDisk_5000cca27312f758", "lsm_data": {}, "lvs": [ { "block_uuid": "f3JXNg-aAID-YIs1-wJHE-iEkd-zD2m-ptDT1E", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-2dbc70d6-f927-4f29-8ab7-80e7b8501c34", "osd_fsid": "2dbc70d6-f927-4f29-8ab7-80e7b8501c34", "osd_id": "4", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "block" } ], "path": "/dev/sde", "rejected_reasons": [ "locked", "Insufficient space (<10 extents) on vgs", "LVM detected" ], "sys_api": { "human_readable_size": "9.10 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "256", "partitions": {}, "path": "/dev/sde", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "0x5000cca27312f759", "sas_device_handle": "0x000c", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "4096", "size": 10000831348736.0, "support_discard": "0", "vendor": "HDDBrand" } }, { "available": false, "ceph_device": null, "device_id": "HDDDisk_5000cca2680d87e8", "lsm_data": {}, "lvs": [ { "block_uuid": "qi4IiA-oTfk-j1DF-ZwVm-LRGD-mCXQ-eBB82M", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-7b866a65-297b-4bed-92a1-bc89f1dd1aab", "osd_fsid": "7b866a65-297b-4bed-92a1-bc89f1dd1aab", "osd_id": "5", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "block" } ], "path": "/dev/sdf", "rejected_reasons": [ "locked", "Insufficient space (<10 extents) on vgs", "LVM detected" ], "sys_api": { "human_readable_size": "8.91 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "256", "partitions": {}, "path": "/dev/sdf", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "0x5000cca2680d87e9", "sas_device_handle": "0x000d", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 9796820402176.0, "support_discard": "0", "vendor": "HDDBrand" } }, { "available": false, "ceph_device": null, "device_id": "HDDDisk_5000cca26603bf54", "lsm_data": {}, "lvs": [ { "block_uuid": "gFOFWG-aTxm-WhYN-RDnC-Ziyj-e3dd-xTPfia", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-8419be1d-235f-42b7-bec3-33256b88a2d4", "osd_fsid": "8419be1d-235f-42b7-bec3-33256b88a2d4", "osd_id": "1", "osdspec_affinity": "dashboard-admin-1664591518471", "type": "block" } ], "path": "/dev/sdg", "rejected_reasons": [ "locked", "Insufficient space (<10 extents) on vgs", "LVM detected" ], "sys_api": { "human_readable_size": "9.10 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "256", "partitions": {}, "path": "/dev/sdg", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "0x5000cca26603bf55", "sas_device_handle": "0x000f", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 10000831348736.0, "support_discard": "0", "vendor": "HDDBrand" } } ] 2022-10-25T04:49:38.26Unknown8+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 190 : cephadm [DBG] err: Inferring config /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/mon.ceph01.domain.local/config 2022-10-25T04:49:38.260731+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 191 : cephadm [DBG] Refreshed host ceph01.domain.local devices (10) 2022-10-25T04:49:38.261045+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 192 : cephadm [INF] Detected new or changed devices on ceph01.domain.local 2022-10-25T04:49:38.261110+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 193 : cephadm [DBG] Finding OSDSpecs for host: 2022-10-25T04:49:38.261151+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 194 : cephadm [DBG] Generating OSDSpec previews for [] 2022-10-25T04:49:38.261185+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 195 : cephadm [DBG] Loading OSDSpec previews to HostCache for host 2022-10-25T04:49:38.285491+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 196 : cephadm [DBG] autotuning memory for ceph01.domain.local 2022-10-25T04:49:38.286770+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 197 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:49:38.287832+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 198 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:49:38.288948+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 199 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:49:38.289945+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 200 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:49:38.290669+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 201 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:49:38.291450+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 202 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:49:38.292364+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 203 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:49:38.292485+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 204 : cephadm [INF] Adjusting osd_memory_target on ceph01.domain.local to 2883M 2022-10-25T04:49:38.308205+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 205 : cephadm [DBG] mon_command: 'config set' -> 0 in 0.016s 2022-10-25T04:49:38.308282+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 206 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.conf 2022-10-25T04:49:38.308544+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 207 : cephadm [DBG] Running command: mkdir -p /etc/ceph 2022-10-25T04:49:38.325534+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 208 : cephadm [DBG] Running command: mkdir -p /tmp/etc/ceph 2022-10-25T04:49:38.340822+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 209 : cephadm [DBG] Running command: touch /tmp/etc/ceph/ceph.conf.new 2022-10-25T04:49:38.364080+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 210 : cephadm [DBG] Running command: chown -R 0:0 /tmp/etc/ceph/ceph.conf.new 2022-10-25T04:49:38.380872+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 211 : cephadm [DBG] Running command: chmod 644 /tmp/etc/ceph/ceph.conf.new 2022-10-25T04:49:38.396406+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 212 : cephadm [DBG] Running command: mv /tmp/etc/ceph/ceph.conf.new /etc/ceph/ceph.conf 2022-10-25T04:49:38.412304+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 213 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-25T04:49:38.412536+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 214 : cephadm [DBG] Running command: mkdir -p /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config 2022-10-25T04:49:38.428418+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 215 : cephadm [DBG] Running command: mkdir -p /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config 2022-10-25T04:49:38.444501+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 216 : cephadm [DBG] Running command: touch /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf.new 2022-10-25T04:49:38.468491+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 217 : cephadm [DBG] Running command: chown -R 0:0 /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf.new 2022-10-25T04:49:38.484323+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 218 : cephadm [DBG] Running command: chmod 644 /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf.new 2022-10-25T04:49:38.500613+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 219 : cephadm [DBG] Running command: mv /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf.new /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.conf 2022-10-25T04:49:38.516055+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 220 : cephadm [INF] Updating ceph01.domain.local:/etc/ceph/ceph.client.admin.keyring 2022-10-25T04:49:38.516370+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 221 : cephadm [DBG] Running command: mkdir -p /etc/ceph 2022-10-25T04:49:38.531714+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 222 : cephadm [DBG] Running command: mkdir -p /tmp/etc/ceph 2022-10-25T04:49:38.547046+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 223 : cephadm [DBG] Running command: touch /tmp/etc/ceph/ceph.client.admin.keyring.new 2022-10-25T04:49:38.570077+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 224 : cephadm [DBG] Running command: chown -R 0:0 /tmp/etc/ceph/ceph.client.admin.keyring.new 2022-10-25T04:49:38.586462+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 225 : cephadm [DBG] Running command: chmod 600 /tmp/etc/ceph/ceph.client.admin.keyring.new 2022-10-25T04:49:38.601889+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 226 : cephadm [DBG] Running command: mv /tmp/etc/ceph/ceph.client.admin.keyring.new /etc/ceph/ceph.client.admin.keyring 2022-10-25T04:49:38.618194+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 228 : cephadm [INF] Updating ceph01.domain.local:/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring 2022-10-25T04:49:38.618518+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 229 : cephadm [DBG] Running command: mkdir -p /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config 2022-10-25T04:49:38.634805+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 230 : cephadm [DBG] Running command: mkdir -p /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config 2022-10-25T04:49:38.650424+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 231 : cephadm [DBG] Running command: touch /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring.new 2022-10-25T04:49:38.746673+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 232 : cephadm [DBG] Running command: chown -R 0:0 /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring.new 2022-10-25T04:49:38.763941+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 233 : cephadm [DBG] Running command: chmod 600 /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring.new 2022-10-25T04:49:38.779589+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 234 : cephadm [DBG] Running command: mv /tmp/var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring.new /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/config/ceph.client.admin.keyring 2022-10-25T04:49:49.010556+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 242 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde check-host 2022-10-25T04:49:49.549598+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 243 : cephadm [DBG] code: 0 2022-10-25T04:49:49.549637+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 244 : cephadm [DBG] err: docker (/usr/bin/docker) is present systemctl is present lvcreate is present Unit chrony.service is enabled and running Host looks OK 2022-10-25T04:49:49.569062+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 245 : cephadm [DBG] host ceph03.domain.local (192.168.10.80) ok 2022-10-25T04:49:49.569116+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 246 : cephadm [DBG] refreshing ceph03.domain.local daemons 2022-10-25T04:49:49.569452+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 247 : cephadm [DBG] _run_cephadm : command = ls 2022-10-25T04:49:49.569490+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 248 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:49:49.569573+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 249 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:49:49.569609+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 250 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-25T04:49:49.569654+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 251 : cephadm [DBG] Running command: which python3 2022-10-25T04:49:49.602803+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 252 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ls 2022-10-25T04:50:11.272429+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 271 : cephadm [DBG] code: 0 2022-10-25T04:50:11.272524+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 272 : cephadm [DBG] out: [ { "style": "cephadm:v1", "name": "osd.10", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.10", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664593093131", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": null, "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": null, "container_image_digests": null, "version": null, "started": null, "created": "2022-10-02T18:10:11.780308Z", "deployed": "2022-10-02T18:10:10.940332Z", "configured": "2022-10-02T18:10:11.780308Z" }, { "style": "cephadm:v1", "name": "node-exporter.ceph03", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@node-exporter.ceph03", "enabled": true, "state": "running", "service_name": "node-exporter", "ports": [ 9100 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "eb094fb1b5753c3fd22279d4cca94ffb384a3d5769bd2827ee3fea6abe679233", "container_image_name": "quay.io/prometheus/node-exporter:v1.3.1", "container_image_id": "1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26", "container_image_digests": [ "quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd" ], "memory_usage": null, "cpu_percentage": null, "version": "", "started": "2022-10-25T04:49:44.686934Z", "created": "2022-10-01T02:37:41.830627Z", "deployed": "2022-10-01T02:37:40.794658Z", "configured": "2022-10-01T02:37:41.830627Z" }, { "style": "cephadm:v1", "name": "crash.ceph03", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@crash.ceph03", "enabled": true, "state": "running", "service_name": "crash", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "415ff20c329c84642e20af64b021ed1ebe30f038de27bdeda43cb7187e6b096c", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": null, "cpu_percentage": null, "version": "17.2.3", "started": "2022-10-25T04:49:44.685638Z", "created": "2022-10-01T02:37:29.059001Z", "deployed": "2022-10-01T02:37:26.663072Z", "configured": "2022-10-01T02:39:05.240184Z" }, { "style": "cephadm:v1", "name": "osd.12", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.12", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664591400232", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": null, "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": null, "container_image_digests": null, "version": null, "started": null, "created": "2022-10-02T01:36:27.051794Z", "deployed": "2022-10-02T01:36:26.295816Z", "configured": "2022-10-02T01:36:27.051794Z" }, { "style": "cephadm:v1", "name": "osd.7", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.7", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664593093131", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": null, "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": null, "container_image_digests": null, "version": null, "started": null, "created": "2022-10-02T18:10:38.203545Z", "deployed": "2022-10-02T18:10:37.419567Z", "configured": "2022-10-02T18:10:38.203545Z" }, { "style": "cephadm:v1", "name": "osd.9", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.9", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664593093131", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": null, "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": null, "container_image_digests": null, "version": null, "started": null, "created": "2022-10-02T18:11:12.482553Z", "deployed": "2022-10-02T18:11:11.594579Z", "configured": "2022-10-02T18:11:12.482553Z" }, { "style": "cephadm:v1", "name": "mds.mds-default.ceph03.ptkjle", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mds.mds-default.ceph03.ptkjle", "enabled": true, "state": "running", "service_name": "mds.mds-default", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "543f9e1a67fd484f9264d82ff8d48f57a665f448122bfc4391869eb80488a1e9", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": null, "cpu_percentage": null, "version": "17.2.3", "started": "2022-10-25T04:49:44.673167Z", "created": "2022-10-01T02:52:46.740393Z", "deployed": "2022-10-01T02:52:45.812418Z", "configured": "2022-10-01T02:52:46.740393Z" }, { "style": "cephadm:v1", "name": "osd.8", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.8", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664593093131", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": null, "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": null, "container_image_digests": null, "version": null, "started": null, "created": "2022-10-02T18:10:58.054971Z", "deployed": "2022-10-02T18:10:57.138997Z", "configured": "2022-10-02T18:10:58.054971Z" }, { "style": "cephadm:v1", "name": "osd.6", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@osd.6", "enabled": true, "state": "running", "service_name": "osd.dashboard-admin-1664593093131", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": null, "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": null, "container_image_digests": null, "version": null, "started": null, "created": "2022-10-02T18:10:23.571968Z", "deployed": "2022-10-02T18:10:22.79UnknownZ", "configured": "2022-10-02T18:10:23.571968Z" }, { "style": "cephadm:v1", "name": "mon.ceph03", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mon.ceph03", "enabled": true, "state": "running", "service_name": "mon", "ports": [], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "90bc36780ad0f57da7502774ddb5fd2b2d15ab1fc7f269d809afae6e9703df24", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": null, "cpu_percentage": null, "version": "17.2.3", "started": "2022-10-25T04:49:44.680537Z", "created": "2022-10-01T02:37:40.494667Z", "deployed": "2022-10-01T02:37:39.734689Z", "configured": "2022-10-01T02:39:08.180098Z" }, { "style": "cephadm:v1", "name": "mgr.ceph03.haayqy", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-cdffec50-412e-11ed-a95e-8be7dd44d8f3@mgr.ceph03.haayqy", "enabled": true, "state": "running", "service_name": "mgr", "ports": [ 8443, 9283 ], "ip": null, "deployed_by": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "rank": null, "rank_generation": null, "extra_container_args": null, "memory_request": null, "memory_limit": null, "container_id": "5bddb56359cb8ad6e7c7a730d30ca255194635d551543df4e24a9d167a3fe288", "container_image_name": "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a", "container_image_id": "0912465dcea5159f56c7d4ccdf1d15a28abfe1be8a56c94eb86cab129c069726", "container_image_digests": [ "quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a" ], "memory_usage": null, "cpu_percentage": null, "version": "17.2.3", "started": "2022-10-25T04:49:44.675417Z", "created": "2022-10-01T02:37:33.198880Z", "deployed": "2022-10-01T02:37:32.494901Z", "configured": "2022-10-01T02:39:11.196009Z" }, { "style": "legacy", "name": "osd.7", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@7", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.10", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@10", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.9", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@9", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.6", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@6", "enabled": false, "state": "stopped", "host_version": "17.2.4" }, { "style": "legacy", "name": "osd.8", "fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "systemd_unit": "ceph-osd@8", "enabled": false, "state": "stopped", "host_version": "17.2.4" } ] 2022-10-25T04:50:11.274431+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 273 : cephadm [DBG] Refreshed host ceph03.domain.local daemons (11) 2022-10-25T04:50:11.356471+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 274 : cephadm [DBG] Refreshing ceph03.domain.local facts 2022-10-25T04:50:11.357312+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 275 : cephadm [DBG] _run_cephadm : command = gather-facts 2022-10-25T04:50:11.357534+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 276 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:50:11.357741+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 277 : cephadm [DBG] args: gather-facts 2022-10-25T04:50:11.357969+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 278 : cephadm [DBG] Running command: which python3 2022-10-25T04:50:11.411912+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 279 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde gather-facts 2022-10-25T04:50:11.822852+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 280 : cephadm [DBG] code: 0 2022-10-25T04:50:11.822913+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 281 : cephadm [DBG] out: { "arch": "x86_64", "bios_date": "04/25/2013", "bios_version": "3703", "cpu_cores": 4, "cpu_count": 1, "cpu_load": { "15min": 1.1, "1min": 6.62, "5min": 2.75 }, "cpu_model": "Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz", "cpu_threads": 8, "flash_capacity": "1.6TB", "flash_capacity_bytes": 1629127794688, "flash_count": 3, "flash_list": [ { "description": "Unknown INTEL OptaneDisk (14.4GB)", "dev_name": "nvme0n1", "disk_size_bytes": 144Unknown39936, "model": "INTEL OptaneDisk", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "SSDBrand SSDDisk (1.6TB)", "dev_name": "sdg", "disk_size_bytes": 160Unknown1314816, "model": "SSDDisk", "rev": "Unknown", "vendor": "SSDBrand", "wwid": "naa.50011731001f6358" }, { "description": "Unknown INTEL OptaneDisk (14.4GB)", "dev_name": "nvme1n1", "disk_size_bytes": 144Unknown39936, "model": "INTEL OptaneDisk", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" } ], "hdd_capacity": "16.3TB", "hdd_capacity_bytes": 16303656165376, "hdd_count": 14, "hdd_list": [ { "description": "Unknown Unknown (58.3MB)", "dev_name": "loop1", "disk_size_bytes": 58261504, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "ATA HDDDisk (3.0TB)", "dev_name": "sdf", "disk_size_bytes": 3000592982016, "model": "HDDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.5000cca248d386a6" }, { "description": "ATA HDDDisk (3.0TB)", "dev_name": "sdd", "disk_size_bytes": 3000592982016, "model": "HDDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.5000cca248d3b622" }, { "description": "ATA HDDDisk (300.1GB)", "dev_name": "sdb", "disk_size_bytes": 300069052416, "model": "HDDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "t10.ATA HDDDisk 4NF0DJV7" }, { "description": "Unknown Unknown (50.3MB)", "dev_name": "loop6", "disk_size_bytes": 50315264, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (50.3MB)", "dev_name": "loop4", "disk_size_bytes": 50319360, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (66.3MB)", "dev_name": "loop2", "disk_size_bytes": 66293760, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (71.1MB)", "dev_name": "loop0", "disk_size_bytes": 71106560, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "ATA HDDDisk (3.0TB)", "dev_name": "sde", "disk_size_bytes": 3000592982016, "model": "HDDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.5000cca248d3eccd" }, { "description": "ATA HDDDisk (3.0TB)", "dev_name": "sdc", "disk_size_bytes": 3000592982016, "model": "HDDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.5000cca248d3a7f4" }, { "description": "Unknown Unknown (0.0)", "dev_name": "loop7", "disk_size_bytes": 0, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "ATA HDDDisk (4.0TB)", "dev_name": "sda", "disk_size_bytes": 4000787030016, "model": "HDDDisk", "rev": "Unknown", "vendor": "ATA", "wwid": "naa.5000cca23dd7dca8" }, { "description": "Unknown Unknown (73.7MB)", "dev_name": "loop5", "disk_size_bytes": 73728000, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" }, { "description": "Unknown Unknown (58.1MB)", "dev_name": "loop3", "disk_size_bytes": 58130432, "model": "Unknown", "rev": "Unknown", "vendor": "Unknown", "wwid": "Unknown" } ], "hostname": "ceph03.domain.local", "interfaces": { "docker0": { "driver": "", "iftype": "logical", "ipv4_address": "172.17.0.1/16", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "bridge", "operstate": "down", "speed": -1, "upper_devs_list": [] }, "enp1s0": { "driver": "mlx4_core", "iftype": "physical", "ipv4_address": "192.168.10.80/24", "ipv6_address": "fe80::e61d:2dff:fe7e:7f70/64", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "up", "speed": 10000, "upper_devs_list": [] }, "enp7s0": { "driver": "r8169", "iftype": "physical", "ipv4_address": "", "ipv6_address": "", "lower_devs_list": [], "mtu": 1500, "nic_type": "ethernet", "operstate": "down", "speed": -1, "upper_devs_list": [] } }, "kernel": "5.4.0-131-generic", "kernel_parameters": { "net.ipv4.ip_nonlocal_bind": "0" }, "kernel_security": { "description": "AppArmor: Enabled(31 enforce)", "enforce": 31, "type": "AppArmor" }, "memory_available_kb": 31673412, "memory_free_kb": 31338824, "memory_total_kb": 32849760, "model": "To be filled by O.E.M. (System Product Name)", "nic_count": 2, "operating_system": "Ubuntu 20.04.5 LTS (Focal Fossa)", "selinux_enabled": false, "subscribed": "Unknown", "system_uptime": 237.76, "tcp6_ports_used": [ 9100, 22 ], "tcp_ports_used": [ 3300, 6789, 6800, 6801, 53, 22 ], "timestamp": 1666673411.803584, "udp6_ports_used": [ 323 ], "udp_ports_used": [ 53, 68, 323 ], "vendor": "System manufacturer" } 2022-10-25T04:50:11.823273+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 282 : cephadm [DBG] Refreshing ceph03.domain.local networks 2022-10-25T04:50:11.823541+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 283 : cephadm [DBG] _run_cephadm : command = list-networks 2022-10-25T04:50:11.823630+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 284 : cephadm [DBG] _run_cephadm : args = [] 2022-10-25T04:50:11.823726+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 285 : cephadm [DBG] mon container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:50:11.823776+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 286 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-25T04:50:11.823839+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 287 : cephadm [DBG] Running command: which python3 2022-10-25T04:50:11.852948+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 288 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a list-networks 2022-10-25T04:50:12.068659+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 289 : cephadm [DBG] code: 0 2022-10-25T04:50:12.068745+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 290 : cephadm [DBG] out: { "172.17.0.0/16": { "docker0": [ "172.17.0.1" ] }, "192.168.10.0/24": { "enp1s0": [ "192.168.10.80" ] }, "192.168.10.1/32": { "enp1s0": [ "192.168.10.80" ] }, "fe80::/64": { "enp1s0": [ "fe80::e61d:2dff:fe7e:7f70" ] } } 2022-10-25T04:50:12.069029+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 291 : cephadm [DBG] Refreshed host ceph03.domain.local networks (4) 2022-10-25T04:50:12.437728+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 293 : cephadm [DBG] refreshing ceph03.domain.local devices 2022-10-25T04:50:12.438217+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 294 : cephadm [DBG] _run_cephadm : command = ceph-volume 2022-10-25T04:50:12.438337+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 295 : cephadm [DBG] _run_cephadm : args = ['--', 'inventory', '--format=json-pretty', '--filter-for-batch'] 2022-10-25T04:50:12.438497+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 296 : cephadm [DBG] osd container image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a 2022-10-25T04:50:12.438600+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 297 : cephadm [DBG] args: --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-25T04:50:12.438718+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 298 : cephadm [DBG] Running command: which python3 2022-10-25T04:50:12.479536+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 299 : cephadm [DBG] Running command: /usr/bin/python3 /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/cephadm.9f5947044415209b488d90a5f9b9807235c9c2dc29836a12b73019a60ec20bde --image quay.io/ceph/ceph@sha256:43f6e905f3e34abe4adbc9042b9d6f6b625dee8fa8d93c2bae53fa9b61c3df1a ceph-volume --fsid cdffec50-412e-11ed-a95e-8be7dd44d8f3 -- inventory --format=json-pretty --filter-for-batch 2022-10-25T04:51:01.338083+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 335 : cephadm [DBG] code: 0 2022-10-25T04:51:01.338148+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 336 : cephadm [DBG] out: [ { "available": false, "ceph_device": null, "device_id": "INTEL_OptaneDisk_002", "lsm_data": {}, "lvs": [ { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-01-01", "osd_fsid": "2ad6eefa-30aa-4a90-96fe-714b85f05007", "osd_id": "6", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "wal", "wal_uuid": "Gz69zo-12VM-vvl7-ncLU-YZbM-ZfG7-RlAXt3" }, { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-01-02", "osd_fsid": "85711c45-5f16-44f4-92f5-8a6b3e916da5", "osd_id": "7", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "wal", "wal_uuid": "mvLm0K-WRbB-51yt-0bFU-yKqO-Osuw-GQNnXI" }, { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-01-03", "osd_fsid": "0493cedf-05f7-450b-9531-f6e765084dca", "osd_id": "8", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "wal", "wal_uuid": "GgLFrE-lRVq-uvaB-apCn-ve2v-a4jU-L2fkih" } ], "path": "/dev/nvme0n1", "rejected_reasons": [ "LVM detected", "locked" ], "sys_api": { "human_readable_size": "13.41 GB", "locked": 1, "model": "INTEL OptaneDisk", "nr_requests": "127", "partitions": {}, "path": "/dev/nvme0n1", "removable": "0", "rev": "", "ro": "0", "rotational": "0", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "none", "sectors": 0, "sectorsize": "512", "size": 144Unknown39936.0, "support_discard": "512", "vendor": "" } }, { "available": false, "ceph_device": null, "device_id": "INTEL_OptaneDisk_PHBT84610AB1016N", "lsm_data": {}, "lvs": [ { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-02-01", "osd_fsid": "4c7941ab-bb1c-49bb-90e8-029fa3475f2e", "osd_id": "9", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "wal", "wal_uuid": "0XCRpd-1y39-ZSKw-pAUT-AuPZ-x0FY-hBJ5mr" }, { "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "ceph-walvol-02-02", "osd_fsid": "feb52321-97c3-469d-a11b-594f952dd569", "osd_id": "10", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "wal", "wal_uuid": "kQHM82-a042-WdAt-dJ9I-VPkY-m3UE-qVEe3f" } ], "path": "/dev/nvme1n1", "rejected_reasons": [ "LVM detected", "locked" ], "sys_api": { "human_readable_size": "13.41 GB", "locked": 1, "model": "INTEL OptaneDisk", "nr_requests": "127", "partitions": {}, "path": "/dev/nvme1n1", "removable": "0", "rev": "", "ro": "0", "rotational": "0", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "none", "sectors": 0, "sectorsize": "512", "size": 144Unknown39936.0, "support_discard": "512", "vendor": "" } }, { "available": false, "ceph_device": null, "device_id": "HDDBrand_HUS724040AL_PK1334PBHPH8PP", "lsm_data": {}, "lvs": [ { "block_uuid": "37wczG-g2V5-suUO-JDaf-U03N-kV3N-pWnBxk", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-2ad6eefa-30aa-4a90-96fe-714b85f05007", "osd_fsid": "2ad6eefa-30aa-4a90-96fe-714b85f05007", "osd_id": "6", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "block" } ], "path": "/dev/sda", "rejected_reasons": [ "LVM detected", "locked", "Insufficient space (<10 extents) on vgs" ], "sys_api": { "human_readable_size": "3.64 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "64", "partitions": {}, "path": "/dev/sda", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 4000787030016.0, "support_discard": "0", "vendor": "ATA" } }, { "available": false, "ceph_device": null, "device_id": "HITACHI_HUS72403_P9HD7G6Y", "lsm_data": {}, "lvs": [ { "block_uuid": "52RfjW-rriV-Amp3-Gihy-7rB0-IKi2-0TdX1C", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-85711c45-5f16-44f4-92f5-8a6b3e916da5", "osd_fsid": "85711c45-5f16-44f4-92f5-8a6b3e916da5", "osd_id": "7", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "block" } ], "path": "/dev/sdc", "rejected_reasons": [ "LVM detected", "locked", "Insufficient space (<10 extents) on vgs" ], "sys_api": { "human_readable_size": "2.73 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "64", "partitions": {}, "path": "/dev/sdc", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 3000592982016.0, "support_discard": "0", "vendor": "ATA" } }, { "available": false, "ceph_device": null, "device_id": "HITACHI_HUS72403_P9HDB79Y", "lsm_data": {}, "lvs": [ { "block_uuid": "ec9Brn-RKKp-MqqA-fjA7-SIhH-WBKd-t9mJoB", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-0493cedf-05f7-450b-9531-f6e765084dca", "osd_fsid": "0493cedf-05f7-450b-9531-f6e765084dca", "osd_id": "8", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "block" } ], "path": "/dev/sdd", "rejected_reasons": [ "LVM detected", "locked", "Insufficient space (<10 extents) on vgs" ], "sys_api": { "human_readable_size": "2.73 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "64", "partitions": {}, "path": "/dev/sdd", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 3000592982016.0, "support_discard": "0", "vendor": "ATA" } }, { "available": false, "ceph_device": null, "device_id": "HITACHI_HUS72403_P9HDUTSY", "lsm_data": {}, "lvs": [ { "block_uuid": "gtYfBc-avfH-KALM-HMr3-5v9Z-4J6b-c7THFL", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-4c7941ab-bb1c-49bb-90e8-029fa3475f2e", "osd_fsid": "4c7941ab-bb1c-49bb-90e8-029fa3475f2e", "osd_id": "9", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "block" } ], "path": "/dev/sde", "rejected_reasons": [ "LVM detected", "locked", "Insufficient space (<10 extents) on vgs" ], "sys_api": { "human_readable_size": "2.73 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "64", "partitions": {}, "path": "/dev/sde", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 3000592982016.0, "support_discard": "0", "vendor": "ATA" } }, { "available": false, "ceph_device": null, "device_id": "HITACHI_HUS72403_P9HBYL5Y", "lsm_data": {}, "lvs": [ { "block_uuid": "p8RhHr-YNC4-f10j-ajMS-o3xH-Mgxy-vUyEk6", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-feb52321-97c3-469d-a11b-594f952dd569", "osd_fsid": "feb52321-97c3-469d-a11b-594f952dd569", "osd_id": "10", "osdspec_affinity": "dashboard-admin-1664593093131", "type": "block" } ], "path": "/dev/sdf", "rejected_reasons": [ "LVM detected", "locked", "Insufficient space (<10 extents) on vgs" ], "sys_api": { "human_readable_size": "2.73 TB", "locked": 1, "model": "HDDDisk", "nr_requests": "64", "partitions": {}, "path": "/dev/sdf", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "1", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 3000592982016.0, "support_discard": "0", "vendor": "ATA" } }, { "available": false, "ceph_device": null, "device_id": "SSDDisk_50011731001f6358", "lsm_data": {}, "lvs": [ { "block_uuid": "9oXlnn-m0im-Dv3G-N3cR-OXjp-CHXF-dBvAzc", "cluster_fsid": "cdffec50-412e-11ed-a95e-8be7dd44d8f3", "cluster_name": "ceph", "name": "osd-block-a5150aab-02b0-44a6-a1c8-67a5b74b4dc9", "osd_fsid": "a5150aab-02b0-44a6-a1c8-67a5b74b4dc9", "osd_id": "12", "osdspec_affinity": "dashboard-admin-1664591400232", "type": "block" } ], "path": "/dev/sdg", "rejected_reasons": [ "LVM detected", "locked", "Insufficient space (<10 extents) on vgs" ], "sys_api": { "human_readable_size": "1.46 TB", "locked": 1, "model": "SSDDisk", "nr_requests": "254", "partitions": {}, "path": "/dev/sdg", "removable": "0", "rev": "Unknown", "ro": "0", "rotational": "0", "sas_address": "", "sas_device_handle": "", "scheduler_mode": "mq-deadline", "sectors": 0, "sectorsize": "512", "size": 160Unknown1314816.0, "support_discard": "4096", "vendor": "SSDBrand" } } ] 2022-10-25T04:51:01.338199+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 337 : cephadm [DBG] err: Inferring config /var/lib/ceph/cdffec50-412e-11ed-a95e-8be7dd44d8f3/mon.ceph03/config 2022-10-25T04:51:01.338400+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 338 : cephadm [DBG] Refreshed host ceph03.domain.local devices (8) 2022-10-25T04:51:01.338623+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 339 : cephadm [INF] Detected new or changed devices on ceph03.domain.local 2022-10-25T04:51:01.338678+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 340 : cephadm [DBG] Finding OSDSpecs for host: 2022-10-25T04:51:01.338713+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 341 : cephadm [DBG] Generating OSDSpec previews for [] 2022-10-25T04:51:01.338742+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 342 : cephadm [DBG] Loading OSDSpec previews to HostCache for host 2022-10-25T04:51:01.478216+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 343 : cephadm [DBG] autotuning memory for ceph03.domain.local 2022-10-25T04:51:01.479454+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 344 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:51:01.480387+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 345 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:51:01.481404+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 346 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:51:01.482460+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 347 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:51:01.483432+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 348 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:51:01.484276+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 349 : cephadm [DBG] mon_command: 'config rm' -> 0 in 0.001s 2022-10-25T04:51:01.484340+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 350 : cephadm [INF] Adjusting osd_memory_target on ceph03.domain.local to 2014M 2022-10-25T04:51:01.587722+0000 mgr.ceph01.domain.local.miydsy (mgr.12644112) 351 : cephadm [DBG] mon_command: 'config set' -> 0 in 0.103s