Ceph

per Wido's comment in #16982-7,

I tried adding new OSDs to the cluster and they also have to catch up, which never happens until I restart them over and over.
osd.136 in this case is a fresh OSD. You can see it jumps with 1.000 maps (osd_map_message_max), but then just waits.
I restart the osd, it goes 1k maps forward and waits. I restart, etc, etc.

and the root cause is analyzed at #16982-11.

in short, the problem here, due to "ceph osd pause", the subscription sent by objecter always gets in the way of OSD, so the latter cannot subscribe for the older osdmap to catch up with the cluster.

so a workaround is to not "ceph osd pause".