Ceph » RADOS

I tried to recover mon quorum from OSDs with the following document.

https://github.com/ceph/ceph/blob/master/doc/rados/troubleshooting/troubleshooting-mon.rst#recovery-using-osds

There are three mons a, b, and c in my cluster.

```
$ kubectl get svc -n ceph-hdd
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT AGE
...
rook-ceph-mon-a ClusterIP 10.68.74.234 <none> 6789/TCP,3300/TCP 24h
rook-ceph-mon-b ClusterIP 10.68.56.39 <none> 6789/TCP,3300/TCP 24h
rook-ceph-mon-c ClusterIP 10.68.112.111 <none> 6789/TCP,3300/TCP 24h
...
```

Here `CLUSTER-IP` field means an IP address of each mon.

I ran `ceph-monstore-tool` and the names of mons are changed by mistake.

```
...
0: v1:10.68.56.39:6789/0 mon.a # Should be "mon.b"
1: v1:10.68.74.234:6789/0 mon.b # Should be "mon.a"
2: v1:10.68.112.111:6789/0 mon.c # Should be "mon.c"
...
```

It's due to this tool's assumption that mons' names are sorted by IP address. However, it's not always true after the following PR.

https://github.com/ceph/ceph/pull/22193