Ceph » Orchestrator

Description of problem:

We don't have any option too make sure public network is set as global(both for mon and osds) while bootsraping ceph cluster with cephadm. After the ceph bootsraping process public_network is generally set for mon only but not for osds.

~_{~
[root@ceph-1 ceph-exec]# ceph config dump | grep -i public_network
mon advanced public_network 192.168.xx.yy/27 *}
~~

- osds were only listening to cluster_network

~_{~
[root@ceph-1 ceph-exec]# netstat -tulpn | grep ceph
tcp 0 0 192.168.aa.bb:6827 0.0.0.0:* LISTEN 6879/ceph-osd
tcp 0 0 0.0.0.0:6828 0.0.0.0:* LISTEN 6879/ceph-osd
tcp 0 0 0.0.0.0:6829 0.0.0.0:* LISTEN 6879/ceph-osd
tcp 0 0 192.168.aa.bb:6830 0.0.0.0:* LISTEN 6879/ceph-osd
tcp 0 0 192.168.aa.bb:6831 0.0.0.0:* LISTEN 6879/ceph-osd
tcp 0 0 0.0.0.0:6832 0.0.0.0:* LISTEN 6911/ceph-osd
tcp 0 0 0.0.0.0:6800 0.0.0.0:* LISTEN 6680/ceph-osd
tcp 0 0 0.0.0.0:6833 0.0.0.0:* LISTEN 6911/ceph-osd}
~~

This will create issue when we integrate the external ceph with OpenStack environment as client(nova,cinder,glance etc) will not be able to connect to osd via public_network.

To Overcome this issue we have to update the ceph config and set public_network to global.

1. ceph config set global public_network 192.168.xx.yy/27
2. ceph orch daemon reconfig mon.host
3. ceph orch daemon reconfig osd.host
   ~~~

~_{~
[root@ceph-1 ceph-exec]# ceph config dump | grep -i public_network
global advanced public_network 192.168.xx.yy/27
[root@ceph-1 ceph-exec]# netstat -nltp | grep -i ceph
tcp 0 0 192.168.aa.bb:6800 0.0.0.0: LISTEN 2250215/ceph-osd
tcp 0 0 192.168.xx.yy:6800 0.0.0.0:* LISTEN 2250215/ceph-osd
tcp 0 0 192.168.aa.bb:6801 0.0.0.0:* LISTEN 2250215/ceph-osd
tcp 0 0 192.168.xx.yy:6801 0.0.0.0:* LISTEN 2250215/ceph-osd
tcp 0 0 192.168.aa.bb:6802 0.0.0.0:* LISTEN 2250215/ceph-osd
tcp 0 0 192.168.xx.yy:6802 0.0.0.0:* LISTEN 2250215/ceph-osd
tcp 0 0 192.168.aa.bb:6803 0.0.0.0:* LISTEN 2250215/ceph-osd}
~~