Ceph » Orchestrator

cephadm is called liks so:

CEPHADM_IMAGE=<registry image url> \
cephadm --verbose bootstrap \
        --mon-ip None \
        --apply-spec /tmp/bootstrap-spec.yaml \
        --config /tmp/bootstrap-ceph.conf \
        --dashboard-password-noupdate \
        --initial-dashboard-password admin \
        --initial-dashboard-user admin \
        --output-config /etc/ceph/ceph.conf \
        --output-keyring /tmp/ceph.client.admin.keyring \
        --skip-monitoring-stack \
        --skip-prepare-host \
        --skip-pull \
        --ssh-private-key /home/cephadm/.ssh/id_rsa \
        --ssh-public-key /home/cephadm/.ssh/id_rsa.pub \
        --ssh-user cephadm \
        > /var/log/ceph/cephadm.log 2>&1

The produced log file:

Skip prepare_host
Cluster fsid: a3a1823e-fd6f-11ea-b045-5254006e8794
Acquiring lock 140173335112728 on /run/cephadm/a3a1823e-fd6f-11ea-b045-5254006e8794.lock
Lock 140173335112728 acquired on /run/cephadm/a3a1823e-fd6f-11ea-b045-5254006e8794.lock
Address: None isn't a valid IP address
Verifying IP None port 3300 ...
Address: None isn't a valid IP address
Cannot bind to IP None port 3300: [Errno -2] Name or service not known
Verifying IP None port 6789 ...
Address: None isn't a valid IP address
Cannot bind to IP None port 6789: [Errno -2] Name or service not known
Base mon IP is None, final addrv is [v2:None:3300,v1:None:6789]
Running command: /usr/sbin/ip route ls
/usr/sbin/ip:stdout default via 192.168.121.1 dev eth0 proto dhcp 
/usr/sbin/ip:stdout 192.168.100.0/24 dev eth1 proto kernel scope link src 192.168.100.44 
/usr/sbin/ip:stdout 192.168.121.0/24 dev eth0 proto kernel scope link src 192.168.121.182 
Running command: /usr/sbin/ip -6 route ls
/usr/sbin/ip:stdout ::1 dev lo proto kernel metric 256 pref medium
/usr/sbin/ip:stdout fe80::/64 dev eth0 proto kernel metric 256 pref medium
/usr/sbin/ip:stdout fe80::/64 dev eth1 proto kernel metric 256 pref medium
Running command: /usr/sbin/ip -6 addr ls
/usr/sbin/ip:stdout 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 state UNKNOWN qlen 1000
/usr/sbin/ip:stdout     inet6 ::1/128 scope host 
/usr/sbin/ip:stdout        valid_lft forever preferred_lft forever
/usr/sbin/ip:stdout 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
/usr/sbin/ip:stdout     inet6 fe80::5054:ff:fe6e:8794/64 scope link 
/usr/sbin/ip:stdout        valid_lft forever preferred_lft forever
/usr/sbin/ip:stdout 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
/usr/sbin/ip:stdout     inet6 fe80::5054:ff:fea7:c6fd/64 scope link 
/usr/sbin/ip:stdout        valid_lft forever preferred_lft forever
Traceback (most recent call last):
  File "/usr/sbin/cephadm", line 6037, in <module>
    r = args.func()
  File "/usr/sbin/cephadm", line 1376, in _default_image
    return func()
  File "/usr/sbin/cephadm", line 2838, in command_bootstrap
    if ipaddress.ip_address(unicode(unwrap_ipv6(base_ip))) in \
  File "/usr/lib64/python3.6/ipaddress.py", line 54, in ip_address
    address)
ValueError: 'None' does not appear to be an IPv4 or IPv6 address
Releasing lock 140173335112728 on /run/cephadm/a3a1823e-fd6f-11ea-b045-5254006e8794.lock
Lock 140173335112728 released on /run/cephadm/a3a1823e-fd6f-11ea-b045-5254006e8794.lock
 ls
2020-09-23 09:37:31,699 DEBUG /usr/sbin/ip:stdout 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 state UNKNOWN qlen 1000
2020-09-23 09:37:31,699 DEBUG /usr/sbin/ip:stdout     inet6 ::1/128 scope host 
2020-09-23 09:37:31,699 DEBUG /usr/sbin/ip:stdout        valid_lft forever preferred_lft forever
2020-09-23 09:37:31,700 DEBUG /usr/sbin/ip:stdout 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
2020-09-23 09:37:31,700 DEBUG /usr/sbin/ip:stdout     inet6 fe80::5054:ff:fe6e:8794/64 scope link 
2020-09-23 09:37:31,700 DEBUG /usr/sbin/ip:stdout        valid_lft forever preferred_lft forever
2020-09-23 09:37:31,700 DEBUG /usr/sbin/ip:stdout 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
2020-09-23 09:37:31,700 DEBUG /usr/sbin/ip:stdout     inet6 fe80::5054:ff:fea7:c6fd/64 scope link 
2020-09-23 09:37:31,700 DEBUG /usr/sbin/ip:stdout        valid_lft forever preferred_lft forever
2020-09-23 09:37:31,711 DEBUG Releasing lock 140173335112728 on /run/cephadm/a3a1823e-fd6f-11ea-b045-5254006e8794.lock
2020-09-23 09:37:31,711 DEBUG Lock 140173335112728 released on /run/cephadm/a3a1823e-fd6f-11ea-b045-5254006e8794.lock

Network config:

master:~ # ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 52:54:00:6e:87:94 brd ff:ff:ff:ff:ff:ff
    inet 192.168.121.182/24 brd 192.168.121.255 scope global eth0
       valid_lft forever preferred_lft forever
    inet6 fe80::5054:ff:fe6e:8794/64 scope link 
       valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 52:54:00:a7:c6:fd brd ff:ff:ff:ff:ff:ff
    inet 192.168.100.44/24 brd 192.168.100.255 scope global eth1
       valid_lft forever preferred_lft forever
    inet6 fe80::5054:ff:fea7:c6fd/64 scope link 
       valid_lft forever preferred_lft forever
master:~ # ip r
default via 192.168.121.1 dev eth0 proto dhcp 
192.168.100.0/24 dev eth1 proto kernel scope link src 192.168.100.44 
192.168.121.0/24 dev eth0 proto kernel scope link src 192.168.121.182