Project

General

Profile

Actions

Bug #6035

closed

ceph-deploy: ceph-create-keys stuck on fedora 18 VMs

Added by Tamilarasi muthamizhan over 10 years ago. Updated over 10 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
Category:
ceph-deploy
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

logs: ubuntu@teuthology:/a/teuthology-2013-08-16_01:10:04-ceph-deploy-master-testing-basic-vps/109387

ubuntu@teuthology:/a/teuthology-2013-08-16_01:10:04-ceph-deploy-master-testing-basic-vps$ teuthology-ls --archive-dir . | grep -v pass | grep "Running command" 
109385       (pid 23634) 2013-08-16T01:15:50.855 INFO:teuthology.orchestra.run.err:[10.214.138.112]: [vpm046.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm046 
109386       (no process or summary.yaml) 2013-08-16T01:15:50.133 INFO:teuthology.orchestra.run.err:[10.214.138.101]: [vpm055.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm055 
109387       (no process or summary.yaml) 2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [vpm057.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm057 
109400       (no process or summary.yaml) 2013-08-16T01:18:07.989 INFO:teuthology.orchestra.run.err:[10.214.138.181]: [vpm114.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm114 
109401       (no process or summary.yaml) 2013-08-16T01:51:57.643 INFO:teuthology.orchestra.run.err:[10.214.138.187]: [vpm108.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm108 
109402       (no process or summary.yaml) 2013-08-16T01:28:27.303 INFO:teuthology.orchestra.run.err:[10.214.138.56]: [vpm033.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm033 
109417       (no process or summary.yaml) 2013-08-16T02:12:36.549 INFO:teuthology.orchestra.run.err:[10.214.138.155]: [vpm105.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm105 
109418       (no process or summary.yaml) 2013-08-16T01:49:48.852 INFO:teuthology.orchestra.run.err:[10.214.138.124]: [vpm066.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm066 
109419       (no process or summary.yaml) 2013-08-16T04:57:11.771 INFO:teuthology.orchestra.run.err:[10.214.138.154]: [vpm099.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm099 
109420       (no process or summary.yaml) 2013-08-16T03:02:32.346 INFO:teuthology.orchestra.run.err:[10.214.138.70]: [vpm027.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm027 
109424       (no process or summary.yaml) 2013-08-16T03:16:08.756 INFO:teuthology.orchestra.run.err:[10.214.138.61]: [vpm026.front.sepia.ceph.com][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i vpm026 --keyring /var/lib/ceph/tmp/ceph-vpm026.mon.keyring 
109431       (no process or summary.yaml) 2013-08-16T02:24:29.840 INFO:teuthology.orchestra.run.err:[10.214.138.121]: [vpm064.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm064 

from teuthology.log:

2013-08-16T01:25:48.640 DEBUG:teuthology.orchestra.run:Running [10.214.138.97]: 'cd /home/ubuntu/cephtest/109387/ceph-deploy && ./ceph-deploy mon create vpm059.front.sepia.ceph.com vpm057.front.sepia.ceph.com' 
2013-08-16T01:25:48.807 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] Deploying mon, cluster ceph hosts vpm059.front.sepia.ceph.com vpm057.front.sepia.ceph.com 
2013-08-16T01:25:48.807 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] detecting platform for host vpm059.front.sepia.ceph.com ... 
2013-08-16T01:25:49.199 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;37mINFO^[[0m  ] distro info: Fedora 18 SphericalCow 
2013-08-16T01:25:49.199 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] deploying mon to vpm059.front.sepia.ceph.com 
2013-08-16T01:25:49.205 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] remote hostname: vpm059 
2013-08-16T01:25:49.220 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] write cluster configuration to /etc/ceph/{cluster}.conf 
2013-08-16T01:25:51.407 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating path: /var/lib/ceph/mon/ceph-vpm059 
2013-08-16T01:25:51.417 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] checking for done path: /var/lib/ceph/mon/ceph-vpm059/done 
2013-08-16T01:25:51.431 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] done path does not exist: /var/lib/ceph/mon/ceph-vpm059/done 
2013-08-16T01:25:51.443 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating keyring file: /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 
2013-08-16T01:25:51.459 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the monitor keyring file 
2013-08-16T01:25:51.486 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: ceph-mon --cluster ceph --mkfs -i vpm059 --keyring /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 
2013-08-16T01:25:52.085 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: mon.noname-a 10.214.138.89:6789/0 is local, renaming to mon.vpm059 
2013-08-16T01:25:52.086 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: set fsid to 2854aeb5-fa5d-41c0-95d3-d65c46ed3782 
2013-08-16T01:25:52.086 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vpm059 for mon.vpm059 
2013-08-16T01:25:52.093 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] unlinking keyring file /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 
2013-08-16T01:25:52.113 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create a done file to avoid re-doing the mon deployment 
2013-08-16T01:25:52.156 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the init path if it does not exist 
2013-08-16T01:25:52.188 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] locating `service` executable... 
2013-08-16T01:25:52.198 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] found `service` executable: /sbin/service 
2013-08-16T01:25:52.198 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: /sbin/service ceph start mon.vpm059 
2013-08-16T01:25:52.657 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] detecting platform for host vpm057.front.sepia.ceph.com ... 
2013-08-16T01:25:53.047 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;37mINFO^[[0m  ] distro info: Fedora 18 SphericalCow 
2013-08-16T01:25:53.047 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] deploying mon to vpm057.front.sepia.ceph.com 
2013-08-16T01:25:53.051 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] remote hostname: vpm057 
2013-08-16T01:25:53.063 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] write cluster configuration to /etc/ceph/{cluster}.conf 
2013-08-16T01:25:53.164 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating path: /var/lib/ceph/mon/ceph-vpm057 
2013-08-16T01:25:53.168 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] checking for done path: /var/lib/ceph/mon/ceph-vpm057/done 
2013-08-16T01:25:53.174 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] done path does not exist: /var/lib/ceph/mon/ceph-vpm057/done 
2013-08-16T01:25:53.181 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating keyring file: /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 
2013-08-16T01:25:53.192 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the monitor keyring file 
2013-08-16T01:25:53.210 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: ceph-mon --cluster ceph --mkfs -i vpm057 --keyring /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 
2013-08-16T01:25:53.877 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: mon.noname-b 10.214.138.97:6789/0 is local, renaming to mon.vpm057 
2013-08-16T01:25:53.877 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: set fsid to 2854aeb5-fa5d-41c0-95d3-d65c46ed3782 
2013-08-16T01:25:53.878 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vpm057 for mon.vpm057 
2013-08-16T01:25:53.882 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] unlinking keyring file /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 
2013-08-16T01:25:53.896 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create a done file to avoid re-doing the mon deployment 
2013-08-16T01:25:53.923 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the init path if it does not exist 
2013-08-16T01:25:53.940 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] locating `service` executable... 
2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] found `service` executable: /sbin/service 
2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: /sbin/service ceph start mon.vpm057 

Actions #1

Updated by Ian Colle over 10 years ago

  • Assignee set to Alfredo Deza
Actions #2

Updated by Alfredo Deza over 10 years ago

Tamil, I attempted to start manually the mon on one of those servers and got errors:

$ /sbin/service ceph start mon.vpm057

/etc/init.d/ceph: mon.vpm057 not found (/etc/ceph/ceph.conf defines mon.a mon.b mon.c mds.a, /var/lib/ceph defines )

That was on the vpm057 machine. This of course has little to do with the fact that the test was hanging, but I am not sure why we have those mons defined
and not mon.vpm057

Also, these logs seem from a few days ago, trying out the latest ceph-deploy it looks like it errors nicely:

(ceph-deploy)ubuntu@teuthology:~/ceph-deploy/hung$ ceph-deploy mon create vpm057.front.sepia.ceph.com
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts vpm057.front.sepia.ceph.com
[ceph_deploy.mon][DEBUG ] detecting platform for host vpm057.front.sepia.ceph.com ...
[root][INFO  ] Running command: which lsb_release
[ceph_deploy.mon][INFO  ] distro info: RedHatEnterpriseServer 6.3 Santiago
[vpm057.front.sepia.ceph.com][DEBUG ] deploying mon to vpm057.front.sepia.ceph.com
[vpm057.front.sepia.ceph.com][DEBUG ] remote hostname: vpm057
[vpm057.front.sepia.ceph.com][INFO  ] write cluster configuration to /etc/ceph/{cluster}.conf
[vpm057.front.sepia.ceph.com][ERROR ] Traceback (most recent call last):
[vpm057.front.sepia.ceph.com][ERROR ]   File "/home/ubuntu/ceph-deploy/ceph_deploy/util/decorators.py", line 10, in inner
[vpm057.front.sepia.ceph.com][ERROR ]     def inner(*args, **kwargs):
[vpm057.front.sepia.ceph.com][ERROR ]   File "/home/ubuntu/ceph-deploy/ceph_deploy/conf.py", line 12, in write_conf
[vpm057.front.sepia.ceph.com][ERROR ]     line = self.fp.readline()
[vpm057.front.sepia.ceph.com][ERROR ] RuntimeError: config file /etc/ceph/ceph.conf exists with different content; use --overwrite-conf to overwrite
[vpm057.front.sepia.ceph.com][INFO  ] creating path: /var/lib/ceph/mon/ceph-vpm057
[vpm057.front.sepia.ceph.com][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-vpm057/done
[vpm057.front.sepia.ceph.com][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-vpm057/done
[vpm057.front.sepia.ceph.com][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-vpm057.mon.keyring
[vpm057.front.sepia.ceph.com][INFO  ] create the monitor keyring file
[vpm057.front.sepia.ceph.com][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i vpm057 --keyring /var/lib/ceph/tmp/ceph-vpm057.mon.keyring
[vpm057.front.sepia.ceph.com][ERROR ] Traceback (most recent call last):
[vpm057.front.sepia.ceph.com][ERROR ]   File "/home/ubuntu/ceph-deploy/ceph_deploy/hosts/common.py", line 72, in mon_create
[vpm057.front.sepia.ceph.com][ERROR ]   File "/home/ubuntu/ceph-deploy/ceph_deploy/util/decorators.py", line 10, in inner
[vpm057.front.sepia.ceph.com][ERROR ]     def inner(*args, **kwargs):
[vpm057.front.sepia.ceph.com][ERROR ]   File "/home/ubuntu/ceph-deploy/ceph_deploy/util/wrappers.py", line 6, in remote_call
[vpm057.front.sepia.ceph.com][ERROR ]     This allows us to only remote-execute the actual calls, not whole functions.
[vpm057.front.sepia.ceph.com][ERROR ]   File "/usr/lib64/python2.6/subprocess.py", line 505, in check_call
[vpm057.front.sepia.ceph.com][ERROR ]     raise CalledProcessError(retcode, cmd)
[vpm057.front.sepia.ceph.com][ERROR ] CalledProcessError: Command '['ceph-mon', '--cluster', 'ceph', '--mkfs', '-i', 'vpm057', '--keyring', '/var/lib/ceph/tmp/ceph-vpm057.mon.keyring']' returned non-zero exit status 10
[vpm057.front.sepia.ceph.com][INFO  ] ceph-mon: mon.a 10.214.138.97:6789/0 is local, but not 'noname-' + something; not assuming it's me
[vpm057.front.sepia.ceph.com][ERROR ] ceph-mon: generated monmap has no fsid; use '--fsid <uuid>'
[ceph_deploy.mon][ERROR ] Failed to execute command: ceph-mon --cluster ceph --mkfs -i vpm057 --keyring /var/lib/ceph/tmp/ceph-vpm057.mon.keyring
[ceph_deploy][ERROR ] GenericError: Failed to create 1 monitors

Any ideas?

Actions #3

Updated by Tamilarasi muthamizhan over 10 years ago

  • Subject changed from ceph-deploy: mon create command hung on fedora 18 VMs to ceph-deploy: ceph-create-keys stuck on fedora 18 VMs
  • Priority changed from High to Urgent

ceph version 0.67.1 (e23b817ad0cf1ea19c0a7b7c9999b30bed37d533)

looks like the mon create command doesnt hang anymore but the ceph-create-keys triggered by mon create is stuck up and running, which makes gatherkeys fail.

the test scenario is reproduced on burnupi22[admin node, ceph-deploy commands can be run from /home/ubuntu/ceph-dep/ceph-deploy] and burnupi23 nodes.

[ubuntu@burnupi22 ceph-deploy]$ ./ceph-deploy mon create burnupi22 burnupi23
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts burnupi22 burnupi23
[ceph_deploy.mon][DEBUG ] detecting platform for host burnupi22 ...
[root][INFO  ] Running command: which lsb_release
[ceph_deploy.mon][INFO  ] distro info: Fedora 18 SphericalCow
[burnupi22][DEBUG ] deploying mon to burnupi22
[burnupi22][DEBUG ] remote hostname: burnupi22
[burnupi22][INFO  ] write cluster configuration to /etc/ceph/{cluster}.conf
[burnupi22][INFO  ] creating path: /var/lib/ceph/mon/ceph-burnupi22
[burnupi22][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-burnupi22/done
[burnupi22][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-burnupi22/done
[burnupi22][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-burnupi22.mon.keyring
[burnupi22][INFO  ] create the monitor keyring file
[burnupi22][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i burnupi22 --keyring /var/lib/ceph/tmp/ceph-burnupi22.mon.keyring
[burnupi22][INFO  ] ceph-mon: mon.noname-a 10.214.134.8:6789/0 is local, renaming to mon.burnupi22
[burnupi22][INFO  ] ceph-mon: set fsid to 2a588a0f-12c2-4697-9cc9-edd40220e893
[burnupi22][INFO  ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-burnupi22 for mon.burnupi22
[burnupi22][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-burnupi22.mon.keyring
[burnupi22][INFO  ] create a done file to avoid re-doing the mon deployment
[burnupi22][INFO  ] create the init path if it does not exist
[burnupi22][INFO  ] locating `service` executable...
[burnupi22][INFO  ] found `service` executable: /sbin/service
[burnupi22][INFO  ] Running command: /sbin/service ceph start mon.burnupi22
[ceph_deploy.mon][DEBUG ] detecting platform for host burnupi23 ...
[root][INFO  ] Running command: which lsb_release
[ceph_deploy.mon][INFO  ] distro info: Fedora 18 SphericalCow
[burnupi23][DEBUG ] deploying mon to burnupi23
[burnupi23][DEBUG ] remote hostname: burnupi23
[burnupi23][INFO  ] write cluster configuration to /etc/ceph/{cluster}.conf
[burnupi23][INFO  ] creating path: /var/lib/ceph/mon/ceph-burnupi23
[burnupi23][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-burnupi23/done
[burnupi23][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-burnupi23/done
[burnupi23][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-burnupi23.mon.keyring
[burnupi23][INFO  ] create the monitor keyring file
[burnupi23][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i burnupi23 --keyring /var/lib/ceph/tmp/ceph-burnupi23.mon.keyring
[burnupi23][INFO  ] ceph-mon: mon.noname-b 10.214.134.6:6789/0 is local, renaming to mon.burnupi23
[burnupi23][INFO  ] ceph-mon: set fsid to 2a588a0f-12c2-4697-9cc9-edd40220e893
[burnupi23][INFO  ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-burnupi23 for mon.burnupi23
[burnupi23][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-burnupi23.mon.keyring
[burnupi23][INFO  ] create a done file to avoid re-doing the mon deployment
[burnupi23][INFO  ] create the init path if it does not exist
[burnupi23][INFO  ] locating `service` executable...
[burnupi23][INFO  ] found `service` executable: /sbin/service
[burnupi23][INFO  ] Running command: /sbin/service ceph start mon.burnupi23

[ubuntu@burnupi22 ceph-deploy]$ ./ceph-deploy gatherkeys burnupi23
[ceph_deploy.gatherkeys][DEBUG ] Checking burnupi23 for /etc/ceph/ceph.client.admin.keyring
[ceph_deploy.gatherkeys][WARNIN] Unable to find /etc/ceph/ceph.client.admin.keyring on ['burnupi23']
[ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring
[ceph_deploy.gatherkeys][DEBUG ] Checking burnupi23 for /var/lib/ceph/bootstrap-osd/ceph.keyring
[ceph_deploy.gatherkeys][WARNIN] Unable to find /var/lib/ceph/bootstrap-osd/ceph.keyring on ['burnupi23']
[ceph_deploy.gatherkeys][DEBUG ] Checking burnupi23 for /var/lib/ceph/bootstrap-mds/ceph.keyring
[ceph_deploy.gatherkeys][WARNIN] Unable to find /var/lib/ceph/bootstrap-mds/ceph.keyring on ['burnupi23']

[ubuntu@burnupi22 ceph-deploy]$ ps -ef | grep ceph
root     20411     1  0 12:45 pts/0    00:00:00 /usr/bin/ceph-mon -i burnupi22 --pid-file /var/run/ceph/mon.burnupi22.pid -c /etc/ceph/ceph.conf
root     20427     1  0 12:45 pts/0    00:00:00 /usr/bin/python /usr/sbin/ceph-create-keys -i burnupi22

Actions #4

Updated by Alfredo Deza over 10 years ago

I can no longer replicated this.

Also the hosts have changed from Fedora to Ubuntu. And I really don't see where is the ceph-deploy bug here.

Actions #5

Updated by Alfredo Deza over 10 years ago

  • Status changed from New to Need More Info
Actions #6

Updated by Alfredo Deza over 10 years ago

  • Status changed from Need More Info to Closed

Closing as I cannot replicate this any more.

Actions

Also available in: Atom PDF