Actions
Bug #6035
closedceph-deploy: ceph-create-keys stuck on fedora 18 VMs
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
logs: ubuntu@teuthology:/a/teuthology-2013-08-16_01:10:04-ceph-deploy-master-testing-basic-vps/109387
ubuntu@teuthology:/a/teuthology-2013-08-16_01:10:04-ceph-deploy-master-testing-basic-vps$ teuthology-ls --archive-dir . | grep -v pass | grep "Running command" 109385 (pid 23634) 2013-08-16T01:15:50.855 INFO:teuthology.orchestra.run.err:[10.214.138.112]: [vpm046.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm046 109386 (no process or summary.yaml) 2013-08-16T01:15:50.133 INFO:teuthology.orchestra.run.err:[10.214.138.101]: [vpm055.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm055 109387 (no process or summary.yaml) 2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [vpm057.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm057 109400 (no process or summary.yaml) 2013-08-16T01:18:07.989 INFO:teuthology.orchestra.run.err:[10.214.138.181]: [vpm114.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm114 109401 (no process or summary.yaml) 2013-08-16T01:51:57.643 INFO:teuthology.orchestra.run.err:[10.214.138.187]: [vpm108.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm108 109402 (no process or summary.yaml) 2013-08-16T01:28:27.303 INFO:teuthology.orchestra.run.err:[10.214.138.56]: [vpm033.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm033 109417 (no process or summary.yaml) 2013-08-16T02:12:36.549 INFO:teuthology.orchestra.run.err:[10.214.138.155]: [vpm105.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm105 109418 (no process or summary.yaml) 2013-08-16T01:49:48.852 INFO:teuthology.orchestra.run.err:[10.214.138.124]: [vpm066.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm066 109419 (no process or summary.yaml) 2013-08-16T04:57:11.771 INFO:teuthology.orchestra.run.err:[10.214.138.154]: [vpm099.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm099 109420 (no process or summary.yaml) 2013-08-16T03:02:32.346 INFO:teuthology.orchestra.run.err:[10.214.138.70]: [vpm027.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm027 109424 (no process or summary.yaml) 2013-08-16T03:16:08.756 INFO:teuthology.orchestra.run.err:[10.214.138.61]: [vpm026.front.sepia.ceph.com][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i vpm026 --keyring /var/lib/ceph/tmp/ceph-vpm026.mon.keyring 109431 (no process or summary.yaml) 2013-08-16T02:24:29.840 INFO:teuthology.orchestra.run.err:[10.214.138.121]: [vpm064.front.sepia.ceph.com][INFO ] Running command: /sbin/service ceph start mon.vpm064 from teuthology.log: 2013-08-16T01:25:48.640 DEBUG:teuthology.orchestra.run:Running [10.214.138.97]: 'cd /home/ubuntu/cephtest/109387/ceph-deploy && ./ceph-deploy mon create vpm059.front.sepia.ceph.com vpm057.front.sepia.ceph.com' 2013-08-16T01:25:48.807 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] Deploying mon, cluster ceph hosts vpm059.front.sepia.ceph.com vpm057.front.sepia.ceph.com 2013-08-16T01:25:48.807 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] detecting platform for host vpm059.front.sepia.ceph.com ... 2013-08-16T01:25:49.199 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;37mINFO^[[0m ] distro info: Fedora 18 SphericalCow 2013-08-16T01:25:49.199 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] deploying mon to vpm059.front.sepia.ceph.com 2013-08-16T01:25:49.205 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] remote hostname: vpm059 2013-08-16T01:25:49.220 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] write cluster configuration to /etc/ceph/{cluster}.conf 2013-08-16T01:25:51.407 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] creating path: /var/lib/ceph/mon/ceph-vpm059 2013-08-16T01:25:51.417 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] checking for done path: /var/lib/ceph/mon/ceph-vpm059/done 2013-08-16T01:25:51.431 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] done path does not exist: /var/lib/ceph/mon/ceph-vpm059/done 2013-08-16T01:25:51.443 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] creating keyring file: /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 2013-08-16T01:25:51.459 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] create the monitor keyring file 2013-08-16T01:25:51.486 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] Running command: ceph-mon --cluster ceph --mkfs -i vpm059 --keyring /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 2013-08-16T01:25:52.085 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] ceph-mon: mon.noname-a 10.214.138.89:6789/0 is local, renaming to mon.vpm059 2013-08-16T01:25:52.086 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] ceph-mon: set fsid to 2854aeb5-fa5d-41c0-95d3-d65c46ed3782 2013-08-16T01:25:52.086 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vpm059 for mon.vpm059 2013-08-16T01:25:52.093 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] unlinking keyring file /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 2013-08-16T01:25:52.113 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] create a done file to avoid re-doing the mon deployment 2013-08-16T01:25:52.156 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] create the init path if it does not exist 2013-08-16T01:25:52.188 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] locating `service` executable... 2013-08-16T01:25:52.198 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] found `service` executable: /sbin/service 2013-08-16T01:25:52.198 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] Running command: /sbin/service ceph start mon.vpm059 2013-08-16T01:25:52.657 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] detecting platform for host vpm057.front.sepia.ceph.com ... 2013-08-16T01:25:53.047 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;37mINFO^[[0m ] distro info: Fedora 18 SphericalCow 2013-08-16T01:25:53.047 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] deploying mon to vpm057.front.sepia.ceph.com 2013-08-16T01:25:53.051 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] remote hostname: vpm057 2013-08-16T01:25:53.063 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] write cluster configuration to /etc/ceph/{cluster}.conf 2013-08-16T01:25:53.164 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] creating path: /var/lib/ceph/mon/ceph-vpm057 2013-08-16T01:25:53.168 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] checking for done path: /var/lib/ceph/mon/ceph-vpm057/done 2013-08-16T01:25:53.174 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] done path does not exist: /var/lib/ceph/mon/ceph-vpm057/done 2013-08-16T01:25:53.181 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] creating keyring file: /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 2013-08-16T01:25:53.192 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] create the monitor keyring file 2013-08-16T01:25:53.210 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] Running command: ceph-mon --cluster ceph --mkfs -i vpm057 --keyring /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 2013-08-16T01:25:53.877 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] ceph-mon: mon.noname-b 10.214.138.97:6789/0 is local, renaming to mon.vpm057 2013-08-16T01:25:53.877 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] ceph-mon: set fsid to 2854aeb5-fa5d-41c0-95d3-d65c46ed3782 2013-08-16T01:25:53.878 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vpm057 for mon.vpm057 2013-08-16T01:25:53.882 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] unlinking keyring file /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 2013-08-16T01:25:53.896 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] create a done file to avoid re-doing the mon deployment 2013-08-16T01:25:53.923 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] create the init path if it does not exist 2013-08-16T01:25:53.940 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] locating `service` executable... 2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] found `service` executable: /sbin/service 2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m ] Running command: /sbin/service ceph start mon.vpm057
Actions