Project

General

Profile

Actions

Bug #6035

closed

ceph-deploy: ceph-create-keys stuck on fedora 18 VMs

Added by Tamilarasi muthamizhan over 10 years ago. Updated over 10 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
Category:
ceph-deploy
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

logs: ubuntu@teuthology:/a/teuthology-2013-08-16_01:10:04-ceph-deploy-master-testing-basic-vps/109387

ubuntu@teuthology:/a/teuthology-2013-08-16_01:10:04-ceph-deploy-master-testing-basic-vps$ teuthology-ls --archive-dir . | grep -v pass | grep "Running command" 
109385       (pid 23634) 2013-08-16T01:15:50.855 INFO:teuthology.orchestra.run.err:[10.214.138.112]: [vpm046.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm046 
109386       (no process or summary.yaml) 2013-08-16T01:15:50.133 INFO:teuthology.orchestra.run.err:[10.214.138.101]: [vpm055.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm055 
109387       (no process or summary.yaml) 2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [vpm057.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm057 
109400       (no process or summary.yaml) 2013-08-16T01:18:07.989 INFO:teuthology.orchestra.run.err:[10.214.138.181]: [vpm114.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm114 
109401       (no process or summary.yaml) 2013-08-16T01:51:57.643 INFO:teuthology.orchestra.run.err:[10.214.138.187]: [vpm108.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm108 
109402       (no process or summary.yaml) 2013-08-16T01:28:27.303 INFO:teuthology.orchestra.run.err:[10.214.138.56]: [vpm033.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm033 
109417       (no process or summary.yaml) 2013-08-16T02:12:36.549 INFO:teuthology.orchestra.run.err:[10.214.138.155]: [vpm105.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm105 
109418       (no process or summary.yaml) 2013-08-16T01:49:48.852 INFO:teuthology.orchestra.run.err:[10.214.138.124]: [vpm066.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm066 
109419       (no process or summary.yaml) 2013-08-16T04:57:11.771 INFO:teuthology.orchestra.run.err:[10.214.138.154]: [vpm099.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm099 
109420       (no process or summary.yaml) 2013-08-16T03:02:32.346 INFO:teuthology.orchestra.run.err:[10.214.138.70]: [vpm027.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm027 
109424       (no process or summary.yaml) 2013-08-16T03:16:08.756 INFO:teuthology.orchestra.run.err:[10.214.138.61]: [vpm026.front.sepia.ceph.com][INFO  ] Running command: ceph-mon --cluster ceph --mkfs -i vpm026 --keyring /var/lib/ceph/tmp/ceph-vpm026.mon.keyring 
109431       (no process or summary.yaml) 2013-08-16T02:24:29.840 INFO:teuthology.orchestra.run.err:[10.214.138.121]: [vpm064.front.sepia.ceph.com][INFO  ] Running command: /sbin/service ceph start mon.vpm064 

from teuthology.log:

2013-08-16T01:25:48.640 DEBUG:teuthology.orchestra.run:Running [10.214.138.97]: 'cd /home/ubuntu/cephtest/109387/ceph-deploy && ./ceph-deploy mon create vpm059.front.sepia.ceph.com vpm057.front.sepia.ceph.com' 
2013-08-16T01:25:48.807 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] Deploying mon, cluster ceph hosts vpm059.front.sepia.ceph.com vpm057.front.sepia.ceph.com 
2013-08-16T01:25:48.807 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] detecting platform for host vpm059.front.sepia.ceph.com ... 
2013-08-16T01:25:49.199 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;37mINFO^[[0m  ] distro info: Fedora 18 SphericalCow 
2013-08-16T01:25:49.199 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] deploying mon to vpm059.front.sepia.ceph.com 
2013-08-16T01:25:49.205 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] remote hostname: vpm059 
2013-08-16T01:25:49.220 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] write cluster configuration to /etc/ceph/{cluster}.conf 
2013-08-16T01:25:51.407 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating path: /var/lib/ceph/mon/ceph-vpm059 
2013-08-16T01:25:51.417 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] checking for done path: /var/lib/ceph/mon/ceph-vpm059/done 
2013-08-16T01:25:51.431 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] done path does not exist: /var/lib/ceph/mon/ceph-vpm059/done 
2013-08-16T01:25:51.443 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating keyring file: /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 
2013-08-16T01:25:51.459 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the monitor keyring file 
2013-08-16T01:25:51.486 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: ceph-mon --cluster ceph --mkfs -i vpm059 --keyring /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 
2013-08-16T01:25:52.085 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: mon.noname-a 10.214.138.89:6789/0 is local, renaming to mon.vpm059 
2013-08-16T01:25:52.086 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: set fsid to 2854aeb5-fa5d-41c0-95d3-d65c46ed3782 
2013-08-16T01:25:52.086 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vpm059 for mon.vpm059 
2013-08-16T01:25:52.093 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] unlinking keyring file /var/lib/ceph/tmp/ceph-vpm059.mon.keyring 
2013-08-16T01:25:52.113 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create a done file to avoid re-doing the mon deployment 
2013-08-16T01:25:52.156 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the init path if it does not exist 
2013-08-16T01:25:52.188 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] locating `service` executable... 
2013-08-16T01:25:52.198 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] found `service` executable: /sbin/service 
2013-08-16T01:25:52.198 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm059.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: /sbin/service ceph start mon.vpm059 
2013-08-16T01:25:52.657 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;34mDEBUG^[[0m ] detecting platform for host vpm057.front.sepia.ceph.com ... 
2013-08-16T01:25:53.047 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mceph_deploy.mon^[[0m][^[[1;37mINFO^[[0m  ] distro info: Fedora 18 SphericalCow 
2013-08-16T01:25:53.047 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] deploying mon to vpm057.front.sepia.ceph.com 
2013-08-16T01:25:53.051 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] remote hostname: vpm057 
2013-08-16T01:25:53.063 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] write cluster configuration to /etc/ceph/{cluster}.conf 
2013-08-16T01:25:53.164 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating path: /var/lib/ceph/mon/ceph-vpm057 
2013-08-16T01:25:53.168 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] checking for done path: /var/lib/ceph/mon/ceph-vpm057/done 
2013-08-16T01:25:53.174 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;34mDEBUG^[[0m ] done path does not exist: /var/lib/ceph/mon/ceph-vpm057/done 
2013-08-16T01:25:53.181 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] creating keyring file: /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 
2013-08-16T01:25:53.192 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the monitor keyring file 
2013-08-16T01:25:53.210 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: ceph-mon --cluster ceph --mkfs -i vpm057 --keyring /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 
2013-08-16T01:25:53.877 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: mon.noname-b 10.214.138.97:6789/0 is local, renaming to mon.vpm057 
2013-08-16T01:25:53.877 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: set fsid to 2854aeb5-fa5d-41c0-95d3-d65c46ed3782 
2013-08-16T01:25:53.878 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vpm057 for mon.vpm057 
2013-08-16T01:25:53.882 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] unlinking keyring file /var/lib/ceph/tmp/ceph-vpm057.mon.keyring 
2013-08-16T01:25:53.896 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create a done file to avoid re-doing the mon deployment 
2013-08-16T01:25:53.923 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] create the init path if it does not exist 
2013-08-16T01:25:53.940 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] locating `service` executable... 
2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] found `service` executable: /sbin/service 
2013-08-16T01:25:53.945 INFO:teuthology.orchestra.run.err:[10.214.138.97]: [^[[1mvpm057.front.sepia.ceph.com^[[0m][^[[1;37mINFO^[[0m  ] Running command: /sbin/service ceph start mon.vpm057 

Actions

Also available in: Atom PDF