Bug #19414: ceph-deploy fails on ovh nodes - Ceph - Ceph

Actions

Copy link

Bug #19414

closed

ceph-deploy fails on ovh nodes

Added by Yuri Weinstein about 7 years ago. Updated over 5 years ago.

Status:

Rejected

Priority:

Normal

Assignee:

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

ceph-deploy

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Seems related to ovh nodes,

Run: http://pulpito.ceph.com/teuthology-2017-03-28_05:55:15-ceph-deploy-kraken-distro-basic-ovh/
Jobs: all
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2017-03-28_05:55:15-ceph-deploy-kraken-distro-basic-ovh/955554/teuthology.log

2017-03-29T09:06:09.460 INFO:teuthology.orchestra.run.ovh047.stderr:[ceph_deploy.mon][WARNING] mon.ovh014 monitor is not yet in quorum, tries left: 2
2017-03-29T09:06:09.460 INFO:teuthology.orchestra.run.ovh047.stderr:[ceph_deploy.mon][WARNING] waiting 15 seconds before retrying
2017-03-29T09:06:24.478 INFO:teuthology.orchestra.run.ovh047.stderr:[ovh014][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ovh014.asok mon_status
2017-03-29T09:06:24.644 INFO:teuthology.orchestra.run.ovh047.stderr:[ceph_deploy.mon][WARNING] mon.ovh014 monitor is not yet in quorum, tries left: 1
2017-03-29T09:06:24.644 INFO:teuthology.orchestra.run.ovh047.stderr:[ceph_deploy.mon][WARNING] waiting 20 seconds before retrying
2017-03-29T09:06:44.666 INFO:teuthology.orchestra.run.ovh047.stderr:[ceph_deploy.mon][ERROR ] Some monitors have still not reached quorum:
2017-03-29T09:06:44.666 INFO:teuthology.orchestra.run.ovh047.stderr:[ceph_deploy.mon][ERROR ] ovh014
2017-03-29T09:06:44.666 INFO:teuthology.orchestra.run.ovh047.stderr:[ceph_deploy.mon][ERROR ] ovh047
2017-03-29T09:06:44.666 INFO:teuthology.orchestra.run.ovh047.stderr:
2017-03-29T09:06:44.686 INFO:teuthology.orchestra.run.ovh047:Running: 'sudo ceph-create-keys --cluster ceph --id ovh047'
2017-03-29T09:06:44.967 INFO:teuthology.orchestra.run.ovh047.stderr:INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
2017-03-29T09:06:46.071 INFO:teuthology.orchestra.run.ovh047.stderr:INFO:ceph-create-keys:ceph-mon is not in quorum: 
.....
2017-03-29T09:17:43.759 INFO:teuthology.orchestra.run.ovh047.stderr:INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
2017-03-29T09:17:44.871 INFO:teuthology.orchestra.run.ovh047.stderr:INFO:ceph-create-keys:ceph-mon is not in quorum: u'probing'
2017-03-29T09:17:45.873 INFO:teuthology.orchestra.run.ovh047.stderr:ceph-mon was not able to join quorum within 10 minutes
2017-03-29T09:17:45.880 INFO:tasks.ceph_deploy:Error encountered, logging exception before tearing down ceph-deploy
2017-03-29T09:17:45.880 INFO:tasks.ceph_deploy:Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_ceph_kraken/qa/tasks/ceph_deploy.py", line 303, in build_ceph_cluster
    '--id', remote.shortname])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 193, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 414, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 149, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 171, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed on ovh047 with status 1: 'sudo ceph-create-keys --cluster ceph --id ovh047'