Project

General

Profile

Actions

Bug #14222

open

ovh instance creation failure

Added by Yuri Weinstein over 8 years ago. Updated over 8 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
ceph-deploy, upgrade/hammer-x
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-01-03_21:10:01-ceph-deploy-hammer-distro-basic-openstack/
Jobs: ['58843', '58840', '58838', '58845']
Logs: http://teuthology.ovh.sepia.ceph.com/teuthology/teuthology-2016-01-03_21:10:01-ceph-deploy-hammer-distro-basic-openstack/58838/teuthology.log

2016-01-04T02:30:46.272 DEBUG:teuthology.misc::sh: neutron port-list -f json -c fixed_ips -c device_id
2016-01-04T02:30:48.980 DEBUG:teuthology.misc:[{"fixed_ips": "{\"subnet_id\": \"a28bb4a1-301b-47de-8019-383e7574b615\", \"ip_address\": \"158.69.95.91\"}", "device_id": "1b399e89-1ed6-4682-8827-f89fc122b092"}, {"fixed_ips": "{\"subnet_id\": \"a28bb4a1-301b-47de-8019-383e7574b615\", \"ip_address\": \"158.69.93.120\"}", "device_id": "cf13c1b8-ff3d-4db1-80fd-a74debca891b"}, {"fixed_ips": "{\"subnet_id\": \"a28bb4a1-301b-47de-8019-383e7574b615\", \"ip_address\": \"158.69.94.229\"}", "device_id": "0f84e069-ac02-4198-98f2-757dac2d7bf7"}, {"fixed_ips": "{\"subnet_id\": \"a28bb4a1-301b-47de-8019-383e7574b615\", \"ip_address\": \"158.69.95.93\"}", "device_id": "94945026-73b6-42f2-9f79-e02cf441fefd"}, {"fixed_ips": "{\"subnet_id\": \"a28bb4a1-301b-47de-8019-383e7574b615\", \"ip_address\": \"158.69.71.231\"}", "device_id": "8524bab3-fa4d-49f5-911c-d1eb4442203e"}, {"fixed_ips": "{\"subnet_id\": \"a28bb4a1-301b-47de-8019-383e7574b615\", \"ip_address\": \"158.69.95.53\"}", "device_id": "329fb089-91e0-4f36-8804-8c483cee0f0e"}, {"fixed_ips": "{\"subnet_id\": \"a28bb4a1-... (truncated to the first 1024 characters)
2016-01-04T02:30:49.041 DEBUG:teuthology.misc::sh: openstack server set --name target064108 f6b1743d-aeb0-4a40-98b8-48cd1ba75491
2016-01-04T02:30:53.210 INFO:teuthology.misc:try ssh_keyscan again for target064108.ovh.sepia.ceph.com
2016-01-04T02:31:00.639 INFO:teuthology.misc:try ssh_keyscan again for target064108.ovh.sepia.ceph.com
.........
2016-01-04T02:43:14.199 ERROR:teuthology.provision:'ssh_keyscan_wait target064108.ovh.sepia.ceph.com' reached maximum tries (100) after waiting for 600 seconds
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/provision.py", line 339, in create
    if not misc.ssh_keyscan_wait(fqdn):
  File "/home/teuthworker/src/teuthology_master/teuthology/misc.py", line 1146, in ssh_keyscan_wait
    while proceed():
  File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
MaxWhileTries: 'ssh_keyscan_wait target064108.ovh.sepia.ceph.com' reached maximum tries (100) after waiting for 600 seconds
Actions #1

Updated by Alfredo Deza over 8 years ago

This doesn't look like a ceph-deploy issue. Whatever is doing the "ssh_keyscan_wait" seems to be the cause (or related to it at least).

Maybe OVH or something in teuthology.

Actions #2

Updated by Yuri Weinstein over 8 years ago

  • Project changed from 18 to teuthology
  • Subject changed from ssh_keyscan error in ovh to ssh_keyscan error in ovh - suspect ovh mistery
  • Assignee set to Loïc Dachary
  • Release set to jewel
  • ceph-qa-suite upgrade/hammer-x added
Actions #3

Updated by Josh Durgin over 8 years ago

Seems like this is an ovh internal problem. Perhaps we could work around this sort of flakiness by adding retries for the whole 'provision server' step?

Actions #5

Updated by Yuri Weinstein over 8 years ago

  • Assignee deleted (Loïc Dachary)
Actions #6

Updated by Zack Cerza over 8 years ago

  • Subject changed from ssh_keyscan error in ovh - suspect ovh mistery to ovh instance creation failure

This is a failure to create the instance. I'm unsure why the failure occurred. :-/

Actions #9

Updated by Zack Cerza over 8 years ago

It might actually be. Seen in the console of one of the centos 7.1 instances:
http://zscreenshots.objects.dreamhost.com/01-13-2016-10-11-05.png

Actions

Also available in: Atom PDF