Project

General

Profile

Actions

Fix #12342

closed

OpenStack backend must retry a few times on error 500

Added by Loïc Dachary almost 9 years ago. Updated over 8 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
Category:
-
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

It is common for the OpenStack API to be unavailable during a few seconds. The OpenStack backend should retry a few time instead of failing immediately.

2015-07-15T12:33:13.913 DEBUG:teuthology.provision:OpenStack: {'ssh-key': '/home/ubuntu/.ssh/id_rsa', 'user-data': 'teuthology/openstack-{os_type}-{os_version}-user-data.txt', 'clusters': {'ovh': {'images': {'centos-7.0': 'Centos 7', 'ubuntu-14.04': 'Ubuntu 14.04'}, 'subnet': '167.114.224.0/19', 'openrc.sh': 'teuthology/test/integration/openrc.sh', 'flavor-select-regexp': '^vps-ssd'}}, 'nameserver': '167.114.240.138', 'default-size': {'disk-size': 40, 'ram': 7000, 'cpus': 1}, 'default-volumes': {'count': 0, 'size': 1}}
2015-07-15T12:33:13.913 DEBUG:teuthology.provision:OpenStack:destroy ovh241121
2015-07-15T12:33:13.913 DEBUG:teuthology.misc:. teuthology/test/integration/openrc.sh && openstack server show -f json ovh241121
2015-07-15T12:34:03.612 ERROR:teuthology.misc:. teuthology/test/integration/openrc.sh && openstack server show -f json ovh241121 error ERROR: openstack The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-74de6c6d-6d53-464c-9438-5c7310b9d4e8)
Traceback (most recent call last):
  File "/home/ubuntu/teuthology/teuthology/misc.py", line 1304, in sh
    shell=True)
  File "/usr/lib/python2.7/subprocess.py", line 573, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '. teuthology/test/integration/openrc.sh && openstack server show -f json ovh241121' returned non-zero exit status 1

Actions #1

Updated by Loïc Dachary over 8 years ago

  • Status changed from 12 to Rejected

it's ok to treat that as an error. It did not show as a false negative in the path few weeks.

Actions

Also available in: Atom PDF