Project

General

Profile

Bug #18702

mira009 crashed and so all the jobs that tried to use mira009 failed

Added by Tamilarasi muthamizhan over 2 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Category:
Infrastructure Hardware
Target version:
-
Start date:
01/27/2017
Due date:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:

Description

an excerpt from the teuthology log:

2017-01-26T00:30:55.005 DEBUG:teuthology.lock:locked ubuntu@vpm053.front.sepia.ceph.com
2017-01-26T00:30:55.032 INFO:teuthology.provision.downburst:Provisioning a ubuntu 14.04 vps
2017-01-26T00:30:55.620 INFO:teuthology.provision.downburst:Downburst failed on ubuntu@vpm053.front.sepia.ceph.com: libvirt: XML-RPC error : Cannot recv data: ssh: connect to host mira009.front.sepia.ceph.com port 22: No route to host: Connection reset by peer
Traceback (most recent call last):
  File "/home/teuthworker/src/downburst/virtualenv/bin/downburst", line 9, in <module>
    load_entry_point('downburst', 'console_scripts', 'downburst')()
  File "/home/teuthworker/src/downburst/downburst/cli.py", line 64, in main
    return args.func(args)
  File "/home/teuthworker/src/downburst/downburst/create.py", line 22, in create
    conn = libvirt.open(args.connect)
  File "/home/teuthworker/src/downburst/virtualenv/local/lib/python2.7/site-packages/libvirt.py", line 255, in open
    if ret is None:raise libvirtError('virConnectOpen() failed')
libvirt.libvirtError: Cannot recv data: ssh: connect to host mira009.front.sepia.ceph.com port 22: No route to host: Connection reset by peer
2017-01-26T00:30:55.621 ERROR:teuthology.lock:Unable to create virtual machine: ubuntu@vpm053.front.sepia.ceph.com
2017-01-26T00:30:58.964 ERROR:teuthology.provision.downburst:Error destroying vpm053.front.sepia.ceph.com: libvirt: XML-RPC error : Cannot recv data: ssh: connect to host mira009.front.sepia.ceph.com port 22: No route to host: Connection reset by peer
Traceback (most recent call last):
  File "/home/teuthworker/src/downburst/virtualenv/bin/downburst", line 9, in <module>
    load_entry_point('downburst', 'console_scripts', 'downburst')()
  File "/home/teuthworker/src/downburst/downburst/cli.py", line 64, in main
    return args.func(args)
  File "/home/teuthworker/src/downburst/downburst/destroy.py", line 42, in destroy
    conn = libvirt.open(args.connect)
  File "/home/teuthworker/src/downburst/virtualenv/local/lib/python2.7/site-packages/libvirt.py", line 255, in open
    if ret is None:raise libvirtError('virConnectOpen() failed')
libvirt.libvirtError: Cannot recv data: ssh: connect to host mira009.front.sepia.ceph.com port 22: No route to host: Connection reset by peer

2017-01-26T00:30:58.964 ERROR:teuthology.lock:destroy failed for vpm053.front.sepia.ceph.com
2017-01-26T00:30:59.002 INFO:teuthology.lock:unlocked vpm053.front.sepia.ceph.com

full logs available in http://qa-proxy.ceph.com/teuthology/yuriw-2017-01-25_18:41:00-ceph-ansible-kraken-distro-basic-vps/747666/teuthology.log

History

#1 Updated by David Galloway over 2 years ago

  • Project changed from teuthology to sepia
  • Category set to Test Node
  • Assignee set to David Galloway

This is a hardware issue and should've been filed in Sepia.

#2 Updated by David Galloway over 2 years ago

  • Status changed from New to Resolved

Reimaged host, updated firmware, and recreated VPSes.

#3 Updated by David Galloway about 2 years ago

  • Status changed from Resolved to Verified

mira009 crashed again. Needs to be decommissioned.

#4 Updated by David Galloway over 1 year ago

  • Category changed from Test Node to Infrastructure Hardware
  • Status changed from Verified to Resolved

Also available in: Atom PDF