Infrastructure » sepia

ipmitool -H smithi103.ipmi.sepia.ceph.com XXXXXX power cycle
Error: Unable to establish IPMI v2 / RMCP+ session

teuthology-nuke -r -s -t targets.yaml -u --owner scheduled_teuthology@teuthology
2017-01-06 23:47:00,869.869 INFO:teuthology.nuke:targets:
  smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCcgxAMf2AiDOLvK5NlKkiw8k/QFsf+omTpmSqr1iDfvILgvkjQaeT/yTeX9umimH+c8QXWMFFmAj6Ims+evjwVwNTrwSgd+qcDvjNgmVIxWuapGvPYt0hVpEnkmnVIxNPMZ3Pfd1WLBvC2jDMWpcXNYJWcBPMV+0TRO9Bd9NcOHWQB7PWYUoocPQeoXZZomtKmurzncdq9uwSCfSXUYk5b5yKssSSnp031qIcsNOd6IO7PMiR14oapRxWqnPUqK3hHqjmg34m63W1mqAOpelJ3g1neV2CCQjFvUad8w1Nw7mjCJSKyd7qQI/NDdHluxPpeVzrLrpldL8dk+ZxY0VCj
2017-01-06 23:47:00,895.895 INFO:teuthology.task.internal.check_lock:Checking locks...
2017-01-06 23:47:00,921.921 INFO:teuthology.nuke.actions:checking console status of smithi103.ipmi.sepia.ceph.com
2017-01-06 23:47:41,032.032 INFO:teuthology.orchestra.console:Failed to get ipmi console status for smithi103: Did not get a login prompt from smithi103.front.sepia.ceph.com!
2017-01-06 23:47:56,564.564 INFO:teuthology.nuke.actions:attempting to power on smithi103.ipmi.sepia.ceph.com
2017-01-06 23:47:56,565.565 INFO:teuthology.orchestra.console:Power on smithi103
2017-01-06 23:48:16,589.589 ERROR:teuthology.nuke:
Traceback (most recent call last):
  File "/home/yuriw/teuthology/teuthology/nuke/__init__.py", line 312, in nuke_helper
    check_console(host)
  File "/home/yuriw/teuthology/teuthology/nuke/actions.py", line 425, in check_console
    console.power_on()
  File "/home/yuriw/teuthology/teuthology/orchestra/console.py", line 231, in power_on
    timeout=self.timeout)
  File "/home/yuriw/teuthology/virtualenv/local/lib/python2.7/site-packages/pexpect/spawnbase.py", line 321, in expect
    timeout, searchwindowsize, async)
  File "/home/yuriw/teuthology/virtualenv/local/lib/python2.7/site-packages/pexpect/spawnbase.py", line 345, in expect_list
    return exp.expect_loop(timeout)
  File "/home/yuriw/teuthology/virtualenv/local/lib/python2.7/site-packages/pexpect/expect.py", line 107, in expect_loop
    return self.timeout(e)
  File "/home/yuriw/teuthology/virtualenv/local/lib/python2.7/site-packages/pexpect/expect.py", line 70, in timeout
    raise TIMEOUT(msg)
TIMEOUT: Timeout exceeded.
<pexpect.pty_spawn.spawn object at 0x7f46e5b03a50>
command: /usr/bin/ipmitool
args: ['/usr/bin/ipmitool', '-H', 'smithi103.ipmi.sepia.ceph.com', '-I', 'lanplus', '-U', 'inktank', '-P', 'ApGNXcA7', 'power', 'on']
buffer (last 100 chars): ''
before (last 100 chars): ''
after: <class 'pexpect.exceptions.TIMEOUT'>
match: None
match_index: None
exitstatus: None
flag_eof: False
pid: 20768
child_fd: 5
closed: False
timeout: 30
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None
logfile_read: None
logfile_send: None
maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 0.1
delayafterterminate: 0.1
searcher: searcher_re:
    0: re.compile("Chassis Power Control: Up/On")
    1: EOF
2017-01-06 23:48:16,591.591 INFO:teuthology.nuke:Will attempt to connect via SSH
2017-01-06 23:48:19,969.969 ERROR:teuthology.nuke:Could not nuke {'smithi103.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCcgxAMf2AiDOLvK5NlKkiw8k/QFsf+omTpmSqr1iDfvILgvkjQaeT/yTeX9umimH+c8QXWMFFmAj6Ims+evjwVwNTrwSgd+qcDvjNgmVIxWuapGvPYt0hVpEnkmnVIxNPMZ3Pfd1WLBvC2jDMWpcXNYJWcBPMV+0TRO9Bd9NcOHWQB7PWYUoocPQeoXZZomtKmurzncdq9uwSCfSXUYk5b5yKssSSnp031qIcsNOd6IO7PMiR14oapRxWqnPUqK3hHqjmg34m63W1mqAOpelJ3g1neV2CCQjFvUad8w1Nw7mjCJSKyd7qQI/NDdHluxPpeVzrLrpldL8dk+ZxY0VCj'}
Traceback (most recent call last):
  File "/home/yuriw/teuthology/teuthology/nuke/__init__.py", line 281, in nuke_one
    nuke_helper(ctx, should_unlock)
  File "/home/yuriw/teuthology/teuthology/nuke/__init__.py", line 317, in nuke_helper
    remote.connect()
  File "/home/yuriw/teuthology/teuthology/orchestra/remote.py", line 59, in connect
    self.ssh = connection.connect(**args)
  File "/home/yuriw/teuthology/teuthology/orchestra/connection.py", line 104, in connect
    ssh.connect(**connect_args)
  File "/home/yuriw/teuthology/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 324, in connect
    raise NoValidConnectionsError(errors)
NoValidConnectionsError: [Errno None] Unable to connect to port 22 on 172.21.15.103
2017-01-06 23:48:19,972.972 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCcgxAMf2AiDOLvK5NlKkiw8k/QFsf+omTpmSqr1iDfvILgvkjQaeT/yTeX9umimH+c8QXWMFFmAj6Ims+evjwVwNTrwSgd+qcDvjNgmVIxWuapGvPYt0hVpEnkmnVIxNPMZ3Pfd1WLBvC2jDMWpcXNYJWcBPMV+0TRO9Bd9NcOHWQB7PWYUoocPQeoXZZomtKmurzncdq9uwSCfSXUYk5b5yKssSSnp031qIcsNOd6IO7PMiR14oapRxWqnPUqK3hHqjmg34m63W1mqAOpelJ3g1neV2CCQjFvUad8w1Nw7mjCJSKyd7qQI/NDdHluxPpeVzrLrpldL8dk+ZxY0VCj