Project

General

Profile

Bug #10266

Can't kill runs on magan002 "AuthenticationException: Authentication failed."

Added by Yuri Weinstein over 9 years ago. Updated about 9 years ago.

Status:
Resolved
Priority:
High
Assignee:
Sandon Van Ness
Category:
-
Target version:
-
% Done:

100%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

yuriw@magna002:~$ teuthology-kill -r teuthology-2014-12-03_16:18:02-multimds-giant-testing-basic-magna
2014-12-07 11:45:49,026.026 INFO:teuthology.kill:Assembling run information...
2014-12-07 11:45:52,777.777 INFO:teuthology.kill:Checking Beanstalk Queue...
No jobs in Beanstalk Queue
2014-12-07 11:45:52,849.849 INFO:teuthology.kill:No teuthology processes running
2014-12-07 11:45:53,154.154 INFO:teuthology.kill:Nuking machines: ['magna013', 'magna020', 'magna023', 'magna035']
2014-12-07 11:45:53,405.405 INFO:teuthology.kill:2014-12-07 11:45:53,405.405 INFO:teuthology.nuke:targets:
2014-12-07 11:45:53,406.406 INFO:teuthology.kill:  magna013.ceph.redhat.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCD8zCiKwMqBhzgfiTTta6hOCIV0c6D4COdaE/nDbxPB9RepHbftv8Tt3pkPiab0gC/Z5AFYScCoXY2zKml5PZQf8zR+ip2FN8Fn0aojTNSYvdVbSBLYmNFEslHMSzA1qPuk+xf7fu/N/uzSAyMGqL4XvD6yX1Z6Tp62khAORs6owzfN7fyd4E7zspOjJohJJspOc/XVkLperclPREQKPlIiTAMutICWJ6ncaggjFYbhLtTka6tKBq2DYkWmh7jwtFBKfNslj0h/xdpJi4MswOwaJr1n0z/VA2K7O7wLFHgP2BVeZThYbPjn9mg/z/H9CuouJ4MEKcxb9kM1Y1BQVl
2014-12-07 11:45:53,406.406 INFO:teuthology.kill:  magna020.ceph.redhat.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDL35fy94c578YKm61JaLMADB0vpV9DLe0KK2X7kteaDnaKJuywjYvPw5+WfXnB8pXmK3RhMG67yHQg07dOAJzDnpPI6nSCfEpqUwMZtEnrZOvcHagXfPKnBU7Fw+vm1TD7TVaRzVmGZfvBeBrHAigzX7/nGxAh1IJ/RQjlldjNUHdB5lDOQwCqtc+bslHy1Ks09izeO4oRN3GjcehNsyThTDXWH5MTkinexq4EFYQng6moMtxUEhmvy/BTL8WM1TO0ISoJuSh3ySHaH31NUfiM/dufAMZsNONiLtXX64uGk/RkHJq1DXQ0m/2uA+DtIV3RfLLrl8eOBKQaDt0JDNan
2014-12-07 11:45:53,407.407 INFO:teuthology.kill:  magna023.ceph.redhat.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7pnKwZ48aXIt5ty0S4+Mb354C482JVhog6zAPEbGfEzoXM+lukyjmfCwQw6QCyBUh8SWqrLup4uPjfIDOmmDlajWi4cY3BAdHyp6srv3ELGbc7mDAlm9GqTMDnVe7W0M5j/0BQqjGxSWOBQ4iPeEsB5TiAuB0LQYc/IlwykNmpUdLmuIaHzxgjwcmt1lUQaCiVjcdpvHxwg7TpJlFhzDVoPrZ9gFHsVq6aFAWED8IdwB35wg7ItwYvOG0YXsNkQWc+LXb0wmguis+1MpSL+eMIV9jiH/CWwyeheCCa5IQAFEnxwT+f2/Us6i/ywMM4s16fL95O21nrhsSNP8bjWyP
2014-12-07 11:45:53,407.407 INFO:teuthology.kill:  magna035.ceph.redhat.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmo2ncSK1+4hqeVeeGK6hDCDTAONI/T0agz1X2sadUS3RNy2lk0bC1p+nq23EGn+oTeOuG9Le5jWjIwlhh0v4Mmx/mSSForWO5WhoV+ezrKtq0hhkk9zjmFNJa31l/5Q2UPycGtQGhfLlW4XblLYoxsj68xfy5ygGgCr6VcIi1UGyaRsp0k++ExoE5x0fUFAyvO7V6pryHLVwniN/aBhf+g1Iynl94h6R6djygE06eBoyQ9s+5HiqQpKn2t/0knV64gBb8LThLkIKSW7mcqV28q1w0S14IHEw1wiRK6CNg8MqKkgW/lP74MY4PnS8XALbXa7CllWNu1hoUAcgYx8iP
2014-12-07 11:45:53,407.407 INFO:teuthology.kill:2014-12-07 11:45:53,405.405 INFO:teuthology.task.internal:Checking locks...
2014-12-07 11:45:53,416.416 INFO:teuthology.kill:2014-12-07 11:45:53,416.416 INFO:teuthology.task.internal:Checking locks...
2014-12-07 11:45:53,420.420 INFO:teuthology.kill:2014-12-07 11:45:53,419.419 INFO:teuthology.task.internal:Checking locks...
2014-12-07 11:45:53,423.423 INFO:teuthology.kill:2014-12-07 11:45:53,422.422 INFO:teuthology.task.internal:Checking locks...
2014-12-07 11:45:53,451.451 INFO:teuthology.kill:2014-12-07 11:45:53,451.451 INFO:teuthology.task.internal:Opening connections...
2014-12-07 11:45:53,454.454 INFO:teuthology.kill:2014-12-07 11:45:53,454.454 INFO:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'magna013.ceph.redhat.com', 'timeout': 60}
2014-12-07 11:45:53,462.462 INFO:teuthology.kill:2014-12-07 11:45:53,462.462 INFO:teuthology.task.internal:Opening connections...
2014-12-07 11:45:53,463.463 INFO:teuthology.kill:2014-12-07 11:45:53,463.463 INFO:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'magna035.ceph.redhat.com', 'timeout': 60}
2014-12-07 11:45:53,478.478 INFO:teuthology.kill:2014-12-07 11:45:53,477.477 INFO:teuthology.task.internal:Opening connections...
2014-12-07 11:45:53,478.478 INFO:teuthology.kill:2014-12-07 11:45:53,478.478 INFO:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'magna020.ceph.redhat.com', 'timeout': 60}
2014-12-07 11:45:53,481.481 INFO:teuthology.kill:2014-12-07 11:45:53,481.481 INFO:teuthology.task.internal:Opening connections...
2014-12-07 11:45:53,482.482 INFO:teuthology.kill:2014-12-07 11:45:53,482.482 INFO:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'magna023.ceph.redhat.com', 'timeout': 60}
2014-12-07 11:45:53,603.603 INFO:teuthology.kill:2014-12-07 11:45:53,603.603 ERROR:teuthology.orchestra.connection:Error connecting to magna013.ceph.redhat.com
2014-12-07 11:45:53,604.604 INFO:teuthology.kill:Traceback (most recent call last):
2014-12-07 11:45:53,604.604 INFO:teuthology.kill:  File "/home/yuriw/teuthology/teuthology/orchestra/connection.py", line 102, in connect
2014-12-07 11:45:53,604.604 INFO:teuthology.kill:    ssh.connect(**connect_args)
2014-12-07 11:45:53,604.604 INFO:teuthology.kill:  File "/home/yuriw/teuthology/virtualenv/lib/python2.7/site-packages/paramiko/client.py", line 332, in connect
2014-12-07 11:45:53,605.605 INFO:teuthology.kill:    self._auth(username, password, pkey, key_filenames, allow_agent, look_for_keys)
2014-12-07 11:45:53,605.605 INFO:teuthology.kill:  File "/home/yuriw/teuthology/virtualenv/lib/python2.7/site-packages/paramiko/client.py", line 493, in _auth
2014-12-07 11:45:53,605.605 INFO:teuthology.kill:    raise saved_exception
2014-12-07 11:45:53,605.605 INFO:teuthology.kill:AuthenticationException: Authentication failed.
2014-12-07 11:45:53,636.636 INFO:teuthology.kill:2014-12-07 11:45:53,635.635 ERROR:teuthology.orchestra.connection:Error connecting to magna020.ceph.redhat.com
2014-12-07 11:45:53,636.636 INFO:teuthology.kill:Traceback (most recent call last):
2014-12-07 11:45:53,636.636 INFO:teuthology.kill:  File "/home/yuriw/teuthology/teuthology/orchestra/connection.py", line 102, in connect
2014-12-07 11:45:53,637.637 INFO:teuthology.kill:    ssh.connect(**connect_args)
2014-12-07 11:45:53,637.637 INFO:teuthology.kill:  File "/home/yuriw/teuthology/virtualenv/lib/python2.7/site-packages/paramiko/client.py", line 332, in connect
2014-12-07 11:45:53,637.637 INFO:teuthology.kill:    self._auth(username, password, pkey, key_filenames, allow_agent, look_for_keys)
2014-12-07 11:45:53,637.637 INFO:teuthology.kill:  File "/home/yuriw/teuthology/virtualenv/lib/python2.7/site-packages/paramiko/client.py", line 493, in _auth
2014-12-07 11:45:53,638.638 INFO:teuthology.kill:    raise saved_exception
2014-12-07 11:45:53,638.638 INFO:teuthology.kill:AuthenticationException: Authentication failed.

History

#1 Updated by Zack Cerza over 9 years ago

  • Project changed from teuthology to devops
  • Assignee set to Sandon Van Ness

What even caused this? I can't of course log in to the machines to check it out.

#2 Updated by Sandon Van Ness about 9 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

I believe this was an old issue from when the lab was first setup which I resolved shortly after this was opened.

Also available in: Atom PDF