Project

General

Profile

Actions
Copy link

Bug #8433

closed

SSHException: Key-exchange timed out waiting for key negotiation

Added by Zack Cerza almost 10 years ago. Updated about 8 years ago.

Status:
Duplicate
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/infernalis-x
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://pulpito.ceph.com/teuthology-2014-05-20_19:55:02-upgrade:dumpling-x:stress-split-firefly---basic-plana/268335/
http://qa-proxy.ceph.com/teuthology/teuthology-2014-05-20_19:55:02-upgrade:dumpling-x:stress-split-firefly---basic-plana/268335/teuthology.log

2014-05-21T17:07:25.386 ERROR:paramiko.transport:Exception: Key-exchange timed out waiting for key negotiation
2014-05-21T17:07:25.387 ERROR:paramiko.transport:Traceback (most recent call last):
2014-05-21T17:07:25.387 ERROR:paramiko.transport:  File "/home/teuthworker/teuthology-firefly/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 1551, in run
2014-05-21T17:07:25.387 ERROR:paramiko.transport:    self._channel_handler_table[ptype](chan, m)
2014-05-21T17:07:25.387 ERROR:paramiko.transport:  File "/home/teuthworker/teuthology-firefly/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1063, in _handle_close
2014-05-21T17:07:25.388 ERROR:paramiko.transport:    self.transport._send_user_message(m)
2014-05-21T17:07:25.388 ERROR:paramiko.transport:  File "/home/teuthworker/teuthology-firefly/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 1424, in _send_user_message
2014-05-21T17:07:25.388 ERROR:paramiko.transport:    raise SSHException('Key-exchange timed out waiting for key negotiation')
2014-05-21T17:07:25.388 ERROR:paramiko.transport:SSHException: Key-exchange timed out waiting for key negotiation
2014-05-21T17:07:25.388 ERROR:paramiko.transport:

... I don't know what caused this.

Related issues 1 (0 open — 1 closed)

Is duplicate of Ceph - Bug #15236: openstack: SSHException: Key-exchange timed outClosed03/22/2016

Actions
Actions
Copy link
 #1

Updated by Zack Cerza almost 10 years ago

The last host mentioned is 10.214.132.4

$ host 10.214.132.4
4.132.214.10.in-addr.arpa domain name pointer plana74.front.sepia.ceph.com.

$ ssh plana74 echo connected
connected
Actions
Copy link
 #3

Updated by Sage Weil over 9 years ago

  • Status changed from New to Can't reproduce
Actions
Copy link
 #4

Updated by Loïc Dachary over 8 years ago

  • Status changed from Can't reproduce to New
  • Regression set to No
2015-10-15T19:05:54.194 INFO:teuthology.orchestra.run.target253205.stderr:and/or irreparable damage to your cluster.  Do not use
2015-10-15T19:05:54.194 INFO:teuthology.orchestra.run.target253205.stderr:feature with important data.
2015-10-15T19:05:54.194 INFO:teuthology.orchestra.run.target253205.stderr:
2015-10-15T19:05:54.210 INFO:teuthology.orchestra.run.target253205.stderr:2015-10-15 19:05:54.217523 7f00453e9700 -1 WARNING: the following dangerous and experimental features are enabled: *
2015-10-15T19:05:54.588 INFO:teuthology.orchestra.run.target253205.stderr:dumped all in format json
2015-10-15T19:06:24.794 ERROR:paramiko.transport:Exception: Key-exchange timed out waiting for key negotiation
2015-10-15T19:06:24.795 ERROR:paramiko.transport:Traceback (most recent call last):
2015-10-15T19:06:24.795 ERROR:paramiko.transport:  File "/home/ubuntu/teuthology/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 1635, in run
2015-10-15T19:06:24.795 ERROR:paramiko.transport:    self._channel_handler_table[ptype](chan, m)
2015-10-15T19:06:24.795 ERROR:paramiko.transport:  File "/home/ubuntu/teuthology/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1048, in _handle_close
2015-10-15T19:06:24.796 ERROR:paramiko.transport:    self.transport._send_user_message(m)
2015-10-15T19:06:24.796 ERROR:paramiko.transport:  File "/home/ubuntu/teuthology/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 1478, in _send_user_message
2015-10-15T19:06:24.796 ERROR:paramiko.transport:    raise SSHException('Key-exchange timed out waiting for key negotiation')
2015-10-15T19:06:24.796 ERROR:paramiko.transport:SSHException: Key-exchange timed out waiting for key negotiation
2015-10-15T19:06:24.797 ERROR:paramiko.transport:
2015-10-15T19:06:24.799 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
  File "/home/ubuntu/src/ceph-qa-suite_wip-12471-resources-hint/tasks/ceph_manager.py", line 650, in wrapper
    return func(self)
  File "/home/ubuntu/src/ceph-qa-suite_wip-12471-resources-hint/tasks/ceph_manager.py", line 697, in do_thrash
    timeout=self.config.get('timeout')
  File "/home/ubuntu/src/ceph-qa-suite_wip-12471-resources-hint/tasks/ceph_manager.py", line 1627, in wait_for_recovery
    cur_active_recovered = self.get_num_active_recovered()
  File "/home/ubuntu/src/ceph-qa-suite_wip-12471-resources-hint/tasks/ceph_manager.py", line 1483, in get_num_active_recovered
    pgs = self.get_pg_stats()
  File "/home/ubuntu/src/ceph-qa-suite_wip-12471-resources-hint/tasks/ceph_manager.py", line 1328, in get_pg_stats
    out = self.raw_cluster_cmd('pg', 'dump', '--format=json')
  File "/home/ubuntu/src/ceph-qa-suite_wip-12471-resources-hint/tasks/ceph_manager.py", line 821, in raw_cluster_cmd
    stdout=StringIO(),
  File "/home/ubuntu/teuthology/teuthology/orchestra/remote.py", line 156, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/ubuntu/teuthology/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/ubuntu/teuthology/teuthology/orchestra/run.py", line 94, in wait
    greenlet.get()
  File "/home/ubuntu/teuthology/virtualenv/local/lib/python2.7/site-packages/gevent/greenlet.py", line 331, in get
    raise self._exception
SSHException: Key-exchange timed out waiting for key negotiation
Actions
Copy link
 #6

Updated by Nathan Cutler about 8 years ago

  • Status changed from New to 12
  • Priority changed from Normal to High

Bumping priority because the issue still exists and it has been 2 years.

Actions
Copy link
 #7

Updated by Nathan Cutler about 8 years ago

After encountering the usual problems with uploading the teuthology log, I made it available here:

https://gist.githubusercontent.com/smithfarm/5fc4204d0bff6bc3a0fd/raw/1e1df52272d6e24cc592b7248a1b57c868624beb/teuthology-53.log

Actions
Copy link
 #8

Updated by Nathan Cutler about 8 years ago

Following the SSH timeout in paramiko, from line 55436 osds 3,4,5 complain that they cannot see osds 0,1,2

Actions
Copy link
 #9

Updated by Nathan Cutler about 8 years ago

  • Is duplicate of Bug #13522: Apparent deadlock between tcmalloc getting a stacktrace and dlopen allocating memory added
Actions
Copy link
 #10

Updated by Nathan Cutler about 8 years ago

  • Is duplicate of deleted (Bug #13522: Apparent deadlock between tcmalloc getting a stacktrace and dlopen allocating memory)
Actions
Copy link
 #11

Updated by Nathan Cutler about 8 years ago

  • Has duplicate Bug #13522: Apparent deadlock between tcmalloc getting a stacktrace and dlopen allocating memory added
Actions
Copy link
 #13

Updated by Nathan Cutler about 8 years ago

  • ceph-qa-suite upgrade/infernalis-x added
Actions
Copy link
 #14

Updated by Loïc Dachary about 8 years ago

  • Status changed from 12 to Duplicate
Actions
Copy link
 #15

Updated by Loïc Dachary about 8 years ago

  • Project changed from teuthology to Ceph
Actions
Copy link
 #16

Updated by Loïc Dachary about 8 years ago

  • Is duplicate of Bug #15236: openstack: SSHException: Key-exchange timed out added
Actions
Copy link

Also available in: Atom PDF