Project

General

Profile

Bug #45556

ConnectionLostError: SSH connection to smithixxx was lost

Added by Neha Ojha almost 4 years ago. Updated 7 months ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2020-05-13T15:24:14.031 DEBUG:teuthology.orchestra.console:expect after: smithi137 login:
2020-05-13T15:24:14.184 INFO:teuthology.misc:Re-opening connections...
2020-05-13T15:24:14.185 INFO:teuthology.misc:trying to connect to ubuntu@smithi137.front.sepia.ceph.com
2020-05-13T15:24:14.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2020-05-13T15:24:14.187 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi137.front.sepia.ceph.com', 'timeout': 60}

octopus: /a/yuriw-2020-05-13_14:51:27-powercycle-wip-yuri-octopus_15.2.2_RC0-distro-basic-smithi/5052175/
master: /a/teuthology-2020-04-11_03:09:01-powercycle-master-distro-basic-smithi/4944154/

raceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/contextutil.py", line 34, in nested
    yield vars
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri-octopus_15.2.2_RC0/qa/tasks/ceph.py", line 1832, in task
    yield
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/run_tasks.py", line 90, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/__init__.py", line 597, in task
    lambda: ship_utilities(ctx=ctx, config=None),
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/contextutil.py", line 56, in nested
    reraise(*exc)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/contextutil.py", line 32, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/__init__.py", line 214, in install
    install_packages(ctx, package_list, config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/__init__.py", line 83, in install_packages
    ctx, remote, pkgs[system_type], config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 87, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 101, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 37, in resurrect_traceback
    reraise(*exc_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 24, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/rpm.py", line 237, in _update_package_list_and_install
    .format(install_cmd=install_cmd, rpms=' '.join(rpm))
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/remote.py", line 203, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/run.py", line 473, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/run.py", line 162, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/run.py", line 176, in _raise_for_status
    node=self.hostname)
ConnectionLostError: SSH connection to smithi137 was lost: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

Related issues

Related to teuthology - Bug #45543: powercycle: NoValidConnectionsError: [Errno None] Unable to connect to port x New

History

#1 Updated by Neha Ojha almost 4 years ago

  • Related to Bug #45543: powercycle: NoValidConnectionsError: [Errno None] Unable to connect to port x added

#2 Updated by Neha Ojha almost 4 years ago

  • Project changed from Infrastructure to teuthology

#3 Updated by Patrick Donnelly almost 4 years ago

/ceph/teuthology-archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067910/teuthology.log

and many others!

#4 Updated by Kyrylo Shatskyy almost 4 years ago

The "Connection lost error" looks more like infrastructure or networking issues.
However it could be a problem in software, for example, during yum install it stops networking by some reason, however, if this is not 100% reproducible, there more like networking issue, or lab infrastructure.

#7 Updated by Aishwarya Mathuria about 2 years ago

/a/yuriw-2022-03-14_18:47:44-rados-wip-yuri3-testing-2022-03-14-0946-distro-default-smithi/6736437

#8 Updated by Kamoltat (Junior) Sirivadhna about 2 years ago

/a/yuriw-2022-03-26_19:49:47-rados-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6762721
/a/yuriw-2022-03-26_19:49:47-rados-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6762732
/a/yuriw-2022-03-26_19:49:47-rados-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6762743

#9 Updated by Kamoltat (Junior) Sirivadhna over 1 year ago

/a/ksirivad-2022-06-27_21:11:03-orch:cephadm-wip-ksirivad-test-46749-and-45511-distro-default-smithi/6901517/

#10 Updated by Kamoltat (Junior) Sirivadhna 7 months ago

  • Status changed from New to Closed

Closing this because it is more of a infrastructure issue and it is hard to reproduce or resolve.

Also available in: Atom PDF