Bug #45556
ConnectionLostError: SSH connection to smithixxx was lost
0%
Description
2020-05-13T15:24:14.031 DEBUG:teuthology.orchestra.console:expect after: smithi137 login: 2020-05-13T15:24:14.184 INFO:teuthology.misc:Re-opening connections... 2020-05-13T15:24:14.185 INFO:teuthology.misc:trying to connect to ubuntu@smithi137.front.sepia.ceph.com 2020-05-13T15:24:14.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-05-13T15:24:14.187 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi137.front.sepia.ceph.com', 'timeout': 60}
octopus: /a/yuriw-2020-05-13_14:51:27-powercycle-wip-yuri-octopus_15.2.2_RC0-distro-basic-smithi/5052175/
master: /a/teuthology-2020-04-11_03:09:01-powercycle-master-distro-basic-smithi/4944154/
raceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri-octopus_15.2.2_RC0/qa/tasks/ceph.py", line 1832, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/run_tasks.py", line 90, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/__init__.py", line 597, in task lambda: ship_utilities(ctx=ctx, config=None), File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/contextutil.py", line 56, in nested reraise(*exc) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/contextutil.py", line 32, in nested vars.append(enter()) File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/__init__.py", line 214, in install install_packages(ctx, package_list, config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/__init__.py", line 83, in install_packages ctx, remote, pkgs[system_type], config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 87, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 101, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 37, in resurrect_traceback reraise(*exc_info) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/parallel.py", line 24, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/task/install/rpm.py", line 237, in _update_package_list_and_install .format(install_cmd=install_cmd, rpms=' '.join(rpm)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/remote.py", line 203, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/run.py", line 473, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/run.py", line 162, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/teuthology/orchestra/run.py", line 176, in _raise_for_status node=self.hostname) ConnectionLostError: SSH connection to smithi137 was lost: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'
Related issues
History
#1 Updated by Neha Ojha almost 4 years ago
- Related to Bug #45543: powercycle: NoValidConnectionsError: [Errno None] Unable to connect to port x added
#2 Updated by Neha Ojha almost 4 years ago
- Project changed from Infrastructure to teuthology
#3 Updated by Patrick Donnelly almost 4 years ago
/ceph/teuthology-archive/pdonnell-2020-05-18_20:49:47-fs-wip-pdonnell-testing-20200516.030215-distro-basic-smithi/5067910/teuthology.log
and many others!
#4 Updated by Kyrylo Shatskyy almost 4 years ago
The "Connection lost error" looks more like infrastructure or networking issues.
However it could be a problem in software, for example, during yum install it stops networking by some reason, however, if this is not 100% reproducible, there more like networking issue, or lab infrastructure.
#6 Updated by David Galloway almost 3 years ago
This is probably https://tracker.ceph.com/issues/45512
#7 Updated by Aishwarya Mathuria about 2 years ago
/a/yuriw-2022-03-14_18:47:44-rados-wip-yuri3-testing-2022-03-14-0946-distro-default-smithi/6736437
#8 Updated by Kamoltat (Junior) Sirivadhna about 2 years ago
/a/yuriw-2022-03-26_19:49:47-rados-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6762721
/a/yuriw-2022-03-26_19:49:47-rados-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6762732
/a/yuriw-2022-03-26_19:49:47-rados-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6762743
#9 Updated by Kamoltat (Junior) Sirivadhna over 1 year ago
/a/ksirivad-2022-06-27_21:11:03-orch:cephadm-wip-ksirivad-test-46749-and-45511-distro-default-smithi/6901517/
#10 Updated by Kamoltat (Junior) Sirivadhna 7 months ago
- Status changed from New to Closed
Closing this because it is more of a infrastructure issue and it is hard to reproduce or resolve.