Actions
Bug #58283
openServer connection dropped:
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):
Description
022-12-15T07:02:09.541 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image
2022-12-15T07:02:09.541 INFO:teuthology.orchestra.run.smithi094.stdout: available.
2022-12-15T07:02:09.541 DEBUG:teuthology.orchestra.run.smithi094:> mktemp
2022-12-15T07:02:09.547 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.vz78lnGmx4
2022-12-15T07:02:09.548 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vz78lnGmx4
2022-12-15T07:02:09.605 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.vz78lnGmx4
2022-12-15T07:02:09.667 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.vz78lnGmx4 is 9KB
2022-12-15T07:02:09.684 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-12-15T07:02:09.686 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 852, in _read_response
t, data = self._read_packet()
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp.py", line 201, in _read_packet
x = self._read_all(4)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp.py", line 188, in _read_all
raise EOFError()
EOFError
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 103, in run_tasks
manager = run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 1235, in task
p.spawn(process_role, ctx, config, timeout, role, role_config)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 1334, in process_role
install_and_reboot(ctx, {role: need_install}, config)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 503, in install_and_reboot
install_kernel(role_remote, config[role], version=src)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 863, in install_kernel
grub2conf = teuthology.get_file(remote,
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 718, in get_file
local_path = remote.get_file(path, sudo=sudo, dest_dir=dest_dir)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 620, in get_file
self._sftp_get_file(path, local_path)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 546, in _sftp_get_file
sftp.get(remote_path, local_path)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 811, in get
size = self.getfo(remotepath, fl, callback, prefetch)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 782, in getfo
file_size = self.stat(remotepath).st_size
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 493, in stat
t, msg = self._request(CMD_STAT, path)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 822, in _request
return self._read_response(num)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 854, in _read_response
raise SSHException("Server connection dropped: {}".format(e))
paramiko.ssh_exception.SSHException: Server connection dropped:
2022-12-15T07:02:09.781 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c1c5a3ff26db460a8e558e38ed84f164
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 852, in _read_response
t, data = self._read_packet()
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp.py", line 201, in _read_packet
x = self._read_all(4)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp.py", line 188, in _read_all
raise EOFError()
EOFError
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 103, in run_tasks
manager = run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 1235, in task
p.spawn(process_role, ctx, config, timeout, role, role_config)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 1334, in process_role
install_and_reboot(ctx, {role: need_install}, config)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 503, in install_and_reboot
install_kernel(role_remote, config[role], version=src)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/kernel.py", line 863, in install_kernel
grub2conf = teuthology.get_file(remote,
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 718, in get_file
local_path = remote.get_file(path, sudo=sudo, dest_dir=dest_dir)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 620, in get_file
self._sftp_get_file(path, local_path)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 546, in _sftp_get_file
sftp.get(remote_path, local_path)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 811, in get
size = self.getfo(remotepath, fl, callback, prefetch)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 782, in getfo
file_size = self.stat(remotepath).st_size
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 493, in stat
t, msg = self._request(CMD_STAT, path)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 822, in _request
return self._read_response(num)
File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/sftp_client.py", line 854, in _read_response
raise SSHException("Server connection dropped: {}".format(e))
paramiko.ssh_exception.SSHException: Server connection dropped:
2022-12-15T07:02:09.785 DEBUG:teuthology.run_tasks:Unwinding manager console_log
2022-12-15T07:02:09.808 INFO:teuthology.nuke:Checking targets against current locks
2022-12-15T07:02:15.697 DEBUG:teuthology.nuke:shortname: smithi094
2022-12-15T07:02:15.699 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-15T07:02:15.728 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2022-12-15_06:28:05-rados-wip-ksirivad-testing-main-distro-default-smithi/7117883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-12-15 06:52:16.615607', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSUO3vhGt1rf5eDrzk+rpnb+75orbXO8s9hn4Hz0asm82mqy4CbEoVFey69ZeczN2hhjJKARfaRBV+7kRwbfdnYcsxtLeV84p/0IgpJvb5EBb2oI0aljbAYrpEK02SuOUUeg7spDVtqsfJoOCPejs7w4r50A53PmfvAH5NldgmmMg/tvUKGaDiPREM6DGdWKNGBQ8EbCFMjaWjZ0tJMxWuYaXGZZMBuYng+2XKvS40PPWAkw6J78xnKx6eMLH+h0diW2FbqbAGrT16lrAJgWOKTWI4MtMKuenieyIgI+Oe7vkMkJy8xIz6f+bTjmhhaAcjU9ujkMsW8/sxkb9VSUD4L6yxWBICOU4CyoebjdjTh8GnN+XiOz9Sl/hrpPxaUa2240CtTCxJK1RAi1aWpm8D9Vyt5mZ/EUrDx4RwXad8PcykXrimV5MhmQwxugPI8qkYxWBZwblV2FgSZ6KpxnbaSU9taJ+LD3fUUDElw9u7rG4FVqg8pvezmWBMglRUqpc='}
2022-12-15T07:02:15.803 INFO:teuthology.orchestra.console:Power off smithi094
2022-12-15T07:02:15.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
Updated by adam kraitman over 1 year ago
- Status changed from New to Pending Backport
- Assignee set to adam kraitman
Please check if you still see this error
Actions