Project

General

Profile

Bug #45552

qa/task/vstart_runner.py: admin_socket: exception getting command descriptions: [Errno 111] Connection refused

Added by Xiubo Li 4 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
fs
Component(FS):
Labels (FS):
qa
Pull request ID:
Crash signature:

Description

admin_socket: exception getting command descriptions: [Errno 111] Connection refused
2020-05-14 04:43:00,312.312 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on local...
2020-05-14 04:43:00,314.314 INFO:__main__:Running ['sudo', 'fusermount', '-u', '/tmp/tmpio4w8jxr/mnt.0']
2020-05-14 04:43:00,362.362 INFO:__main__:kill 
2020-05-14 04:43:00,363.363 INFO:__main__:kill: killing pid 12982 (['sudo', 'nsenter', '--net=/var/run/netns/ceph-ns--tmp-tmpio4w8jxr-mnt.0', './bin/ceph-fuse', '-f', '--name', 'client.0', '/tmp/tmpio4w8jxr/mnt.0'])
/var/tmp/sclw6ZPnz: line 8: kill: (12987) - No such process
2020-05-14 04:43:00,407.407 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--tmp-tmpio4w8jxr-mnt.0' netns for '/tmp/tmpio4w8jxr/mnt.0'
2020-05-14 04:43:00,408.408 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--tmp-tmpio4w8jxr-mnt.0'
2020-05-14 04:43:00,409.409 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip link set brx.1 down']
2020-05-14 04:43:00,463.463 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip link delete brx.1']
2020-05-14 04:43:00,536.536 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip netns delete ceph-ns--tmp-tmpio4w8jxr-mnt.0']
2020-05-14 04:43:00,587.587 INFO:__main__:Running ['ip', 'addr']
2020-05-14 04:43:00,597.597 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip link show']
2020-05-14 04:43:00,642.642 INFO:__main__:Running ['rm', '-rf', '/tmp/tmpio4w8jxr/mnt.0']
2020-05-14 04:43:00,650.650 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--tmp-tmpio4w8jxr-mnt.1' netns for '/tmp/tmpio4w8jxr/mnt.1'
2020-05-14 04:43:00,650.650 INFO:__main__:Running ['ip', 'addr']
2020-05-14 04:43:00,656.656 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip link show']
2020-05-14 04:43:00,700.700 INFO:__main__:Running ['rm', '-rf', '/tmp/tmpio4w8jxr/mnt.1']
2020-05-14 04:43:00,707.707 INFO:__main__:kill 
2020-05-14 04:43:00,707.707 INFO:__main__:kill: killing pid 14705 (['sudo', 'nsenter', '--net=/var/run/netns/ceph-ns--tmp-tmpio4w8jxr-mnt.2', './bin/ceph-fuse', '--client_mountpoint=/volumes/grpid/volid', '-f', '--name', 'client.guest', '/tmp/tmpio4w8jxr/mnt.2'])
2020-05-14T04:42:59.086-0400 7f9cec49df80 -1 WARNING: all dangerous and experimental features are enabled.
2020-05-14T04:42:59.105-0400 7f9cec49df80 -1 WARNING: all dangerous and experimental features are enabled.
2020-05-14T04:42:59.112-0400 7f9cec49df80 -1 WARNING: all dangerous and experimental features are enabled.
2020-05-14T04:42:59.113-0400 7f9cec49df80 -1 init, newargv = 0x559618321fb0 newargc=9ceph-fuse[14710]: starting ceph client

ceph-fuse[14710]: starting fuse
/var/tmp/sclizx25e: line 8: 14710 Killed                  'nsenter' '--net=/var/run/netns/ceph-ns--tmp-tmpio4w8jxr-mnt.2' './bin/ceph-fuse' '--client_mountpoint=/volumes/grpid/volid' '-f' '--name' 'client.guest' '/tmp/tmpio4w8jxr/mnt.2'
2020-05-14 04:43:00,749.749 INFO:tasks.cephfs.mount:Cleaning the 'ceph-ns--tmp-tmpio4w8jxr-mnt.2' netns for '/tmp/tmpio4w8jxr/mnt.2'
2020-05-14 04:43:00,750.750 INFO:tasks.cephfs.mount:Removing the netns 'ceph-ns--tmp-tmpio4w8jxr-mnt.2'
2020-05-14 04:43:00,751.751 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip link set brx.2 down']
2020-05-14 04:43:00,804.804 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip link delete brx.2']
2020-05-14 04:43:00,871.871 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip netns delete ceph-ns--tmp-tmpio4w8jxr-mnt.2']
2020-05-14 04:43:00,924.924 INFO:__main__:Running ['ip', 'addr']
2020-05-14 04:43:00,934.934 INFO:__main__:Running ['sudo', 'bash', '-c', 'ip link show']
2020-05-14 04:43:00,983.983 INFO:__main__:Running ['rm', '-rf', '/tmp/tmpio4w8jxr/mnt.2']
rm: cannot remove '/tmp/tmpio4w8jxr/mnt.2': Is a directory
2020-05-14 04:43:00,994.994 INFO:__main__:test_readonly_authorization (tasks.cephfs.test_volume_client.TestVolumeClient) ... ERROR
2020-05-14 04:43:00,995.995 INFO:__main__:ERROR
2020-05-14 04:43:00,995.995 INFO:__main__:Stopped test: test_readonly_authorization (tasks.cephfs.test_volume_client.TestVolumeClient) in 169.83121s
2020-05-14 04:43:00,996.996 INFO:__main__:
2020-05-14 04:43:00,996.996 INFO:__main__:======================================================================
2020-05-14 04:43:00,996.996 INFO:__main__:ERROR: test_readonly_authorization (tasks.cephfs.test_volume_client.TestVolumeClient)
2020-05-14 04:43:00,996.996 INFO:__main__:----------------------------------------------------------------------
2020-05-14 04:43:00,996.996 INFO:__main__:Traceback (most recent call last):
2020-05-14 04:43:00,997.997 INFO:__main__:  File "/data/ceph/qa/tasks/cephfs/test_volume_client.py", line 597, in test_readonly_authorization
2020-05-14 04:43:00,997.997 INFO:__main__:    guest_mount.mount_wait(mount_path=mount_path)
2020-05-14 04:43:00,997.997 INFO:__main__:  File "/data/ceph/qa/tasks/cephfs/mount.py", line 365, in mount_wait
2020-05-14 04:43:00,997.997 INFO:__main__:    mount_options=mount_options)
2020-05-14 04:43:00,997.997 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 780, in mount
2020-05-14 04:43:00,997.997 INFO:__main__:    self.gather_mount_info()
2020-05-14 04:43:00,997.997 INFO:__main__:  File "/data/ceph/qa/tasks/cephfs/fuse_mount.py", line 173, in gather_mount_info
2020-05-14 04:43:00,998.998 INFO:__main__:    status = self.admin_socket(['status'])
2020-05-14 04:43:00,998.998 INFO:__main__:  File "/data/ceph/qa/tasks/cephfs/fuse_mount.py", line 451, in admin_socket
2020-05-14 04:43:00,998.998 INFO:__main__:    timeout=(15*60))
2020-05-14 04:43:00,998.998 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 436, in sh
2020-05-14 04:43:00,998.998 INFO:__main__:    proc = self.run(**kwargs)
2020-05-14 04:43:00,998.998 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 355, in run
2020-05-14 04:43:00,998.998 INFO:__main__:    return self._do_run(**kwargs)
2020-05-14 04:43:00,998.998 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 419, in _do_run
2020-05-14 04:43:00,998.998 INFO:__main__:    proc.wait()
2020-05-14 04:43:00,998.998 INFO:__main__:  File "../qa/tasks/vstart_runner.py", line 202, in wait
2020-05-14 04:43:00,999.999 INFO:__main__:    raise CommandFailedError(self.args, self.exitstatus)
2020-05-14 04:43:00,999.999 INFO:__main__:teuthology.exceptions.CommandFailedError: Command failed with status 22: ['sudo', './bin/ceph', '--admin-daemon', '/tmp/ceph-asok.KoC3ci/client.guest.14724.asok', 'status']

History

#1 Updated by Xiubo Li 4 months ago

  • Status changed from New to In Progress

#2 Updated by Xiubo Li 4 months ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 35062

#3 Updated by Patrick Donnelly 4 months ago

  • Status changed from Fix Under Review to Resolved
  • Target version set to v16.0.0

Also available in: Atom PDF