Actions
Bug #65256
closedBug #65022: qa: test_max_items_per_obj open procs not fully cleaned up
umount: /home/ubuntu/cephtest/mnt.0: target is busy.
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
https://pulpito.ceph.com/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633108/
2024-03-31T22:51:45.342 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-31T22:51:45.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T22:51:45.342 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-31T22:51:45.368 INFO:teuthology.orchestra.run.smithi136.stderr:umount: /home/ubuntu/cephtest/mnt.0: target is busy. 2024-03-31T22:51:45.370 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-31T22:51:45.370 DEBUG:tasks.cephfs.kernel_mount:Killing processes on client.0... 2024-03-31T22:51:45.370 INFO:teuthology.orchestra.run:Running command with timeout 300 ... 2024-03-31T22:51:53.275 INFO:teuthology.orchestra.run.smithi136.stdout:ceph 23809 0.0 0.0 14224 12288 ? Ss 22:48 0:00 /usr/bin/python3 -s /usr/bin/ceph-crash 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to ... ERROR 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner: 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:ERROR: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/cephfs_test_case.py", line 205, in tearDown 2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner: m.teardown() 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/kernel_mount.py", line 210, in teardown 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: self.umount() 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/kernel_mount.py", line 170, in umount 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: raise e 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/kernel_mount.py", line 163, in umount 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=cmd, timeout=UMOUNT_TIMEOUT, omit_sudo=False) 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: r.wait() 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi136 with status 32: 'sudo umount /home/ubuntu/cephtest/mnt.0' 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner: 2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-31T22:51:53.279 INFO:tasks.cephfs_test_runner:Ran 1 test in 68.493s 2024-03-31T22:51:53.279 INFO:tasks.cephfs_test_runner: 2024-03-31T22:51:53.279 INFO:tasks.cephfs_test_runner:FAILED (errors=1) ... 2024-03-31T22:53:10.432 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T22:53:10.542 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-03-31T22:53:10.643 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-03-31T22:53:10.748 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/openfiletable} duration: 585.5900835990906 failure_reason: 'Test failure: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1c64ab0923a84752bcba7c1f282ca6ba status: fail success: false 2024-03-31T22:53:10.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T22:53:10.835 INFO:teuthology.run:FAIL
Actions