Project

General

Profile

Actions

Bug #65256

closed

Bug #65022: qa: test_max_items_per_obj open procs not fully cleaned up

umount: /home/ubuntu/cephtest/mnt.0: target is busy.

Added by Xiubo Li about 1 month ago. Updated 30 days ago.

Status:
Duplicate
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

https://pulpito.ceph.com/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633108/

2024-03-31T22:51:45.342 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0...
2024-03-31T22:51:45.342 INFO:teuthology.orchestra.run:Running command with timeout 300
2024-03-31T22:51:45.342 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.0
2024-03-31T22:51:45.368 INFO:teuthology.orchestra.run.smithi136.stderr:umount: /home/ubuntu/cephtest/mnt.0: target is busy.
2024-03-31T22:51:45.370 DEBUG:teuthology.orchestra.run:got remote process result: 32
2024-03-31T22:51:45.370 DEBUG:tasks.cephfs.kernel_mount:Killing processes on client.0...
2024-03-31T22:51:45.370 INFO:teuthology.orchestra.run:Running command with timeout 300
...
2024-03-31T22:51:53.275 INFO:teuthology.orchestra.run.smithi136.stdout:ceph       23809  0.0  0.0  14224 12288 ?        Ss   22:48   0:00 /usr/bin/python3 -s /usr/bin/ceph-crash
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to ... ERROR
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:======================================================================
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:ERROR: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable)
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/cephfs_test_case.py", line 205, in tearDown
2024-03-31T22:51:53.277 INFO:tasks.cephfs_test_runner:    m.teardown()
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/kernel_mount.py", line 210, in teardown
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:    self.umount()
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/kernel_mount.py", line 170, in umount
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:    raise e
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph_384f31f3d3aee7f8ba3f60846b8844c049165583/qa/tasks/cephfs/kernel_mount.py", line 163, in umount
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:    self.client_remote.run(args=cmd, timeout=UMOUNT_TIMEOUT, omit_sudo=False)
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:    r.wait()
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:    raise CommandFailedError(
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi136 with status 32: 'sudo umount /home/ubuntu/cephtest/mnt.0'
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:
2024-03-31T22:51:53.278 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-03-31T22:51:53.279 INFO:tasks.cephfs_test_runner:Ran 1 test in 68.493s
2024-03-31T22:51:53.279 INFO:tasks.cephfs_test_runner:
2024-03-31T22:51:53.279 INFO:tasks.cephfs_test_runner:FAILED (errors=1)
...
2024-03-31T22:53:10.432 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-31T22:53:10.542 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2024-03-31T22:53:10.643 INFO:teuthology.orchestra.console.smithi167:Power off completed
2024-03-31T22:53:10.748 INFO:teuthology.run:Summary data:
description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client
  conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1}
  mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap
  overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1
  tasks/openfiletable}
duration: 585.5900835990906
failure_reason: 'Test failure: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable)'
flavor: default
owner: scheduled_teuthology@teuthology
sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1c64ab0923a84752bcba7c1f282ca6ba
status: fail
success: false

2024-03-31T22:53:10.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-31T22:53:10.835 INFO:teuthology.run:FAIL
Actions #1

Updated by Xiubo Li 30 days ago

  • Status changed from Fix Under Review to Duplicate
  • Parent task set to #65022
Actions

Also available in: Atom PDF