Project

General

Profile

Actions

Bug #20681

closed

kclient: umount target is busy

Added by Patrick Donnelly almost 7 years ago. Updated about 5 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
multimds
Component(FS):
kceph
Labels (FS):
multimds
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2017-07-18T18:30:41.475 INFO:tasks.kclient:Unmounting kernel clients...
2017-07-18T18:30:41.476 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0...
2017-07-18T18:30:41.476 INFO:teuthology.orchestra.run.smithi090:Running: 'sudo umount /home/ubuntu/cephtest/mnt.0'
2017-07-18T18:30:49.604 INFO:teuthology.orchestra.run.smithi090.stderr:umount: /home/ubuntu/cephtest/mnt.0: target is busy
2017-07-18T18:30:49.604 INFO:teuthology.orchestra.run.smithi090.stderr:        (In some cases useful info about processes that
2017-07-18T18:30:49.604 INFO:teuthology.orchestra.run.smithi090.stderr:         use the device is found by lsof(8) or fuser(1).)
2017-07-18T18:30:49.607 WARNING:tasks.kclient:Ordinary umount failed, forcing...
2017-07-18T18:30:49.607 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0...
2017-07-18T18:30:49.607 INFO:teuthology.orchestra.run.smithi090:Running: 'sudo umount /home/ubuntu/cephtest/mnt.0 -f'
2017-07-18T18:30:49.682 INFO:teuthology.orchestra.run.smithi090:Running: 'rmdir -- /home/ubuntu/cephtest/mnt.0'
2017-07-18T18:30:49.686 INFO:teuthology.orchestra.run:waiting for 300
2017-07-18T18:30:55.692 ERROR:teuthology.run_tasks:Manager failed: kclient
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 159, in run_tasks
    suppress = manager.__exit__(*exc_info)
  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
    self.gen.next()
  File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/kclient.py", line 137, in task
    raise RuntimeError("Kernel mounts did not umount cleanly")
RuntimeError: Kernel mounts did not umount cleanly

From: /ceph/teuthology-archive/pdonnell-2017-07-18_16:08:43-multimds-master-testing-basic-smithi/1412797/teuthology.log

Zheng, any suggestions on how to debug this further? I didn't see anything in the kernel log. (Should we be enabling kernel debugging for these tests?)

Actions #1

Updated by Zheng Yan almost 7 years ago

  • Status changed from New to Need More Info

'sudo umount /home/ubuntu/cephtest/mnt.0' failed, but 'sudo umount /home/ubuntu/cephtest/mnt.0 -f' succeeded.

It's likely that some process was using the mount. We can execute 'lsof' if umount fails.

https://github.com/ceph/ceph/pull/16413

Actions #2

Updated by Zheng Yan over 5 years ago

  • Status changed from Need More Info to Closed

open new ticket if it happens again

Actions #3

Updated by Patrick Donnelly about 5 years ago

  • Category deleted (90)
  • Labels (FS) multimds added
Actions

Also available in: Atom PDF