Project

General

Profile

Actions
Copy link

Bug #39399

open

ceph.py: ureadahead on ubuntu may prevent osd umount

Added by Sage Weil about 5 years ago. Updated over 4 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2019-04-21T05:56:27.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com
2019-04-21T05:56:27.794 INFO:teuthology.orchestra.run.smithi112:Running:
2019-04-21T05:56:27.794 INFO:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0
2019-04-21T05:56:27.895 INFO:teuthology.orchestra.run.smithi112.stderr:umount: /var/lib/ceph/osd/ceph-0: target is busy
2019-04-21T05:56:27.896 INFO:teuthology.orchestra.run.smithi112.stderr:        (In some cases useful info about processes that
2019-04-21T05:56:27.896 INFO:teuthology.orchestra.run.smithi112.stderr:         use the device is found by lsof(8) or fuser(1).)
2019-04-21T05:56:27.896 DEBUG:teuthology.orchestra.run:got remote process result: 32
2019-04-21T05:56:27.896 INFO:teuthology.orchestra.run.smithi112:Running:
2019-04-21T05:56:27.897 INFO:teuthology.orchestra.run.smithi112:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf
2019-04-21T05:56:27.983 INFO:teuthology.orchestra.run.smithi112.stdout:COMMAND    PID  TID       USER   FD      TYPE             DEVICE    SIZE/OFF       NODE NAME
...
2019-04-21T05:56:28.073 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG              252,1 96636764160         38 /var/lib/ceph/osd/ceph-0/block
2019-04-21T05:56:28.074 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1     3276192       4037 /usr/lib/locale/locale-archive
2019-04-21T05:56:28.074 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1       14648     105446 /lib/x86_64-linux-gnu/libcom_err.so.2.1
2019-04-21T05:56:28.074 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1       18976     105476 /lib/x86_64-linux-gnu/libuuid.so.1.3.0
2019-04-21T05:56:28.075 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1     1868984     105569 /lib/x86_64-linux-gnu/libc-2.23.so
2019-04-21T05:56:28.075 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1      138696     105567 /lib/x86_64-linux-gnu/libpthread-2.23.so
2019-04-21T05:56:28.075 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1      270696     105418 /lib/x86_64-linux-gnu/libext2fs.so.2.4
2019-04-21T05:56:28.075 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1      262408     105478 /lib/x86_64-linux-gnu/libblkid.so.1.1.0
2019-04-21T05:56:28.075 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1      100376     105663 /lib/x86_64-linux-gnu/libnih.so.1.0.0
2019-04-21T05:56:28.076 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1       31712     105592 /lib/x86_64-linux-gnu/librt-2.23.so
2019-04-21T05:56:28.076 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root  mem       REG                8,1      162632     105565 /lib/x86_64-linux-gnu/ld-2.23.so
2019-04-21T05:56:28.076 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root    0r      CHR                1,3         0t0          6 /dev/null
2019-04-21T05:56:28.076 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root    1u     unix 0xffff880074973400         0t0      12388 type=STREAM
2019-04-21T05:56:28.077 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root    2u     unix 0xffff880074973400         0t0      12388 type=STREAM
2019-04-21T05:56:28.077 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root    3r      DIR                0,9           0          1 /sys/kernel/debug/tracing
2019-04-21T05:56:28.077 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root    4r      REG                0,9           0       2093 /sys/kernel/debug/tracing/trace
2019-04-21T05:56:28.077 INFO:teuthology.orchestra.run.smithi112.stdout:ureadahea  304            root    5r      REG              252,1 96636764160         38 /var/lib/ceph/osd/ceph-0/block

/a/yuriw-2019-04-17_22:58:23-powercycle-nautilus-distro-basic-smithi/3860155

probably we need to disable ureadahead on ubuntu? see http://manpages.ubuntu.com/manpages/trusty/man8/ureadahead.8.html

Actions
Copy link
 #1

Updated by Patrick Donnelly over 4 years ago

  • Status changed from 12 to New
Actions
Copy link

Also available in: Atom PDF