Bug #14451: ceph-disk: duplicate osd mount points and umount fails to unmount temporary mount - Ceph - Ceph

Actions

Copy link

Bug #14451

closed

ceph-disk: duplicate osd mount points and umount fails to unmount temporary mount

Added by Vikhyat Umrao about 8 years ago. Updated about 8 years ago.

Status:

Duplicate

Priority:

Normal

Assignee:

Category:

Target version:

% Done:

Source:

other

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

ceph-disk: duplicate osd mount points and umount fails to unmount temprory mount

Could be related to http://tracker.ceph.com/issues/13160 .

mount | grep sdp1
/dev/sdp1 on /var/lib/ceph/tmp/mnt.EFQ84y type xfs (rw,noatime,attr2,inode64,noquota)
/dev/sdp1 on /var/lib/ceph/osd/ceph-60 type xfs (rw,noatime,attr2,inode64,noquota)

umount /var/lib/ceph/tmp/mnt.EFQ84y
umount: /var/lib/ceph/tmp/mnt.EFQ84y: mountpoint not found

and if we check "mnt.EFQ84y" does not exist in this path "/var/lib/ceph/tmp/"

ls /var/lib/ceph/tmp/
ceph-disk.activate.lock ceph-disk.prepare.lock

^^ and because of that it is failing.

ls /var/lib/ceph/osd/ceph-60/
activate.monmap active ceph_fsid current fsid journal journal_uuid keyring magic ready store_version superblock sysvinit whoami

/dev/sdp1 on /var/lib/ceph/tmp/mnt.EFQ84y type xfs (rw,noatime,attr2,inode64,noquota)
dev/sdp1 on /var/lib/ceph/osd/ceph-60 type xfs (rw,noatime,attr2,inode64,noquota)

If we try to umount /var/lib/ceph/tmp/mnt.EFQ84y we are getting error
<vikhyat> mountpoint not found
<vikhyat> and we are right as if we do :
<vikhyat> ls /var/lib/ceph/tmp/
<vikhyat> ceph-disk.activate.lock ceph-disk.prepare.lock
<vikhyat> we do not have "mnt.EFQ84y"
<vikhyat> because of that is failing

Related issues 1 (0 open — 1 closed)

Actions

Copy link

Updated by Vikhyat Umrao about 8 years ago

Vikhyat Umrao wrote:

ceph-disk: duplicate osd mount points and umount fails to unmount temprory mount

Could be related to http://tracker.ceph.com/issues/13160 .

mount | grep sdp1
/dev/sdp1 on /var/lib/ceph/tmp/mnt.EFQ84y type xfs (rw,noatime,attr2,inode64,noquota)
/dev/sdp1 on /var/lib/ceph/osd/ceph-60 type xfs (rw,noatime,attr2,inode64,noquota)

umount /var/lib/ceph/tmp/mnt.EFQ84y
umount: /var/lib/ceph/tmp/mnt.EFQ84y: mountpoint not found

and if we check "mnt.EFQ84y" does not exist in this path "/var/lib/ceph/tmp/"

ls /var/lib/ceph/tmp/
ceph-disk.activate.lock ceph-disk.prepare.lock

^^ and because of that it is failing.

ls /var/lib/ceph/osd/ceph-60/
activate.monmap active ceph_fsid current fsid journal journal_uuid keyring magic ready store_version superblock sysvinit whoami

Actions

Copy link

Updated by Vikhyat Umrao about 8 years ago

Issue came into picture when we rebooted one of the osd nodes and some of the osd was having this issue.

Actions

Copy link

Updated by Vikhyat Umrao about 8 years ago

From /var/log/messages

Jan 19 21:12:30 osd-node1 systemd-udevd: timeout: killing '/usr/sbin/ceph-disk-activate /dev/sdp1' [1270]
Jan 19 21:12:30 osd-node1 systemd-udevd: timeout: killing '/usr/sbin/ceph-disk-activate /dev/sdi1' [1297]
Jan 19 21:12:30 osd-node1 systemd-udevd: '/usr/sbin/ceph-disk-activate /dev/sdi1' [1297] terminated by signal 9 (Killed)
Jan 19 21:12:30 osd-node1 systemd-udevd: '/usr/sbin/ceph-disk-activate /dev/sdp1' [1270] terminated by signal 9 (Killed)

Actions

Copy link

Updated by Loïc Dachary about 8 years ago

Subject changed from ceph-disk: duplicate osd mount points and umount fails to unmount temprory mount to ceph-disk: duplicate osd mount points and umount fails to unmount temporary mount

Actions

Copy link