Project

General

Profile

Actions

Bug #58411

closed

mds: a few simple operations crash mds

Added by Zhansong Gao over 1 year ago. Updated 8 months ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Correctness/Safety
Target version:
% Done:

100%

Source:
Tags:
backport_processed
Backport:
reef,quincy,pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
crash
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

mount a cephfs with multiple active mds daemons on '/mnt/cephfs' and then do the following operations in order:

(1) create directorys 'target' and 'link'
mkdir /mnt/cephfs/{target,link}
(2) pinning 'target' to mds.0 and 'link' to mds.1
setfattr -n ceph.dir.pin -v 0 /mnt/cephfs/target && setfattr -n ceph.dir.pin -v 1 /mnt/cephfs/link
(3) create file 'test.txt' in directory 'target'
touch /mnt/cephfs/target/test.txt
(4) create a hard link for 'test.txt' in directory 'link'
ln /mnt/cephfs/target/test.txt /mnt/cephfs/link/test.txt
(5) truncate 'test.txt' by opening hard link
truncate -s 0 /mnt/cephfs/link/test.txt

The mds.1 will crash after the above operations and operation(5) will be blocked.
If a standby mds replaces the crashed mds as mds.1, it will also crash immediately.
To stop the endless crash, use 'ceph tell mds.0 client ls' to find the client
currently in use and 'ceph tell mds.0 client evict' to evict it, and then restart
the crashed mds daemons.


Related issues 3 (0 open3 closed)

Copied to CephFS - Backport #61233: quincy: mds: a few simple operations crash mdsResolvedVenky ShankarActions
Copied to CephFS - Backport #61234: reef: mds: a few simple operations crash mdsResolvedVenky ShankarActions
Copied to CephFS - Backport #61235: pacific: mds: a few simple operations crash mdsResolvedVenky ShankarActions
Actions #1

Updated by Venky Shankar about 1 year ago

  • Category set to Correctness/Safety
  • Status changed from New to Triaged
  • Assignee set to Zhansong Gao
  • Backport set to pacific,quincy
  • Labels (FS) crash added

Good catch!

Actions #2

Updated by Zhansong Gao about 1 year ago

This bug will only be triggered in kernel client and ceph-fuse client doesn't have this problem.

Actions #3

Updated by Venky Shankar 11 months ago

  • Status changed from Triaged to Fix Under Review
  • Priority changed from Normal to Low
  • Target version changed from v18.0.0 to v19.0.0
  • Backport changed from pacific,quincy to reef,quincy,pacific
Actions #4

Updated by Venky Shankar 11 months ago

  • Status changed from Fix Under Review to Pending Backport
Actions #5

Updated by Backport Bot 11 months ago

  • Copied to Backport #61233: quincy: mds: a few simple operations crash mds added
Actions #6

Updated by Backport Bot 11 months ago

  • Copied to Backport #61234: reef: mds: a few simple operations crash mds added
Actions #7

Updated by Backport Bot 11 months ago

  • Copied to Backport #61235: pacific: mds: a few simple operations crash mds added
Actions #8

Updated by Backport Bot 11 months ago

  • Tags set to backport_processed
Actions #9

Updated by Konstantin Shalygin 8 months ago

  • Status changed from Pending Backport to Resolved
  • % Done changed from 0 to 100
Actions

Also available in: Atom PDF