Project

General

Profile

Actions

Bug #39026

closed

mds: crash during mds restart

Added by shen hang about 5 years ago. Updated almost 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
nautilus,mimic,luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

On version 12.2.10

1767 2019-03-11 18:21:16.251278 7fe2cc325700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/     huge/release/12.2.10/rpm/el7/BUILD/ceph-12.2.10/src/mds/Server.cc: In function 'void Server::handle_client_reconnect(MClientReconnect*)' thread 7fe2cc325700 time 2019-03-11      18:21:16.248739
1768 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.10/rpm/el7/BUILD/ceph-12.     2.10/src/mds/Server.cc: 948: FAILED assert(session)

Normarly, after reconnect timeout, we killed all the session that hadn't received and handled reconnect msg. But some reconnect msgs were received and not yet handled before the relevant session was killed. So when the msg was being handled the session would be null. That's why mds crashed.
After knowing the session was killed ,the client wouldn't wait for the ack for reconnect msg,so omitting the reconnect msg may be the proper way.


Related issues 4 (0 open4 closed)

Related to Ceph - Bug #40588: mimic: mds: msg weren't destroyed before handle_client_reconnect returned, if the reconnect msg was from non-existent sessionResolvedshen hang

Actions
Copied to CephFS - Backport #39191: luminous: mds: crash during mds restartResolvedPrashant DActions
Copied to CephFS - Backport #39192: nautilus: mds: crash during mds restartResolvedPrashant DActions
Copied to CephFS - Backport #39193: mimic: mds: crash during mds restartResolvedPrashant DActions
Actions #2

Updated by Patrick Donnelly about 5 years ago

  • Subject changed from mds:we encountered crash when mds restart. to mds: crash during mds restart
  • Status changed from New to Fix Under Review
  • Assignee set to shen hang
  • Target version set to v15.0.0
  • Start date deleted (03/29/2019)
  • Source set to Community (dev)
  • Tags deleted (cephfs mds )
  • Backport set to nautilus,mimic,luminous
  • Pull request ID set to 27256
Actions #3

Updated by Patrick Donnelly about 5 years ago

  • Project changed from Ceph to CephFS
  • Component(FS) MDS added
Actions #4

Updated by Patrick Donnelly about 5 years ago

  • Description updated (diff)
  • Status changed from Fix Under Review to Pending Backport
  • Affected Versions v12.2.10 added
Actions #5

Updated by Nathan Cutler about 5 years ago

Actions #6

Updated by Nathan Cutler about 5 years ago

Actions #7

Updated by Nathan Cutler about 5 years ago

Actions #8

Updated by Nathan Cutler almost 5 years ago

  • Status changed from Pending Backport to Resolved
Actions #9

Updated by Nathan Cutler almost 5 years ago

  • Related to Bug #40588: mimic: mds: msg weren't destroyed before handle_client_reconnect returned, if the reconnect msg was from non-existent session added
Actions

Also available in: Atom PDF