Project

General

Profile

Actions

Backport #17285

closed

ceph-mon leaks in MDSMonitor when ceph-mds process is running but MDS is not configured

Added by Igor Podoski over 7 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
Release:
hammer
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Actions #1

Updated by Igor Podoski over 7 years ago

PR https://github.com/ceph/ceph/pull/10238 is fixing this leak at hammer branch. After v10.0.5 there was massive MDSMonitor code reorganization and bug probably was fixed.

Actions #2

Updated by Nathan Cutler over 7 years ago

  • Tracker changed from Bug to Backport
Actions #3

Updated by Nathan Cutler over 7 years ago

  • Description updated (diff)

original description

Memory is leaking every time when you see in monitor log:

mon.0@0(leader).mds e1 warning, MDS mds.? XXX.XXX.XXX.XXX:6800/1494583 up but filesystem disabled

Is not very noticeable, however when cluster is in unstable state, e.g. network cards are dropping random packets, monitors tend to fall into election loop. When two monitors are marking themselves as leaders for a while and then start election from the beginning, MDS messages are forwarded from one to another (to leader). After a while amount of MDS messages is quite big and when they hit monitor which is leader (at that point of time) memory leak is very visible and it leads to OOM kill.

This will only occur on disabled / not configured MDS.

Bug lasts until ceph v10.0.5.

Actions #4

Updated by Nathan Cutler over 7 years ago

  • Status changed from New to In Progress
Actions #5

Updated by Nathan Cutler over 7 years ago

  • Description updated (diff)
Actions #6

Updated by Nathan Cutler over 7 years ago

  • Subject changed from ceph-mon leaks in MDSMonito when ceph-mds process is running but MDS is not configured to ceph-mon leaks in MDSMonitor when ceph-mds process is running but MDS is not configured
Actions #7

Updated by Nathan Cutler over 7 years ago

  • Status changed from In Progress to Resolved
  • Target version set to v0.94.10
Actions

Also available in: Atom PDF