Project

General

Profile

Actions

Bug #20594

closed

mds: cache limits should be expressed in memory usage, not inode count

Added by Patrick Donnelly almost 7 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
Urgent
Category:
Performance/Resource Usage
Target version:
% Done:

0%

Source:
Development
Tags:
Backport:
luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Cached inode count (mds_cache_size) is an imperfect limit for what we really want. We frequently have to tell users/customers to tune this based on the amount of memory they want to consume for the MDS which is unacceptable.

Instead, use mempools with the cached objects to track memory usage and limit based on that.

BZ: https://bugzilla.redhat.com/show_bug.cgi?id=1464976


Related issues 5 (2 open3 closed)

Related to CephFS - Feature #4504: mds: trim based on total memory usageResolved03/19/2013

Actions
Related to CephFS - Feature #4502: mds: Make the MemoryModel usefulNew03/19/2013

Actions
Related to CephFS - Bug #21402: mds: move remaining containers in CDentry/CDir/CInode to mempoolResolvedPatrick Donnelly09/15/2017

Actions
Related to CephFS - Feature #36663: mds: adjust cache memory limit automatically via target that tracks RSSIn ProgressSidharth Anupkrishnan

Actions
Copied to CephFS - Backport #21384: luminous: mds: cache limits should be expressed in memory usage, not inode countResolvedPatrick DonnellyActions
Actions #1

Updated by Ian Colle almost 7 years ago

  • Assignee set to Patrick Donnelly
Actions #2

Updated by Greg Farnum over 6 years ago

See #4504 and associated MemoryModel tickets.

Actions #3

Updated by Patrick Donnelly over 6 years ago

  • Related to Feature #4504: mds: trim based on total memory usage added
Actions #4

Updated by Patrick Donnelly over 6 years ago

  • Related to Feature #4502: mds: Make the MemoryModel useful added
Actions #5

Updated by Patrick Donnelly over 6 years ago

  • Status changed from New to In Progress
Actions #6

Updated by Sage Weil over 6 years ago

  • Priority changed from Immediate to Urgent
Actions #7

Updated by Patrick Donnelly over 6 years ago

  • Status changed from In Progress to Fix Under Review
  • Target version set to v12.2.1
  • Backport set to luminous
Actions #8

Updated by Patrick Donnelly over 6 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions #9

Updated by Patrick Donnelly over 6 years ago

  • Copied to Backport #21384: luminous: mds: cache limits should be expressed in memory usage, not inode count added
Actions #10

Updated by Patrick Donnelly over 6 years ago

  • Related to Bug #21402: mds: move remaining containers in CDentry/CDir/CInode to mempool added
Actions #11

Updated by Patrick Donnelly over 6 years ago

  • Status changed from Pending Backport to Resolved
Actions #12

Updated by Patrick Donnelly over 5 years ago

  • Related to Feature #36663: mds: adjust cache memory limit automatically via target that tracks RSS added
Actions

Also available in: Atom PDF