Project

General

Profile

Actions
Copy link

Bug #20594

closed

mds: cache limits should be expressed in memory usage, not inode count

Added by Patrick Donnelly almost 7 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Patrick Donnelly
Category:
Performance/Resource Usage
Target version:
Ceph - v12.2.1
% Done:

0%

Source:
Development
Tags:
Backport:
luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Cached inode count (mds_cache_size) is an imperfect limit for what we really want. We frequently have to tell users/customers to tune this based on the amount of memory they want to consume for the MDS which is unacceptable.

Instead, use mempools with the cached objects to track memory usage and limit based on that.

BZ: https://bugzilla.redhat.com/show_bug.cgi?id=1464976

Related issues 5 (2 open — 3 closed)

Related to CephFS - Feature #4504: mds: trim based on total memory usageResolved03/19/2013

Actions
Related to CephFS - Feature #4502: mds: Make the MemoryModel usefulNew03/19/2013

Actions
Related to CephFS - Bug #21402: mds: move remaining containers in CDentry/CDir/CInode to mempoolResolvedPatrick Donnelly09/15/2017

Actions
Related to CephFS - Feature #36663: mds: adjust cache memory limit automatically via target that tracks RSSIn ProgressSidharth Anupkrishnan

Actions
Copied to CephFS - Backport #21384: luminous: mds: cache limits should be expressed in memory usage, not inode countResolvedPatrick DonnellyActions
Actions
Copy link
 #1

Updated by Ian Colle almost 7 years ago

  • Assignee set to Patrick Donnelly
Actions
Copy link
 #2

Updated by Greg Farnum almost 7 years ago

See #4504 and associated MemoryModel tickets.

Actions
Copy link
 #3

Updated by Patrick Donnelly almost 7 years ago

  • Related to Feature #4504: mds: trim based on total memory usage added
Actions
Copy link
 #4

Updated by Patrick Donnelly almost 7 years ago

  • Related to Feature #4502: mds: Make the MemoryModel useful added
Actions
Copy link
 #5

Updated by Patrick Donnelly almost 7 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #6

Updated by Sage Weil over 6 years ago

  • Priority changed from Immediate to Urgent
Actions
Copy link
 #7

Updated by Patrick Donnelly over 6 years ago

  • Status changed from In Progress to Fix Under Review
  • Target version set to v12.2.1
  • Backport set to luminous
Actions
Copy link
 #8

Updated by Patrick Donnelly over 6 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions
Copy link
 #9

Updated by Patrick Donnelly over 6 years ago

  • Copied to Backport #21384: luminous: mds: cache limits should be expressed in memory usage, not inode count added
Actions
Copy link
 #10

Updated by Patrick Donnelly over 6 years ago

  • Related to Bug #21402: mds: move remaining containers in CDentry/CDir/CInode to mempool added
Actions
Copy link
 #11

Updated by Patrick Donnelly over 6 years ago

  • Status changed from Pending Backport to Resolved
Actions
Copy link
 #12

Updated by Patrick Donnelly over 5 years ago

  • Related to Feature #36663: mds: adjust cache memory limit automatically via target that tracks RSS added
Actions
Copy link

Also available in: Atom PDF