Project

General

Profile

Feature #36663

mds: adjust cache memory limit automatically via target that tracks RSS

Added by Patrick Donnelly about 2 years ago. Updated about 11 hours ago.

Status:
In Progress
Priority:
High
Assignee:
Sidharth Anupkrishnan
Category:
Performance/Resource Usage
Target version:
Ceph - v17.0.0
% Done:

0%

Source:
Development
Tags:
Backport:
Reviewed:
Affected Versions:
Component(FS):
MDS
Labels (FS):
task(intern), task(medium)
Pull request ID:
27027

Description

Basic idea is to have a new config like `mds_memory_target` that, if set, automatically adjusts `mds_cache_memory_limit` in response to RSS memory usage.

Recent experiments found that real RSS usage is about 1.25x the `mds_cache_memory_limit`. So, another layer which tracks RSS and makes finer adjustments would be valuable.

Related issues

Related to CephFS - Bug #22962: mds: move remaining containers in CDentry/CDir/CInode to mempool (cont.) New 09/15/2017
Related to CephFS - Bug #20594: mds: cache limits should be expressed in memory usage, not inode count Resolved 07/12/2017

History

#1 Updated by Patrick Donnelly about 2 years ago

  • Related to Bug #22962: mds: move remaining containers in CDentry/CDir/CInode to mempool (cont.) added

#2 Updated by Patrick Donnelly about 2 years ago

  • Related to Bug #20594: mds: cache limits should be expressed in memory usage, not inode count added

#3 Updated by Patrick Donnelly almost 2 years ago

  • Status changed from New to In Progress
  • Assignee set to Sidharth Anupkrishnan
  • Target version changed from v14.0.0 to v15.0.0
  • Labels (FS) task(intern), task(medium) added

#4 Updated by Patrick Donnelly almost 2 years ago

  • Backport set to nautilus

#5 Updated by Vikhyat Umrao about 1 year ago

  • Pull request ID set to 27027

#6 Updated by Patrick Donnelly 11 months ago

  • Target version changed from v15.0.0 to v16.0.0
  • Backport deleted (nautilus)

#7 Updated by Patrick Donnelly about 11 hours ago

  • Target version changed from v16.0.0 to v17.0.0

Also available in: Atom PDF