Project

General

Profile

Actions

Feature #57481

open

mds: enhance scrub to fragment/merge dirfrags

Added by Patrick Donnelly over 1 year ago. Updated 11 days ago.

Status:
Pending Backport
Priority:
High
Category:
Administration/Usability
Target version:
% Done:

0%

Source:
Development
Tags:
backport_processed
Backport:
quincy,reef,squid
Reviewed:
Affected Versions:
Component(FS):
MDS
Labels (FS):
scrub, task(easy), task(intern)
Pull request ID:

Description

Typically, this can only be induced via a client workload. That can be expensive due to the caps generated. See MDBalancer::maybe_fragment for how to trigger fragment/merge. The code change in the MDS should be trivial. The real work is in writing the tests. Suggest a few unit tests which create a directory hierarchy, flush the MDS journal, modify fragment/merge configs, issue a scrub, and check the fragment/merge happened as expected.


Related issues 3 (3 open0 closed)

Copied to CephFS - Backport #65488: reef: mds: enhance scrub to fragment/merge dirfragsIn ProgressChristopher HoffmanActions
Copied to CephFS - Backport #65489: squid: mds: enhance scrub to fragment/merge dirfragsIn ProgressChristopher HoffmanActions
Copied to CephFS - Backport #65490: quincy: mds: enhance scrub to fragment/merge dirfragsIn ProgressChristopher HoffmanActions
Actions #1

Updated by Venky Shankar over 1 year ago

Additionally, the MDS does not fragment directory snapshots. The tracker for this - https://tracker.ceph.com/issues/55215

This results in "large omap" warnings.

Actions #2

Updated by Venky Shankar about 1 year ago

  • Assignee set to Rishabh Dave
  • Target version changed from v18.0.0 to v19.0.0
  • Backport changed from quincy,pacific to reef,quincy

Rishabh, please take this one.

Actions #3

Updated by Venky Shankar 8 months ago

  • Assignee changed from Rishabh Dave to Christopher Hoffman

Chris, please take this one.

Actions #4

Updated by Christopher Hoffman 8 months ago

  • Status changed from New to In Progress
Actions #5

Updated by Christopher Hoffman 7 months ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 53564
Actions #6

Updated by Venky Shankar 14 days ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from reef,quincy to quincy,reef,squid
Actions #7

Updated by Venky Shankar 14 days ago

  • Target version changed from v19.0.0 to v20.0.0
Actions #8

Updated by Christopher Hoffman 11 days ago

  • Tags set to backport_processed
Actions #9

Updated by Christopher Hoffman 11 days ago

  • Copied to Backport #65488: reef: mds: enhance scrub to fragment/merge dirfrags added
Actions #10

Updated by Christopher Hoffman 11 days ago

  • Copied to Backport #65489: squid: mds: enhance scrub to fragment/merge dirfrags added
Actions #11

Updated by Christopher Hoffman 11 days ago

  • Copied to Backport #65490: quincy: mds: enhance scrub to fragment/merge dirfrags added
Actions

Also available in: Atom PDF