Project

General

Profile

Actions

Bug #24467

closed

mds: low wrlock efficiency due to dirfrags traversal

Added by Xuehan Xu almost 6 years ago. Updated over 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Performance/Resource Usage
Target version:
% Done:

0%

Source:
Development
Tags:
Backport:
luminous,mimic
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
multimds
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Recently, when trying to create/remove massive files/dirs(7x10^6) within a common directory, we found that as the creations go on, the time to create a single file/dir increases. After a series analysis, we found that this is due to the traversal of dirfrags the number of which increases exponentially as the number of subdirs/subfiles increases.


Related issues 2 (0 open2 closed)

Copied to CephFS - Backport #24696: luminous: mds: low wrlock efficiency due to dirfrags traversalResolvedNathan CutlerActions
Copied to CephFS - Backport #24704: mimic: mds: low wrlock efficiency due to dirfrags traversalResolvedNathan CutlerActions
Actions #1

Updated by Kefu Chai almost 6 years ago

  • Category set to Performance/Resource Usage
  • Status changed from New to Fix Under Review
  • Assignee set to Xuehan Xu
Actions #2

Updated by Patrick Donnelly almost 6 years ago

  • Subject changed from low wrlock efficiency due to dirfrags traversal to mds: low wrlock efficiency due to dirfrags traversal
  • Status changed from Fix Under Review to Pending Backport
  • Source set to Development
  • Backport set to luminous,mimic
Actions #3

Updated by Patrick Donnelly almost 6 years ago

  • Copied to Backport #24696: luminous: mds: low wrlock efficiency due to dirfrags traversal added
Actions #4

Updated by Patrick Donnelly almost 6 years ago

  • Copied to Backport #24704: mimic: mds: low wrlock efficiency due to dirfrags traversal added
Actions #5

Updated by Patrick Donnelly over 5 years ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF