Project

General

Profile

Feature #26955

os/filestore: Add switch to turn on/off filestore dir splitting

Added by Zhi Zhang over 5 years ago. Updated over 5 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
Reviewed:
Affected Versions:
Component(RADOS):
FileStore
Pull request ID:

Description

We had done pre-split and increased split multiple, etc, at the beginning of building cluster in order to reduce the performance impact of dir splitting. But with the number of objects increased to hundreds millions, our clusters would stilll experience dir splitting, which would bring performance impact to the online traffic.

So we add this switch to easily control filestore dir splitting, that could turn it off dynamically when there is heavy online traffic, and turn it on again at night when traffic is very low.

History

#1 Updated by Zhi Zhang over 5 years ago

https://github.com/ceph/ceph/pull/23460

1. Refined HashIndex::must_split() to be more readable.
2. Introduced a hard limit which is TWO times the expected split threshold without rand factor, to prevent users abusing the new option.

#2 Updated by Zhi Zhang over 5 years ago

  • Project changed from Ceph to RADOS
  • Category deleted (OSD)

#3 Updated by Zhi Zhang over 5 years ago

  • Component(RADOS) FileStore added

Also available in: Atom PDF