Feature #15835: filestore: randomize split threshold - RADOS - Ceph

Actions

Copy link

Feature #15835

closed

filestore: randomize split threshold

Added by Josh Durgin almost 8 years ago. Updated about 6 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Josh Durgin

Category:

Performance/Resource Usage

Target version:

% Done:

Source:

Support

Tags:

Backport:

jewel

Reviewed:

Affected Versions:

Component(RADOS):

Pull request ID:

Description

If the distribution of files is roughly even, many osds will reach the split threshold at the same time, causing them all to incur high latency as they all split directories at once.

A simple change that may mitigate this is to randomize the split threshold, similar to the randomized scrub threshold, so different osds split directories over a larger period of time.

Related issues 1 (0 open — 1 closed)

Actions

Copy link

Updated by Vikhyat Umrao over 7 years ago

Source changed from other to Support

Actions

Copy link

Updated by Peng Chen about 7 years ago

Hi! I am an undergrad student wishing to contribute to CEPH, and I would like to work on this issue. Please let me know.

Thanks,

Peng Chen

Actions

Copy link

Updated by Josh Durgin about 7 years ago

This one is more about performance testing, and at this point I think effort there is better spent on bluestore than filestore, and bluestore does not have internal splitting like this at all.

Perhaps you'd like to try http://tracker.ceph.com/issues/18629 ?

Actions

Copy link