Project

General

Profile

Actions

Documentation #49406

closed

Exceeding osd nearfull ratio causes write throttle.

Added by Justin Mammarella about 3 years ago. Updated almost 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Tags:
Backport:
Reviewed:
Affected Versions:
Labels (FS):
Pull request ID:

Description

We noticed a 20x write performance reduction on our CEPHFS cluster shortly after one of our OSDs exceeded the near-full ratio.

Historically (pre nautilus), the "nearfull" warning never had any operational impact, so it took us a while to narrow down the actual cause.

Would be worth adding to user documentation: "If we are near [nearfull] ENOSPC, write synchronously." and the implications on client performance.

Appears to be related to the following commit:

https://github.com/ceph/ceph-client/commit/7614209736fbc4927584d4387faade4f31444fce

Kernel 4.19.154

Actions

Also available in: Atom PDF