Project

General

Profile

Actions

Fix #41782

closed

mds: allow stray directories to fragment and switch from 10 stray directories to 1

Added by Patrick Donnelly over 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
-
Category:
-
Target version:
% Done:

0%

Source:
Development
Tags:
Backport:
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Stray directories can become too full which can result in unexpected ENOSPC errors. See for example, #41778.

Evaluate whether it's feasible to allow fragmentation on strays. It is probably a conservative barrier erected for when fragmentation wasn't considered stable (pre-luminous). The use of 10 stray directories was a workaround. Using only 1 with fragmentation is much simpler.


Files

out.tar.bz (733 KB) out.tar.bz vstart cluster logs Milind Changire, 10/31/2019 02:24 PM

Related issues 2 (2 open0 closed)

Related to CephFS - Bug #41778: 'No space left on device' due to snapshotsNew09/11/2019

Actions
Related to CephFS - Feature #58193: mds: remove stray directory indexes since stray directory can fragmentNewDhairya Parmar

Actions
Actions #1

Updated by Patrick Donnelly over 4 years ago

  • Related to Bug #41778: 'No space left on device' due to snapshots added
Actions #2

Updated by Patrick Donnelly over 4 years ago

  • Assignee set to Milind Changire
Actions #3

Updated by Milind Changire over 4 years ago

please see attachment out.tar.bz which includes ceph.conf as to why `ceph status` command hangs on Fedora 30 laptop.

Actions #4

Updated by Patrick Donnelly over 4 years ago

Milind Changire wrote:

please see attachment out.tar.bz which includes ceph.conf as to why `ceph status` command hangs on Fedora 30 laptop.

perhaps it's because you aren't running "bin/ceph status"? Is ceph also installed on your system using Fedora packages?

Actions #5

Updated by Milind Changire over 4 years ago

Patrick Donnelly wrote:

Milind Changire wrote:

please see attachment out.tar.bz which includes ceph.conf as to why `ceph status` command hangs on Fedora 30 laptop.

perhaps it's because you aren't running "bin/ceph status"? Is ceph also installed on your system using Fedora packages?

this wasn't the case
I had a /etc/ceph/ceph.conf along with build/ceph.conf
Zheng pointed this case to me and it indeed being the case, my vstart cluster started working normally after I removed /etc/ceph/ceph.conf

Actions #6

Updated by Milind Changire over 4 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 31521

Update:
Stray dirs are not being dropped from 10 to 1. Zheng recommended having more stray dirs.
Only fragmentation on stray dirs is being enabled with this PR.

Actions #7

Updated by Patrick Donnelly over 4 years ago

  • Target version changed from v15.0.0 to v16.0.0

We'll look at merging this at the beginning of Pacific release cycle.

Actions #8

Updated by Patrick Donnelly over 3 years ago

  • Status changed from Fix Under Review to Resolved
  • Assignee deleted (Milind Changire)
  • Pull request ID changed from 31521 to 33479
Actions #9

Updated by Patrick Donnelly over 1 year ago

  • Related to Feature #58193: mds: remove stray directory indexes since stray directory can fragment added
Actions

Also available in: Atom PDF