Project

General

Profile

Bug #44509

using ceph-bluestore-tool bluefs-bdev-new-db results in 128k or 64k leftover on slow device

Added by Stefan Priebe 24 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

Atfer using bluefs-bdev-new-db bluefs-bdev-new-db on 24 osds. All of those OSDs are in the following state even after one week:

osd.0 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.1 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.2 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.3 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.4 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.5 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.6 spilled over 64 KiB metadata from 'db' device (13 GiB used of 185 GiB) to slow device
osd.7 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.8 spilled over 128 KiB metadata from 'db' device (13 GiB used of 185 GiB) to slow device
osd.9 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.10 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.11 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.12 spilled over 64 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.13 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.14 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.15 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.16 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.17 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.18 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.19 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.20 spilled over 128 KiB metadata from 'db' device (13 GiB used of 185 GiB) to slow device
osd.21 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.22 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device
osd.23 spilled over 128 KiB metadata from 'db' device (12 GiB used of 185 GiB) to slow device

I tried manually compat or restart of the osd but nothing helps.

Also available in: Atom PDF