Project

General

Profile

Actions
Copy link

Bug #46780

closed

BlueFS Spillover without db being full

Added by Seena Fallah almost 4 years ago. Updated almost 3 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
Ceph - v14.2.2, Ceph - v14.2.3, Ceph - v14.2.4, Ceph - v14.2.5, Ceph - v14.2.6, Ceph - v14.2.7, Ceph - v14.2.8, Ceph - v14.2.9
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Hi. I'm facing a issue that my OSDs are going to spillover but db used that I check from prometheus `ceph_bluefs_db_used_bytes` is just 33GB and my db size is 191GB. The spillover amount is just 65MB and when I do a manual compaction it will resolved. Sometimes it needs double manual compaction to be cleaned.
I see this occurred when flushing event is triggering in RocksDB logs
I have attached the osd log when spillover occurred.
After a time I do a manual compaction it will again have spillover with this 65MB value.
Why my db has free space but it can't use it?
I'm using nautilus 14.2.9 on ubuntu 18.04.4

Files

Download all files
ceph-osd.116.log (46.7 KB) ceph-osd.116.log Seena Fallah, 07/30/2020 11:09 PM
Screenshot from 2020-07-31 03-48-42.png (26.3 KB) Screenshot from 2020-07-31 03-48-42.png Seena Fallah, 07/30/2020 11:19 PM
Screenshot from 2020-07-31 03-48-30.png (26.4 KB) Screenshot from 2020-07-31 03-48-30.png Seena Fallah, 07/30/2020 11:19 PM
Actions
Copy link

Also available in: Atom PDF