Project

General

Profile

Actions
Copy link

Support #15337

closed

OSDs are very unbalanced

Added by Mehdi Abaakouk about 8 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Tags:
Reviewed:
Affected Versions:
v0.94.6
Pull request ID:

Description

Hi,

we are experiencing that our OSDS are very unbalanced, some of them are filled to 50% and some others go up to 93%, I have attached the details (ceph osd tree/ceph osd df/crushmap)

For the cluster story, it have started we 3 hosts and 9 OSDs with firefly version and now it have 50 OSDs across 13 hosts with hammer (0.94.6) on ubuntu trusty. (We have used giant for while between)

The weight of each OSDs was ~ 1.0 for 1T, but we started to have trouble about data repartition, we got our first OSD full and then start reducing the weight to free space on full OSDs.

After some reading, we discover that we should enable the tunable "straw_calc_version = 1" to fix the situation, we do, got a big data rebalancing.

But the data repartition was not better.

So we try to use straw2 instead of straw1. The data have moved a lot too but we are still experiencing a bad data repartition.

Cheers,

Files

Download all files
crushmap.txt (6.64 KB) crushmap.txt Mehdi Abaakouk, 03/31/2016 01:45 PM
ceph-osd-df.txt (2.78 KB) ceph-osd-df.txt Mehdi Abaakouk, 03/31/2016 01:46 PM
ceph-osd-tree.txt (5.09 KB) ceph-osd-tree.txt Mehdi Abaakouk, 03/31/2016 01:46 PM
ceph-pg-dump.json.txt.gz (594 KB) ceph-pg-dump.json.txt.gz Mehdi Abaakouk, 03/31/2016 01:49 PM
ceph-osd-dump.txt (13.1 KB) ceph-osd-dump.txt Mehdi Abaakouk, 04/05/2016 06:13 AM
Actions
Copy link

Also available in: Atom PDF