Project

General

Profile

Actions

Bug #13844

closed

ceph df MAX AVAIL is incorrect for simple replicated pool

Added by Dan van der Ster over 8 years ago. Updated over 7 years ago.

Status:
Rejected
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
Regression:
Yes
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Since we upgraded from firefly to hammer the MAX AVAIL column is quite wrong for most of our pools.

GLOBAL:
    SIZE      AVAIL     RAW USED     %RAW USED
    3564T     2544T        1020T         28.61

Example pool:

POOLS:
    NAME                   ID     USED       %USED     MAX AVAIL     OBJECTS
    volumes                4        255T      7.17          272T     67556416

By my calculations MAX AVAIL should be 2184T/3 = 728T.

pool 4 'volumes' replicated size 3 min_size 2 crush_ruleset 0 object_hash rjenkins pg_num 4096 pgp_num 4096 last_change 296326 min_read_recency_for_promote 1 stripe_width 0

crush_ruleset 0:

    {
        "rule_id": 0,
        "rule_name": "data",
        "ruleset": 0,
        "type": 1,
        "min_size": 1,
        "max_size": 10,
        "steps": [
            {
                "op": "take",
                "item": -2,
                "item_name": "0513-R-0050" 
            },
            {
                "op": "chooseleaf_firstn",
                "num": 0,
                "type": "rack" 
            },
            {
                "op": "emit" 
            }
        ]
    },

The osd tree:

ID   WEIGHT     TYPE NAME                            UP/DOWN REWEIGHT PRIMARY-AFFINITY
 -92          0 root drain
 -18  218.39999 root os
 -22  218.39999     room 0513-R-0050-os
 -30   54.59999         rack RJ55-os
 -34   54.59999             host p05151113748698-os
 -44   54.59999         rack RJ47-os
 -26   54.59999             host p05151113613837-os
 -62   54.59999         rack RJ45-os
 -50   54.59999             host p05151113587529-os
 -64   54.59999         rack RJ41-os
 -63   54.59999             host p05151113561997-os
  -1 3349.22803 root default
  -2 2184.42822     room 0513-R-0050
  -3  163.80000         rack RJ35
 -15   54.59999             host p05151113471870
 -16   54.59999             host p05151113489275
 -17   54.59999             host p05151113479552
  -4  163.80000         rack RJ37
 -23   54.59999             host p05151113507373
 -24   54.59999             host p05151113508409
 -25   54.59999             host p05151113521447
  -5  163.80000         rack RJ39
 -19   54.59999             host p05151113538756
 -20   54.59999             host p05151113535271
 -21   54.59999             host p05151113534235
  -6  163.80000         rack RJ41
 -27   54.59999             host p05151113558761
 -28   54.59999             host p05151113544113
 -29   54.59999             host p05151113551146
  -7  163.79990         rack RJ43
 -31   54.59999             host p05151113573587
 -32   54.59999             host p05151113578124
 -33   54.59991             host p05151113568206
  -8  163.79990         rack RJ45
 -35   54.59999             host p05151113578807
 -41   54.59999             host p05151113585107
 -47   54.59991             host p05151113590997
  -9  163.80000         rack RJ47
 -38   54.59999             host p05151113599377
 -39   54.59999             host p05151113598352
 -40   54.59999             host p05151113619324
 -10  219.30989         rack RJ49
 -36   55.50992             host p05151113636272
 -43   54.59999             host p05151113640230
 -48   54.59999             host p05151113642826
 -49   54.59999             host p05151113633314
 -11  218.39981         rack RJ51
 -37   54.59991             host p05151113676458
 -42   54.59999             host p05151113674062
 -45   54.59991             host p05151113669359
 -46   54.59999             host p05151113654107
 -12  219.30989         rack RJ53
 -53   54.59999             host p05151113723693
 -54   54.59999             host p05151113706163
 -56   54.59999             host p05151113719408
 -58   55.50992             host p05151113677609
 -13  163.20972         rack RJ55
 -59   54.39999             host p05151113760120
 -60   54.40973             host p05151113725483
 -61   54.39999             host p05151113751590
 -14  217.59900         rack RJ57
 -51   54.39999             host p05151113781242
 -52   54.39999             host p05151113782262
 -55   54.39999             host p05151113778539
 -57   54.39999             host p05151113777233
 -65 1164.79980     room 0513-R-0060
 -71  582.39990         ipservice S513-A-IP37
 -70  291.19995             rack BA09
 -69   72.79999                 host p05798818a82857
 -73   72.79999                 host p05798818b00047
 -83   72.79999                 host p05798818b00174
 -86   72.79999                 host p05798818b04322
 -80  291.19995             rack BA10
 -79   72.79999                 host p05798818v47100
 -88   72.79999                 host p05798818v64334
 -90   72.79999                 host p05798818w03166
 -91   72.79999                 host p05798818v51559
 -76  582.39990         ipservice S513-A-IP62
 -75  291.19995             rack BA11
 -74   72.79999                 host p05798818s98313
 -84   72.79999                 host p05798818s63747
 -85   72.79999                 host p05798818s49204
 -89   72.79999                 host p05798818s40185
 -78  291.19995             rack BA12
 -77   72.79999                 host p05798818b12431
 -81   72.79999                 host p05798818b37327
 -82   72.79999                 host p05798818b78429
 -87   72.79999                 host p05798818b40951
Actions

Also available in: Atom PDF