Project

General

Profile

Feature #7746

Capacity Management: rbd df

Added by Neil Levine about 10 years ago. Updated almost 9 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Jason Dillaman
Target version:
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

Currently, ceph df shows two sets of statistics: global and pool.

For global, the output is generated from aggregating the data returned from the OS on each OSD host, so this show actual used/available.

For the pool data, the output is generated by ceph, and in fact shows provisioned space, not actual used space. This means for RBD pools with thinly provisioned files, the output can't be used for capacity management as the totals can be higher than the physical space on the disks.

Eg:

  1. ceph df

GLOBAL:

SIZE      AVAIL     RAW USED     %RAW USED
1627M     906M      720M         44.29

POOLS:

NAME             ID     USED       %USED     OBJECTS
data             0      89183M     5.35      22529
metadata         1      6096K      0         22
rbd              2      813M       0.05      214
fedora           3      197M       0.01      61
.rgw             4      0          0         0
.rgw.gc          5      0          0         32
.rgw.control     6      0          0         8
.users.uid       7      444        0         1
.users           8      11         0         1
.users.swift     9      11         0         1
cac              10     759G       46.68     4294

The proposal is to rename the Used column to "Provisioned" and add a new column titled "Used" which shows real space used by a pool.


Related issues

Duplicated by rbd - Feature #3283: rbd: calc-utilization or similar Duplicate
Duplicated by rbd - Feature #2167: rbd: report the allocated size/space of a RBD with "rbd info <rbd name>" Duplicate 03/12/2012

Associated revisions

Revision 7ffafc56 (diff)
Added by Jason Dillaman almost 9 years ago

rbd: add disk usage tool

The new disk usage tool uses the new fast diff object map feature
(when enabled) to quickly calculate the provisioned vs actual usage
of images and associated snapshots within a pool.

Fixes: #7746
Signed-off-by: Jason Dillaman <>

History

#1 Updated by Neil Levine about 10 years ago

Confirmed that this doesn't just affect RBD pools but affects any pool, as the data is generated from reading the offset on a sparse file written by the OSD.

#2 Updated by Neil Levine almost 10 years ago

  • Subject changed from Show actual used space per pool and provisioned used space per pool in ceph df command to Capacity Management: Show actual used space per pool and provisioned used space per pool in ceph df command

#3 Updated by Neil Levine almost 10 years ago

  • Target version set to 0.82

#4 Updated by Sage Weil almost 10 years ago

  • Target version deleted (0.82)

#5 Updated by Neil Levine almost 10 years ago

  • Subject changed from Capacity Management: Show actual used space per pool and provisioned used space per pool in ceph df command to Capacity Management: RBD Pool Usage

#6 Updated by Neil Levine almost 10 years ago

  • Subject changed from Capacity Management: RBD Pool Usage to Capacity Management: RBD Pool Usage via ceph df

#7 Updated by Neil Levine almost 10 years ago

  • Project changed from Ceph to rbd
  • Subject changed from Capacity Management: RBD Pool Usage via ceph df to Capacity Management: rbd df

Rather than show RBD pool usage via ceph df, the suggestion was a dedicated rbd df command which shows provisioned and used space.

#8 Updated by Josh Durgin over 9 years ago

  • Status changed from 12 to In Progress
  • Assignee set to Jason Dillaman

see wip-7746

#9 Updated by Ian Colle over 9 years ago

  • Target version set to v0.88

#10 Updated by Ian Colle over 9 years ago

  • Target version changed from v0.88 to v0.89

#11 Updated by Ian Colle over 9 years ago

  • Status changed from In Progress to Fix Under Review

#12 Updated by Jason Dillaman over 9 years ago

  • Status changed from Fix Under Review to In Progress
  • Parent task set to #4087

#13 Updated by Jason Dillaman over 9 years ago

  • Parent task deleted (#4087)

Dependent on issue #4087

#14 Updated by Jason Dillaman over 9 years ago

  • Tracker changed from Subtask to Feature

#15 Updated by Sage Weil over 9 years ago

  • Target version changed from v0.89 to v0.90

#16 Updated by Josh Durgin over 9 years ago

  • Target version changed from v0.90 to v0.91

#17 Updated by Sage Weil over 9 years ago

  • Target version changed from v0.91 to v0.92

#18 Updated by Sage Weil about 9 years ago

  • Target version changed from v0.92 to v0.93 - Last Hammer Sprint

#19 Updated by Sage Weil about 9 years ago

  • Target version deleted (v0.93 - Last Hammer Sprint)

#20 Updated by Josh Durgin almost 9 years ago

  • Target version set to v0.96

#21 Updated by Josh Durgin almost 9 years ago

  • Target version changed from v0.96 to v9.0.2

#22 Updated by Jason Dillaman almost 9 years ago

#23 Updated by Jason Dillaman almost 9 years ago

  • Status changed from In Progress to Fix Under Review

#24 Updated by Josh Durgin almost 9 years ago

  • Target version changed from v9.0.2 to v9.0.3

#25 Updated by Josh Durgin almost 9 years ago

  • Status changed from Fix Under Review to Duplicate

#26 Updated by Josh Durgin almost 9 years ago

  • Status changed from Duplicate to Fix Under Review

#27 Updated by Josh Durgin almost 9 years ago

  • Status changed from Fix Under Review to Resolved

Also available in: Atom PDF