Project

General

Profile

Actions

Feature #45011

closed

Feature #39478: mgr/dashboard: new RGW workflows & RGW enhancements

Feature #39477: mgr/dashboard: add/edit missing RGW bucket info

mgr/dashboard: Display users current bucket quota usage

Added by Alfonso Martínez about 4 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Component - RGW
Target version:
% Done:

100%

Source:
Tags:
Backport:
octopus, nautilus
Reviewed:
Affected Versions:
Pull request ID:

Description

In Dashboard > Object Gateway > Buckets:
Display the user bucket quota usage: the current size, % used and number of objects for the bucket.

It seems the usage info is already available:

$ radosgw-admin bucket stats --uid testid --bucket bucket
[
    {
        "bucket": "bucket",
        "num_shards": 11,
        "tenant": "",
        "zonegroup": "b5f43b50-abd5-4b39-9b45-5b529997ea5b",
        "placement_rule": "default-placement",
        "explicit_placement": {
            "data_pool": "",
            "data_extra_pool": "",
            "index_pool": "" 
        },
        "id": "702aaf09-0a49-49a7-8da0-629e9f905d40.4137.1",
        "marker": "702aaf09-0a49-49a7-8da0-629e9f905d40.4137.1",
        "index_type": "Normal",
        "owner": "testid",
        "ver": "0#2,1#3,2#1,3#1,4#3,5#3,6#3,7#1,8#1,9#1,10#1",
        "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0",
        "mtime": "2020-04-08T16:03:53.198989Z",
        "creation_time": "2020-04-08T16:03:50.051813Z",
        "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#",
        "usage": {
            "rgw.main": {
                "size": 12697,
                "size_actual": 40960,
                "size_utilized": 12697,
                "size_kb": 13,
                "size_kb_actual": 40,
                "size_kb_utilized": 13,
                "num_objects": 9
            }
        },
        "bucket_quota": {
            "enabled": false,
            "check_on_raw": false,
            "max_size": -1,
            "max_size_kb": 0,
            "max_objects": -1
        }
    }
]


Related issues 5 (1 open4 closed)

Related to Dashboard - Feature #45964: mgr/dashboard: Add support for setting bucket quotasNew

Actions
Related to Dashboard - Feature #45965: mgr/dashboard: Display users current quota usageResolved

Actions
Related to Dashboard - Bug #45968: mgr/dashboard: Tooltips missing from progress barsResolvedTiago Melo

Actions
Copied to Dashboard - Backport #46354: octopus: mgr/dashboard: Display users current bucket quota usageResolvedErnesto PuertaActions
Copied to Dashboard - Backport #48180: nautilus: mgr/dashboard: Display users current bucket quota usageResolvedAvan ThakkarActions
Actions #1

Updated by Lenz Grimmer about 4 years ago

  • Translation missing: en.field_tag_list set to feature-gap, administration
Actions #2

Updated by Avan Thakkar almost 4 years ago

  • Pull request ID set to 34606
Actions #3

Updated by Alfonso Martínez almost 4 years ago

After a conversation with @CaseyBodley,

we should show 2 new columns based on the 2 quota types:
https://docs.ceph.com/docs/master/radosgw/admin/#quota-management

(pseudocode, here assuming we receive a payload like the issue description):

1) Size:

a) If size quota limit exists (bucket_quota['max_size'] > 0), then show a progress bar calculating the %:
% usage = SUM ( usage[...][size_actual] ) / bucket_quota['max_size']
If we don't want to show progress bar, we can show calculated % and amounts.
b) If there is no quota limit, then show a number: the total sum of bytes: SUM ( usage[...][size_actual] )

2) Objects:

a) If object quota limit exists (bucket_quota['max_objects'] > 0), then show a progress bar calculating the %:
% usage = SUM ( usage[...][num_objects] ) / bucket_quota['max_objects']
If we don't want to show progress bar, we can show calculated % and amounts.
b) If there is no quota limit, then show a number: the total sum of objects: SUM ( usage[...][num_objects] )
Actions #4

Updated by Alfonso Martínez almost 4 years ago

Clarification from @CaseyBodley (here assuming we receive a payload like the issue description):

size_actual: the sum of object sizes in the bucket.
size_kb_actual: like the above, but rounded.

size_utilized: the size of their underlying rados objects, which may be compressed.
size_kb_utilized: like the above, but rounded.

So for accurate calculations we should use "size_actual".

Actions #5

Updated by Avan Thakkar almost 4 years ago

  • Status changed from New to In Progress
Actions #6

Updated by Avan Thakkar almost 4 years ago

  • Status changed from In Progress to Fix Under Review
Actions #7

Updated by Lenz Grimmer almost 4 years ago

  • Related to Feature #45964: mgr/dashboard: Add support for setting bucket quotas added
Actions #8

Updated by Lenz Grimmer almost 4 years ago

  • Related to Feature #45965: mgr/dashboard: Display users current quota usage added
Actions #9

Updated by Lenz Grimmer almost 4 years ago

  • Translation missing: en.field_tag_list changed from feature-gap, administration to feature-gap, administration, rgw, quota
Actions #10

Updated by Lenz Grimmer almost 4 years ago

  • Related to Bug #45968: mgr/dashboard: Tooltips missing from progress bars added
Actions #11

Updated by Lenz Grimmer almost 4 years ago

  • Status changed from Fix Under Review to Resolved
Actions #12

Updated by Ernesto Puerta almost 4 years ago

  • Backport set to octopus
Actions #13

Updated by Ernesto Puerta almost 4 years ago

  • Status changed from Resolved to Pending Backport
Actions #14

Updated by Ernesto Puerta almost 4 years ago

  • Copied to Backport #46354: octopus: mgr/dashboard: Display users current bucket quota usage added
Actions #15

Updated by Lenz Grimmer almost 4 years ago

  • Status changed from Pending Backport to Resolved
Actions #16

Updated by Avan Thakkar over 3 years ago

  • Status changed from Resolved to Pending Backport
  • Backport changed from octopus to octopus, nautilus
Actions #17

Updated by Avan Thakkar over 3 years ago

  • Copied to Backport #48180: nautilus: mgr/dashboard: Display users current bucket quota usage added
Actions #18

Updated by Avan Thakkar over 3 years ago

  • Status changed from Pending Backport to Resolved
Actions #19

Updated by Alfonso Martínez about 3 years ago

  • % Done changed from 0 to 100
Actions #20

Updated by Ernesto Puerta about 3 years ago

  • Project changed from mgr to Dashboard
  • Category changed from 143 to Component - RGW
Actions

Also available in: Atom PDF