Project

General

Profile

Feature #45011

Feature #39478: mgr/dashboard: new RGW workflows & RGW enhancements

Feature #39477: mgr/dashboard: add/edit missing RGW bucket info

mgr/dashboard: Display users current bucket quota usage

Added by Alfonso Martínez 10 months ago. Updated 2 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
dashboard/rgw
Target version:
% Done:

0%

Source:
Tags:
Backport:
octopus, nautilus
Reviewed:
Affected Versions:
Pull request ID:

Description

In Dashboard > Object Gateway > Buckets:
Display the user bucket quota usage: the current size, % used and number of objects for the bucket.

It seems the usage info is already available:

$ radosgw-admin bucket stats --uid testid --bucket bucket
[
    {
        "bucket": "bucket",
        "num_shards": 11,
        "tenant": "",
        "zonegroup": "b5f43b50-abd5-4b39-9b45-5b529997ea5b",
        "placement_rule": "default-placement",
        "explicit_placement": {
            "data_pool": "",
            "data_extra_pool": "",
            "index_pool": "" 
        },
        "id": "702aaf09-0a49-49a7-8da0-629e9f905d40.4137.1",
        "marker": "702aaf09-0a49-49a7-8da0-629e9f905d40.4137.1",
        "index_type": "Normal",
        "owner": "testid",
        "ver": "0#2,1#3,2#1,3#1,4#3,5#3,6#3,7#1,8#1,9#1,10#1",
        "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0",
        "mtime": "2020-04-08T16:03:53.198989Z",
        "creation_time": "2020-04-08T16:03:50.051813Z",
        "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#",
        "usage": {
            "rgw.main": {
                "size": 12697,
                "size_actual": 40960,
                "size_utilized": 12697,
                "size_kb": 13,
                "size_kb_actual": 40,
                "size_kb_utilized": 13,
                "num_objects": 9
            }
        },
        "bucket_quota": {
            "enabled": false,
            "check_on_raw": false,
            "max_size": -1,
            "max_size_kb": 0,
            "max_objects": -1
        }
    }
]


Related issues

Related to mgr - Feature #45964: mgr/dashboard: Add support for setting bucket quotas New
Related to mgr - Feature #45965: mgr/dashboard: Display users current quota usage Need More Info
Related to mgr - Bug #45968: mgr/dashboard: Tooltips missing from progress bars Resolved
Copied to mgr - Backport #46354: octopus: mgr/dashboard: Display users current bucket quota usage Resolved
Copied to mgr - Backport #48180: nautilus: mgr/dashboard: Display users current bucket quota usage Resolved

History

#1 Updated by Lenz Grimmer 10 months ago

  • Tags set to feature-gap, administration

#2 Updated by Avan Thakkar 9 months ago

  • Pull request ID set to 34606

#3 Updated by Alfonso Martínez 9 months ago

After a conversation with @CaseyBodley,

we should show 2 new columns based on the 2 quota types:
https://docs.ceph.com/docs/master/radosgw/admin/#quota-management

(pseudocode, here assuming we receive a payload like the issue description):

1) Size:

a) If size quota limit exists (bucket_quota['max_size'] > 0), then show a progress bar calculating the %:
% usage = SUM ( usage[...][size_actual] ) / bucket_quota['max_size']
If we don't want to show progress bar, we can show calculated % and amounts.
b) If there is no quota limit, then show a number: the total sum of bytes: SUM ( usage[...][size_actual] )

2) Objects:

a) If object quota limit exists (bucket_quota['max_objects'] > 0), then show a progress bar calculating the %:
% usage = SUM ( usage[...][num_objects] ) / bucket_quota['max_objects']
If we don't want to show progress bar, we can show calculated % and amounts.
b) If there is no quota limit, then show a number: the total sum of objects: SUM ( usage[...][num_objects] )

#4 Updated by Alfonso Martínez 8 months ago

Clarification from @CaseyBodley (here assuming we receive a payload like the issue description):

size_actual: the sum of object sizes in the bucket.
size_kb_actual: like the above, but rounded.

size_utilized: the size of their underlying rados objects, which may be compressed.
size_kb_utilized: like the above, but rounded.

So for accurate calculations we should use "size_actual".

#5 Updated by Avan Thakkar 8 months ago

  • Status changed from New to In Progress

#6 Updated by Avan Thakkar 8 months ago

  • Status changed from In Progress to Fix Under Review

#7 Updated by Lenz Grimmer 8 months ago

  • Related to Feature #45964: mgr/dashboard: Add support for setting bucket quotas added

#8 Updated by Lenz Grimmer 8 months ago

  • Related to Feature #45965: mgr/dashboard: Display users current quota usage added

#9 Updated by Lenz Grimmer 8 months ago

  • Tags changed from feature-gap, administration to feature-gap, administration, rgw, quota

#10 Updated by Lenz Grimmer 8 months ago

  • Related to Bug #45968: mgr/dashboard: Tooltips missing from progress bars added

#11 Updated by Lenz Grimmer 7 months ago

  • Status changed from Fix Under Review to Resolved

#12 Updated by Ernesto Puerta 7 months ago

  • Backport set to octopus

#13 Updated by Ernesto Puerta 7 months ago

  • Status changed from Resolved to Pending Backport

#14 Updated by Ernesto Puerta 7 months ago

  • Copied to Backport #46354: octopus: mgr/dashboard: Display users current bucket quota usage added

#15 Updated by Lenz Grimmer 7 months ago

  • Status changed from Pending Backport to Resolved

#16 Updated by Avan Thakkar 3 months ago

  • Status changed from Resolved to Pending Backport
  • Backport changed from octopus to octopus, nautilus

#17 Updated by Avan Thakkar 3 months ago

  • Copied to Backport #48180: nautilus: mgr/dashboard: Display users current bucket quota usage added

#18 Updated by Avan Thakkar 2 months ago

  • Status changed from Pending Backport to Resolved

Also available in: Atom PDF