Project

General

Profile

Actions

Bug #22963

closed

radosgw-admin usage show loops indefinitly - again

Added by Ingo Reimann about 6 years ago. Updated about 6 years ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
-
% Done:

0%

Source:
Tags:
rgw, usage
Backport:
luminous
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

After updating our cluster from jewel to luminous, radosgw-admin usage show loops. I thought #21196 should have closed the Bug.

EG:
radosgw-admin usage show --uid="DunkelDatenaustausch" --start-date=2018-01-01 --end-date=2018-02-01

{
    "entries": [
        {
            "user": "DunkelDatenaustausch",
            "buckets": [
                {
                    "bucket": "",
                    "time": "2018-01-17 10:00:00.000000Z",
                    "epoch": 1516183200,
                    "owner": "DunkelDatenaustausch",
                    "categories": [
                        {
                            "category": "list_buckets",
                            "bytes_sent": 344,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        }
                    ]
                },
                {
                    "bucket": "",
                    "time": "2018-01-17 10:00:00.000000Z",
                    "epoch": 1516183200,
                    "owner": "DunkelDatenaustausch",
                    "categories": [
                        {
                            "category": "list_buckets",
                            "bytes_sent": 344,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        }
                    ]
                },
                {
                    "bucket": "",
                    "time": "2018-01-17 10:00:00.000000Z",
                    "epoch": 1516183200,
                    "owner": "DunkelDatenaustausch",
                    "categories": [
                        {
                            "category": "list_buckets",
                            "bytes_sent": 344,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        }
                    ]
                },
                [...]

Interestingly, the amount of data, bytes_sent and bytes_received seem to be correct and respect to complete time range. We wrote a little wrapper, that detects and breaks the loop. We still got the correct accounting, when we added the bytes afterwards.

For some accounts, we still get the original behaviour.

The cluster is rather old. It has been upgraded over years from bobtail, probably. I included the zonegroup config.


Files

clusterinfo.zip (20.6 KB) clusterinfo.zip Ingo Reimann, 02/09/2018 06:40 AM

Related issues 3 (0 open3 closed)

Related to RADOS - Bug #22050: ERROR type entries of pglog do not update min_last_complete_ondisk, potentially ballooning memory usageResolvedJosh Durgin11/06/2017

Actions
Related to rgw - Bug #23229: usage trim loops forever: infinite calls to rgw.user_usage_log_trimResolvedRobin Johnson03/05/2018

Actions
Copied to rgw - Backport #23686: luminous: radosgw-admin usage show loops indefinitly - againResolvedAbhishek LekshmananActions
Actions

Also available in: Atom PDF