Project

General

Profile

Bug #50520

slow radosgw-admin startup when large value of rgw_gc_max_objs configured

Added by Mark Kogan 17 days ago. Updated 39 minutes ago.

Status:
Pending Backport
Priority:
High
Assignee:
Target version:
% Done:

0%

Source:
Support
Tags:
gc
Backport:
octopus pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

on a test setup, each increment by thousand of rgw_gc_max_objs
increases the radosgw-admin command execution time by 1.2 sec:

for example:

time ./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=32 user list
                                                 ^^^^^^^^^^^^^^^^^^^^
[
    "56789abcdef0123456789abcdef0123456789abcdef0123456789abcdef01234",
    "testx$9876543210abcdef0123456789abcdef0123456789abcdef0123456789abcdef",
    "cosbench00",
    "0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef",
    "test",
    "cosbench01",
    "cosbench03",
    "testid",
    "cosbench04",
    "cosbench02",
    "cosbench05" 
]
./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=32 user list  0.17s user 0.03s system 77% cpu 0.258 total
                                                                                                            ^^^^^^^^^^^

time ./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=1009 user list
...
./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=1009 user list  0.37s user 0.06s system 33% cpu 1.270 total

time ./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=2003 user list
...
./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=2003 user list  0.60s user 0.10s system 29% cpu 2.408 total

time ./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=3001 user list
...
./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=3001 user list  0.79s user 0.14s system 26% cpu 3.435 total

time ./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=4001 user list
...
./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=4001 user list  1.05s user 0.17s system 26% cpu 4.677 total

time ./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=5003 user list
[
    "56789abcdef0123456789abcdef0123456789abcdef0123456789abcdef01234",
    "testx$9876543210abcdef0123456789abcdef0123456789abcdef0123456789abcdef",
    "cosbench00",
    "0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef",
    "test",
    "cosbench01",
    "cosbench03",
    "testid",
    "cosbench04",
    "cosbench02",
    "cosbench05" 
]
./bin/radosgw-admin -n client.rgw.silvertip --rgw_gc_max_objs=5003 user list  1.22s user 0.20s system 25% cpu 5.640 total
#                                                                                                             ^^^^^^^^^^^


Related issues

Duplicated by rgw - Bug #48983: radosgw not working - upgraded from mimic to octopus Duplicate
Copied to rgw - Backport #50802: octopus: slow radosgw-admin startup when large value of rgw_gc_max_objs configured New
Copied to rgw - Backport #50803: pacific: slow radosgw-admin startup when large value of rgw_gc_max_objs configured New

History

#1 Updated by Mark Kogan 17 days ago

  • Pull request ID set to 41027

#2 Updated by Casey Bodley 14 days ago

  • Status changed from In Progress to Fix Under Review

#3 Updated by Casey Bodley 7 days ago

  • Duplicated by Bug #48983: radosgw not working - upgraded from mimic to octopus added

#4 Updated by Casey Bodley 39 minutes ago

  • Status changed from Fix Under Review to Pending Backport
  • Tags set to gc
  • Backport set to octopus pacific

#5 Updated by Backport Bot 37 minutes ago

  • Copied to Backport #50802: octopus: slow radosgw-admin startup when large value of rgw_gc_max_objs configured added

#6 Updated by Backport Bot 36 minutes ago

  • Copied to Backport #50803: pacific: slow radosgw-admin startup when large value of rgw_gc_max_objs configured added

Also available in: Atom PDF