Bug #39393
inefficient unordered bucket listing
% Done:
0%
Source:
Tags:
Backport:
luminous mimic nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Description
RGWRados::cls_bucket_list_unordered() loops over bucket index shards, but each loop uses CLSRGWIssueBucketList to send a [call rgw.bucket_list] osd op to every shard of the bucket index
attached before/after logs of an unordered list_bucket request from s3tests_boto3.functional.test_s3.test_bucket_list_unordered with rgw_override_bucket_index_max_shards=8
the difference is clear after counting the number of [call rgw.bucket_list] osd ops:
$ grep 'call rgw.bucket_list' unordered-8-shard-bucket-list-before.log | wc -l 64 $ grep 'call rgw.bucket_list' unordered-8-shard-bucket-list-after.log | wc -l 8
Related issues
History
#1 Updated by Casey Bodley almost 5 years ago
- File unordered-8-shard-bucket-list-after.log View added
- File unordered-8-shard-bucket-list-before.log View added
- Status changed from Fix Under Review to 7
#2 Updated by Casey Bodley almost 5 years ago
- Status changed from 7 to Pending Backport
#3 Updated by Nathan Cutler almost 5 years ago
- Copied to Backport #39409: luminous: inefficient unordered bucket listing added
#4 Updated by Nathan Cutler almost 5 years ago
- Copied to Backport #39410: nautilus: inefficient unordered bucket listing added
#5 Updated by Nathan Cutler almost 5 years ago
- Copied to Backport #39411: mimic: inefficient unordered bucket listing added
#6 Updated by Nathan Cutler almost 5 years ago
- Status changed from Pending Backport to Resolved