Project

General

Profile

Bug #42505

bucket rm --purge-objects --bypass-gc uses ordered_listing instead unordered

Added by Manuel Rios 5 months ago. Updated about 2 months ago.

Status:
Triaged
Priority:
Normal
Assignee:
Target version:
-
% Done:

0%

Source:
Tags:
bucketlisting
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

Hi

We're deleting a bucket near 9M objects , 47TB.

When use radosgw-admin bucket rm --purge-objects it use unnordered listing.

When use r*adosgw-admin bucket rm --purge-objects --bypass-gc* it use ordered listing and become more slow.

Should not use by default both unnordered listing?

Regards

History

#1 Updated by Casey Bodley 5 months ago

  • Assignee set to Matt Benjamin

#2 Updated by Casey Bodley about 2 months ago

  • Status changed from New to Triaged
  • Assignee changed from Matt Benjamin to Mark Kogan
  • Tags set to bucketlisting

#3 Updated by Mark Kogan about 2 months ago

Testing on master unordered listing (cls_bucket_list_unordered()) is used to itterate over the objects:

radosgw-admin bucket rm --bucket=hotsauce-bench000000000000 --bypass-gc --purge-objects --debug_rgw=20 |& grep cls_bucket_list
2020-02-17T14:39:45.488+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_ordered: :hotsauce-bench000000000000[52efcca2-f7a7-40fa-8fa4-849f90026b81.4288.1]) start_
after="_multipart_[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1                                                               
2020-02-17T14:39:45.488+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_ordered request from each of 23 shard(s) for 60 entries to get 1001 total entries        
2020-02-17T14:39:45.492+0200 7f5850e82a00 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0                                              
2020-02-17T14:39:45.492+0200 7f5850e82a00 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET                                                   
2020-02-17T14:39:45.492+0200 7f5850e82a00 10 cls_bucket_list_unordered :hotsauce-bench000000000000[52efcca2-f7a7-40fa-8fa4-849f90026b81.4288.1]) start_after [] 
num_entries 1100                                                                                                                                                
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037368[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037371[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037402[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037441[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037482[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037484[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037492[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037554[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037556[]                                                            
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037562[]
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037564[]
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037626[]
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037634[]
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037636[]
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037677[]
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037679[]
2020-02-17T14:39:52.919+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037706[]
2020-02-17T14:39:52.920+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037708[]
2020-02-17T14:39:52.920+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037749[]
2020-02-17T14:39:52.920+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037750[]
2020-02-17T14:39:52.920+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037759[]
2020-02-17T14:39:52.920+0200 7f5850e82a00 10 RGWRados::cls_bucket_list_unordered: got 000000037820[]
...
2020-02-17T14:41:23.550+0200 7f0da5da1a00 10 cls_bucket_list_unordered :hotsauce-bench000000000000[52efcca2-f7a7-40fa-8fa4-849f90026b81.4288.1]) start_after 000
000017691[] num_entries 1100
2020-02-17T14:41:23.587+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017732[]
2020-02-17T14:41:23.587+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017771[]
2020-02-17T14:41:23.587+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017773[]
2020-02-17T14:41:23.587+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017802[]
2020-02-17T14:41:23.587+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017804[]
2020-02-17T14:41:23.588+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017806[]
2020-02-17T14:41:23.588+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017843[]
2020-02-17T14:41:23.588+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000017884[]

...
2020-02-17T14:41:27.457+0200 7f0da5da1a00 10 cls_bucket_list_unordered :hotsauce-bench000000000000[52efcca2-f7a7-40fa-8fa4-849f90026b81.4288.1]) start_after 000
000040596[] num_entries 1100
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040637[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040639[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040676[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040678[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040709[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040710[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040719[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040790[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040792[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040799[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040862[]
2020-02-17T14:41:27.461+0200 7f0da5da1a00 10 RGWRados::cls_bucket_list_unordered: got 000000040870[]

Also available in: Atom PDF