Project

General

Profile

Bug #16412

Bucket index shards orphaned after bucket delete

Added by Michael Kidd about 3 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Normal
Target version:
-
Start date:
06/22/2016
Due date:
% Done:

0%

Source:
Support
Tags:
Backport:
jewel, hammer
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:

Description

Observed behavior:
  • In an environment with bucket index sharding enabled, deletion of a bucket leaves behind the bucket index shards.
Desired behavior:
  • When a bucket is deleted, all bucket index shards should be deleted.
Reproduction:
  • Enable bucket index sharding:
    rgw_override_bucket_index_max_shards = 32
  • Create buckets
  • Delete buckets
  • List contents of bucket index pool

Attempted deleting the bucket data with the following three methods, all with the exact same results:

# s3cmd del --recursive s3://bucket-to-delete
# radosgw-admin bucket rm --bucket bucket-to-delete  --purge-objects
# radosgw-admin user rm --uid user-to-delete --purge-data

Further, attempting to clean up with metadata rm does not help:

# radosgw-admin metadata rm bucket:default.538200.103

The deleted buckets do not show up with metadata list:

# radosgw-admin metadata list --metadata-key="bucket.instance" | grep default.538200.103 -c
0

But they do show up with rados ls:

# rados ls -p .rgw.buckets.index | grep default.538200.103 -c
32


Related issues

Copied to rgw - Backport #16732: jewel: Bucket index shards orphaned after bucket delete Resolved
Copied to rgw - Backport #16734: hammer: Bucket index shards orphaned after bucket delete Resolved

History

#1 Updated by Michael Kidd about 3 years ago

  • Description updated (diff)

#2 Updated by Orit Wasserman almost 3 years ago

  • Assignee set to Orit Wasserman

#3 Updated by Orit Wasserman almost 3 years ago

  • Backport set to jewel,hammer

#4 Updated by Orit Wasserman almost 3 years ago

  • Backport changed from jewel,hammer to jewel, infernalis, hammer

#5 Updated by Orit Wasserman almost 3 years ago

  • Status changed from New to Pending Backport

#6 Updated by Nathan Cutler almost 3 years ago

  • Copied to Backport #16732: jewel: Bucket index shards orphaned after bucket delete added

#7 Updated by Nathan Cutler almost 3 years ago

  • Copied to Backport #16733: infernalis: Bucket index shards orphaned after bucket delete added

#8 Updated by Nathan Cutler almost 3 years ago

  • Copied to Backport #16734: hammer: Bucket index shards orphaned after bucket delete added

#9 Updated by Loic Dachary almost 3 years ago

  • Backport changed from jewel, infernalis, hammer to jewel, hammer

infernalis is EOL

#10 Updated by Loic Dachary almost 3 years ago

  • Copied to deleted (Backport #16733: infernalis: Bucket index shards orphaned after bucket delete)

#11 Updated by Loic Dachary almost 3 years ago

  • Status changed from Pending Backport to Resolved

Also available in: Atom PDF