Project

General

Profile

Actions

Bug #16412

closed

Bucket index shards orphaned after bucket delete

Added by Michael Kidd almost 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Normal
Target version:
-
% Done:

0%

Source:
Support
Tags:
Backport:
jewel, hammer
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Observed behavior:
  • In an environment with bucket index sharding enabled, deletion of a bucket leaves behind the bucket index shards.
Desired behavior:
  • When a bucket is deleted, all bucket index shards should be deleted.
Reproduction:
  • Enable bucket index sharding:
    rgw_override_bucket_index_max_shards = 32
  • Create buckets
  • Delete buckets
  • List contents of bucket index pool

Attempted deleting the bucket data with the following three methods, all with the exact same results:

# s3cmd del --recursive s3://bucket-to-delete
# radosgw-admin bucket rm --bucket bucket-to-delete  --purge-objects
# radosgw-admin user rm --uid user-to-delete --purge-data

Further, attempting to clean up with metadata rm does not help:

# radosgw-admin metadata rm bucket:default.538200.103

The deleted buckets do not show up with metadata list:

# radosgw-admin metadata list --metadata-key="bucket.instance" | grep default.538200.103 -c
0

But they do show up with rados ls:

# rados ls -p .rgw.buckets.index | grep default.538200.103 -c
32


Related issues 2 (0 open2 closed)

Copied to rgw - Backport #16732: jewel: Bucket index shards orphaned after bucket deleteResolvedAbhishek VarshneyActions
Copied to rgw - Backport #16734: hammer: Bucket index shards orphaned after bucket deleteResolvedYehuda SadehActions
Actions #1

Updated by Michael Kidd almost 8 years ago

  • Description updated (diff)
Actions #2

Updated by Orit Wasserman almost 8 years ago

  • Assignee set to Orit Wasserman
Actions #3

Updated by Orit Wasserman almost 8 years ago

  • Backport set to jewel,hammer
Actions #4

Updated by Orit Wasserman almost 8 years ago

  • Backport changed from jewel,hammer to jewel, infernalis, hammer
Actions #5

Updated by Orit Wasserman almost 8 years ago

  • Status changed from New to Pending Backport
Actions #6

Updated by Nathan Cutler almost 8 years ago

  • Copied to Backport #16732: jewel: Bucket index shards orphaned after bucket delete added
Actions #7

Updated by Nathan Cutler almost 8 years ago

  • Copied to Backport #16733: infernalis: Bucket index shards orphaned after bucket delete added
Actions #8

Updated by Nathan Cutler almost 8 years ago

  • Copied to Backport #16734: hammer: Bucket index shards orphaned after bucket delete added
Actions #9

Updated by Loïc Dachary over 7 years ago

  • Backport changed from jewel, infernalis, hammer to jewel, hammer

infernalis is EOL

Actions #10

Updated by Loïc Dachary over 7 years ago

  • Copied to deleted (Backport #16733: infernalis: Bucket index shards orphaned after bucket delete)
Actions #11

Updated by Loïc Dachary over 7 years ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF