Bug #21041
open
Stale bucket names in user bucket list.
Added by Robin Johnson over 6 years ago.
Updated over 6 years ago.
Description
The list of buckets for some users ends up with buckets that no longer exist sometimes.
There needs to be something to clean up the bucket listing for each user of these buckets.
Rough plan:
- For each user
- The bucket names are the keys of the OMAP xattr for RADOS object {{${username}.buckets}}
- Get bucket list for the user
- Check if a bucket by that name exists
- Remove from OMAP if does not exist.
We have hit this issue, and would appreciate if there is a fix plan.
$ s3cmd-1.6.1/s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://
2017-11-18 03:34 s3://my-new-bucket1510975987366
$ s3cmd-1.6.1/s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://my-new-bucket1510975987366
ERROR: Bucket 'my-new-bucket1510975987366' does not exist
ERROR: S3 error: 404 (NoSuchBucket)
And we had to manually remove the OMAP key:
# rados -p nyc3a.rgw.users.uid getomapval 2963870.buckets my-new-bucket1510975987366 my-new-bucket1510975987366_omap_val
Writing to my-new-bucket1510975987366_omap_val
# rados -p nyc3a.rgw.users.uid rmomapkey 2963870.buckets my-new-bucket1510975987366
$ s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://
$ s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://my-new-bucket1510975987366
ERROR: Bucket 'my-new-bucket1510975987366' does not exist
ERROR: S3 error: 404 (NoSuchBucket)
We are using
$ rados --version
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
$ ceph --version
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
Also available in: Atom
PDF