Project

General

Profile

Actions

Bug #21041

open

Stale bucket names in user bucket list.

Added by Robin Johnson over 6 years ago. Updated over 6 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

The list of buckets for some users ends up with buckets that no longer exist sometimes.

There needs to be something to clean up the bucket listing for each user of these buckets.

Rough plan:
  1. For each user
    • The bucket names are the keys of the OMAP xattr for RADOS object {{${username}.buckets}}
      1. Get bucket list for the user
      2. Check if a bucket by that name exists
      3. Remove from OMAP if does not exist.
Actions #1

Updated by Yue Zhu over 6 years ago

We have hit this issue, and would appreciate if there is a fix plan.

$ s3cmd-1.6.1/s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://
2017-11-18 03:34  s3://my-new-bucket1510975987366
$ s3cmd-1.6.1/s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://my-new-bucket1510975987366
ERROR: Bucket 'my-new-bucket1510975987366' does not exist
ERROR: S3 error: 404 (NoSuchBucket)

And we had to manually remove the OMAP key:

# rados -p nyc3a.rgw.users.uid getomapval 2963870.buckets my-new-bucket1510975987366 my-new-bucket1510975987366_omap_val
Writing to my-new-bucket1510975987366_omap_val
# rados -p nyc3a.rgw.users.uid rmomapkey 2963870.buckets my-new-bucket1510975987366
$ s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://
$ s3cmd -c ~/work/s3cmd_cfg/s3cmd_test.cfg ls s3://my-new-bucket1510975987366
ERROR: Bucket 'my-new-bucket1510975987366' does not exist
ERROR: S3 error: 404 (NoSuchBucket)
Actions #2

Updated by Yue Zhu over 6 years ago

We are using

$ rados --version
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
$ ceph --version
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)

Actions

Also available in: Atom PDF