Project

General

Profile

Actions

Bug #22124

closed

rgw: user stats increased after bucket reshard

Added by Aleksei Gutikov over 6 years ago. Updated about 6 years ago.

Status:
Resolved
Priority:
Urgent
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
luminous jewel
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

after calling

./bin/radosgw-admin bucket reshard --num-shards=10 --bucket=xxx

User stats increases like after adding another same bucket with data.


Related issues 2 (0 open2 closed)

Copied to rgw - Backport #22434: luminous: rgw: user stats increased after bucket reshardResolvedAbhishek LekshmananActions
Copied to rgw - Backport #22987: jewel: rgw: user stats increased after bucket reshardResolvedOrit WassermanActions
Actions #2

Updated by Sage Weil over 6 years ago

  • Status changed from New to Fix Under Review
  • Priority changed from Normal to Urgent
Actions #3

Updated by Aleksei Gutikov over 6 years ago

Aleksei Gutikov wrote:

https://github.com/ceph/ceph/pull/18922

Sorry, this is not the fix, mixed up with http://tracker.ceph.com/issues/22122

Actions #4

Updated by Casey Bodley over 6 years ago

  • Status changed from Fix Under Review to New
Actions #5

Updated by Orit Wasserman over 6 years ago

  • Assignee set to Orit Wasserman
Actions #6

Updated by Orit Wasserman over 6 years ago

  • Backport set to luminous
Actions #7

Updated by Yehuda Sadeh over 6 years ago

We probably need to remove the stats entry for the old bucket instance from the user stats.

Actions #8

Updated by Orit Wasserman over 6 years ago

need also to reset user stats

Actions #10

Updated by Orit Wasserman over 6 years ago

  • Status changed from New to Fix Under Review
Actions #11

Updated by Orit Wasserman over 6 years ago

  • Status changed from Fix Under Review to 17
Actions #12

Updated by Yehuda Sadeh over 6 years ago

  • Status changed from 17 to Pending Backport
Actions #13

Updated by Nathan Cutler over 6 years ago

  • Copied to Backport #22434: luminous: rgw: user stats increased after bucket reshard added
Actions #14

Updated by Zongyou Yao over 6 years ago

@Orit Wasserman Wasserman, the pr https://github.com/ceph/ceph/pull/19253 has introduced a new bug, after this pr, execute the command `./bin/radosgw-admin bucket reshard --num-shards=10 --bucket=xxx` and the bucket xxx is missing from get service list,here is a test:

  1. s3cmd mb s3://testbucket
    Bucket 's3://testbucket/' created
  2. s3cmd ls
    2018-01-11 06:48 s3://testbucket
  3. ./bin/radosgw-admin bucket reshard --bucket=testbucket --num-shards=10
    2018-01-11 14:49:00.964 7fedf81ab3c0 -1 WARNING: all dangerous and experimental features are enabled.
    2018-01-11 14:49:00.964 7fedf81ab3c0 -1 WARNING: all dangerous and experimental features are enabled.
    2018-01-11 14:49:00.984 7fedf81ab3c0 -1 WARNING: all dangerous and experimental features are enabled.
    2018-01-11 14:49:01.424 7fedf81ab3c0 0 WARNING: detected a version of libcurl which contains a bug in curl_multi_wait(). enabling a workaround that may degrade performance slightly.
    • NOTICE: operation will not remove old bucket index objects ***
    • these will need to be removed manually ***
      tenant:
      bucket name: testbucket
      old bucket instance id: 071ae4cf-ffb2-4a82-8b7a-ca1ebd5e204f.4153.1
      new bucket instance id: 071ae4cf-ffb2-4a82-8b7a-ca1ebd5e204f.4148.1
      total entries: 0
  4. s3cmd ls #

the testbucket is missing.

And I have tested even before this commit, the user stats not increased after bucket reshard.

Maybe we need to revert the commit.

Actions #15

Updated by Orit Wasserman over 6 years ago

I will check it

Actions #16

Updated by Orit Wasserman over 6 years ago

@Zongyou Yao thanks for catching this.
I revert the pr and I will try a different fix.

Actions #17

Updated by Orit Wasserman about 6 years ago

  • Status changed from Pending Backport to In Progress
Actions #19

Updated by Orit Wasserman about 6 years ago

  • Status changed from In Progress to Fix Under Review
Actions #20

Updated by Yuri Weinstein about 6 years ago

merged luminous backport: https://github.com/ceph/ceph/pull/20327

Actions #21

Updated by Nathan Cutler about 6 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions #22

Updated by Nathan Cutler about 6 years ago

  • Status changed from Pending Backport to Resolved
Actions #23

Updated by Nathan Cutler about 6 years ago

  • Status changed from Resolved to Pending Backport
  • Backport changed from luminous to luminous jewel

Adding jewel backport

Actions #24

Updated by Nathan Cutler about 6 years ago

  • Copied to Backport #22987: jewel: rgw: user stats increased after bucket reshard added
Actions #25

Updated by Nathan Cutler about 6 years ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF