Bug #11180: rgwadmin tasks assumes non-regional output - rgw - Ceph

Actions

Copy link

Bug #11180

closed

rgwadmin tasks assumes non-regional output

Added by Alfredo Deza about 9 years ago. Updated almost 9 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Alfredo Deza

Target version:

% Done:

Source:

other

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

It picks the first item in the summary list, which has nothing to do with the user that should be used:

Traceback (most recent call last):
  File "/home/adeza/teuthology/teuthology/run_tasks.py", line 53, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/adeza/teuthology/teuthology/run_tasks.py", line 41, in run_one_task
    return fn(**kwargs)
  File "./ceph-qa-suite/tasks/radosgw_admin.py", line 835, in task
    assert total['successful_ops'] > 0, 'Total: %s' % total
AssertionError: Total: {u'successful_ops': 0, u'bytes_received': 0, u'bytes_sent': 78, u'ops': 1}

Actions

Copy link

Updated by Alfredo Deza about 9 years ago

Status changed from New to Fix Under Review

Pull request opened: https://github.com/ceph/ceph-qa-suite/pull/372

Actions

Copy link

Updated by Alfredo Deza about 9 years ago

Status changed from Fix Under Review to Resolved

merged commit dfea7dd into master
And cherry-picked the commit onto firefly, hammer, giant, dumpling, and next

Actions

Copy link

Updated by Loïc Dachary about 9 years ago

The problem manifests itself in other places as well. The real question is : why does it show up now ? How did it work a month ago ? Nothing significant seems to have changed. http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/ . It could be just random luck (i.e. the non regional summary was always inserted first) but...

Actions

Copy link

Updated by Loïc Dachary about 9 years ago

Status changed from Resolved to 12

The following seem to have the same problem

which would explain why http://pulpito.ceph.com/loic-2015-03-22_14:55:18-rgw-v0.87.1---basic-multi/815825/ fails

Actions

Copy link

Updated by Yehuda Sadeh about 9 years ago

My guess is that it's the new versioning detection code in the radosgw sync agent. We probably set it up, but don't use it until later. Originally, it was only generating requests during the s3-tests run, but now it sends one request on startup.

Actions

Copy link

Updated by Abhishek Lekshmanan about 9 years ago

Isn't summary supposed to be a total view of other usage elements? ie. if successful ops are greater than zero isn't summary[successful_ops] supposed to be > 0 for eg. Or am I missing something else here?

Actions

Copy link

Updated by Loïc Dachary about 9 years ago

Status changed from 12 to Fix Under Review

https://github.com/ceph/ceph-qa-suite/pull/375

Actions

Copy link

Updated by Loïc Dachary about 9 years ago

testing a giant cherry-pick with

filter='rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec.yaml},rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec-cache.yaml},rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec.yaml},rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec-cache.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/ec-cache.yaml tasks/rgw_s3tests.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml},rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/ec-cache.yaml tasks/rgw_s3tests.yaml}'
./virtualenv/bin/teuthology-suite --filter="$filter" --priority 101 --suite rgw --filter-out btrfs,ext4 --suite-branch wip-rgw-regional-summary --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant

http://pulpito.ceph.com/loic-2015-03-23_00:22:33-rgw-giant---basic-multi/

Actions

Copy link