Project

General

Profile

Actions
Copy link

Bug #52647

closed

rgw/singleton failures: assert rgwlog['bucket'].find(bucket_name) == 0 or rgwlog['bucket'].find(bucket_name2) == 0

Added by Casey Bodley over 2 years ago. Updated over 2 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Matt Benjamin
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
43442
Crash signature (v1):
Crash signature (v2):

Description

ex. http://qa-proxy.ceph.com/teuthology/amaredia-2021-09-15_18:23:38-rgw-master-distro-basic-smithi/6391193/teuthology.log

2021-09-15T18:46:43.214 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e60965abae2c4310bcc3043238aac70f
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/run_tasks.py", line 91, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/teuthology/run_tasks.py", line 70, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_linuxbox2_ceph_221fdb858be083a981697cdb59c19f0659be3f1d/qa/tasks/radosgw_admin.py", line 701, in task
    assert rgwlog['bucket'].find(bucket_name) == 0 or rgwlog['bucket'].find(bucket_name2) == 0
AssertionError

relevant output of 'radosgw-admin log show':

2021-09-15T18:46:42.771 DEBUG:teuthology.orchestra.run.smithi187:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2021-09-15-18--
...
2021-09-15T18:46:42.981 INFO:teuthology.orchestra.run.smithi187.stdout:{
2021-09-15T18:46:42.982 INFO:teuthology.orchestra.run.smithi187.stdout:    "bucket_id": "",
2021-09-15T18:46:42.982 INFO:teuthology.orchestra.run.smithi187.stdout:    "bucket_owner": "",
2021-09-15T18:46:42.982 INFO:teuthology.orchestra.run.smithi187.stdout:    "bucket": "",
2021-09-15T18:46:42.982 INFO:teuthology.orchestra.run.smithi187.stdout:    "log_entries": [
2021-09-15T18:46:42.983 INFO:teuthology.orchestra.run.smithi187.stdout:        {
2021-09-15T18:46:42.983 INFO:teuthology.orchestra.run.smithi187.stdout:            "bucket": "",
2021-09-15T18:46:42.983 INFO:teuthology.orchestra.run.smithi187.stdout:            "time": "2021-09-15T18:46:30.052869Z",
2021-09-15T18:46:42.983 INFO:teuthology.orchestra.run.smithi187.stdout:            "time_local": "2021-09-15T18:46:30.052869+0000",
2021-09-15T18:46:42.983 INFO:teuthology.orchestra.run.smithi187.stdout:            "remote_addr": "172.21.15.187",
2021-09-15T18:46:42.984 INFO:teuthology.orchestra.run.smithi187.stdout:            "user": "anonymous",
2021-09-15T18:46:42.984 INFO:teuthology.orchestra.run.smithi187.stdout:            "operation": "list_buckets",
2021-09-15T18:46:42.985 INFO:teuthology.orchestra.run.smithi187.stdout:            "uri": "GET / HTTP/1.1",
2021-09-15T18:46:42.985 INFO:teuthology.orchestra.run.smithi187.stdout:            "http_status": "200",
2021-09-15T18:46:42.985 INFO:teuthology.orchestra.run.smithi187.stdout:            "error_code": "",
2021-09-15T18:46:42.985 INFO:teuthology.orchestra.run.smithi187.stdout:            "bytes_sent": 231,
2021-09-15T18:46:42.985 INFO:teuthology.orchestra.run.smithi187.stdout:            "bytes_received": 0,
2021-09-15T18:46:42.986 INFO:teuthology.orchestra.run.smithi187.stdout:            "object_size": 0,
2021-09-15T18:46:42.986 INFO:teuthology.orchestra.run.smithi187.stdout:            "total_time": 1,
2021-09-15T18:46:42.986 INFO:teuthology.orchestra.run.smithi187.stdout:            "user_agent": "curl/7.61.1",
2021-09-15T18:46:42.986 INFO:teuthology.orchestra.run.smithi187.stdout:            "referrer": "",
2021-09-15T18:46:42.987 INFO:teuthology.orchestra.run.smithi187.stdout:            "trans_id": "tx000000000000000000001-0061423f86-107f-default",
2021-09-15T18:46:42.987 INFO:teuthology.orchestra.run.smithi187.stdout:            "authentication_type": "Local" 
2021-09-15T18:46:42.987 INFO:teuthology.orchestra.run.smithi187.stderr:2021-09-15T18:46:42.866+0000 7fab4bced380 10 log_show_next pos 584 bl 584 off 277 eof 1
2021-09-15T18:46:42.988 INFO:teuthology.orchestra.run.smithi187.stdout:        },
2021-09-15T18:46:42.988 INFO:teuthology.orchestra.run.smithi187.stdout:        {
2021-09-15T18:46:42.988 INFO:teuthology.orchestra.run.smithi187.stdout:            "bucket": "",
2021-09-15T18:46:42.989 INFO:teuthology.orchestra.run.smithi187.stdout:            "time": "2021-09-15T18:46:35.699783Z",
2021-09-15T18:46:42.989 INFO:teuthology.orchestra.run.smithi187.stdout:            "time_local": "2021-09-15T18:46:35.699783+0000",
2021-09-15T18:46:42.989 INFO:teuthology.orchestra.run.smithi187.stdout:            "remote_addr": "172.21.0.51",
2021-09-15T18:46:42.989 INFO:teuthology.orchestra.run.smithi187.stdout:            "user": "foo",
2021-09-15T18:46:42.990 INFO:teuthology.orchestra.run.smithi187.stdout:            "operation": "list_buckets",
2021-09-15T18:46:42.990 INFO:teuthology.orchestra.run.smithi187.stdout:            "uri": "GET / HTTP/1.1",
2021-09-15T18:46:42.990 INFO:teuthology.orchestra.run.smithi187.stdout:            "http_status": "200",
2021-09-15T18:46:42.990 INFO:teuthology.orchestra.run.smithi187.stdout:            "error_code": "",
2021-09-15T18:46:42.990 INFO:teuthology.orchestra.run.smithi187.stdout:            "bytes_sent": 322,
2021-09-15T18:46:42.991 INFO:teuthology.orchestra.run.smithi187.stdout:            "bytes_received": 0,
2021-09-15T18:46:42.991 INFO:teuthology.orchestra.run.smithi187.stdout:            "object_size": 0,
2021-09-15T18:46:42.992 INFO:teuthology.orchestra.run.smithi187.stdout:            "total_time": 0,
2021-09-15T18:46:42.992 INFO:teuthology.orchestra.run.smithi187.stdout:            "user_agent": "Boto/2.49.0 Python/3.6.9 Linux/4.15.0-142-generic",
2021-09-15T18:46:42.992 INFO:teuthology.orchestra.run.smithi187.stdout:            "referrer": "",
2021-09-15T18:46:42.992 INFO:teuthology.orchestra.run.smithi187.stdout:            "trans_id": "tx000000000000000000003-0061423f8b-107f-default",
2021-09-15T18:46:42.992 INFO:teuthology.orchestra.run.smithi187.stdout:            "authentication_type": "Local" 
2021-09-15T18:46:42.993 INFO:teuthology.orchestra.run.smithi187.stdout:        }
2021-09-15T18:46:42.993 INFO:teuthology.orchestra.run.smithi187.stdout:    ],
2021-09-15T18:46:42.993 INFO:teuthology.orchestra.run.smithi187.stdout:    "log_sum": {
2021-09-15T18:46:42.993 INFO:teuthology.orchestra.run.smithi187.stdout:        "bytes_sent": 553,
2021-09-15T18:46:42.994 INFO:teuthology.orchestra.run.smithi187.stdout:        "bytes_received": 0,
2021-09-15T18:46:42.994 INFO:teuthology.orchestra.run.smithi187.stdout:        "total_time": 1,
2021-09-15T18:46:42.994 INFO:teuthology.orchestra.run.smithi187.stdout:        "total_entries": 2
2021-09-15T18:46:42.994 INFO:teuthology.orchestra.run.smithi187.stdout:    }
2021-09-15T18:46:42.995 INFO:teuthology.orchestra.run.smithi187.stdout:}

Related issues 1 (0 open — 1 closed)

Has duplicate rgw - Bug #52668: rgw: radosgw_admin.py is reporting errors in "log show --object" testsResolvedMatt Benjamin

Actions
Actions
Copy link
 #1

Updated by Matt Benjamin over 2 years ago

We think I introduced this test failure by enabling logging for list-bucket. We need a correction for those tests.

Matt

Actions
Copy link
 #2

Updated by Daniel Gryniewicz over 2 years ago

  • Has duplicate Bug #52668: rgw: radosgw_admin.py is reporting errors in "log show --object" tests added
Actions
Copy link
 #3

Updated by Matt Benjamin over 2 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 43442
Actions
Copy link
 #4

Updated by Casey Bodley over 2 years ago

  • Status changed from Fix Under Review to Resolved
Actions
Copy link

Also available in: Atom PDF