Project

General

Profile

Actions
Copy link

Bug #65354

closed

Bug #63909: persistent topic stats test fails

rgw/notifications: topic migration test failures

Added by Casey Bodley 30 days ago. Updated 25 days ago.

Status:
Duplicate
Priority:
Urgent
Assignee:
Yuval Lifshitz
Target version:
-
% Done:

0%

Source:
Tags:
notifications
Backport:
squid
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

two failures on main in https://qa-proxy.ceph.com/teuthology/cbodley-2024-04-05_17:23:35-rgw-wip-64571-distro-default-smithi/7641529/teuthology.log:

2024-04-05T19:39:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:======================================================================
2024-04-05T19:39:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:FAIL: test data path v2 persistent migration
2024-04-05T19:39:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:----------------------------------------------------------------------
2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:Traceback (most recent call last):
2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3/dist-packages/nose/case.py", line 197, in runTest
2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:    self.test(*self.arg)
2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 4820, in test_persistent_ps_s3_data_path_v2_migration
2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:    assert False, str(e)
2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:AssertionError: 20 != 0
2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:-------------------- >> begin captured logging << --------------------


2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:======================================================================
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:FAIL: test data path v2 large migration
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:----------------------------------------------------------------------
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:Traceback (most recent call last):
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3/dist-packages/nose/case.py", line 197, in runTest
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:    self.test(*self.arg)
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 5055, in test_ps_s3_data_path_v2_large_migration
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:    assert_equal(len(topics_json['topics']), 1)
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:AssertionError: 2 != 1
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:-------------------- >> begin captured logging << --------------------
Actions
Copy link
 #1

Updated by Casey Bodley 30 days ago

https://qa-proxy.ceph.com/teuthology/cbodley-2024-04-04_17:31:11-rgw-wip-rgw-account-topic-distro-default-smithi/7640314/teuthology.log also shows this failure:

2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:======================================================================
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:FAIL: test data path v2 large migration
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:----------------------------------------------------------------------
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:Traceback (most recent call last):
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:  File "/usr/lib/python3/dist-packages/nose/case.py", line 197, in runTest
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:    self.test(*self.arg)
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 5079, in test_ps_s3_data_path_v2_large_migration
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:    assert_equal(len(topics_json['topics']), 1)
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:AssertionError: 2 != 1
2024-04-04T18:14:08.632 INFO:teuthology.orchestra.run.smithi023.stderr:-------------------- >> begin captured logging << --------------------

Actions
Copy link
 #2

Updated by Yuval Lifshitz 27 days ago

I'm trying to address these issues in this PR: https://github.com/ceph/ceph/pull/55663
Actions
Copy link
 #3

Updated by Yuval Lifshitz 25 days ago

  • Status changed from New to Duplicate
  • Assignee changed from Ali Masarwa to Yuval Lifshitz
  • Parent task set to #63909

the issues above are failures due to test issues that were fixed here: https://tracker.ceph.com/issues/63909
sometimes the migration test fails due to rgw crash. this is tracked here: https://tracker.ceph.com/issues/65337

Actions
Copy link

Also available in: Atom PDF