Actions
Bug #65354
closedBug #63909: persistent topic stats test fails
rgw/notifications: topic migration test failures
% Done:
0%
Source:
Tags:
notifications
Backport:
squid
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
two failures on main in https://qa-proxy.ceph.com/teuthology/cbodley-2024-04-05_17:23:35-rgw-wip-64571-distro-default-smithi/7641529/teuthology.log:
2024-04-05T19:39:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:====================================================================== 2024-04-05T19:39:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:FAIL: test data path v2 persistent migration 2024-04-05T19:39:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:---------------------------------------------------------------------- 2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:Traceback (most recent call last): 2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr: File "/usr/lib/python3/dist-packages/nose/case.py", line 197, in runTest 2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr: self.test(*self.arg) 2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 4820, in test_persistent_ps_s3_data_path_v2_migration 2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr: assert False, str(e) 2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:AssertionError: 20 != 0 2024-04-05T19:39:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:-------------------- >> begin captured logging << --------------------
2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:====================================================================== 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:FAIL: test data path v2 large migration 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:---------------------------------------------------------------------- 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:Traceback (most recent call last): 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr: File "/usr/lib/python3/dist-packages/nose/case.py", line 197, in runTest 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr: self.test(*self.arg) 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 5055, in test_ps_s3_data_path_v2_large_migration 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr: assert_equal(len(topics_json['topics']), 1) 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:AssertionError: 2 != 1 2024-04-05T19:39:40.161 INFO:teuthology.orchestra.run.smithi019.stderr:-------------------- >> begin captured logging << --------------------
Updated by Casey Bodley about 1 month ago
https://qa-proxy.ceph.com/teuthology/cbodley-2024-04-04_17:31:11-rgw-wip-rgw-account-topic-distro-default-smithi/7640314/teuthology.log also shows this failure:
2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:====================================================================== 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:FAIL: test data path v2 large migration 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:---------------------------------------------------------------------- 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:Traceback (most recent call last): 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr: File "/usr/lib/python3/dist-packages/nose/case.py", line 197, in runTest 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr: self.test(*self.arg) 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr: File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 5079, in test_ps_s3_data_path_v2_large_migration 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr: assert_equal(len(topics_json['topics']), 1) 2024-04-04T18:14:08.631 INFO:teuthology.orchestra.run.smithi023.stderr:AssertionError: 2 != 1 2024-04-04T18:14:08.632 INFO:teuthology.orchestra.run.smithi023.stderr:-------------------- >> begin captured logging << --------------------
Updated by Yuval Lifshitz about 1 month ago
I'm trying to address these issues in this PR: https://github.com/ceph/ceph/pull/55663
- this commit: https://github.com/ceph/ceph/pull/55663/commits/81f2cb2ee6e5342cc6fa562e16d300dad8ea7edd should address the issue in: test_persistent_ps_s3_data_path_v2_migration
- this commit: https://github.com/ceph/ceph/pull/55663/commits/8e82fbbf7743b13117aa3d3815f7fe20b291415a might address the issue in: test_ps_s3_data_path_v2_large_migration
however, this will address the issue only if it there was another unrelated failure in the run, that failed to cleanup the topics
Updated by Yuval Lifshitz about 1 month ago
- Status changed from New to Duplicate
- Assignee changed from Ali Masarwa to Yuval Lifshitz
- Parent task set to #63909
the issues above are failures due to test issues that were fixed here: https://tracker.ceph.com/issues/63909
sometimes the migration test fails due to rgw crash. this is tracked here: https://tracker.ceph.com/issues/65337
Actions