Bug #44405
Updated by Alfonso MartÃnez about 4 years ago
UPDATE: Latest PR that solves it: https://github.com/ceph/ceph/pull/34666 https://tracker.ceph.com/issues/44405#note-8 Previous PR: https://github.com/ceph/ceph/pull/33718 <pre> 2020-03-04T03:16:30.735 INFO:tasks.cephfs_test_runner:====================================================================== 2020-03-04T03:16:30.735 INFO:tasks.cephfs_test_runner:FAIL: test_all (tasks.mgr.dashboard.test_rgw.RgwBucketTest) 2020-03-04T03:16:30.735 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2020-03-04T03:16:30.735 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-03-03-1622/qa/tasks/mgr/dashboard/test_rgw.py", line 255, in test_all 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner: self.assertStatus(200) 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-03-03-1622/qa/tasks/mgr/dashboard/helper.py", line 365, in assertStatus 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner: self.assertEqual(self._resp.status_code, status) 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner:AssertionError: 400 != 200 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner: 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2020-03-04T03:16:30.736 INFO:tasks.cephfs_test_runner:Ran 169 tests in 1769.345s 2020-03-04T03:16:30.737 INFO:tasks.cephfs_test_runner: 2020-03-04T03:16:30.737 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2020-03-04T03:16:30.737 INFO:tasks.cephfs_test_runner: 2020-03-04T03:16:30.737 INFO:tasks.cephfs_test_runner:====================================================================== 2020-03-04T03:16:30.737 INFO:tasks.cephfs_test_runner:FAIL: test_all (tasks.mgr.dashboard.test_rgw.RgwBucketTest) 2020-03-04T03:16:30.737 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2020-03-04T03:16:30.738 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2020-03-04T03:16:30.738 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-03-03-1622/qa/tasks/mgr/dashboard/test_rgw.py", line 255, in test_all 2020-03-04T03:16:30.738 INFO:tasks.cephfs_test_runner: self.assertStatus(200) 2020-03-04T03:16:30.738 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-03-03-1622/qa/tasks/mgr/dashboard/helper.py", line 365, in assertStatus 2020-03-04T03:16:30.738 INFO:tasks.cephfs_test_runner: self.assertEqual(self._resp.status_code, status) 2020-03-04T03:16:30.738 INFO:tasks.cephfs_test_runner:AssertionError: 400 != 200 2020-03-04T03:16:30.738 INFO:tasks.cephfs_test_runner: 2020-03-04T03:16:30.738 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-03-03-1622/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) </pre> <pre> 2020-03-04T03:16:29.197+0000 7f24ca97f700 0 [dashboard DEBUG rest_client] RGW REST API PUT req: /teuth-test-bucket?versioning data: b'<VersioningConfiguration><Status>Suspended</Status><MfaDelete>Disabled</MfaDelete></VersioningConfiguration>' 2020-03-04T03:16:29.197+0000 7f24ca97f700 20 mgr get_config key: mgr/dashboard/REST_REQUESTS_TIMEOUT 2020-03-04T03:16:29.197+0000 7f24ca97f700 10 mgr get_typed_config REST_REQUESTS_TIMEOUT not found 2020-03-04T03:16:29.197+0000 7f24ca97f700 20 mgr get_config key: mgr/dashboard/REST_REQUESTS_TIMEOUT 2020-03-04T03:16:29.197+0000 7f24ca97f700 10 mgr get_typed_config REST_REQUESTS_TIMEOUT not found 2020-03-04T03:16:29.201+0000 7f24ca97f700 0 [dashboard DEBUG urllib3.connectionpool] http://172.21.15.139:80 "PUT /teuth-test-bucket?versioning HTTP/1.1" 403 150 2020-03-04T03:16:29.241+0000 7f24ca97f700 0 [dashboard ERROR rest_client] RGW REST API failed PUT req status: 403 2020-03-04T03:16:29.242+0000 7f24ca97f700 0 [dashboard ERROR exception] Dashboard Exception Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/services/rgw_client.py", line 529, in set_bucket_versioning request(data=data, headers=headers) File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 323, in __call__ data, raw_content, headers) File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 446, in do_request resp.content) dashboard.rest_client.RequestException: RGW REST API failed request with status code 403 (b'{"Code":"AccessDenied","BucketName":"teuth-test-bucket","RequestId":"tx00000' b'000000000000002a-005e5f1d8d-11cd-default","HostId":"11cd-default-default"}') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 93, in dashboard_exception_handler return handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__ return self.callable(*self.args, **self.kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/__init__.py", line 665, in inner ret = func(*args, **kwargs) File "/usr/share/ceph/mgr/dashboard/controllers/__init__.py", line 858, in wrapper return func(*vpath, **params) File "/usr/share/ceph/mgr/dashboard/controllers/rgw.py", line 232, in set versioning_state, mfa_delete, mfa_token_serial, mfa_token_pin) File "/usr/share/ceph/mgr/dashboard/controllers/rgw.py", line 162, in _set_versioning mfa_token_serial, mfa_token_pin) File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 521, in func_wrapper **kwargs) File "/usr/share/ceph/mgr/dashboard/services/rgw_client.py", line 538, in set_bucket_versioning component='rgw') dashboard.exceptions.DashboardException: Bad MFA credentials: RGW REST API failed request with status code 403 (b'{"Code":"AccessDenied","BucketName":"teuth-test-bucket","RequestId":"tx00000' b'000000000000002a-005e5f1d8d-11cd-default","HostId":"11cd-default-default"}') 2020-03-04T03:16:29.243+0000 7f24ca97f700 0 [dashboard INFO request] [::ffff:172.21.0.51:47928] [PUT] [400] [0.062s] [admin] [221.0B] /api/rgw/bucket/teuth-test-bucket </pre>