Bug #58751
kmip: 2 test_sse_kms_multipart failures on ubuntu
0%
Description
sse tests are passing against other services (barbican, vault_old, vault_kv, vault_transit), but 2 are failing against kmip with:
An error occurred (InvalidArgument) when calling the GetObject operation: Failed to retrieve the actual key, kms-keyid: my-key-1
examples:
http://qa-proxy.ceph.com/teuthology/yuvalif-2023-02-12_19:47:07-rgw-wip-yuval-fix-58167-distro-default-smithi/7170096/teuthology.log
http://qa-proxy.ceph.com/teuthology/cbodley-2023-02-16_14:01:19-rgw-wip-cbodley-testing-distro-default-smithi/7176280/teuthology.log
FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - b...
FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1
2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout:=================================== FAILURES =================================== 2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout:________________________ test_sse_kms_multipart_upload _________________________ 2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.encryption 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.fails_on_dbstore 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: def test_sse_kms_multipart_upload(): 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: kms_keyid = get_main_kms_keyid() 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: bucket_name = get_new_bucket() 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: client = get_client() 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: key = "multipart_enc" 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: content_type = 'text/plain' 2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: objlen = 30 * 1024 * 1024 2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: metadata = {'foo': 'bar'} 2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: enc_headers = { 2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption': 'aws:kms', 2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption-aws-kms-key-id': kms_keyid, 2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: 'Content-Type': content_type 2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: resend_parts = [] 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: (upload_id, data, parts) = _multipart_upload_enc(client, bucket_name, key, objlen, 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: part_size=5*1024*1024, init_headers=enc_headers, part_headers=enc_headers, metadata=metadata, resend_parts=resend_parts) 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: lf = (lambda **kwargs: kwargs['params']['headers'].update(enc_headers)) 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: client.meta.events.register('before-call.s3.CompleteMultipartUpload', lf) 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: client.complete_multipart_upload(Bucket=bucket_name, Key=key, UploadId=upload_id, MultipartUpload={'Parts': parts}) 2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.head_bucket(Bucket=bucket_name) 2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: rgw_object_count = int(response['ResponseMetadata']['HTTPHeaders'].get('x-rgw-object-count', 1)) 2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: assert rgw_object_count == 1 2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: rgw_bytes_used = int(response['ResponseMetadata']['HTTPHeaders'].get('x-rgw-bytes-used', objlen)) 2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: assert rgw_bytes_used == objlen 2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: lf = (lambda **kwargs: kwargs['params']['headers'].update(part_headers)) 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: client.meta.events.register('before-call.s3.UploadPart', lf) 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.get_object(Bucket=bucket_name, Key=key) 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: assert response['Metadata'] == metadata 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: assert response['ResponseMetadata']['HTTPHeaders']['content-type'] == content_type 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: body = _get_body(response) 2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: assert body == data 2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: size = response['ContentLength'] 2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: assert len(body) == size 2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout:> _check_content_using_range(key, bucket_name, data, 1000000) 2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:9595: 2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:5837: in _check_content_using_range 2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.get_object(Bucket=bucket_name, Key=key, Range=r) 2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:514: in _api_call 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout: return self._make_api_call(operation_name, kwargs) 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:self = <botocore.client.S3 object at 0x7fc446008eb0> 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:operation_name = 'GetObject' 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:api_params = {'Bucket': 'test-client.0-rtzbfz4vd26jfhj-416', 'Key': 'multipart_enc', 'Range': 'bytes=22000000-22999999'} 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout: def _make_api_call(self, operation_name, api_params): 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model = self._service_model.operation_model(operation_name) 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: service_name = self._service_model.service_name 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: history_recorder.record( 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'API_CALL', 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'service': service_name, 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'operation': operation_name, 2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'params': api_params, 2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: if operation_model.deprecated: 2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: logger.debug( 2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: request_context = { 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_region': self.meta.region_name, 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_config': self.meta.config, 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'auth_type': operation_model.auth_type, 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: request_dict = self._convert_to_request_dict( 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: api_params, operation_model, context=request_context 2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: service_id = self._service_model.service_id.hyphenize() 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: handler, event_response = self.meta.events.emit_until_response( 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: 'before-call.{service_id}.{operation_name}'.format( 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: ), 2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model, 2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: params=request_dict, 2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: request_signer=self._request_signer, 2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context, 2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: if event_response is not None: 2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = event_response 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: else: 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: apply_request_checksum(request_dict) 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = self._make_request( 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model, request_dict, request_context 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: self.meta.events.emit( 2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: 'after-call.{service_id}.{operation_name}'.format( 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: ), 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: http_response=http, 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: parsed=parsed_response, 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model, 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context, 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout: if http.status_code >= 300: 2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout: error_class = self.exceptions.from_code(error_code) 2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:> raise error_class(parsed_response, operation_name) 2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:E botocore.exceptions.ClientError: An error occurred (InvalidArgument) when calling the GetObject operation: Failed to retrieve the actual key, kms-keyid: my-key-1 2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:938: ClientError 2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:Done with cleanup of buckets in tests. 2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:Done with cleanup of buckets in tests. 2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:Done with cleanup of buckets in tests. 2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:___________________ test_sse_kms_multipart_invalid_chunks_1 ____________________ 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.encryption 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.fails_on_dbstore 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: def test_sse_kms_multipart_invalid_chunks_1(): 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: kms_keyid = get_main_kms_keyid() 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: kms_keyid2 = get_secondary_kms_keyid() 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: bucket_name = get_new_bucket() 2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: client = get_client() 2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: key = "multipart_enc" 2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: content_type = 'text/bla' 2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: objlen = 30 * 1024 * 1024 2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: metadata = {'foo': 'bar'} 2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: init_headers = { 2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption': 'aws:kms', 2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption-aws-kms-key-id': kms_keyid, 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: 'Content-Type': content_type 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: part_headers = { 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption': 'aws:kms', 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption-aws-kms-key-id': kms_keyid2 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: resend_parts = [] 2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:> _multipart_upload_enc(client, bucket_name, key, objlen, part_size=5*1024*1024, 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: init_headers=init_headers, part_headers=part_headers, metadata=metadata, 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: resend_parts=resend_parts) 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:9621: 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:9211: in _multipart_upload_enc 2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.upload_part(UploadId=upload_id, Bucket=bucket_name, Key=key, PartNumber=part_num, Body=part) 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:514: in _api_call 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout: return self._make_api_call(operation_name, kwargs) 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:self = <botocore.client.S3 object at 0x7fc445ec10a0> 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:operation_name = 'UploadPart' 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:api_params = {'Body': <_io.BytesIO object at 0x7fc446107f90>, 'Bucket': 'test-client.0-rtzbfz4vd26jfhj-417', 'Key': 'multipart_enc', 'PartNumber': 2, ...} 2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: def _make_api_call(self, operation_name, api_params): 2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model = self._service_model.operation_model(operation_name) 2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: service_name = self._service_model.service_name 2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: history_recorder.record( 2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: 'API_CALL', 2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: 'service': service_name, 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: 'operation': operation_name, 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: 'params': api_params, 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: if operation_model.deprecated: 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: logger.debug( 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: request_context = { 2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_region': self.meta.region_name, 2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_config': self.meta.config, 2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: 'auth_type': operation_model.auth_type, 2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: request_dict = self._convert_to_request_dict( 2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: api_params, operation_model, context=request_context 2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: service_id = self._service_model.service_id.hyphenize() 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: handler, event_response = self.meta.events.emit_until_response( 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: 'before-call.{service_id}.{operation_name}'.format( 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: ), 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model, 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: params=request_dict, 2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: request_signer=self._request_signer, 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context, 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: if event_response is not None: 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = event_response 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: else: 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: apply_request_checksum(request_dict) 2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = self._make_request( 2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model, request_dict, request_context 2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: self.meta.events.emit( 2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: 'after-call.{service_id}.{operation_name}'.format( 2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name 2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: ), 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: http_response=http, 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: parsed=parsed_response, 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model, 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context, 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: ) 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: if http.status_code >= 300: 2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout: error_class = self.exceptions.from_code(error_code) 2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout:> raise error_class(parsed_response, operation_name) 2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout:E botocore.exceptions.ClientError: An error occurred (InvalidArgument) when calling the UploadPart operation: Failed to retrieve the actual key, kms-keyid: my-key-1 2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:938: ClientError
History
#1 Updated by Casey Bodley about 1 year ago
- Description updated (diff)
#2 Updated by Casey Bodley about 1 year ago
- Assignee set to Marcus Watts
#3 Updated by Casey Bodley about 1 year ago
#4 Updated by Casey Bodley about 1 year ago
- Subject changed from kmip: 2 test_sse_kms_multipart failures to kmip: 2 test_sse_kms_multipart failures on ubuntu
this seems to be specific to ubuntu. i've seen it pass elsewhere:
centos: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:46:45-rgw-reef-distro-default-smithi/7202955/teuthology.log
rhel: http://qa-proxy.ceph.com/teuthology/cbodley-2023-03-13_18:22:40-rgw-wip-cbodley-testing-distro-default-smithi/7205498/teuthology.log
#5 Updated by Casey Bodley 3 months ago
- Priority changed from Urgent to Normal
kmip tests disabled with https://github.com/ceph/ceph/pull/54840. moving out of urgent since it's not blocking qa anymore