Bug #58751
Updated by Casey Bodley about 1 year ago
sse tests are passing against other services (barbican, vault_old, vault_kv, vault_transit), but 2 are failing against kmip with:
> An error occurred (InvalidArgument) when calling the GetObject operation: Failed to retrieve the actual key, kms-keyid: my-key-1
examples:
http://qa-proxy.ceph.com/teuthology/yuvalif-2023-02-12_19:47:07-rgw-wip-yuval-fix-58167-distro-default-smithi/7170096/teuthology.log
http://qa-proxy.ceph.com/teuthology/cbodley-2023-02-16_14:01:19-rgw-wip-cbodley-testing-distro-default-smithi/7176280/teuthology.log
FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - b...
FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1
<pre>
2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout:=================================== FAILURES ===================================
2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout:________________________ test_sse_kms_multipart_upload _________________________
2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.166 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.encryption
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.fails_on_dbstore
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: def test_sse_kms_multipart_upload():
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: kms_keyid = get_main_kms_keyid()
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: bucket_name = get_new_bucket()
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: client = get_client()
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: key = "multipart_enc"
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: content_type = 'text/plain'
2023-02-16T04:12:53.167 INFO:teuthology.orchestra.run.smithi078.stdout: objlen = 30 * 1024 * 1024
2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: metadata = {'foo': 'bar'}
2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: enc_headers = {
2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption': 'aws:kms',
2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption-aws-kms-key-id': kms_keyid,
2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: 'Content-Type': content_type
2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: }
2023-02-16T04:12:53.168 INFO:teuthology.orchestra.run.smithi078.stdout: resend_parts = []
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: (upload_id, data, parts) = _multipart_upload_enc(client, bucket_name, key, objlen,
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: part_size=5*1024*1024, init_headers=enc_headers, part_headers=enc_headers, metadata=metadata, resend_parts=resend_parts)
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: lf = (lambda **kwargs: kwargs['params']['headers'].update(enc_headers))
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: client.meta.events.register('before-call.s3.CompleteMultipartUpload', lf)
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout: client.complete_multipart_upload(Bucket=bucket_name, Key=key, UploadId=upload_id, MultipartUpload={'Parts': parts})
2023-02-16T04:12:53.169 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.head_bucket(Bucket=bucket_name)
2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: rgw_object_count = int(response['ResponseMetadata']['HTTPHeaders'].get('x-rgw-object-count', 1))
2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: assert rgw_object_count == 1
2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: rgw_bytes_used = int(response['ResponseMetadata']['HTTPHeaders'].get('x-rgw-bytes-used', objlen))
2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: assert rgw_bytes_used == objlen
2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.170 INFO:teuthology.orchestra.run.smithi078.stdout: lf = (lambda **kwargs: kwargs['params']['headers'].update(part_headers))
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: client.meta.events.register('before-call.s3.UploadPart', lf)
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.get_object(Bucket=bucket_name, Key=key)
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: assert response['Metadata'] == metadata
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: assert response['ResponseMetadata']['HTTPHeaders']['content-type'] == content_type
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.171 INFO:teuthology.orchestra.run.smithi078.stdout: body = _get_body(response)
2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: assert body == data
2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: size = response['ContentLength']
2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: assert len(body) == size
2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.172 INFO:teuthology.orchestra.run.smithi078.stdout:> _check_content_using_range(key, bucket_name, data, 1000000)
2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:9595:
2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:5837: in _check_content_using_range
2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.get_object(Bucket=bucket_name, Key=key, Range=r)
2023-02-16T04:12:53.173 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:514: in _api_call
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout: return self._make_api_call(operation_name, kwargs)
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:self = <botocore.client.S3 object at 0x7fc446008eb0>
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:operation_name = 'GetObject'
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:api_params = {'Bucket': 'test-client.0-rtzbfz4vd26jfhj-416', 'Key': 'multipart_enc', 'Range': 'bytes=22000000-22999999'}
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.174 INFO:teuthology.orchestra.run.smithi078.stdout: def _make_api_call(self, operation_name, api_params):
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model = self._service_model.operation_model(operation_name)
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: service_name = self._service_model.service_name
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: history_recorder.record(
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'API_CALL',
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: {
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'service': service_name,
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'operation': operation_name,
2023-02-16T04:12:53.175 INFO:teuthology.orchestra.run.smithi078.stdout: 'params': api_params,
2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: },
2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: if operation_model.deprecated:
2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: logger.debug(
2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name
2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.176 INFO:teuthology.orchestra.run.smithi078.stdout: request_context = {
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_region': self.meta.region_name,
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_config': self.meta.config,
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'has_streaming_input': operation_model.has_streaming_input,
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: 'auth_type': operation_model.auth_type,
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: }
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: request_dict = self._convert_to_request_dict(
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: api_params, operation_model, context=request_context
2023-02-16T04:12:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: resolve_checksum_context(request_dict, operation_model, api_params)
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: service_id = self._service_model.service_id.hyphenize()
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: handler, event_response = self.meta.events.emit_until_response(
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: 'before-call.{service_id}.{operation_name}'.format(
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: ),
2023-02-16T04:12:53.178 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model,
2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: params=request_dict,
2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: request_signer=self._request_signer,
2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context,
2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: if event_response is not None:
2023-02-16T04:12:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = event_response
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: else:
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: apply_request_checksum(request_dict)
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = self._make_request(
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model, request_dict, request_context
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: self.meta.events.emit(
2023-02-16T04:12:53.180 INFO:teuthology.orchestra.run.smithi078.stdout: 'after-call.{service_id}.{operation_name}'.format(
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: ),
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: http_response=http,
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: parsed=parsed_response,
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model,
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context,
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.181 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout: if http.status_code >= 300:
2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout: error_code = parsed_response.get("Error", {}).get("Code")
2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout: error_class = self.exceptions.from_code(error_code)
2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:> raise error_class(parsed_response, operation_name)
2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:E botocore.exceptions.ClientError: An error occurred (InvalidArgument) when calling the GetObject operation: Failed to retrieve the actual key, kms-keyid: my-key-1
2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:938: ClientError
2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:--------------------------- Captured stdout teardown ---------------------------
2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:Done with cleanup of buckets in tests.
2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:Done with cleanup of buckets in tests.
2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:Done with cleanup of buckets in tests.
2023-02-16T04:12:53.183 INFO:teuthology.orchestra.run.smithi078.stdout:___________________ test_sse_kms_multipart_invalid_chunks_1 ____________________
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.encryption
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.fails_on_dbstore
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: def test_sse_kms_multipart_invalid_chunks_1():
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: kms_keyid = get_main_kms_keyid()
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: kms_keyid2 = get_secondary_kms_keyid()
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: bucket_name = get_new_bucket()
2023-02-16T04:12:53.184 INFO:teuthology.orchestra.run.smithi078.stdout: client = get_client()
2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: key = "multipart_enc"
2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: content_type = 'text/bla'
2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: objlen = 30 * 1024 * 1024
2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: metadata = {'foo': 'bar'}
2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: init_headers = {
2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption': 'aws:kms',
2023-02-16T04:12:53.185 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption-aws-kms-key-id': kms_keyid,
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: 'Content-Type': content_type
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: }
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: part_headers = {
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption': 'aws:kms',
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: 'x-amz-server-side-encryption-aws-kms-key-id': kms_keyid2
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: }
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout: resend_parts = []
2023-02-16T04:12:53.186 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:> _multipart_upload_enc(client, bucket_name, key, objlen, part_size=5*1024*1024,
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: init_headers=init_headers, part_headers=part_headers, metadata=metadata,
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: resend_parts=resend_parts)
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:9621:
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:9211: in _multipart_upload_enc
2023-02-16T04:12:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.upload_part(UploadId=upload_id, Bucket=bucket_name, Key=key, PartNumber=part_num, Body=part)
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:514: in _api_call
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout: return self._make_api_call(operation_name, kwargs)
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:self = <botocore.client.S3 object at 0x7fc445ec10a0>
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:operation_name = 'UploadPart'
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:api_params = {'Body': <_io.BytesIO object at 0x7fc446107f90>, 'Bucket': 'test-client.0-rtzbfz4vd26jfhj-417', 'Key': 'multipart_enc', 'PartNumber': 2, ...}
2023-02-16T04:12:53.188 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: def _make_api_call(self, operation_name, api_params):
2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model = self._service_model.operation_model(operation_name)
2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: service_name = self._service_model.service_name
2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: history_recorder.record(
2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: 'API_CALL',
2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: {
2023-02-16T04:12:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: 'service': service_name,
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: 'operation': operation_name,
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: 'params': api_params,
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: },
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: if operation_model.deprecated:
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: logger.debug(
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name
2023-02-16T04:12:53.190 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: request_context = {
2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_region': self.meta.region_name,
2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: 'client_config': self.meta.config,
2023-02-16T04:12:53.191 INFO:teuthology.orchestra.run.smithi078.stdout: 'has_streaming_input': operation_model.has_streaming_input,
2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: 'auth_type': operation_model.auth_type,
2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: }
2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: request_dict = self._convert_to_request_dict(
2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: api_params, operation_model, context=request_context
2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout: resolve_checksum_context(request_dict, operation_model, api_params)
2023-02-16T04:12:53.192 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: service_id = self._service_model.service_id.hyphenize()
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: handler, event_response = self.meta.events.emit_until_response(
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: 'before-call.{service_id}.{operation_name}'.format(
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: ),
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model,
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: params=request_dict,
2023-02-16T04:12:53.193 INFO:teuthology.orchestra.run.smithi078.stdout: request_signer=self._request_signer,
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context,
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: if event_response is not None:
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = event_response
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: else:
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: apply_request_checksum(request_dict)
2023-02-16T04:12:53.194 INFO:teuthology.orchestra.run.smithi078.stdout: http, parsed_response = self._make_request(
2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: operation_model, request_dict, request_context
2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: self.meta.events.emit(
2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: 'after-call.{service_id}.{operation_name}'.format(
2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: service_id=service_id, operation_name=operation_name
2023-02-16T04:12:53.195 INFO:teuthology.orchestra.run.smithi078.stdout: ),
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: http_response=http,
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: parsed=parsed_response,
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: model=operation_model,
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: context=request_context,
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: )
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: if http.status_code >= 300:
2023-02-16T04:12:53.196 INFO:teuthology.orchestra.run.smithi078.stdout: error_code = parsed_response.get("Error", {}).get("Code")
2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout: error_class = self.exceptions.from_code(error_code)
2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout:> raise error_class(parsed_response, operation_name)
2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout:E botocore.exceptions.ClientError: An error occurred (InvalidArgument) when calling the UploadPart operation: Failed to retrieve the actual key, kms-keyid: my-key-1
2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout:
2023-02-16T04:12:53.197 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.8/site-packages/botocore/client.py:938: ClientError
</pre>