|
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::S3AnonymousEngine denied with reason=-1
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::LocalEngine
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s v4 signature format = 18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s v4 credential format = 99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s access key id = 99III557UP8H1N2WM9RZ
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s credential scope = 20230524/dwh-lab/s3/aws4_request
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache put: name=default.rgw.meta+users.keys+99III557UP8H1N2WM9RZ info.flags=0x6
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj moving default.rgw.meta+users.keys+99III557UP8H1N2WM9RZ to cache LRU end
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.keys+99III557UP8H1N2WM9RZ : hit (requested=0x1, cached=0x7)
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85babd8 obj=default.rgw.meta:users.uid:Trino state=0x55b6d0192520 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x11, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 CONTENT_LENGTH=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 CONTENT_TYPE=application/octet-stream
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AMZ_SDK_INVOCATION_ID=eb288112-f921-ecf0-93e4-ac45ac227eab
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s canonical headers format = amz-sdk-invocation-id:25a54695-ad68-2c89-fb46-f1c327bbefc5
|
|
amz-sdk-request:attempt=1;max=11
|
|
amz-sdk-retry:0/0/500
|
|
content-type:application/octet-stream
|
|
host:s3-dwh-lab
|
|
range:bytes=4-1206330
|
|
user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
x-amz-date:20230524T183012Z
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AMZ_SDK_REQUEST=attempt=1;max=11
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AMZ_SDK_RETRY=0/0/500
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj chain_cache_entry: cache_locator=default.rgw.meta+users.uid+Trino
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AUTHORIZATION=AWS4-HMAC-SHA256 Credential=99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date, Signature=bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s payload request hash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_CONNECTION=Keep-Alive
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_HOST=s3-dwh-lab
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_RANGE=bytes=4-1242779
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_USER_AGENT=, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_VERSION=1.1
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_X_AMZ_CONTENT_SHA256=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_X_AMZ_DATE=20230524T183012Z
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 REMOTE_ADDR=10.208.80.16
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 REQUEST_METHOD=GET
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 REQUEST_URI=/prod-ods-work/ad_items_records/full.51735/out_59_0.parquet
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 SCRIPT_URI=/prod-ods-work/ad_items_records/full.51735/out_59_0.parquet
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 SERVER_PORT=80
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 1 ====== starting new request req=0x7f9ae8862730 =====
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 15 req 3750175572355161715 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user2</ID><DisplayName>user2</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user2</ID><DisplayName>user2</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s initializing for trans_id = tx0000065b842cb3172e042-00646e57b4-5b6e2b2-first
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s generated signature = eaefcd41e73a9b4e50f09135bee348f7147981ead619b339c23b648e7bcf80c7
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s canonical request = GET
|
|
/prod-ods-work/ad_items_records/full.51735/out_77_0.parquet
|
|
amz-sdk-invocation-id:25a54695-ad68-2c89-fb46-f1c327bbefc5
|
|
amz-sdk-request:attempt=1;max=11
|
|
amz-sdk-retry:0/0/500
|
|
content-type:application/octet-stream
|
|
host:s3-dwh-lab
|
|
range:bytes=4-1206330
|
|
user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
x-amz-date:20230524T183012Z
|
|
amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date
|
|
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s rgw api priority: s3=8 s3website=7
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s canonical request hash = 743e8cde81d2d0634393bae54f6607415f00c9e08c31555d1e152ee01299fc21
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256
|
|
20230524T183012Z
|
|
20230524/dwh-lab/s3/aws4_request
|
|
6b4a2302023c4f39268c7c8cd881d91579dc84245931a11c629a237bdcdb09f8
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj server signature=eaefcd41e73a9b4e50f09135bee348f7147981ead619b339c23b648e7bcf80c7
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj client signature=eaefcd41e73a9b4e50f09135bee348f7147981ead619b339c23b648e7bcf80c7
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj compare=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s host=s3-dwh-lab
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae87becf8 obj=default.rgw.meta:users.uid:Trino state=0x55b6b04a4e20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s string to sign = AWS4-HMAC-SHA256
|
|
20230524T183012Z
|
|
20230524/dwh-lab/s3/aws4_request
|
|
743e8cde81d2d0634393bae54f6607415f00c9e08c31555d1e152ee01299fc21
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj normalizing buckets and tenants
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s final domain/bucket subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 s->info.domain= s->info.request_uri=/prod-ods-work/ad_items_records/full.51735/out_59_0.parquet
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s->object=ad_items_records/full.51735/out_134_0.parquet s->bucket=prod-ods-work
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj init permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s meta>> HTTP_X_AMZ_CONTENT_SHA256
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s meta>> HTTP_X_AMZ_DATE
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85bb200 obj=default.rgw.meta:root:prod-ods-work state=0x55b838689960 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s x>> x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s x>> x-amz-date:20230524T183012Z
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s generated signature = 18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256
|
|
20230524T183012Z
|
|
20230524/dwh-lab/s3/aws4_request
|
|
743e8cde81d2d0634393bae54f6607415f00c9e08c31555d1e152ee01299fc21
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj server signature=18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s get_handler handler=22RGWHandler_REST_Obj_S3
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj client signature=18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj compare=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s handler=22RGWHandler_REST_Obj_S3
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s getting op 0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user2</ID><DisplayName>user2</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user2</ID><DisplayName>user2</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj normalizing buckets and tenants
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s get_system_obj_state: rctx=0x7f9ae88617c0 obj=default.rgw.log:script.prerequest. state=0x55b67cc7f960 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s->object=ad_items_records/full.51735/out_77_0.parquet s->bucket=prod-ods-work
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj init permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s cache get: name=default.rgw.log++script.prerequest. : hit (negative entry)
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85bacf8 obj=default.rgw.meta:users.uid:Trino state=0x55b838689960 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj scheduling with throttler client=2 cost=1
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj op=21RGWGetObj_ObjStore_S3
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj verifying requester
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae86bd200 obj=default.rgw.meta:root:prod-ods-work state=0x55b6577fae20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::StrategyRegistry::s3_main_strategy_t: trying rgw::auth::s3::AWSAuthStrategy
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::S3AnonymousEngine
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::S3AnonymousEngine denied with reason=-1
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::LocalEngine
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s v4 signature format = bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s v4 credential format = 99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s access key id = 99III557UP8H1N2WM9RZ
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s credential scope = 20230524/dwh-lab/s3/aws4_request
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user2</ID><DisplayName>user2</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user2</ID><DisplayName>user2</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae86bccf8 obj=default.rgw.meta:users.uid:Trino state=0x55b6577fae20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj recalculating target
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj reading permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj recalculating target
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj reading permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj recalculating target
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj reading permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s canonical headers format = amz-sdk-invocation-id:eb288112-f921-ecf0-93e4-ac45ac227eab
|
|
amz-sdk-request:attempt=1;max=11
|
|
amz-sdk-retry:0/0/500
|
|
content-type:application/octet-stream
|
|
host:s3-dwh-lab
|
|
range:bytes=4-1242779
|
|
user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
x-amz-date:20230524T183012Z
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj recalculating target
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj reading permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s payload request hash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae87bfad0 obj=prod-ods-work:ad_items_records/full.51735/out_76_0.parquet state=0x55b6b03f19e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj WARNING: blocking librados call
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae85bbad0 obj=prod-ods-work:ad_items_records/full.51735/out_134_0.parquet state=0x55b6cb510de8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj WARNING: blocking librados call
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s canonical request = GET
|
|
/prod-ods-work/ad_items_records/full.51735/out_59_0.parquet
|
|
amz-sdk-invocation-id:eb288112-f921-ecf0-93e4-ac45ac227eab
|
|
amz-sdk-request:attempt=1;max=11
|
|
amz-sdk-retry:0/0/500
|
|
content-type:application/octet-stream
|
|
host:s3-dwh-lab
|
|
range:bytes=4-1242779
|
|
user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
x-amz-date:20230524T183012Z
|
|
amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date
|
|
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s canonical request hash = d549534f241a5770e73a7d802ba7ba7268bd77bd510842d4fa2629a867573ddc
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s string to sign = AWS4-HMAC-SHA256
|
|
20230524T183012Z
|
|
20230524/dwh-lab/s3/aws4_request
|
|
d549534f241a5770e73a7d802ba7ba7268bd77bd510842d4fa2629a867573ddc
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae873ead0 obj=prod-ods-work:ad_items_records/full.51735/out_60_0.parquet state=0x55b6c8dfe1e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj WARNING: blocking librados call
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae86bdad0 obj=prod-ods-work:ad_items_records/full.51735/out_77_0.parquet state=0x55b6bd54a5e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj WARNING: blocking librados call
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s generated signature = bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256
|
|
20230524T183012Z
|
|
20230524/dwh-lab/s3/aws4_request
|
|
d549534f241a5770e73a7d802ba7ba7268bd77bd510842d4fa2629a867573ddc
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj server signature=bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj client signature=bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj compare=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj normalizing buckets and tenants
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s->object=ad_items_records/full.51735/out_59_0.parquet s->bucket=prod-ods-work
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj init permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae8861200 obj=default.rgw.meta:root:prod-ods-work state=0x55b67cc7f960 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user2</ID><DisplayName>user2</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user2</ID><DisplayName>user2</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj manifest: total_size = 1214308
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337634.9564975436449649728
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae8860cf8 obj=default.rgw.meta:users.uid:Trino state=0x55b67cc7f960 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 15 req 7853848101899647239 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user1</ID><DisplayName>user1</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user1</ID><DisplayName>user1</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj init op
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj manifest: total_size = 1194579
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337664.17379721212291051974
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae873e488 obj=default.rgw.meta:users.uid:user2 state=0x55b657fb9ba0 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 15 req 3750175572355161715 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user1</ID><DisplayName>user1</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user1</ID><DisplayName>user1</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj init op
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae87bf488 obj=default.rgw.meta:users.uid:user2 state=0x55b6b04a4e20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj verifying op mask
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj verifying op permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj verifying op mask
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj verifying op permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj verifying op params
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj pre-executing
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj check rate limiting
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj verifying op params
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj pre-executing
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj executing
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj check rate limiting
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj executing
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae87bfad0 obj=prod-ods-work:ad_items_records/full.51735/out_76_0.parquet state=0x55b6b03f19e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae873ead0 obj=prod-ods-work:ad_items_records/full.51735/out_60_0.parquet state=0x55b6c8dfe1e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 15 req 3750175572355161715 0.000000000s Encryption mode:
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae87bfad0 obj=prod-ods-work:ad_items_records/full.51735/out_76_0.parquet state=0x55b6b03f19e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver
|
|
2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet obj-ofs=4 read_ofs=4 len=1188934
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj manifest: total_size = 1208444
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337634.12111259888233767509
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 15 req 7853848101899647239 0.000000000s Encryption mode:
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user1</ID><DisplayName>user1</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user1</ID><DisplayName>user1</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj init op
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae873ead0 obj=prod-ods-work:ad_items_records/full.51735/out_60_0.parquet state=0x55b6c8dfe1e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85bb488 obj=default.rgw.meta:users.uid:user2 state=0x55b838689960 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_60_0.parquet obj-ofs=4 read_ofs=4 len=1209113
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj recalculating target
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj reading permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj verifying op mask
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj verifying op permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj verifying op params
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj pre-executing
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj check rate limiting
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj executing
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae85bbad0 obj=prod-ods-work:ad_items_records/full.51735/out_134_0.parquet state=0x55b6cb510de8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s Encryption mode:
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae85bbad0 obj=prod-ods-work:ad_items_records/full.51735/out_134_0.parquet state=0x55b6cb510de8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1
|
|
2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_134_0.parquet obj-ofs=4 read_ofs=4 len=1202107
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae8861ad0 obj=prod-ods-work:ad_items_records/full.51735/out_59_0.parquet state=0x55b659deb9e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj WARNING: blocking librados call
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj manifest: total_size = 1211490
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337664.8246275765501030898
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user1</ID><DisplayName>user1</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user1</ID><DisplayName>user1</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj init op
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae86bd488 obj=default.rgw.meta:users.uid:user2 state=0x55b6577fae20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj verifying op mask
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj verifying op permissions
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj verifying op params
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj pre-executing
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj check rate limiting
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj executing
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae86bdad0 obj=prod-ods-work:ad_items_records/full.51735/out_77_0.parquet state=0x55b6bd54a5e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s Encryption mode:
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae86bdad0 obj=prod-ods-work:ad_items_records/full.51735/out_77_0.parquet state=0x55b6bd54a5e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1
|
|
2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_77_0.parquet obj-ofs=4 read_ofs=4 len=1206327
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 10 req 7329681834020888642 0.004000066s s3:get_obj manifest: total_size = 1247553
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109344318.11121045277499360749
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 15 req 7329681834020888642 0.004000066s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user1</ID><DisplayName>user1</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user1</ID><DisplayName>user1</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj init op
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_system_obj_state: rctx=0x7f9ae8861488 obj=default.rgw.meta:users.uid:user2 state=0x55b709995720 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 10 req 7329681834020888642 0.004000066s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 10 req 7329681834020888642 0.004000066s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj verifying op mask
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj required_mask= 1 user.op_mask=7
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj verifying op permissions
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj verifying op params
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj pre-executing
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj check rate limiting
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj executing
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_obj_state: rctx=0x7f9ae8861ad0 obj=prod-ods-work:ad_items_records/full.51735/out_59_0.parquet state=0x55b659deb9e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.acl
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.content_type
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.etag
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.idtag
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.manifest
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 15 req 7329681834020888642 0.004000066s Encryption mode:
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_obj_state: rctx=0x7f9ae8861ad0 obj=prod-ods-work:ad_items_records/full.51735/out_59_0.parquet state=0x55b659deb9e8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1
|
|
2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet obj-ofs=4 read_ofs=4 len=1242776
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 10 D3nDataCache: flush(): bl.length <= rgw_get_obj_max_req_size (default 4MB) - write to datacache, bl.length=16448
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 10 D3nDataCache::put(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet, len=16448
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 20 D3nDataCache: Before eviction _free_data_cache_size:100632677312, _outstanding_write_size:0, freed_size:0
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 30 D3nDataCache: d3n_libaio_create_write_request(): Write To Cache, oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet, len=16448
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 20 D3nDataCache: d3n_prepare_libaio_write_op(): Write To Cache, location=/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 0 ERROR: D3nCacheAioWriteRequest::create_io: open file failed, errno=2, location='/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet'
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 0 ERROR: D3nDataCache: d3n_libaio_create_write_request() prepare libaio write op r=-1
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 1 D3nDataCache: create_aio_write_request fail, r=-1
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 2 req 17250614352638959360 0.016000265s s3:get_obj completing
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 20 req 17250614352638959360 0.016000265s get_system_obj_state: rctx=0x7f9ae853a7c0 obj=default.rgw.log:script.postrequest. state=0x55b6cab6e9a0 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 10 req 17250614352638959360 0.016000265s cache get: name=default.rgw.log++script.postrequest. : hit (negative entry)
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 2 req 17250614352638959360 0.016000265s s3:get_obj op status=0
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 2 req 17250614352638959360 0.016000265s s3:get_obj http status=206
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 1 ====== req done req=0x7f9ae853b730 op status=0 http_status=206 latency=0.016000265s ======
|
|
2023-05-24T18:30:12.616+0000 7f9bb9a05700 1 beast: 0x7f9ae853b730: 10.208.80.16 - Trino [24/May/2023:18:30:12.600 +0000] "GET /prod-ods-work/ad_items_records/full.51735/out_142_0.parquet HTTP/1.1" 206 16448 - ", aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino" bytes=1236059-9223372036854775806 latency=0.016000265s
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 CONTENT_LENGTH=0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 CONTENT_TYPE=application/octet-stream
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AMZ_SDK_INVOCATION_ID=45e97df7-ad37-79aa-f196-d156e323dc42
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AMZ_SDK_REQUEST=attempt=1;max=11
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AMZ_SDK_RETRY=0/0/500
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AUTHORIZATION=AWS4-HMAC-SHA256 Credential=99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date, Signature=056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_CONNECTION=Keep-Alive
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_HOST=s3-dwh-lab
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_RANGE=bytes=4-1164510
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_USER_AGENT=, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_VERSION=1.1
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_X_AMZ_CONTENT_SHA256=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_X_AMZ_DATE=20230524T183012Z
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 REMOTE_ADDR=10.208.80.16
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 REQUEST_METHOD=GET
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 REQUEST_URI=/prod-ods-work/ad_items_records/full.51735/out_48_0.parquet
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 SCRIPT_URI=/prod-ods-work/ad_items_records/full.51735/out_48_0.parquet
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 SERVER_PORT=80
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 1 ====== starting new request req=0x7f9ae853b730 =====
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s initializing for trans_id = tx0000042fa6d3402467854-00646e57b4-5b6e2b2-first
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s rgw api priority: s3=8 s3website=7
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s host=s3-dwh-lab
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s final domain/bucket subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 s->info.domain= s->info.request_uri=/prod-ods-work/ad_items_records/full.51735/out_48_0.parquet
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s meta>> HTTP_X_AMZ_CONTENT_SHA256
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s meta>> HTTP_X_AMZ_DATE
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s x>> x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s x>> x-amz-date:20230524T183012Z
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s get_handler handler=22RGWHandler_REST_Obj_S3
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s handler=22RGWHandler_REST_Obj_S3
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s getting op 0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s get_system_obj_state: rctx=0x7f9ae853a7c0 obj=default.rgw.log:script.prerequest. state=0x55b67f7a6e20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s cache get: name=default.rgw.log++script.prerequest. : hit (negative entry)
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj scheduling with throttler client=2 cost=1
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj op=21RGWGetObj_ObjStore_S3
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj verifying requester
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::StrategyRegistry::s3_main_strategy_t: trying rgw::auth::s3::AWSAuthStrategy
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::S3AnonymousEngine
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::S3AnonymousEngine denied with reason=-1
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::LocalEngine
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s v4 signature format = 056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s v4 credential format = 99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s access key id = 99III557UP8H1N2WM9RZ
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s credential scope = 20230524/dwh-lab/s3/aws4_request
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s canonical headers format = amz-sdk-invocation-id:45e97df7-ad37-79aa-f196-d156e323dc42
|
|
amz-sdk-request:attempt=1;max=11
|
|
amz-sdk-retry:0/0/500
|
|
content-type:application/octet-stream
|
|
host:s3-dwh-lab
|
|
range:bytes=4-1164510
|
|
user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
x-amz-date:20230524T183012Z
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s payload request hash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s canonical request = GET
|
|
/prod-ods-work/ad_items_records/full.51735/out_48_0.parquet
|
|
amz-sdk-invocation-id:45e97df7-ad37-79aa-f196-d156e323dc42
|
|
amz-sdk-request:attempt=1;max=11
|
|
amz-sdk-retry:0/0/500
|
|
content-type:application/octet-stream
|
|
host:s3-dwh-lab
|
|
range:bytes=4-1164510
|
|
user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino
|
|
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
x-amz-date:20230524T183012Z
|
|
amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date
|
|
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s canonical request hash = 329be98a0e6840ef4fd1bedb0def38e8c1e09e2740eff86a8ec0a8c5590067e3
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s string to sign = AWS4-HMAC-SHA256
|
|
20230524T183012Z
|
|
20230524/dwh-lab/s3/aws4_request
|
|
329be98a0e6840ef4fd1bedb0def38e8c1e09e2740eff86a8ec0a8c5590067e3
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s generated signature = 056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256
|
|
20230524T183012Z
|
|
20230524/dwh-lab/s3/aws4_request
|
|
329be98a0e6840ef4fd1bedb0def38e8c1e09e2740eff86a8ec0a8c5590067e3
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj server signature=056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj client signature=056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj compare=0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj normalizing buckets and tenants
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s->object=ad_items_records/full.51735/out_48_0.parquet s->bucket=prod-ods-work
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj init permissions
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae853a200 obj=default.rgw.meta:root:prod-ods-work state=0x55b67f7a6e20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17)
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user2</ID><DisplayName>user2</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user2</ID><DisplayName>user2</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae8539cf8 obj=default.rgw.meta:users.uid:Trino state=0x55b67f7a6e20 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj recalculating target
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj reading permissions
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae853aad0 obj=prod-ods-work:ad_items_records/full.51735/out_48_0.parquet state=0x55b6c5940de8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj WARNING: blocking librados call
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 10 req 4826290020824807508 0.004000067s s3:get_obj manifest: total_size = 1169382
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109329617.4491066039763630892
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 15 req 4826290020824807508 0.004000067s s3:get_obj decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>user1</ID><DisplayName>user1</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>user1</ID><DisplayName>user1</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj init op
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_system_obj_state: rctx=0x7f9ae853a488 obj=default.rgw.meta:users.uid:user2 state=0x55b65c8d8520 s->prefetch_data=0
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 10 req 4826290020824807508 0.004000067s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17)
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_system_obj_state: s->obj_tag was set empty
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr: user.rgw.idtag
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 10 req 4826290020824807508 0.004000067s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17)
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj verifying op mask
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj required_mask= 1 user.op_mask=7
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj verifying op permissions
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj verifying op params
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj pre-executing
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj check rate limiting
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj executing
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_obj_state: rctx=0x7f9ae853aad0 obj=prod-ods-work:ad_items_records/full.51735/out_48_0.parquet state=0x55b6c5940de8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.acl
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.content_type
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.etag
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.idtag
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.manifest
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 15 req 4826290020824807508 0.004000067s Encryption mode:
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_obj_state: rctx=0x7f9ae853aad0 obj=prod-ods-work:ad_items_records/full.51735/out_48_0.parquet state=0x55b6c5940de8 s->prefetch_data=0
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1
|
|
2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_48_0.parquet obj-ofs=4 read_ofs=4 len=1164507
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 10 D3nDataCache: flush(): bl.length <= rgw_get_obj_max_req_size (default 4MB) - write to datacache, bl.length=1242776
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 10 D3nDataCache::put(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet, len=1242776
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 20 D3nDataCache: Before eviction _free_data_cache_size:100632677312, _outstanding_write_size:0, freed_size:0
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 30 D3nDataCache: d3n_libaio_create_write_request(): Write To Cache, oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet, len=1242776
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 20 D3nDataCache: d3n_prepare_libaio_write_op(): Write To Cache, location=/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 0 ERROR: D3nCacheAioWriteRequest::create_io: open file failed, errno=2, location='/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet'
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 0 ERROR: D3nDataCache: d3n_libaio_create_write_request() prepare libaio write op r=-1
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 1 D3nDataCache: create_aio_write_request fail, r=-1
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 2 req 7329681834020888642 0.020000331s s3:get_obj completing
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 20 req 7329681834020888642 0.020000331s get_system_obj_state: rctx=0x7f9ae88617c0 obj=default.rgw.log:script.postrequest. state=0x55b6dbc0c520 s->prefetch_data=0
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 10 req 7329681834020888642 0.020000331s cache get: name=default.rgw.log++script.postrequest. : hit (negative entry)
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 2 req 7329681834020888642 0.020000331s s3:get_obj op status=0
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 2 req 7329681834020888642 0.020000331s s3:get_obj http status=206
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 1 ====== req done req=0x7f9ae8862730 op status=0 http_status=206 latency=0.020000331s ======
|
|
2023-05-24T18:30:12.632+0000 7f9b5c14a700 1 beast: 0x7f9ae8862730: 10.208.80.16 - Trino [24/May/2023:18:30:12.612 +0000] "GET /prod-ods-work/ad_items_records/full.51735/out_59_0.parquet HTTP/1.1" 206 1242776 - ", aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino" bytes=4-1242779 latency=0.020000331s
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 10 D3nDataCache: flush(): bl.length <= rgw_get_obj_max_req_size (default 4MB) - write to datacache, bl.length=1188934
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 10 D3nDataCache::put(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet, len=1188934
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 20 D3nDataCache: Before eviction _free_data_cache_size:100632677312, _outstanding_write_size:0, freed_size:0
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 30 D3nDataCache: d3n_libaio_create_write_request(): Write To Cache, oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet, len=1188934
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 20 D3nDataCache: d3n_prepare_libaio_write_op(): Write To Cache, location=/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 0 ERROR: D3nCacheAioWriteRequest::create_io: open file failed, errno=2, location='/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet'
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 0 ERROR: D3nDataCache: d3n_libaio_create_write_request() prepare libaio write op r=-1
|
|
2023-05-24T18:30:12.632+0000 7f9b939b9700 1 D3nDataCache: create_aio_write_request fail, r=-1
|