2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::S3AnonymousEngine denied with reason=-1 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::LocalEngine 2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s v4 signature format = 18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s v4 credential format = 99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s access key id = 99III557UP8H1N2WM9RZ 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s credential scope = 20230524/dwh-lab/s3/aws4_request 2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache put: name=default.rgw.meta+users.keys+99III557UP8H1N2WM9RZ info.flags=0x6 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj moving default.rgw.meta+users.keys+99III557UP8H1N2WM9RZ to cache LRU end 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.keys+99III557UP8H1N2WM9RZ : hit (requested=0x1, cached=0x7) 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85babd8 obj=default.rgw.meta:users.uid:Trino state=0x55b6d0192520 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x11, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 CONTENT_LENGTH=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 CONTENT_TYPE=application/octet-stream 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AMZ_SDK_INVOCATION_ID=eb288112-f921-ecf0-93e4-ac45ac227eab 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s canonical headers format = amz-sdk-invocation-id:25a54695-ad68-2c89-fb46-f1c327bbefc5 amz-sdk-request:attempt=1;max=11 amz-sdk-retry:0/0/500 content-type:application/octet-stream host:s3-dwh-lab range:bytes=4-1206330 user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20230524T183012Z 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AMZ_SDK_REQUEST=attempt=1;max=11 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AMZ_SDK_RETRY=0/0/500 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj chain_cache_entry: cache_locator=default.rgw.meta+users.uid+Trino 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_AUTHORIZATION=AWS4-HMAC-SHA256 Credential=99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date, Signature=bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s payload request hash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_CONNECTION=Keep-Alive 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_HOST=s3-dwh-lab 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_RANGE=bytes=4-1242779 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_USER_AGENT=, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_VERSION=1.1 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_X_AMZ_CONTENT_SHA256=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 HTTP_X_AMZ_DATE=20230524T183012Z 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 REMOTE_ADDR=10.208.80.16 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 REQUEST_METHOD=GET 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 REQUEST_URI=/prod-ods-work/ad_items_records/full.51735/out_59_0.parquet 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 SCRIPT_URI=/prod-ods-work/ad_items_records/full.51735/out_59_0.parquet 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 SERVER_PORT=80 2023-05-24T18:30:12.612+0000 7f9b4f931700 1 ====== starting new request req=0x7f9ae8862730 ===== 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26 2023-05-24T18:30:12.612+0000 7f9b5513c700 15 req 3750175572355161715 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser2user2user2user2FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s initializing for trans_id = tx0000065b842cb3172e042-00646e57b4-5b6e2b2-first 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s generated signature = eaefcd41e73a9b4e50f09135bee348f7147981ead619b339c23b648e7bcf80c7 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s canonical request = GET /prod-ods-work/ad_items_records/full.51735/out_77_0.parquet amz-sdk-invocation-id:25a54695-ad68-2c89-fb46-f1c327bbefc5 amz-sdk-request:attempt=1;max=11 amz-sdk-retry:0/0/500 content-type:application/octet-stream host:s3-dwh-lab range:bytes=4-1206330 user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20230524T183012Z amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s rgw api priority: s3=8 s3website=7 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s canonical request hash = 743e8cde81d2d0634393bae54f6607415f00c9e08c31555d1e152ee01299fc21 2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256 20230524T183012Z 20230524/dwh-lab/s3/aws4_request 6b4a2302023c4f39268c7c8cd881d91579dc84245931a11c629a237bdcdb09f8 2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj server signature=eaefcd41e73a9b4e50f09135bee348f7147981ead619b339c23b648e7bcf80c7 2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj client signature=eaefcd41e73a9b4e50f09135bee348f7147981ead619b339c23b648e7bcf80c7 2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj compare=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s host=s3-dwh-lab 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae87becf8 obj=default.rgw.meta:users.uid:Trino state=0x55b6b04a4e20 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s string to sign = AWS4-HMAC-SHA256 20230524T183012Z 20230524/dwh-lab/s3/aws4_request 743e8cde81d2d0634393bae54f6607415f00c9e08c31555d1e152ee01299fc21 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj normalizing buckets and tenants 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s final domain/bucket subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 s->info.domain= s->info.request_uri=/prod-ods-work/ad_items_records/full.51735/out_59_0.parquet 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s->object=ad_items_records/full.51735/out_134_0.parquet s->bucket=prod-ods-work 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj init permissions 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s meta>> HTTP_X_AMZ_CONTENT_SHA256 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s meta>> HTTP_X_AMZ_DATE 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85bb200 obj=default.rgw.meta:root:prod-ods-work state=0x55b838689960 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s x>> x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s x>> x-amz-date:20230524T183012Z 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s generated signature = 18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0 2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256 20230524T183012Z 20230524/dwh-lab/s3/aws4_request 743e8cde81d2d0634393bae54f6607415f00c9e08c31555d1e152ee01299fc21 2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj server signature=18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s get_handler handler=22RGWHandler_REST_Obj_S3 2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj client signature=18eb562c51e86dbc921241891e30357c08a171c037d0bcce203f2cb21fbab8e0 2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj compare=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s handler=22RGWHandler_REST_Obj_S3 2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s getting op 0 2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser2user2user2user2FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj normalizing buckets and tenants 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s get_system_obj_state: rctx=0x7f9ae88617c0 obj=default.rgw.log:script.prerequest. state=0x55b67cc7f960 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s->object=ad_items_records/full.51735/out_77_0.parquet s->bucket=prod-ods-work 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj init permissions 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s cache get: name=default.rgw.log++script.prerequest. : hit (negative entry) 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85bacf8 obj=default.rgw.meta:users.uid:Trino state=0x55b838689960 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj scheduling with throttler client=2 cost=1 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj op=21RGWGetObj_ObjStore_S3 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj verifying requester 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae86bd200 obj=default.rgw.meta:root:prod-ods-work state=0x55b6577fae20 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::StrategyRegistry::s3_main_strategy_t: trying rgw::auth::s3::AWSAuthStrategy 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::S3AnonymousEngine 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::S3AnonymousEngine denied with reason=-1 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::LocalEngine 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s v4 signature format = bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s v4 credential format = 99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s access key id = 99III557UP8H1N2WM9RZ 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s credential scope = 20230524/dwh-lab/s3/aws4_request 2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser2user2user2user2FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae86bccf8 obj=default.rgw.meta:users.uid:Trino state=0x55b6577fae20 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj recalculating target 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj reading permissions 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj recalculating target 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj reading permissions 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj recalculating target 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj reading permissions 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s canonical headers format = amz-sdk-invocation-id:eb288112-f921-ecf0-93e4-ac45ac227eab amz-sdk-request:attempt=1;max=11 amz-sdk-retry:0/0/500 content-type:application/octet-stream host:s3-dwh-lab range:bytes=4-1242779 user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20230524T183012Z 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj recalculating target 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj reading permissions 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s payload request hash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae87bfad0 obj=prod-ods-work:ad_items_records/full.51735/out_76_0.parquet state=0x55b6b03f19e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj WARNING: blocking librados call 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae85bbad0 obj=prod-ods-work:ad_items_records/full.51735/out_134_0.parquet state=0x55b6cb510de8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj WARNING: blocking librados call 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s canonical request = GET /prod-ods-work/ad_items_records/full.51735/out_59_0.parquet amz-sdk-invocation-id:eb288112-f921-ecf0-93e4-ac45ac227eab amz-sdk-request:attempt=1;max=11 amz-sdk-retry:0/0/500 content-type:application/octet-stream host:s3-dwh-lab range:bytes=4-1242779 user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20230524T183012Z amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s canonical request hash = d549534f241a5770e73a7d802ba7ba7268bd77bd510842d4fa2629a867573ddc 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s string to sign = AWS4-HMAC-SHA256 20230524T183012Z 20230524/dwh-lab/s3/aws4_request d549534f241a5770e73a7d802ba7ba7268bd77bd510842d4fa2629a867573ddc 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae873ead0 obj=prod-ods-work:ad_items_records/full.51735/out_60_0.parquet state=0x55b6c8dfe1e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj WARNING: blocking librados call 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae86bdad0 obj=prod-ods-work:ad_items_records/full.51735/out_77_0.parquet state=0x55b6bd54a5e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj WARNING: blocking librados call 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s generated signature = bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7 2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256 20230524T183012Z 20230524/dwh-lab/s3/aws4_request d549534f241a5770e73a7d802ba7ba7268bd77bd510842d4fa2629a867573ddc 2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj server signature=bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7 2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj client signature=bf7af0f202145a2791b7d6099396158da7dd20a7b8224057e94d9d459c7f22e7 2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj compare=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access 2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj normalizing buckets and tenants 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s->object=ad_items_records/full.51735/out_59_0.parquet s->bucket=prod-ods-work 2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj init permissions 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae8861200 obj=default.rgw.meta:root:prod-ods-work state=0x55b67cc7f960 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 15 req 7329681834020888642 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser2user2user2user2FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj manifest: total_size = 1214308 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337634.9564975436449649728 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae8860cf8 obj=default.rgw.meta:users.uid:Trino state=0x55b67cc7f960 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b4f931700 10 req 7329681834020888642 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b3c10a700 15 req 7853848101899647239 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser1user1user1user1FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj init op 2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj manifest: total_size = 1194579 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337664.17379721212291051974 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae873e488 obj=default.rgw.meta:users.uid:user2 state=0x55b657fb9ba0 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b5513c700 15 req 3750175572355161715 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser1user1user1user1FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj init op 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b3c10a700 10 req 7853848101899647239 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae87bf488 obj=default.rgw.meta:users.uid:user2 state=0x55b6b04a4e20 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b5513c700 10 req 3750175572355161715 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj verifying op mask 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj verifying op permissions 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj verifying op mask 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj verifying op permissions 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj verifying op params 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj pre-executing 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj check rate limiting 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj verifying op params 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj pre-executing 2023-05-24T18:30:12.612+0000 7f9b5513c700 2 req 3750175572355161715 0.000000000s s3:get_obj executing 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj check rate limiting 2023-05-24T18:30:12.612+0000 7f9b3c10a700 2 req 7853848101899647239 0.000000000s s3:get_obj executing 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae87bfad0 obj=prod-ods-work:ad_items_records/full.51735/out_76_0.parquet state=0x55b6b03f19e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae873ead0 obj=prod-ods-work:ad_items_records/full.51735/out_60_0.parquet state=0x55b6c8dfe1e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length 2023-05-24T18:30:12.612+0000 7f9b5513c700 15 req 3750175572355161715 0.000000000s Encryption mode: 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae87bfad0 obj=prod-ods-work:ad_items_records/full.51735/out_76_0.parquet state=0x55b6b03f19e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl 2023-05-24T18:30:12.612+0000 7f9b5513c700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver 2023-05-24T18:30:12.612+0000 7f9b5513c700 20 req 3750175572355161715 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet obj-ofs=4 read_ofs=4 len=1188934 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj manifest: total_size = 1208444 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337634.12111259888233767509 2023-05-24T18:30:12.612+0000 7f9b3c10a700 15 req 7853848101899647239 0.000000000s Encryption mode: 2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser1user1user1user1FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj init op 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae873ead0 obj=prod-ods-work:ad_items_records/full.51735/out_60_0.parquet state=0x55b6c8dfe1e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae85bb488 obj=default.rgw.meta:users.uid:user2 state=0x55b838689960 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b3c10a700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b3c10a700 20 req 7853848101899647239 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_60_0.parquet obj-ofs=4 read_ofs=4 len=1209113 2023-05-24T18:30:12.612+0000 7f9b39104700 10 req 17765580082178875006 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj recalculating target 2023-05-24T18:30:12.612+0000 7f9b4f931700 2 req 7329681834020888642 0.000000000s s3:get_obj reading permissions 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj verifying op mask 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj verifying op permissions 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj verifying op params 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj pre-executing 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj check rate limiting 2023-05-24T18:30:12.612+0000 7f9b39104700 2 req 17765580082178875006 0.000000000s s3:get_obj executing 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae85bbad0 obj=prod-ods-work:ad_items_records/full.51735/out_134_0.parquet state=0x55b6cb510de8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length 2023-05-24T18:30:12.612+0000 7f9b39104700 15 req 17765580082178875006 0.000000000s Encryption mode: 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae85bbad0 obj=prod-ods-work:ad_items_records/full.51735/out_134_0.parquet state=0x55b6cb510de8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b39104700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1 2023-05-24T18:30:12.612+0000 7f9b39104700 20 req 17765580082178875006 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_134_0.parquet obj-ofs=4 read_ofs=4 len=1202107 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae8861ad0 obj=prod-ods-work:ad_items_records/full.51735/out_59_0.parquet state=0x55b659deb9e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b4f931700 20 req 7329681834020888642 0.000000000s s3:get_obj WARNING: blocking librados call 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj manifest: total_size = 1211490 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109337664.8246275765501030898 2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser1user1user1user1FULL_CONTROL 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj init op 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae86bd488 obj=default.rgw.meta:users.uid:user2 state=0x55b6577fae20 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b73979700 10 req 14292280422533198756 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj verifying op mask 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj required_mask= 1 user.op_mask=7 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj verifying op permissions 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj verifying op params 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj pre-executing 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj check rate limiting 2023-05-24T18:30:12.612+0000 7f9b73979700 2 req 14292280422533198756 0.000000000s s3:get_obj executing 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae86bdad0 obj=prod-ods-work:ad_items_records/full.51735/out_77_0.parquet state=0x55b6bd54a5e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.acl 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.content_type 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.etag 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.idtag 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.manifest 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length 2023-05-24T18:30:12.612+0000 7f9b73979700 15 req 14292280422533198756 0.000000000s Encryption mode: 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae86bdad0 obj=prod-ods-work:ad_items_records/full.51735/out_77_0.parquet state=0x55b6bd54a5e8 s->prefetch_data=0 2023-05-24T18:30:12.612+0000 7f9b73979700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1 2023-05-24T18:30:12.612+0000 7f9b73979700 20 req 14292280422533198756 0.000000000s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_77_0.parquet obj-ofs=4 read_ofs=4 len=1206327 2023-05-24T18:30:12.616+0000 7f9b4f931700 10 req 7329681834020888642 0.004000066s s3:get_obj manifest: total_size = 1247553 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109344318.11121045277499360749 2023-05-24T18:30:12.616+0000 7f9b4f931700 15 req 7329681834020888642 0.004000066s s3:get_obj decode_policy Read AccessControlPolicyuser1user1user1user1FULL_CONTROL 2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj init op 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_system_obj_state: rctx=0x7f9ae8861488 obj=default.rgw.meta:users.uid:user2 state=0x55b709995720 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9b4f931700 10 req 7329681834020888642 0.004000066s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.616+0000 7f9b4f931700 10 req 7329681834020888642 0.004000066s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj verifying op mask 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj required_mask= 1 user.op_mask=7 2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj verifying op permissions 2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj verifying op params 2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj pre-executing 2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj check rate limiting 2023-05-24T18:30:12.616+0000 7f9b4f931700 2 req 7329681834020888642 0.004000066s s3:get_obj executing 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_obj_state: rctx=0x7f9ae8861ad0 obj=prod-ods-work:ad_items_records/full.51735/out_59_0.parquet state=0x55b659deb9e8 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.acl 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.content_type 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.etag 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.idtag 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.manifest 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length 2023-05-24T18:30:12.616+0000 7f9b4f931700 15 req 7329681834020888642 0.004000066s Encryption mode: 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj get_obj_state: rctx=0x7f9ae8861ad0 obj=prod-ods-work:ad_items_records/full.51735/out_59_0.parquet state=0x55b659deb9e8 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9b4f931700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1 2023-05-24T18:30:12.616+0000 7f9b4f931700 20 req 7329681834020888642 0.004000066s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet obj-ofs=4 read_ofs=4 len=1242776 2023-05-24T18:30:12.616+0000 7f9bb9a05700 10 D3nDataCache: flush(): bl.length <= rgw_get_obj_max_req_size (default 4MB) - write to datacache, bl.length=16448 2023-05-24T18:30:12.616+0000 7f9bb9a05700 10 D3nDataCache::put(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet, len=16448 2023-05-24T18:30:12.616+0000 7f9bb9a05700 20 D3nDataCache: Before eviction _free_data_cache_size:100632677312, _outstanding_write_size:0, freed_size:0 2023-05-24T18:30:12.616+0000 7f9bb9a05700 30 D3nDataCache: d3n_libaio_create_write_request(): Write To Cache, oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet, len=16448 2023-05-24T18:30:12.616+0000 7f9bb9a05700 20 D3nDataCache: d3n_prepare_libaio_write_op(): Write To Cache, location=/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet 2023-05-24T18:30:12.616+0000 7f9bb9a05700 0 ERROR: D3nCacheAioWriteRequest::create_io: open file failed, errno=2, location='/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_142_0.parquet' 2023-05-24T18:30:12.616+0000 7f9bb9a05700 0 ERROR: D3nDataCache: d3n_libaio_create_write_request() prepare libaio write op r=-1 2023-05-24T18:30:12.616+0000 7f9bb9a05700 1 D3nDataCache: create_aio_write_request fail, r=-1 2023-05-24T18:30:12.616+0000 7f9bb9a05700 2 req 17250614352638959360 0.016000265s s3:get_obj completing 2023-05-24T18:30:12.616+0000 7f9bb9a05700 20 req 17250614352638959360 0.016000265s get_system_obj_state: rctx=0x7f9ae853a7c0 obj=default.rgw.log:script.postrequest. state=0x55b6cab6e9a0 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9bb9a05700 10 req 17250614352638959360 0.016000265s cache get: name=default.rgw.log++script.postrequest. : hit (negative entry) 2023-05-24T18:30:12.616+0000 7f9bb9a05700 2 req 17250614352638959360 0.016000265s s3:get_obj op status=0 2023-05-24T18:30:12.616+0000 7f9bb9a05700 2 req 17250614352638959360 0.016000265s s3:get_obj http status=206 2023-05-24T18:30:12.616+0000 7f9bb9a05700 1 ====== req done req=0x7f9ae853b730 op status=0 http_status=206 latency=0.016000265s ====== 2023-05-24T18:30:12.616+0000 7f9bb9a05700 1 beast: 0x7f9ae853b730: 10.208.80.16 - Trino [24/May/2023:18:30:12.600 +0000] "GET /prod-ods-work/ad_items_records/full.51735/out_142_0.parquet HTTP/1.1" 206 16448 - ", aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino" bytes=1236059-9223372036854775806 latency=0.016000265s 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 CONTENT_LENGTH=0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 CONTENT_TYPE=application/octet-stream 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AMZ_SDK_INVOCATION_ID=45e97df7-ad37-79aa-f196-d156e323dc42 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AMZ_SDK_REQUEST=attempt=1;max=11 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AMZ_SDK_RETRY=0/0/500 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_AUTHORIZATION=AWS4-HMAC-SHA256 Credential=99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date, Signature=056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_CONNECTION=Keep-Alive 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_HOST=s3-dwh-lab 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_RANGE=bytes=4-1164510 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_USER_AGENT=, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_VERSION=1.1 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_X_AMZ_CONTENT_SHA256=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 HTTP_X_AMZ_DATE=20230524T183012Z 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 REMOTE_ADDR=10.208.80.16 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 REQUEST_METHOD=GET 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 REQUEST_URI=/prod-ods-work/ad_items_records/full.51735/out_48_0.parquet 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 SCRIPT_URI=/prod-ods-work/ad_items_records/full.51735/out_48_0.parquet 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 SERVER_PORT=80 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 1 ====== starting new request req=0x7f9ae853b730 ===== 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s initializing for trans_id = tx0000042fa6d3402467854-00646e57b4-5b6e2b2-first 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s rgw api priority: s3=8 s3website=7 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s host=s3-dwh-lab 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s final domain/bucket subdomain= domain= in_hosted_domain=0 in_hosted_domain_s3website=0 s->info.domain= s->info.request_uri=/prod-ods-work/ad_items_records/full.51735/out_48_0.parquet 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s meta>> HTTP_X_AMZ_CONTENT_SHA256 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s meta>> HTTP_X_AMZ_DATE 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s x>> x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s x>> x-amz-date:20230524T183012Z 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s get_handler handler=22RGWHandler_REST_Obj_S3 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s handler=22RGWHandler_REST_Obj_S3 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s getting op 0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s get_system_obj_state: rctx=0x7f9ae853a7c0 obj=default.rgw.log:script.prerequest. state=0x55b67f7a6e20 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s cache get: name=default.rgw.log++script.prerequest. : hit (negative entry) 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj scheduling with throttler client=2 cost=1 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj op=21RGWGetObj_ObjStore_S3 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj verifying requester 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::StrategyRegistry::s3_main_strategy_t: trying rgw::auth::s3::AWSAuthStrategy 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::S3AnonymousEngine 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::S3AnonymousEngine denied with reason=-1 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy: trying rgw::auth::s3::LocalEngine 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s v4 signature format = 056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s v4 credential format = 99III557UP8H1N2WM9RZ/20230524/dwh-lab/s3/aws4_request 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s access key id = 99III557UP8H1N2WM9RZ 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s credential scope = 20230524/dwh-lab/s3/aws4_request 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s canonical headers format = amz-sdk-invocation-id:45e97df7-ad37-79aa-f196-d156e323dc42 amz-sdk-request:attempt=1;max=11 amz-sdk-retry:0/0/500 content-type:application/octet-stream host:s3-dwh-lab range:bytes=4-1164510 user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20230524T183012Z 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s payload request hash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s canonical request = GET /prod-ods-work/ad_items_records/full.51735/out_48_0.parquet amz-sdk-invocation-id:45e97df7-ad37-79aa-f196-d156e323dc42 amz-sdk-request:attempt=1;max=11 amz-sdk-retry:0/0/500 content-type:application/octet-stream host:s3-dwh-lab range:bytes=4-1164510 user-agent:, aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date:20230524T183012Z amz-sdk-invocation-id;amz-sdk-request;amz-sdk-retry;content-type;host;range;user-agent;x-amz-content-sha256;x-amz-date e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s canonical request hash = 329be98a0e6840ef4fd1bedb0def38e8c1e09e2740eff86a8ec0a8c5590067e3 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s string to sign = AWS4-HMAC-SHA256 20230524T183012Z 20230524/dwh-lab/s3/aws4_request 329be98a0e6840ef4fd1bedb0def38e8c1e09e2740eff86a8ec0a8c5590067e3 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s date_k = 24902eca368d019a396ead451a29cf6c727b932c85ae5142bc4cc533f634fff1 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s region_k = eda3961638cbe65843455771008fd0f0bc3f16629759caa55ce1f9c17042c82b 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s service_k = 67333e1c76ccbd169ea01160607cd20b1f6dc1846b6892e472e65b02a396b7eb 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s signing_k = 388ffc4194d4a931cc01c4e22c3392cad7788038068cd773fabeb2e73c885a26 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s generated signature = 056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj string_to_sign=AWS4-HMAC-SHA256 20230524T183012Z 20230524/dwh-lab/s3/aws4_request 329be98a0e6840ef4fd1bedb0def38e8c1e09e2740eff86a8ec0a8c5590067e3 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj server signature=056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj client signature=056fb2b3edda0d1c9f007fc0825a5495a02877dc5d20e57a67c377da5fc069fb 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj compare=0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::LocalEngine granted access 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj rgw::auth::s3::AWSAuthStrategy granted access 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj normalizing buckets and tenants 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s->object=ad_items_records/full.51735/out_48_0.parquet s->bucket=prod-ods-work 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj init permissions 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae853a200 obj=default.rgw.meta:root:prod-ods-work state=0x55b67f7a6e20 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+root+prod-ods-work : hit (requested=0x11, cached=0x17) 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 15 req 4826290020824807508 0.000000000s s3:get_obj decode_policy Read AccessControlPolicyuser2user2user2user2FULL_CONTROL 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: rctx=0x7f9ae8539cf8 obj=default.rgw.meta:users.uid:Trino state=0x55b67f7a6e20 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 10 req 4826290020824807508 0.000000000s s3:get_obj cache get: name=default.rgw.meta+users.uid+Trino : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj recalculating target 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 2 req 4826290020824807508 0.000000000s s3:get_obj reading permissions 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj get_obj_state: rctx=0x7f9ae853aad0 obj=prod-ods-work:ad_items_records/full.51735/out_48_0.parquet state=0x55b6c5940de8 s->prefetch_data=0 2023-05-24T18:30:12.616+0000 7f9b2f0f0700 20 req 4826290020824807508 0.000000000s s3:get_obj WARNING: blocking librados call 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 10 req 4826290020824807508 0.004000067s s3:get_obj manifest: total_size = 1169382 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_obj_state: setting s->obj_tag to 2804fdd4-5ce0-4803-9588-5b622abc0ae2.109329617.4491066039763630892 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 15 req 4826290020824807508 0.004000067s s3:get_obj decode_policy Read AccessControlPolicyuser1user1user1user1FULL_CONTROL 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj init op 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_system_obj_state: rctx=0x7f9ae853a488 obj=default.rgw.meta:users.uid:user2 state=0x55b65c8d8520 s->prefetch_data=0 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 10 req 4826290020824807508 0.004000067s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x16, cached=0x17) 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_system_obj_state: s->obj_tag was set empty 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr: user.rgw.idtag 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 10 req 4826290020824807508 0.004000067s s3:get_obj cache get: name=default.rgw.meta+users.uid+user2 : hit (requested=0x13, cached=0x17) 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj verifying op mask 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj required_mask= 1 user.op_mask=7 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj verifying op permissions 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj verifying op params 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj pre-executing 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj check rate limiting 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 2 req 4826290020824807508 0.004000067s s3:get_obj executing 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_obj_state: rctx=0x7f9ae853aad0 obj=prod-ods-work:ad_items_records/full.51735/out_48_0.parquet state=0x55b6c5940de8 s->prefetch_data=0 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.acl 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.content_type 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.etag 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.idtag 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.manifest 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.pg_ver 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.source_zone 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.tail_tag 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-content-sha256 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-date 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj Read xattr rgw_rados: user.rgw.x-amz-decoded-content-length 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 15 req 4826290020824807508 0.004000067s Encryption mode: 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj get_obj_state: rctx=0x7f9ae853aad0 obj=prod-ods-work:ad_items_records/full.51735/out_48_0.parquet state=0x55b6c5940de8 s->prefetch_data=0 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 30 D3nDataCache::get_obj_iterate_cb(): is head object : 1 2023-05-24T18:30:12.620+0000 7f9b2f0f0700 20 req 4826290020824807508 0.004000067s s3:get_obj D3nDataCache::get_obj_iterate_cb(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_48_0.parquet obj-ofs=4 read_ofs=4 len=1164507 2023-05-24T18:30:12.632+0000 7f9b5c14a700 10 D3nDataCache: flush(): bl.length <= rgw_get_obj_max_req_size (default 4MB) - write to datacache, bl.length=1242776 2023-05-24T18:30:12.632+0000 7f9b5c14a700 10 D3nDataCache::put(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet, len=1242776 2023-05-24T18:30:12.632+0000 7f9b5c14a700 20 D3nDataCache: Before eviction _free_data_cache_size:100632677312, _outstanding_write_size:0, freed_size:0 2023-05-24T18:30:12.632+0000 7f9b5c14a700 30 D3nDataCache: d3n_libaio_create_write_request(): Write To Cache, oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet, len=1242776 2023-05-24T18:30:12.632+0000 7f9b5c14a700 20 D3nDataCache: d3n_prepare_libaio_write_op(): Write To Cache, location=/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet 2023-05-24T18:30:12.632+0000 7f9b5c14a700 0 ERROR: D3nCacheAioWriteRequest::create_io: open file failed, errno=2, location='/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_59_0.parquet' 2023-05-24T18:30:12.632+0000 7f9b5c14a700 0 ERROR: D3nDataCache: d3n_libaio_create_write_request() prepare libaio write op r=-1 2023-05-24T18:30:12.632+0000 7f9b5c14a700 1 D3nDataCache: create_aio_write_request fail, r=-1 2023-05-24T18:30:12.632+0000 7f9b5c14a700 2 req 7329681834020888642 0.020000331s s3:get_obj completing 2023-05-24T18:30:12.632+0000 7f9b5c14a700 20 req 7329681834020888642 0.020000331s get_system_obj_state: rctx=0x7f9ae88617c0 obj=default.rgw.log:script.postrequest. state=0x55b6dbc0c520 s->prefetch_data=0 2023-05-24T18:30:12.632+0000 7f9b5c14a700 10 req 7329681834020888642 0.020000331s cache get: name=default.rgw.log++script.postrequest. : hit (negative entry) 2023-05-24T18:30:12.632+0000 7f9b5c14a700 2 req 7329681834020888642 0.020000331s s3:get_obj op status=0 2023-05-24T18:30:12.632+0000 7f9b5c14a700 2 req 7329681834020888642 0.020000331s s3:get_obj http status=206 2023-05-24T18:30:12.632+0000 7f9b5c14a700 1 ====== req done req=0x7f9ae8862730 op status=0 http_status=206 latency=0.020000331s ====== 2023-05-24T18:30:12.632+0000 7f9b5c14a700 1 beast: 0x7f9ae8862730: 10.208.80.16 - Trino [24/May/2023:18:30:12.612 +0000] "GET /prod-ods-work/ad_items_records/full.51735/out_59_0.parquet HTTP/1.1" 206 1242776 - ", aws-sdk-java/1.12.261 Linux/3.10.0-1160.49.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/17.0.6+10 java/17.0.6 vendor/Eclipse_Adoptium cfg/retry-mode/legacy, Trino" bytes=4-1242779 latency=0.020000331s 2023-05-24T18:30:12.632+0000 7f9b939b9700 10 D3nDataCache: flush(): bl.length <= rgw_get_obj_max_req_size (default 4MB) - write to datacache, bl.length=1188934 2023-05-24T18:30:12.632+0000 7f9b939b9700 10 D3nDataCache::put(): oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet, len=1188934 2023-05-24T18:30:12.632+0000 7f9b939b9700 20 D3nDataCache: Before eviction _free_data_cache_size:100632677312, _outstanding_write_size:0, freed_size:0 2023-05-24T18:30:12.632+0000 7f9b939b9700 30 D3nDataCache: d3n_libaio_create_write_request(): Write To Cache, oid=2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet, len=1188934 2023-05-24T18:30:12.632+0000 7f9b939b9700 20 D3nDataCache: d3n_prepare_libaio_write_op(): Write To Cache, location=/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet 2023-05-24T18:30:12.632+0000 7f9b939b9700 0 ERROR: D3nCacheAioWriteRequest::create_io: open file failed, errno=2, location='/rgw-cache/2804fdd4-5ce0-4803-9588-5b622abc0ae2.10376607.13_ad_items_records/full.51735/out_76_0.parquet' 2023-05-24T18:30:12.632+0000 7f9b939b9700 0 ERROR: D3nDataCache: d3n_libaio_create_write_request() prepare libaio write op r=-1 2023-05-24T18:30:12.632+0000 7f9b939b9700 1 D3nDataCache: create_aio_write_request fail, r=-1