Project

General

Profile

Actions

Bug #36092

closed

Radosgw elastic search sync module not working properly (all result same)

Added by hoan nv over 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
High
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
mimic luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Hi all.

Currently, i create a zone with elasticsearch tier.

My radosgw log

2018-09-19 14:45:00.281 7f5b8272b700 15 decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>hoannv</I
D><DisplayName>hoannv</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>hoannv
</ID><DisplayName>hoannv</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000333:s3:GET /hoannv-test/:metadata_search:recalculating target
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000340:s3:GET /hoannv-test/:metadata_search:reading permissions
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000342:s3:GET /hoannv-test/:metadata_search:init op
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000343:s3:GET /hoannv-test/:metadata_search:verifying op mask
2018-09-19 14:45:00.281 7f5b8272b700 20 required_mask= 1 user.op_mask=7
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000345:s3:GET /hoannv-test/:metadata_search:verifying op permissions
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000346:s3:GET /hoannv-test/:metadata_search:verifying op params
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000347:s3:GET /hoannv-test/:metadata_search:pre-executing
2018-09-19 14:45:00.281 7f5b8272b700  2 req 3:0.000348:s3:GET /hoannv-test/:metadata_search:executing
2018-09-19 14:45:00.281 7f5b8272b700 20 sending request to elasticsearch, payload={"query":{"bool":{"must":[{"term":{"bucket":"hoannv-test"}},{"bool":{"must":[{"term":
{"permissions":"hoannv"}},{"term":{"name":"abc"}}]}}]}}}
2018-09-19 14:45:00.281 7f5b8272b700 20 sending request to http://10.5.8.176:9200/rgw-ss-realm-a9f0523f/_search?size=100
2018-09-19 14:45:00.281 7f5b8272b700 20 register_request mgr=0x563b55f92000 req_data->id=4, curl_handle=0x563b564bad00
2018-09-19 14:45:00.281 7f5ba2171700 20 link_request req_data=0x563b565a2d80 req_data->id=4, curl_handle=0x563b564bad00
2018-09-19 14:45:00.293 7f5ba2171700 10 receive_http_header
2018-09-19 14:45:00.293 7f5ba2171700 10 received header:HTTP/1.1 200 OK
2018-09-19 14:45:00.293 7f5ba2171700 10 receive_http_header
2018-09-19 14:45:00.293 7f5ba2171700 10 received header:access-control-allow-credentials: true
2018-09-19 14:45:00.293 7f5ba2171700 10 receive_http_header
2018-09-19 14:45:00.293 7f5ba2171700 10 received header:content-type: application/json; charset=UTF-8
2018-09-19 14:45:00.293 7f5ba2171700 10 receive_http_header
2018-09-19 14:45:00.293 7f5ba2171700 10 received header:content-length: 1198
2018-09-19 14:45:00.293 7f5ba2171700 10 receive_http_header
2018-09-19 14:45:00.293 7f5ba2171700 10 received header:
2018-09-19 14:45:00.293 7f5b8272b700 20 response: {"took":7,"timed_out":false,"_shards":{"total":10,"successful":10,"skipped":0,"failed":0},"hits":{"total":2,"max_scor
e":1.0,"hits":[{"_index":"rgw-ss-realm-a9f0523f","_type":"object","_id":"6df1b9b2-cf4d-425e-b30d-9f37dd58d615.24821.2%3Afoo%3AYVFOWWDceKspKX8EAa9eyuwZghW5X2X","_score" 
:1.0,"_source":{"bucket":"hoannv-test","name":"foo","instance":"YVFOWWDceKspKX8EAa9eyuwZghW5X2X","versioned_epoch":2,"owner":{"id":"hoannv","display_name":"hoannv"},"p
ermissions":["hoannv"],"meta":{"size":47,"mtime":"2018-09-19T02:53:25.973Z","content_type":"text/plain","etag":"0a278abf92bcfe8ecb645f463f3f218","tail_tag":"6df1b9b2-c
f4d-425e-b30d-9f37dd58d615.26307.1205368"}}},{"_index":"rgw-ss-realm-a9f0523f","_type":"object","_id":"6df1b9b2-cf4d-425e-b30d-9f37dd58d615.24821.2%3Afoo1%3AUzoRWOircq
w4CKawvO4Wm-GmrwAmkJz","_score":1.0,"_source":{"bucket":"hoannv-test","name":"foo1","instance":"UzoRWOircqw4CKawvO4Wm-GmrwAmkJz","versioned_epoch":2,"owner":{"id":"hoa
nnv","display_name":"hoannv"},"permissions":["hoannv"],"meta":{"size":47,"mtime":"2018-09-19T07:19:34.978Z","content_type":"text/plain","etag":"0a278abf92bcfe8ecb645f4
63f3f218","tail_tag":"6df1b9b2-cf4d-425e-b30d-9f37dd58d615.26307.1362851"}}}]}}

I see this log call a request to

http://10.5.8.176:9200/rgw-ss-realm-a9f0523f/_search?size=100 has payload

 {"query":{"bool":{"must":[{"term":{"bucket":"hoannv-test"}},{"bool":{"must":[{"term":{"permissions":"hoannv"}},{"term":{"name":"abc"}}]}}]}}}

I use curl to create a request to this endpoint.

curl -XGET 'http://10.5.8.176:9200/rgw-ss-realm-a9f0523f/_search?size=100' -d '{"query":{"bool":{"must":[{"term":{"bucket":"hoannv-test"}},{"bool":{"must":[{"term":{"permissions":"hoannv"}},{"term":{"name":"foo1"}}]}}]}}}'

{"took":4,"timed_out":false,"_shards":{"total":10,"successful":10,"skipped":0,"failed":0},"hits":{"total":1,"max_score":0.8630463,"hits":[{"_index":"rgw-ss-realm-a9f0523f","_type":"object","_id":"6df1b9b2-cf4d-425e-b30d-9f37dd58d615.24821.2%3Afoo1%3AUzoRWOircqw4CKawvO4Wm-GmrwAmkJz","_score":0.8630463,"_source":{"bucket":"hoannv-test","name":"foo1","instance":"UzoRWOircqw4CKawvO4Wm-GmrwAmkJz","versioned_epoch":2,"owner":{"id":"hoannv","display_name":"hoannv"},"permissions":["hoannv"],"meta":{"size":47,"mtime":"2018-09-19T07:19:34.978Z","content_type":"text/plain","etag":"0a278abf92bcfe8ecb645f463f3f218","tail_tag":"6df1b9b2-cf4d-425e-b30d-9f37dd58d615.26307.1362851"}}}]}}

Result of this query not same result of radosgw log. I tested the result always all

Thanks


Related issues 2 (0 open2 closed)

Copied to rgw - Backport #38194: mimic: Radosgw elastic search sync module not working properly (all result same)ResolvedYehuda SadehActions
Copied to rgw - Backport #38694: luminous: Radosgw elastic search sync module not working properly (all result same)ResolvedYehuda SadehActions
Actions

Also available in: Atom PDF