Actions
Bug #17822
closedmultisite requests failing with '400 Bad Request' with civetweb 1.8
Status:
Resolved
Priority:
High
Assignee:
-
Target version:
-
% Done:
0%
Source:
other
Tags:
Backport:
jewel
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
The multisite test script test/rgw/test_multi.py is getting stuck due to rejected requests. On the sending side:
2016-11-08 10:21:40.697972 7f3bb49f3700 20 cr:s=0x55f4a34ef570:op=0x55f4a363f500:17RGWFetchAllMetaCR: operate() 2016-11-08 10:21:40.697992 7f3bb49f3700 20 cr:s=0x55f4a3a3aa30:op=0x55f4a358f000:13RGWOmapAppend: operate() 2016-11-08 10:21:40.698009 7f3bb49f3700 20 cr:s=0x55f4a34ef570:op=0x55f4a3640300:21RGWReadRESTResourceCRINSt7__cxx114listINS0_12basic_stringIcSt11char_traitsIcESaIcEEESaIS6_EEEE: operate() 2016-11-08 10:21:40.698081 7f3bb49f3700 20 RGWEnv::set(): HTTP_DATE: Tue Nov 8 15:21:40 2016 2016-11-08 10:21:40.698088 7f3bb49f3700 20 > HTTP_DATE -> Tue Nov 8 15:21:40 2016 2016-11-08 10:21:40.698096 7f3bb49f3700 10 get_canon_resource(): dest=/admin/metadata 2016-11-08 10:21:40.698097 7f3bb49f3700 10 generated canonical header: GET 2016-11-08 10:21:40.698138 7f3bb49f3700 15 generated auth header: AWS MGOSXQZS645INJSF:V3r0yc7VaXSm49eKgo1Q+hcu4YA= 2016-11-08 10:21:40.698166 7f3bb49f3700 20 sending request to http://localhost:8000/admin/metadata?rgwx-zonegroup=c4f11fe7-d7b7-4079-b7aa-4c4afcc978d4 2016-11-08 10:21:40.698179 7f3bb49f3700 20 register_request mgr=0x55f4a348e558 req_data->id=1, easy_handle=0x55f4a3a7a000 2016-11-08 10:21:40.698189 7f3bb49f3700 20 run: stack=0x55f4a34ef570 is io blocked 2016-11-08 10:21:40.698200 7f3bb51f4700 20 link_request req_data=0x55f4a3746640 req_data->id=1, easy_handle=0x55f4a3a7a000 2016-11-08 10:21:40.698387 7f3bb51f4700 10 receive_http_header 2016-11-08 10:21:40.698393 7f3bb51f4700 10 received header:HTTP/1.1 400 Bad Request 2016-11-08 10:21:40.698424 7f3bb51f4700 10 receive_http_header 2016-11-08 10:21:40.698428 7f3bb51f4700 10 received header:Cache-Control: no-cache, no-store, must-revalidate, private, max-age=0 2016-11-08 10:21:40.698436 7f3bb51f4700 10 receive_http_header 2016-11-08 10:21:40.698436 7f3bb51f4700 10 received header:Pragma: no-cache 2016-11-08 10:21:40.698439 7f3bb51f4700 10 receive_http_header 2016-11-08 10:21:40.698440 7f3bb51f4700 10 received header:Expires: 0 2016-11-08 10:21:40.698443 7f3bb51f4700 10 receive_http_header 2016-11-08 10:21:40.698445 7f3bb51f4700 10 received header:Date: Tue, 08 Nov 2016 15:21:40 GMT 2016-11-08 10:21:40.698449 7f3bb51f4700 10 receive_http_header 2016-11-08 10:21:40.698451 7f3bb51f4700 10 received header:Connection: close 2016-11-08 10:21:40.698454 7f3bb51f4700 10 receive_http_header 2016-11-08 10:21:40.698455 7f3bb51f4700 10 received header: 2016-11-08 10:21:40.698529 7f3bb49f3700 20 cr:s=0x55f4a34ef570:op=0x55f4a3640300:21RGWReadRESTResourceCRINSt7__cxx114listINS0_12basic_stringIcSt11char_traitsIcESaIcEEESaIS6_EEEE: operate() 2016-11-08 10:21:40.698605 7f3bb49f3700 20 cr:s=0x55f4a34ef570:op=0x55f4a3640300:21RGWReadRESTResourceCRINSt7__cxx114listINS0_12basic_stringIcSt11char_traitsIcESaIcEEESaIS6_EEEE: operate() returned r=-22 2016-11-08 10:21:40.698615 7f3bb49f3700 20 cr:s=0x55f4a34ef570:op=0x55f4a363f500:17RGWFetchAllMetaCR: operate() 2016-11-08 10:21:40.698617 7f3bb49f3700 0 meta sync: ERROR: failed to fetch metadata sections
The receiving side's radosgw does not log anything about this request (no match for "admin/metadata").
After reverting the commit that updated civetweb to 1.8 (commit 3252c10a1523b9aa753fd4a88503eb5959b165f9), these requests succeed and the test_multi.py completes successfully.
Files
Actions