rgw: test suite times out
We have seen a number of instances where the s3-tests test suite (running via jenkins) does not complete after 20 minutes. The rgw/apache logs show that we stop receiving requests from the test suite after a few minutes (3-5). Up until that moment all requests seem to be handled ok, and there's no clear failure. This has been witnessed only on benjamin.
I've set another client to send a requests to benjamin every few seconds, and didn't find any correlating failures. At the time the jenkins run stopped, the second client continued its operation successfully (and we can also see that in the apache logs).
- networking issue (jenkins <-> benjamin)
- bad data that is returned from rgw causes the test suite to hang
- bug in the test suite
We need more information. Specifically we'd like to have a look at the running test process when this issue happens.