Project

General

Profile

Actions
Copy link

Bug #57128

closed

rgw: s3tests are failing with timeout

Added by Yuval Lifshitz over 1 year ago. Updated over 1 year ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

see: http://qa-proxy.ceph.com/teuthology/yuvalif-2022-08-14_16:17:39-rgw-wip-yuval-fix-lua-post-ctx-distro-default-smithi/6972445/teuthology.log
folowing tests:
  • s3tests_boto3.functional.test_s3.test_delete_tags_obj_public
  • s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id
  • s3tests_boto3.functional.test_s3.test_multipart_upload_on_a_bucket_with_policy
  • s3tests_boto3.functional.test_s3select.test_progress_expressions

all failing with:

botocore.exceptions.ReadTimeoutError: Read timeout on endpoint URL: "https://smithi088.front.sepia.ceph.com:443/test-client.0-3brqtosenfaanjd-436/testputtagsacl"

timeout failure is also seen in other runs:

Related issues 1 (0 open — 1 closed)

Is duplicate of rgw - Bug #56609: performance issues causing teuthology failures: RGWWatcher::handle_error (107) Transport endpoint is not connectedClosed

Actions
Actions
Copy link
 #1

Updated by Casey Bodley over 1 year ago

  • Is duplicate of Bug #56609: performance issues causing teuthology failures: RGWWatcher::handle_error (107) Transport endpoint is not connected added
Actions
Copy link
 #2

Updated by Casey Bodley over 1 year ago

  • Status changed from New to Duplicate

seeing the same long delays, correlated with 'Transport endpoint is not connected' errors, as https://tracker.ceph.com/issues/56609

2022-08-14T19:49:38.565 INFO:teuthology.orchestra.run.smithi088.stderr:s3tests_boto3.functional.test_s3select.test_bool_cast_expressions ... ok
2022-08-14T19:50:51.277 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:50:51.270+0000 186ed700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 278961200 err (107) Transport endpoint is not connected
2022-08-14T19:51:42.805 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:51:39.872+0000 186ed700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 590175552 err (107) Transport endpoint is not connected
2022-08-14T19:53:11.462 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:53:11.454+0000 17eec700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 590136128 err (107) Transport endpoint is not connected
2022-08-14T19:53:14.272 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:53:12.778+0000 17eec700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 5437917824 err (107) Transport endpoint is not connected
2022-08-14T19:53:14.273 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:53:12.778+0000 17eec700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 5420909520 err (107) Transport endpoint is not connected
2022-08-14T19:53:15.755 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:53:12.778+0000 17eec700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 5459152832 err (107) Transport endpoint is not connected
2022-08-14T19:53:17.232 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:53:14.276+0000 17eec700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 586954128 err (107) Transport endpoint is not connected
2022-08-14T19:53:27.362 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:53:26.206+0000 17eec700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 5456920704 err (107) Transport endpoint is not connected
2022-08-14T19:53:27.367 INFO:tasks.rgw.client.0.smithi088.stdout:2022-08-14T19:53:26.206+0000 17eec700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 1469980896 err (107) Transport endpoint is not connected
2022-08-14T19:57:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:s3tests_boto3.functional.test_s3select.test_progress_expressions ... ERROR

Actions
Copy link

Also available in: Atom PDF