Project

General

Profile

Actions

Bug #56609

closed

performance issues causing teuthology failures: RGWWatcher::handle_error (107) Transport endpoint is not connected

Added by Casey Bodley almost 2 years ago. Updated over 1 year ago.

Status:
Closed
Priority:
Urgent
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

some s3tests in teuthology are failing due to significant delays, including watch/notify dinnections:

2022-07-18T04:09:12.709 INFO:teuthology.orchestra.run.smithi117.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... ok
2022-07-18T04:13:05.070 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:05.016+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 539093392 err (107) Transport endpoint is not connected
2022-07-18T04:13:05.073 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:05.045+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 538935136 err (107) Transport endpoint is not connected
2022-07-18T04:13:05.074 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:05.050+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 5486698560 err (107) Transport endpoint is not connected
2022-07-18T04:13:05.076 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:05.051+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 765811392 err (107) Transport endpoint is not connected
2022-07-18T04:13:21.233 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:13.675+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 765769920 err (107) Transport endpoint is not connected
2022-07-18T04:13:21.234 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:13.675+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 539131760 err (107) Transport endpoint is not connected
2022-07-18T04:13:21.235 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:13.675+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 539052992 err (107) Transport endpoint is not connected
2022-07-18T04:13:21.236 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:13:13.676+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 297726304 err (107) Transport endpoint is not connected
2022-07-18T04:14:41.903 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:14:40.668+0000 1a623700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 5460315872 err (107) Transport endpoint is not connected
2022-07-18T04:14:41.937 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:14:41.934+0000 1a623700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 766699728 err (107) Transport endpoint is not connected
2022-07-18T04:14:41.938 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:14:41.934+0000 1a623700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 768581008 err (107) Transport endpoint is not connected
2022-07-18T04:14:41.939 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:14:41.934+0000 1a623700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 839848816 err (107) Transport endpoint is not connected
2022-07-18T04:14:41.985 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:14:41.975+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 5478414768 err (107) Transport endpoint is not connected
2022-07-18T04:14:41.986 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:14:41.975+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 292018432 err (107) Transport endpoint is not connected
2022-07-18T04:14:41.986 INFO:tasks.rgw.client.0.smithi117.stdout:2022-07-18T04:14:41.976+0000 1ae24700 -1 rgw watcher librados: RGWWatcher::handle_error cookie 535364960 err (107) Transport endpoint is not connected
2022-07-18T04:15:43.605 INFO:teuthology.orchestra.run.smithi117.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... ERROR

ex: http://qa-proxy.ceph.com/teuthology/mbenjamin-2022-07-17_22:24:15-rgw-wip-rgwlc-azone-distro-default-smithi/6935342/teuthology.log


Related issues 1 (0 open1 closed)

Has duplicate rgw - Bug #57128: rgw: s3tests are failing with timeoutDuplicate

Actions
Actions

Also available in: Atom PDF