Project

General

Profile

Actions

Bug #17882

closed

s3tests-test-readwrite failed in rados run (Connection refused)

Added by Kefu Chai over 7 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2016-11-13T05:17:51.639 INFO:teuthology.orchestra.run.smithi047:Running: 'python -c \'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))\' /home/ubuntu/ceph
test/archive/s3readwrite.client.0.config.yaml'
2016-11-13T05:17:51.751 DEBUG:teuthology.orchestra.remote:smithi047:/home/ubuntu/cephtest/archive/s3readwrite.client.0.config.yaml is 398B
2016-11-13T05:17:51.761 INFO:teuthology.orchestra.run.smithi047:Running: '/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite'
2016-11-13T05:17:51.992 INFO:teuthology.orchestra.run.smithi047.stderr:Using random seeds: {'writer': 2758126676, 'main': 4006936538, 'names': 4190759309, 'contents': 1839283049, 'reader': 1826822776}
2016-11-13T05:19:01.839 INFO:teuthology.orchestra.run.smithi047.stderr:Traceback (most recent call last):
2016-11-13T05:19:01.840 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite", line 11, in <module>
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:    load_entry_point('s3tests', 'console_scripts', 's3tests-test-readwrite')()
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/readwrite.py", line 165, in main
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:    bucket = conn.create_bucket(bucket_name)
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/connection.py", line 616, in create_bucket
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:    data=data)
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/connection.py", line 668, in make_request
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:    retry_handler=retry_handler
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:    retry_handler=retry_handler)
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 1030, in _mexe
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:    raise ex
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:socket.error: [Errno 111] Connection refused
2016-11-13T05:19:01.860 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 30, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_wip-vive-la-libcephfs-devel/tasks/s3readwrite.py", line 229, in run_tests
    stdin=conf,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 192, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 403, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 166, in wait
    label=self.label)
CommandFailedError: Command failed on smithi047 with status 1: '/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite'

http://pulpito.ceph.com/kchai-2016-11-13_05:09:22-rados-wip-kefu-testing---basic-smithi/544075/


Related issues 1 (0 open1 closed)

Copied to rgw - Backport #40450: nautilus: s3tests-test-readwrite failed in rados run (Connection refused)ResolvedNathan CutlerActions
Actions #1

Updated by Kefu Chai almost 5 years ago

2019-06-11T02:37:45.746 INFO:teuthology.orchestra.run.smithi083.stderr:Traceback (most recent call last):
2019-06-11T02:37:45.746 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite", line 11, in <module>
2019-06-11T02:37:45.746 INFO:teuthology.orchestra.run.smithi083.stderr:    load_entry_point('s3tests', 'console_scripts', 's3tests-test-readwrite')()
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/readwrite.py", line 165, in main
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:    bucket = conn.create_bucket(bucket_name)
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/s3/connection.py", line 619, in create_bucket
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:    data=data)
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/s3/connection.py", line 671, in make_request
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:    retry_handler=retry_handler
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request
2019-06-11T02:37:45.748 INFO:teuthology.orchestra.run.smithi083.stderr:    retry_handler=retry_handler)
2019-06-11T02:37:45.748 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/connection.py", line 1030, in _mexe
2019-06-11T02:37:45.749 INFO:teuthology.orchestra.run.smithi083.stderr:    raise ex
2019-06-11T02:37:45.749 INFO:teuthology.orchestra.run.smithi083.stderr:socket.error: [Errno 111] Connection refused

/a/kchai-2019-06-11_01:51:33-rados-wip-kefu-testing-2019-06-09-0009-distro-basic-smithi/4021061

Actions #2

Updated by Kefu Chai almost 5 years ago

  • Assignee deleted (Matt Benjamin)
Actions #3

Updated by Kefu Chai almost 5 years ago

  • Priority changed from Normal to Urgent

/a/kchai-2019-06-14_03:33:14-rados-wip-kefu-testing-2019-06-12-0017-distro-basic-smithi/4030532/

make it urgent, as it can be consistently reproduced.

Actions #4

Updated by Casey Bodley almost 5 years ago

  • Status changed from New to 7
  • Pull request ID set to 28631
Actions #5

Updated by Casey Bodley almost 5 years ago

  • Status changed from 7 to Pending Backport
  • Backport set to nautilus
Actions #6

Updated by Nathan Cutler almost 5 years ago

  • Copied to Backport #40450: nautilus: s3tests-test-readwrite failed in rados run (Connection refused) added
Actions #7

Updated by Nathan Cutler over 4 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved".

Actions

Also available in: Atom PDF