Project

General

Profile

Bug #17882

s3tests-test-readwrite failed in rados run (Connection refused)

Added by Kefu Chai almost 3 years ago. Updated 23 days ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Target version:
-
Start date:
11/13/2016
Due date:
% Done:

0%

Source:
Tags:
Backport:
nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:

Description

2016-11-13T05:17:51.639 INFO:teuthology.orchestra.run.smithi047:Running: 'python -c \'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))\' /home/ubuntu/ceph
test/archive/s3readwrite.client.0.config.yaml'
2016-11-13T05:17:51.751 DEBUG:teuthology.orchestra.remote:smithi047:/home/ubuntu/cephtest/archive/s3readwrite.client.0.config.yaml is 398B
2016-11-13T05:17:51.761 INFO:teuthology.orchestra.run.smithi047:Running: '/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite'
2016-11-13T05:17:51.992 INFO:teuthology.orchestra.run.smithi047.stderr:Using random seeds: {'writer': 2758126676, 'main': 4006936538, 'names': 4190759309, 'contents': 1839283049, 'reader': 1826822776}
2016-11-13T05:19:01.839 INFO:teuthology.orchestra.run.smithi047.stderr:Traceback (most recent call last):
2016-11-13T05:19:01.840 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite", line 11, in <module>
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:    load_entry_point('s3tests', 'console_scripts', 's3tests-test-readwrite')()
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/readwrite.py", line 165, in main
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:    bucket = conn.create_bucket(bucket_name)
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/connection.py", line 616, in create_bucket
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:    data=data)
2016-11-13T05:19:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/connection.py", line 668, in make_request
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:    retry_handler=retry_handler
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:    retry_handler=retry_handler)
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/connection.py", line 1030, in _mexe
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:    raise ex
2016-11-13T05:19:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:socket.error: [Errno 111] Connection refused
2016-11-13T05:19:01.860 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 30, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_wip-vive-la-libcephfs-devel/tasks/s3readwrite.py", line 229, in run_tests
    stdin=conf,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 192, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 403, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 166, in wait
    label=self.label)
CommandFailedError: Command failed on smithi047 with status 1: '/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite'

http://pulpito.ceph.com/kchai-2016-11-13_05:09:22-rados-wip-kefu-testing---basic-smithi/544075/


Related issues

Copied to rgw - Backport #40450: nautilus: s3tests-test-readwrite failed in rados run (Connection refused) Resolved

History

#1 Updated by Kefu Chai 3 months ago

2019-06-11T02:37:45.746 INFO:teuthology.orchestra.run.smithi083.stderr:Traceback (most recent call last):
2019-06-11T02:37:45.746 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/bin/s3tests-test-readwrite", line 11, in <module>
2019-06-11T02:37:45.746 INFO:teuthology.orchestra.run.smithi083.stderr:    load_entry_point('s3tests', 'console_scripts', 's3tests-test-readwrite')()
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/readwrite.py", line 165, in main
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:    bucket = conn.create_bucket(bucket_name)
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/s3/connection.py", line 619, in create_bucket
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:    data=data)
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/s3/connection.py", line 671, in make_request
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:    retry_handler=retry_handler
2019-06-11T02:37:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/connection.py", line 1071, in make_request
2019-06-11T02:37:45.748 INFO:teuthology.orchestra.run.smithi083.stderr:    retry_handler=retry_handler)
2019-06-11T02:37:45.748 INFO:teuthology.orchestra.run.smithi083.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/boto/connection.py", line 1030, in _mexe
2019-06-11T02:37:45.749 INFO:teuthology.orchestra.run.smithi083.stderr:    raise ex
2019-06-11T02:37:45.749 INFO:teuthology.orchestra.run.smithi083.stderr:socket.error: [Errno 111] Connection refused

/a/kchai-2019-06-11_01:51:33-rados-wip-kefu-testing-2019-06-09-0009-distro-basic-smithi/4021061

#2 Updated by Kefu Chai 3 months ago

  • Assignee deleted (Matt Benjamin)

#3 Updated by Kefu Chai 3 months ago

  • Priority changed from Normal to Urgent

/a/kchai-2019-06-14_03:33:14-rados-wip-kefu-testing-2019-06-12-0017-distro-basic-smithi/4030532/

make it urgent, as it can be consistently reproduced.

#4 Updated by Casey Bodley 3 months ago

  • Status changed from New to Testing
  • Pull request ID set to 28631

#5 Updated by Casey Bodley 3 months ago

  • Status changed from Testing to Pending Backport
  • Backport set to nautilus

#6 Updated by Nathan Cutler 3 months ago

  • Copied to Backport #40450: nautilus: s3tests-test-readwrite failed in rados run (Connection refused) added

#7 Updated by Nathan Cutler 23 days ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved".

Also available in: Atom PDF