Project

General

Profile

Actions

Bug #7163

closed

s3tests bootsrap fails in the nightlies

Added by Tamilarasi muthamizhan over 10 years ago. Updated about 10 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Sandon Van Ness
Category:
-
% Done:

100%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

logs: ubuntu@teuthology:/a/teuthology-2014-01-13_19:35:03-upgrade:small-next-testing-basic-vps/37349

I think we had similar issue before and it was resolved.
Yehuda, could you please look at this one?

2014-01-15T01:47:08.689 DEBUG:teuthology.orchestra.run:Running [10.214.138.111]: 'cd /home/ubuntu/cephtest/s3-tests && ./bootstrap'
2014-01-15T01:47:09.750 INFO:teuthology.orchestra.run.out:[10.214.138.111]: The --no-site-packages flag is deprecated; it is now the default behavior.
2014-01-15T01:47:09.751 INFO:teuthology.orchestra.run.out:[10.214.138.111]: New python executable in virtualenv/bin/python
2014-01-15T01:47:10.769 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Installing distribute.............................................................................................................................................................................................done.
2014-01-15T01:47:11.166 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Installing pip...............done.
2014-01-15T01:47:12.641 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Downloading/unpacking pip from https://pypi.python.org/packages/source/p/pip/pip-1.5.tar.gz#md5=6969b8a8adc4c7f7c5eb1707118f0686
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:   Running setup.py egg_info for package pip
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     warning: no files found matching 'pip/cacert.pem'
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     warning: no files found matching '*.html' under directory 'docs'
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     warning: no previously-included files matching '*.rst' found under directory 'docs/_build'
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     no previously-included directories found matching 'docs/_build/_sources'
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Installing collected packages: pip
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:   Found existing installation: pip 1.1
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     Uninstalling pip:
2014-01-15T01:47:12.642 INFO:teuthology.orchestra.run.out:[10.214.138.111]:       Successfully uninstalled pip
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:   Running setup.py install for pip
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     warning: no files found matching 'pip/cacert.pem'
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     warning: no files found matching '*.html' under directory 'docs'
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     warning: no previously-included files matching '*.rst' found under directory 'docs/_build'
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     no previously-included directories found matching 'docs/_build/_sources'
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     Installing pip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     Installing pip2.7 script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin
2014-01-15T01:47:12.643 INFO:teuthology.orchestra.run.out:[10.214.138.111]:     Installing pip2 script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin
2014-01-15T01:47:12.644 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Successfully installed pip
2014-01-15T01:47:12.644 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Cleaning up...
2014-01-15T01:47:13.038 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Wheel installs require setuptools >= 0.8 for dist-info support.
2014-01-15T01:47:13.038 INFO:teuthology.orchestra.run.out:[10.214.138.111]: pip's wheel support requires setuptools >= 0.8 for dist-info support.
2014-01-15T01:47:13.039 INFO:teuthology.orchestra.run.out:[10.214.138.111]: Storing debug log for failure in /home/ubuntu/.pip/pip.log
2014-01-15T01:47:13.055 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/teuthology-next/teuthology/contextutil.py", line 25, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/teuthology-next/teuthology/task/s3tests.py", line 223, in configure
    './bootstrap',
  File "/home/teuthworker/teuthology-next/teuthology/orchestra/remote.py", line 47, in run
    r = self._runner(client=self.ssh, **kwargs)
  File "/home/teuthworker/teuthology-next/teuthology/orchestra/run.py", line 271, in run
    r.exitstatus = _check_status(r.exitstatus)
  File "/home/teuthworker/teuthology-next/teuthology/orchestra/run.py", line 267, in _check_status
    raise CommandFailedError(command=r.command, exitstatus=status, node=host)
CommandFailedError: Command failed on 10.214.138.111 with status 1: 'cd /home/ubuntu/cephtest/s3-tests && ./bootstrap'

Actions #1

Updated by Tamilarasi muthamizhan over 10 years ago

also a lot of nightlies seems to be stuck up on this error, hence marking it as "urgent".

Actions #2

Updated by Tamilarasi muthamizhan over 10 years ago

  • Assignee changed from Yehuda Sadeh to Sandon Van Ness

hi Sandon, did this issue get addressed?

It seems to be happening on debians only [upstream issues?]. on the rpms, it works just fine.

Actions #3

Updated by Sandon Van Ness over 10 years ago

A previous fix I had I forgot to commit to the non-master release branches (cuttlefish, dumpling) I committed that so it should be good now. I will also fixed the swift one as well that had some additional issues.

Actions #4

Updated by Sandon Van Ness over 10 years ago

  • Status changed from New to Closed
  • % Done changed from 0 to 100

s3/swift bootstraps are fixed for a while now, 21, 0 failures passes on 1-20 on a recent run.

Actions #5

Updated by Tamilarasi muthamizhan over 10 years ago

  • Status changed from Closed to In Progress

looks like this is still happening,

logs: ubuntu@teuthology:/a/teuthology-2014-01-22_19:35:19-upgrade:small-next-testing-basic-vps/48193

Actions #7

Updated by Sandon Van Ness over 10 years ago

I did a similar fix and I unfortunately somehow missed seeing the next branch which I realized yesterday after seeing the failure and did a cherry-pick to next so it should be fixed there now.

Actions #8

Updated by Sandon Van Ness about 10 years ago

  • Status changed from In Progress to Resolved

This has been good for a while now.

Actions

Also available in: Atom PDF