Bug #9770: stderr during yum install is dropped - teuthology - Ceph

Actions

Copy link

Bug #9770

closed

stderr during yum install is dropped

Added by Zack Cerza over 9 years ago. Updated over 9 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Zack Cerza

Category:

% Done:

Source:

other

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Crash signature (v1):

Crash signature (v2):

Description

Seen while looking for another error message:

http://qa-proxy.ceph.com/teuthology/teuthology-2014-10-13_21:30:02-upgrade:firefly-firefly-distro-basic-vps/546756/teuthology.log

2014-10-13T22:02:50.126 INFO:teuthology.orchestra.run.vpm076:Running: 'sudo yum install ceph-radosgw-0.80.5 -y'
2014-10-13T22:02:52.887 INFO:teuthology.orchestra.run.vpm076.stdout:Loaded plugins: priorities
2014-10-13T22:02:57.998 INFO:teuthology.orchestra.run.vpm076.stdout:291 packages excluded due to repository priority protections
2014-10-13T22:02:58.000 INFO:teuthology.orchestra.run.vpm076.stdout:Setting up Install Process
2014-10-13T22:02:59.274 INFO:teuthology.orchestra.run.vpm076.stdout:Resolving Dependencies
2014-10-13T22:02:59.276 INFO:teuthology.orchestra.run.vpm076.stdout:--> Running transaction check
2014-10-13T22:02:59.276 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-radosgw.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.423 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.433 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: ceph-common = 0.80.5-0.el6 for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.522 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: libfcgi.so.0()(64bit) for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.549 INFO:teuthology.orchestra.run.vpm076.stdout:--> Running transaction check
2014-10-13T22:02:59.550 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-common.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.607 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-ceph = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.609 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.645 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.648 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-requests for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.650 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-radosgw.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.666 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.668 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package fcgi.x86_64 0:2.4.0-10.el6 will be installed
2014-10-13T22:02:59.685 INFO:teuthology.orchestra.run.vpm076.stdout:--> Running transaction check
2014-10-13T22:02:59.686 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-common.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.705 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.708 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.710 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-radosgw.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.726 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.729 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-ceph.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.734 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.736 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.739 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-flask for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.740 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-requests.noarch 0:1.1.0-4.el6 will be installed
2014-10-13T22:02:59.745 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-urllib3 for package: python-requests-1.1.0-4.el6.noarch
2014-10-13T22:02:59.747 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-ordereddict for package: python-requests-1.1.0-4.el6.noarch
2014-10-13T22:02:59.749 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-chardet for package: python-requests-1.1.0-4.el6.noarch
2014-10-13T22:02:59.750 INFO:teuthology.orchestra.run.vpm076.stdout:--> Running transaction check
2014-10-13T22:02:59.751 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-common.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.770 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.772 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.775 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-radosgw.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.791 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.793 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-ceph.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.796 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.798 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.801 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-chardet.noarch 0:2.0.1-1.el6 will be installed
2014-10-13T22:02:59.802 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-flask.noarch 1:0.9-7.el6 will be installed
2014-10-13T22:02:59.804 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-werkzeug for package: 1:python-flask-0.9-7.el6.noarch
2014-10-13T22:02:59.807 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-jinja2-26 for package: 1:python-flask-0.9-7.el6.noarch
2014-10-13T22:02:59.809 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-ordereddict.noarch 0:1.1-2.el6 will be installed
2014-10-13T22:02:59.810 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-urllib3.noarch 0:1.5-7.el6 will be installed
2014-10-13T22:02:59.813 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-six for package: python-urllib3-1.5-7.el6.noarch
2014-10-13T22:02:59.815 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-backports-ssl_match_hostname for package: python-urllib3-1.5-7.el6.noarch
2014-10-13T22:02:59.817 INFO:teuthology.orchestra.run.vpm076.stdout:--> Running transaction check
2014-10-13T22:02:59.817 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-common.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.836 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.838 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.841 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-radosgw.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.856 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.859 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-backports-ssl_match_hostname.noarch 0:3.4.0.2-1.el6 will be installed
2014-10-13T22:02:59.861 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-backports for package: python-backports-ssl_match_hostname-3.4.0.2-1.el6.noarch
2014-10-13T22:02:59.862 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-ceph.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.865 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.868 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.870 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-jinja2-26.noarch 0:2.6-3.el6 will be installed
2014-10-13T22:02:59.872 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-babel >= 0.8 for package: python-jinja2-26-2.6-3.el6.noarch
2014-10-13T22:02:59.884 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: python-markupsafe for package: python-jinja2-26-2.6-3.el6.noarch
2014-10-13T22:02:59.889 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-six.noarch 0:1.7.3-1.el6 will be installed
2014-10-13T22:02:59.890 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-werkzeug.noarch 0:0.8.3-2.el6 will be installed
2014-10-13T22:02:59.890 INFO:teuthology.orchestra.run.vpm076.stdout:--> Running transaction check
2014-10-13T22:02:59.891 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-common.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.910 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.913 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-common-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.915 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package ceph-radosgw.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.931 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: ceph-radosgw-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.933 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-babel.noarch 0:0.9.4-5.1.el6 will be installed
2014-10-13T22:02:59.943 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-backports.x86_64 0:1.0-3.el6 will be installed
2014-10-13T22:02:59.944 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-ceph.x86_64 0:0.80.5-0.el6 will be installed
2014-10-13T22:02:59.948 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librbd1 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.953 INFO:teuthology.orchestra.run.vpm076.stdout:--> Processing Dependency: librados2 = 0.80.5-0.el6 for package: python-ceph-0.80.5-0.el6.x86_64
2014-10-13T22:02:59.957 INFO:teuthology.orchestra.run.vpm076.stdout:---> Package python-markupsafe.x86_64 0:0.9.2-4.el6 will be installed
2014-10-13T22:03:00.562 INFO:teuthology.orchestra.run.vpm076.stdout:--> Finished Dependency Resolution
2014-10-13T22:03:00.652 INFO:teuthology.orchestra.run.vpm076.stdout: You could try using --skip-broken to work around the problem
2014-10-13T22:03:02.287 INFO:teuthology.orchestra.run.vpm076.stdout: You could try running: rpm -Va --nofiles --nodigest
2014-10-13T22:03:02.335 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 496, in _update_rpm_package_list_and_install
    stderr=pk_err_mess)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 364, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 105, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on vpm076 with status 1: 'sudo yum install ceph-radosgw-0.80.5 -y'

Where is stderr? Nowhere! Look here:
https://github.com/ceph/teuthology/blob/660832376680fe8f264be9831fcc5a1dd873371e/teuthology/task/install.py#L496

We're having run() store stderr in a StringIO, so it won't log that output, but then we don't do anything with it either.