Project

General

Profile

Actions

Bug #11480

closed

Error "ceph version 0.87.1 was not installed, found 0.87.2." in upgrade:giant-giant-distro-basic-vps run

Added by Yuri Weinstein almost 9 years ago. Updated about 8 years ago.

Status:
Can't reproduce
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
fs, upgrade/giant
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Seems to be effecting centos 6.5, rhel 5.4 and 6.5
Run: http://pulpito.ceph.com/teuthology-2015-04-26_17:15:01-upgrade:giant-giant-distro-basic-vps/
Jobs: ['864361', '864363', '864364', '864367', '864369', '864370']
Logs for one: http://qa-proxy.ceph.com/teuthology/teuthology-2015-04-26_17:15:01-upgrade:giant-giant-distro-basic-vps/864361/

2015-04-27T11:35:19.910 INFO:teuthology.orchestra.run.vpm095.stdout:  ceph-common.x86_64 1:0.87.2-109.g87a7cec.el6
2015-04-27T11:35:19.910 INFO:teuthology.orchestra.run.vpm095.stdout:
2015-04-27T11:35:19.910 INFO:teuthology.orchestra.run.vpm095.stdout:Complete!
2015-04-27T11:35:19.961 INFO:teuthology.orchestra.run.vpm095:Running: 'arch'
2015-04-27T11:35:20.375 INFO:teuthology.orchestra.run.vpm095:Running: 'lsb_release -is'
2015-04-27T11:35:20.452 INFO:teuthology.orchestra.run.vpm095:Running: 'lsb_release -rs'
2015-04-27T11:35:20.499 INFO:teuthology.task.install:config is {'project': 'ceph', 'branch': 'giant'}
2015-04-27T11:35:20.499 INFO:teuthology.orchestra.run.vpm095:Running: 'sudo lsb_release -is'
2015-04-27T11:35:20.721 DEBUG:teuthology.misc:System to be installed: CentOS
2015-04-27T11:35:20.722 INFO:teuthology.orchestra.run.vpm095:Running: 'wget -q -O- http://gitbuilder.ceph.com/ceph-rpm-centos6-x86_64-basic/ref/giant/version'
2015-04-27T11:35:20.849 INFO:teuthology.orchestra.run.vpm095:Running: "rpm -q ceph --qf '%{VERSION}'" 
2015-04-27T11:35:21.696 INFO:teuthology.packaging:The installed version of ceph is 0.87.2
2015-04-27T11:35:21.697 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/parallel.py", line 50, in _run_spawned
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 41, in run_one_task
    return fn(**kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/sequential.py", line 48, in task
    mgr.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1144, in upgrade
    upgrade_common(ctx, config, upgrade_old_style)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1091, in upgrade_common
    verify_package_version(ctx, node, remote)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 518, in verify_package_version
    pkg=pkg_to_check
RuntimeError: ceph version 0.87.1 was not installed, found 0.87.2.

github URL http://gitbuilder.ceph.com/ceph-rpm-centos6-x86_64-basic/ref/giant/version shows v0.87.1-109.g87a7cec

Actions #1

Updated by Loïc Dachary almost 9 years ago

I suspect this happened exactly when 0.87.2 was being published and it does not need to actually be fixed. Unless there is a way to fix that kind of rare race condition.

Actions #2

Updated by Ken Dreyer almost 9 years ago

Probably the same issue as described in #11222 . Gitbuilder doesn't see a change to /refs/heads/giant when the v0.87.2 tag gets pushed. It thinks that it has already built https://github.com/ceph/ceph/commit/87a7cec9ab11c677de2ab23a7668a77d2f5b955e , so it doesn't know to rebuild that same sha1.

Actions #3

Updated by Greg Farnum almost 9 years ago

Did one of you actually force the rebuild so it won't happen again? :)

Actions #5

Updated by Sage Weil about 8 years ago

  • Status changed from New to Can't reproduce
Actions

Also available in: Atom PDF