Project

General

Profile

Bug #45081

cephadm: `upgrade check 15.2.1` : OrchestratorError: Failed to pull 15.2.1 on ceph0

Added by Sebastian Wagner 8 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
cephadm
Target version:
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

Apr 14 11:22:43 ceph1 bash[37629]: debug 2020-04-14T09:22:42.997+0000 7ff504d1f700 -1 Remote method threw exception: Traceback (most recent call last):
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 548, in wrapper
Apr 14 11:22:43 ceph1 bash[37629]:     return AsyncCompletion(value=f(*args, **kwargs), name=f.__name__)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 3046, in upgrade_check
Apr 14 11:22:43 ceph1 bash[37629]:     target_id, target_version = self._get_container_image_id(target_name)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 3029, in _get_container_image_id
Apr 14 11:22:43 ceph1 bash[37629]:     image_name, host, '\n'.join(out)))
Apr 14 11:22:43 ceph1 bash[37629]: orchestrator._interface.OrchestratorError: Failed to pull 15.2.1 on ceph0:
Apr 14 11:22:43 ceph1 bash[37629]: debug 2020-04-14T09:22:42.997+0000 7ff504d1f700 -1 mgr handle_command module 'orchestrator' command handler threw exception: Remote method threw exception: Traceback (most recent call last):
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 548, in wrapper
Apr 14 11:22:43 ceph1 bash[37629]:     return AsyncCompletion(value=f(*args, **kwargs), name=f.__name__)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 3046, in upgrade_check
Apr 14 11:22:43 ceph1 bash[37629]:     target_id, target_version = self._get_container_image_id(target_name)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 3029, in _get_container_image_id
Apr 14 11:22:43 ceph1 bash[37629]:     image_name, host, '\n'.join(out)))
Apr 14 11:22:43 ceph1 bash[37629]: orchestrator._interface.OrchestratorError: Failed to pull 15.2.1 on ceph0:
Apr 14 11:22:43 ceph1 bash[37629]: debug 2020-04-14T09:22:42.997+0000 7ff504d1f700 -1 mgr.server reply reply (22) Invalid argument Traceback (most recent call last):
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/mgr_module.py", line 1153, in _handle_command
Apr 14 11:22:43 ceph1 bash[37629]:     return self.handle_command(inbuf, cmd)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 110, in handle_command
Apr 14 11:22:43 ceph1 bash[37629]:     return dispatch[cmd['prefix']].call(self, cmd, inbuf)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/mgr_module.py", line 308, in call
Apr 14 11:22:43 ceph1 bash[37629]:     return self.func(mgr, **kwargs)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 72, in <lambda>
Apr 14 11:22:43 ceph1 bash[37629]:     wrapper_copy = lambda *l_args, **l_kwargs: wrapper(*l_args, **l_kwargs)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 63, in wrapper
Apr 14 11:22:43 ceph1 bash[37629]:     return func(*args, **kwargs)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/orchestrator/module.py", line 920, in _upgrade_check
Apr 14 11:22:43 ceph1 bash[37629]:     completion = self.upgrade_check(image=image, version=ceph_version)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 1510, in inner
Apr 14 11:22:43 ceph1 bash[37629]:     completion = self._oremote(method_name, args, kwargs)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 1581, in _oremote
Apr 14 11:22:43 ceph1 bash[37629]:     return mgr.remote(o, meth, *args, **kwargs)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/mgr_module.py", line 1515, in remote
Apr 14 11:22:43 ceph1 bash[37629]:     args, kwargs)
Apr 14 11:22:43 ceph1 bash[37629]: RuntimeError: Remote method threw exception: Traceback (most recent call last):
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 548, in wrapper
Apr 14 11:22:43 ceph1 bash[37629]:     return AsyncCompletion(value=f(*args, **kwargs), name=f.__name__)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 3046, in upgrade_check
Apr 14 11:22:43 ceph1 bash[37629]:     target_id, target_version = self._get_container_image_id(target_name)
Apr 14 11:22:43 ceph1 bash[37629]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 3029, in _get_container_image_id
Apr 14 11:22:43 ceph1 bash[37629]:     image_name, host, '\n'.join(out)))
Apr 14 11:22:43 ceph1 bash[37629]: orchestrator._interface.OrchestratorError: Failed to pull 15.2.1 on ceph0:

And according to `ceph config-key dump mgr`, container_image_base is still set to default.

Environment:

  • 15.2.0
  • debian + docker

History

#1 Updated by Sebastian Wagner 8 months ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 34568

#2 Updated by Sebastian Wagner 7 months ago

  • Status changed from Fix Under Review to Pending Backport

#3 Updated by Sebastian Wagner 7 months ago

  • Status changed from Pending Backport to Resolved
  • Target version set to v15.2.2

Also available in: Atom PDF