Bug #45081
cephadm: `upgrade check 15.2.1` : OrchestratorError: Failed to pull 15.2.1 on ceph0
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Description
Apr 14 11:22:43 ceph1 bash[37629]: debug 2020-04-14T09:22:42.997+0000 7ff504d1f700 -1 Remote method threw exception: Traceback (most recent call last): Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 548, in wrapper Apr 14 11:22:43 ceph1 bash[37629]: return AsyncCompletion(value=f(*args, **kwargs), name=f.__name__) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 3046, in upgrade_check Apr 14 11:22:43 ceph1 bash[37629]: target_id, target_version = self._get_container_image_id(target_name) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 3029, in _get_container_image_id Apr 14 11:22:43 ceph1 bash[37629]: image_name, host, '\n'.join(out))) Apr 14 11:22:43 ceph1 bash[37629]: orchestrator._interface.OrchestratorError: Failed to pull 15.2.1 on ceph0: Apr 14 11:22:43 ceph1 bash[37629]: debug 2020-04-14T09:22:42.997+0000 7ff504d1f700 -1 mgr handle_command module 'orchestrator' command handler threw exception: Remote method threw exception: Traceback (most recent call last): Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 548, in wrapper Apr 14 11:22:43 ceph1 bash[37629]: return AsyncCompletion(value=f(*args, **kwargs), name=f.__name__) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 3046, in upgrade_check Apr 14 11:22:43 ceph1 bash[37629]: target_id, target_version = self._get_container_image_id(target_name) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 3029, in _get_container_image_id Apr 14 11:22:43 ceph1 bash[37629]: image_name, host, '\n'.join(out))) Apr 14 11:22:43 ceph1 bash[37629]: orchestrator._interface.OrchestratorError: Failed to pull 15.2.1 on ceph0: Apr 14 11:22:43 ceph1 bash[37629]: debug 2020-04-14T09:22:42.997+0000 7ff504d1f700 -1 mgr.server reply reply (22) Invalid argument Traceback (most recent call last): Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/mgr_module.py", line 1153, in _handle_command Apr 14 11:22:43 ceph1 bash[37629]: return self.handle_command(inbuf, cmd) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 110, in handle_command Apr 14 11:22:43 ceph1 bash[37629]: return dispatch[cmd['prefix']].call(self, cmd, inbuf) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/mgr_module.py", line 308, in call Apr 14 11:22:43 ceph1 bash[37629]: return self.func(mgr, **kwargs) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 72, in <lambda> Apr 14 11:22:43 ceph1 bash[37629]: wrapper_copy = lambda *l_args, **l_kwargs: wrapper(*l_args, **l_kwargs) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 63, in wrapper Apr 14 11:22:43 ceph1 bash[37629]: return func(*args, **kwargs) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/orchestrator/module.py", line 920, in _upgrade_check Apr 14 11:22:43 ceph1 bash[37629]: completion = self.upgrade_check(image=image, version=ceph_version) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 1510, in inner Apr 14 11:22:43 ceph1 bash[37629]: completion = self._oremote(method_name, args, kwargs) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 1581, in _oremote Apr 14 11:22:43 ceph1 bash[37629]: return mgr.remote(o, meth, *args, **kwargs) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/mgr_module.py", line 1515, in remote Apr 14 11:22:43 ceph1 bash[37629]: args, kwargs) Apr 14 11:22:43 ceph1 bash[37629]: RuntimeError: Remote method threw exception: Traceback (most recent call last): Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 548, in wrapper Apr 14 11:22:43 ceph1 bash[37629]: return AsyncCompletion(value=f(*args, **kwargs), name=f.__name__) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 3046, in upgrade_check Apr 14 11:22:43 ceph1 bash[37629]: target_id, target_version = self._get_container_image_id(target_name) Apr 14 11:22:43 ceph1 bash[37629]: File "/usr/share/ceph/mgr/cephadm/module.py", line 3029, in _get_container_image_id Apr 14 11:22:43 ceph1 bash[37629]: image_name, host, '\n'.join(out))) Apr 14 11:22:43 ceph1 bash[37629]: orchestrator._interface.OrchestratorError: Failed to pull 15.2.1 on ceph0:
And according to `ceph config-key dump mgr`, container_image_base is still set to default.
Environment:
- 15.2.0
- debian + docker
History
#1 Updated by Sebastian Wagner almost 4 years ago
- Status changed from New to Fix Under Review
- Pull request ID set to 34568
#2 Updated by Sebastian Wagner almost 4 years ago
- Status changed from Fix Under Review to Pending Backport
#3 Updated by Sebastian Wagner almost 4 years ago
- Status changed from Pending Backport to Resolved
- Target version set to v15.2.2