Ceph » Orchestrator

/a/yuriw-2023-11-16_22:27:54-rados-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7461250

2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]: stat: stderr Error: initializing source docker://haproxy:2.3: (Mirrors also failed: [docker-mirror.front.sepia.ceph.com:5000/library/haproxy:2.3: pinging container registry docker-mirror.front.sepia.ceph.com:5000: Get "https://docker-mirror.front.sepia.ceph.com:5000/v2/": dial tcp 172.21.0.79:5000: connect: no route to host]): docker.io/library/haproxy:2.3: reading manifest 2.3 in docker.io/library/haproxy: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit
2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]: ERROR: Failed to extract uid/gid for path /var/lib: Failed command: /bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/library/haproxy:2.3 -e NODE_NAME=smithi169 -e CEPH_USE_RANDOM_NONCE=1 docker.io/library/haproxy:2.3 -c %u %g /var/lib
2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]: Traceback (most recent call last):
2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]:   File "/usr/share/ceph/mgr/cephadm/serve.py", line 1538, in _remote_connection
2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]:     yield (conn, connr)
2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]:   File "/usr/share/ceph/mgr/cephadm/serve.py", line 1426, in _run_cephadm
2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]:     code, '\n'.join(err)))
2023-11-17T03:49:31.272 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Nov 17 03:49:31 smithi157 ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-mon-smithi157[108190]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr:Non-zero exit code 125 from /bin/podman container inspect --format {{.State.Status}} ceph-3380b800-84fb-11ee-8dbe-212e2dc638e7-haproxy-nfs-foo-smithi169-bnhabx