Project

General

Profile

Actions

Bug #45343

closed

Error: error pulling image "quay.io/ceph-ci/ceph:" "net/http: TLS handshake timeout"

Added by Brad Hubbard about 4 years ago. Updated almost 4 years ago.

Status:
Resolved
Priority:
Normal
Category:
cephadm
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

/a/yuriw-2020-04-28_21:58:13-rados-wip-yuri-testing-2020-04-24-1941-master-distro-basic-smithi/4995287

2020-04-28T22:42:12.936 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:Mon IP 172.21.15.8 is in CIDR network 172.21.0.0/20
2020-04-28T22:42:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:Pulling latest quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716 container...
2020-04-28T22:42:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:Running command: /bin/podman pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716
2020-04-28T22:42:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:/bin/podman:stderr Trying to pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716...
2020-04-28T22:42:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:/bin/podman:stderr Getting image source signatures
2020-04-28T22:42:15.106 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:692477d6fc20e3db43464e7f3a7325291cad60d5295fb49671f30839ce8ed7e3
2020-04-28T22:42:25.034 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:/bin/podman:stderr   Get https://cdn.quay.io/sha256/8a/8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07?Expires=1588114334&Signature=SzDkwlzAjXlqCmbo~z~OK5nk3XIy6YVLZo3~XeeeDCwLRMWR4s~u6RT6Qbts-6dt8m1NuDizKrZh3kK6zEpVjP8nbzHQWKP5Q7FnyJi0a-84sLYZp-dAFiS38IYHC2SAXeidFLX1TQwS76BXU1vw3VQh~dhh~YVP5vnEsK01gPLCpIK-0ejJoOOOQfV-c4VPeZNTJyU4rAPkt1TgB~7bWcl3d~HJiQDP5VaGHiI5IYpEW8ZEJMmRuUlDr4uCBTzdeppAVgepjz-3Ck0veq2k6HYf1c1Ox5lv3PsDywlDMjjpXt4My-lg0A2AysU~NMqmDZzNa2VasphlS30Hhrjgxg__&Key-Pair-Id=APKAJ67PQLWGCSP66DGA: net/http: TLS handshake timeout
2020-04-28T22:42:25.123 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:/bin/podman:stderr Error: error pulling image "quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716": unable to pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716: unable to pull image: Error reading blob sha256:8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07: Get https://cdn.quay.io/sha256/8a/8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07?Expires=1588114334&Signature=SzDkwlzAjXlqCmbo~z~OK5nk3XIy6YVLZo3~XeeeDCwLRMWR4s~u6RT6Qbts-6dt8m1NuDizKrZh3kK6zEpVjP8nbzHQWKP5Q7FnyJi0a-84sLYZp-dAFiS38IYHC2SAXeidFLX1TQwS76BXU1vw3VQh~dhh~YVP5vnEsK01gPLCpIK-0ejJoOOOQfV-c4VPeZNTJyU4rAPkt1TgB~7bWcl3d~HJiQDP5VaGHiI5IYpEW8ZEJMmRuUlDr4uCBTzdeppAVgepjz-3Ck0veq2k6HYf1c1Ox5lv3PsDywlDMjjpXt4My-lg0A2AysU~NMqmDZzNa2VasphlS30Hhrjgxg__&Key-Pair-Id=APKAJ67PQLWGCSP66DGA: net/http: TLS handshake timeout
2020-04-28T22:42:25.128 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:Non-zero exit code 125 from /bin/podman pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716
2020-04-28T22:42:25.128 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:/bin/podman:stderr Trying to pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716...
2020-04-28T22:42:25.128 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:/bin/podman:stderr Getting image source signatures
2020-04-28T22:42:25.129 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:/bin/podman:stderr Copying blob sha256:692477d6fc20e3db43464e7f3a7325291cad60d5295fb49671f30839ce8ed7e3
2020-04-28T22:42:25.130 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:/bin/podman:stderr   Get https://cdn.quay.io/sha256/8a/8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07?Expires=1588114334&Signature=SzDkwlzAjXlqCmbo~z~OK5nk3XIy6YVLZo3~XeeeDCwLRMWR4s~u6RT6Qbts-6dt8m1NuDizKrZh3kK6zEpVjP8nbzHQWKP5Q7FnyJi0a-84sLYZp-dAFiS38IYHC2SAXeidFLX1TQwS76BXU1vw3VQh~dhh~YVP5vnEsK01gPLCpIK-0ejJoOOOQfV-c4VPeZNTJyU4rAPkt1TgB~7bWcl3d~HJiQDP5VaGHiI5IYpEW8ZEJMmRuUlDr4uCBTzdeppAVgepjz-3Ck0veq2k6HYf1c1Ox5lv3PsDywlDMjjpXt4My-lg0A2AysU~NMqmDZzNa2VasphlS30Hhrjgxg__&Key-Pair-Id=APKAJ67PQLWGCSP66DGA: net/http: TLS handshake timeout
2020-04-28T22:42:25.130 INFO:teuthology.orchestra.run.smithi008.stderr:INFO:cephadm:/bin/podman:stderr Error: error pulling image "quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716": unable to pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716: unable to pull image: Error reading blob sha256:8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07: Get https://cdn.quay.io/sha256/8a/8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07?Expires=1588114334&Signature=SzDkwlzAjXlqCmbo~z~OK5nk3XIy6YVLZo3~XeeeDCwLRMWR4s~u6RT6Qbts-6dt8m1NuDizKrZh3kK6zEpVjP8nbzHQWKP5Q7FnyJi0a-84sLYZp-dAFiS38IYHC2SAXeidFLX1TQwS76BXU1vw3VQh~dhh~YVP5vnEsK01gPLCpIK-0ejJoOOOQfV-c4VPeZNTJyU4rAPkt1TgB~7bWcl3d~HJiQDP5VaGHiI5IYpEW8ZEJMmRuUlDr4uCBTzdeppAVgepjz-3Ck0veq2k6HYf1c1Ox5lv3PsDywlDMjjpXt4My-lg0A2AysU~NMqmDZzNa2VasphlS30Hhrjgxg__&Key-Pair-Id=APKAJ67PQLWGCSP66DGA: net/http: TLS handshake timeout
2020-04-28T22:42:25.131 INFO:teuthology.orchestra.run.smithi008.stderr:Traceback (most recent call last):
2020-04-28T22:42:25.131 INFO:teuthology.orchestra.run.smithi008.stderr:  File "/home/ubuntu/cephtest/cephadm", line 4585, in <module>
2020-04-28T22:42:25.132 INFO:teuthology.orchestra.run.smithi008.stderr:    r = args.func()
2020-04-28T22:42:25.132 INFO:teuthology.orchestra.run.smithi008.stderr:  File "/home/ubuntu/cephtest/cephadm", line 1124, in _default_image
2020-04-28T22:42:25.132 INFO:teuthology.orchestra.run.smithi008.stderr:    return func()
2020-04-28T22:42:25.132 INFO:teuthology.orchestra.run.smithi008.stderr:  File "/home/ubuntu/cephtest/cephadm", line 2294, in command_bootstrap
2020-04-28T22:42:25.133 INFO:teuthology.orchestra.run.smithi008.stderr:    call_throws([container_path, 'pull', args.image])
2020-04-28T22:42:25.133 INFO:teuthology.orchestra.run.smithi008.stderr:  File "/home/ubuntu/cephtest/cephadm", line 837, in call_throws
2020-04-28T22:42:25.134 INFO:teuthology.orchestra.run.smithi008.stderr:    raise RuntimeError('Failed command: %s' % ' '.join(command))
2020-04-28T22:42:25.134 INFO:teuthology.orchestra.run.smithi008.stderr:RuntimeError: Failed command: /bin/podman pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716
2020-04-28T22:42:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:Releasing lock 140049454935568 on /run/cephadm/7fcd4600-89a1-11ea-a068-001a4aab830c.lock
2020-04-28T22:42:25.135 INFO:teuthology.orchestra.run.smithi008.stderr:DEBUG:cephadm:Lock 140049454935568 released on /run/cephadm/7fcd4600-89a1-11ea-a068-001a4aab830c.lock
2020-04-28T22:42:25.146 DEBUG:teuthology.orchestra.run:got remote process result: 1
$ podman pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716
Trying to pull quay.io/ceph-ci/ceph:1674bb8f59f2c0d240ee17d0ef66d5eafc97f716...
Getting image source signatures
Copying blob 8a29a15cefae skipped: already exists  
Copying blob 692477d6fc20 done  
Copying config 95e5ea2808 done  
Writing manifest to image destination
Storing signatures
95e5ea2808d268fe814803deb7e090446b7b98e936744ef242e30b89fa9d81b4

This is probably a transient failure since I was able to pull the image with no problem but creating this tracker in case it shows up more regularly.


Related issues 1 (0 open1 closed)

Related to Orchestrator - Bug #46271: podman pull: transient "Error: error creating container storage: error creating read-write layer with ID" failureResolvedSebastian Wagner

Actions
Actions

Also available in: Atom PDF