Project

General

Profile

Backport #18736

"[ceph_deploy][ERROR ] RuntimeError: HTTP Error 504: Gateway Timeout"

Added by Yuri Weinstein 7 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Release:
jewel


Related issues

Related to Ceph - Backport #18737: RuntimeError("ceph-deploy: Failed to install ceph") Closed

History

#1 Updated by Andrew Schoen 7 months ago

Did you perhaps forget to give a 'branch' value to this run? The code there is trying to pull a repo available for master at sha1 83af8cdaaa6d94404e6146b68e532a784e3cc99c. However, there are no repos built for that combination: https://shaman.ceph.com/repos/ceph/master/83af8cdaaa6d94404e6146b68e532a784e3cc99c/

I imagine that the branch value should have been 'hammer', because there are repos for hammer at sha1 83af8cdaaa6d94404e6146b68e532a784e3cc99c and you said this was for v0.94.10 validation. https://shaman.ceph.com/repos/ceph/hammer/83af8cdaaa6d94404e6146b68e532a784e3cc99c/

There is also a chance this is a bug in the ceph-deploy task where --dev is not passed to the ceph-deploy call.

#2 Updated by Yuri Weinstein 7 months ago

This run was scheduled as
CEPH_BRANCH=83af8cdaaa6d94404e6146b68e532a784e3cc99c; MACHINE_NAME=vps; teuthology-suite -v -c hammer -S $CEPH_BRANCH -m $MACHINE_NAME -k distro -s ceph-deploy -e $CEPH_QA_EMAIL --suite-branch hammer --suite-repo https://github.com/ceph/ceph.git --ceph-repo https://github.com/ceph/ceph.git ~/no_shaman.yaml --filter ubuntu -p 90

I will try with only -c hammer

#3 Updated by Yuri Weinstein 7 months ago

Seems like Andrew's analysis is correct, its some "reaction" to -S <sha1> and -c <branch>@ =>
http://pulpito.ceph.com/teuthology-2017-01-30_20:12:16-ceph-deploy-hammer-distro-basic-vps/

#4 Updated by Yuri Weinstein 7 months ago

  • Related to Backport #18737: RuntimeError("ceph-deploy: Failed to install ceph") added

#5 Updated by Nathan Cutler 7 months ago

here's what I see in the failed run: "install" task installs ceph 83af8cd successfully, then ceph-deploy task runs and tries to do the same thing (why??) and fails with

2017-01-30T17:50:13.783 INFO:teuthology.orchestra.run.vpm031.stderr:[ceph_deploy.hosts.debian.install][DEBUG ] fetching repo information from: https://shaman.ceph.com/api/repos/ceph/master/83af8cdaaa6d94404e6146b68e532a784e3cc99c/ubuntu/trusty/repo/?arch=x86_64 
2017-01-30T17:50:13.980 INFO:teuthology.orchestra.run.vpm031.stderr:[ceph_deploy.util.net][ERROR ] repository might not be available yet 
2017-01-30T17:50:13.980 INFO:teuthology.orchestra.run.vpm031.stderr:[ceph_deploy][ERROR ] RuntimeError: HTTP Error 504: Gateway Timeout, failed to fetch https://shaman.ceph.com/api/repos/ceph/master/83af8cdaaa6d94404e6146b68e532a784e3cc99c/ubuntu/trusty/repo/?arch=x86_64

As Andrew noted, "ceph-deploy install" is looking for 83af8cda (which is wip-hammer-backports) under https://shaman.ceph.com/api/repos/ceph/master when it's actually under https://shaman.ceph.com/api/repos/ceph/hammer.

The job mentioned in #18737 fails in the exact same way.

#6 Updated by Nathan Cutler 7 months ago

  • Status changed from New to Need Review

#7 Updated by Nathan Cutler 7 months ago

  • Tracker changed from Bug to Backport
  • Description updated (diff)
  • Release jewel added
  • Release deleted (hammer)

description

This is 0.94.10 point release validation

ubuntu runs http://pulpito.ceph.com/teuthology-2017-01-30_17:38:19-ceph-deploy-hammer-distro-basic-vps/
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2017-01-30_17:38:19-ceph-deploy-hammer-distro-basic-vps/766566/teuthology.log

2017-01-30T17:50:13.783 INFO:teuthology.orchestra.run.vpm031.stderr:[ceph_deploy.hosts.debian.install][DEBUG ] fetching repo information from: https://shaman.ceph.com/api/repos/ceph/master/83af8cdaaa6d94404e6146b68e532a784e3cc99c/ubuntu/trusty/repo/?arch=x86_64
2017-01-30T17:50:13.980 INFO:teuthology.orchestra.run.vpm031.stderr:[ceph_deploy.util.net][ERROR ] repository might not be available yet
2017-01-30T17:50:13.980 INFO:teuthology.orchestra.run.vpm031.stderr:[ceph_deploy][ERROR ] RuntimeError: HTTP Error 504: Gateway Timeout, failed to fetch https://shaman.ceph.com/api/repos/ceph/master/83af8cdaaa6d94404e6146b68e532a784e3cc99c/ubuntu/trusty/repo/?arch=x86_64

#8 Updated by Nathan Cutler 7 months ago

  • Description updated (diff)
  • Status changed from Need Review to In Progress

#9 Updated by Nathan Cutler 7 months ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF