Feature #6362
openmove teuthology required stuff off download.ceph.com
0%
Description
We want to move stuff off ceph.com as only certain people have access to that and instead move it to a lab machine every employee has access to. Another advantage of this will be it will no longer transverse the gateway box in order to grab stuff from ceph.com decreasing the load on that box as well. We will likely want to have a default URL that grabs from github or something (for the things it can) and allow over-rides. The new home for all the ceph.com/git stuff will be moved to:
http://mirror.sepia.ceph.com/git/
Teuthology will need to be modifed to use the new URL as well as allow a config option to use something publicly accessible.
Updated by Zack Cerza over 10 years ago
- Status changed from New to In Progress
Work is ongoing in the wip-mirror branch:
https://github.com/ceph/teuthology/tree/wip-mirror
This doesn't currently solve the issue of stuff living in http://ceph.com/qa - and I'm not sure if we'll be able to do much about that.
Additionally, URLs like this:
http://ceph.com/git/?p=ceph-qa-chef.git;a=blob_plain;f=solo/solo-from-scratch;hb=HEAD
Can't really be mapped easily to ones at github.com, as they use this format:
https://raw.github.com/ceph/ceph-qa-chef/master/solo/solo-from-scratch
I wonder if mirror.ceph.com could match that somehow?
Updated by Nathan Cutler over 7 years ago
- Status changed from In Progress to Resolved
We have git.ceph.com now, which is accessible from outside (and inside) the Sepia VPN.
Updated by Nathan Cutler over 7 years ago
- Assignee set to Nathan Cutler
Ah! This is still relevant. See: https://github.com/ceph/ceph/commit/d4d65fbd6ad15320339751c604613ac63511e645
We are still downloading stuff from http://download.ceph.com/qa
Updated by Nathan Cutler over 7 years ago
- Subject changed from move teuthology required stuff off ceph.com to move teuthology required stuff off download.ceph.com
smithfarm@wilbur:~/src/ceph/SUSE/ceph/qa> grep -r 'download.ceph.com'
workunits/fs/norstats/kernel_untar_tar.sh:wget -q http://download.ceph.com/qa/$KERNEL.tar.xz
workunits/fs/snaps/snap-rm-diff.sh:wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2
workunits/fs/snaps/snaptest-snap-rm-cmp.sh:wget -q http://download.ceph.com/qa/$file
workunits/fs/snaps/untar_snap_rm.sh: wget http://download.ceph.com/qa/$1
workunits/hadoop/wordcount.sh:curl http://download.ceph.com/qa/hadoop_input_files.tar | tar xf - -C $DATA_INPUT
workunits/kernel_untar_build.sh:wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz
workunits/rbd/run_cli_tests.sh:wget -q http://download.ceph.com/qa/rbd_cli_tests.pls
workunits/rbd/run_cli_tests.sh:wget -q http://download.ceph.com/qa/RbdLib.pm
workunits/suites/blogbench.sh:wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2
workunits/suites/ffsb.sh:wget http://download.ceph.com/qa/ffsb.tar.bz2
workunits/suites/fsync-tester.sh:wget http://download.ceph.com/qa/fsync-tester.c
workunits/suites/iogen.sh:wget http://download.ceph.com/qa/iogen_3.1p0.tar
workunits/suites/fsstress.sh:wget -q -O ${TESTDIR}/fsstress/ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz
workunits/suites/pjd.sh:wget http://download.ceph.com/qa/pjd-fstest-20090130-RC-aclfixes.tgz
It seems like some of this stuff is just code that could live in ceph/ceph.git under qa/ ?
Updated by Nathan Cutler over 7 years ago
See #14825 for rbd_cli_tests.pl(s) and RbdLib.pm