Bug #10526
closed
Gitbuilder mirror not syncing
Added by Zack Cerza over 9 years ago.
Updated over 9 years ago.
Description
The gitbuilder.ceph.redhat.com mirror is perpetually out-of-sync. It can't continue this way.
I propose we use a caching proxy (with a large store) instead of a mirror.
I was thinking about using a caching proxy instead of running reposync on apt-mirror.sepia.ceph.com.
The Fedora infra guys have a ton of builds at http://kojipkgs.fedoraproject.org/packages/. The Koji builders need to hit that site all the time, so they use Squid to front it.
If Squid already has a given RPM in its cache, then it serves it very quickly. If it doesn't have it available, then it goes and fetches it from an official mirror.
Example: http://gitbuilder.ceph.redhat.com/ceph-deb-precise-x86_64-basic/ref/master/pool/main/c/ceph/
[ ] ceph-common-dbg_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 86M
[ ] ceph-common_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 8.6M
[ ] ceph-dbg_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 104M
[ ] ceph-fs-common-dbg_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 783K
[ ] ceph-fs-common_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 749K
[ ] ceph-fuse-dbg_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 21M
[ ] ceph-fuse_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 2.7M
[ ] ceph-mds-dbg_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 81M
[ ] ceph-mds_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 6.8M
[ ] ceph-resource-agents_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37 729K
Been like this for hours
- Status changed from New to 7
- Assignee set to Zack Cerza
I'm working on a solution using nginx.
- Status changed from 7 to In Progress
nginx solution seems to be working well. We just need to stop the periodic mirroring on the host.
- Status changed from In Progress to Resolved
Also available in: Atom
PDF