Project

General

Profile

Actions

Bug #10526

closed

Gitbuilder mirror not syncing

Added by Zack Cerza over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

The gitbuilder.ceph.redhat.com mirror is perpetually out-of-sync. It can't continue this way.

I propose we use a caching proxy (with a large store) instead of a mirror.

Actions #1

Updated by Ken Dreyer over 9 years ago

I was thinking about using a caching proxy instead of running reposync on apt-mirror.sepia.ceph.com.

The Fedora infra guys have a ton of builds at http://kojipkgs.fedoraproject.org/packages/. The Koji builders need to hit that site all the time, so they use Squid to front it.

If Squid already has a given RPM in its cache, then it serves it very quickly. If it doesn't have it available, then it goes and fetches it from an official mirror.

Actions #2

Updated by Zack Cerza over 9 years ago

Example: http://gitbuilder.ceph.redhat.com/ceph-deb-precise-x86_64-basic/ref/master/pool/main/c/ceph/

[   ] ceph-common-dbg_0.90-885-ga6f5682-1precise_amd64.deb      2015-01-13 15:37   86M  
[   ] ceph-common_0.90-885-ga6f5682-1precise_amd64.deb          2015-01-13 15:37  8.6M  
[   ] ceph-dbg_0.90-885-ga6f5682-1precise_amd64.deb             2015-01-13 15:37  104M  
[   ] ceph-fs-common-dbg_0.90-885-ga6f5682-1precise_amd64.deb   2015-01-13 15:37  783K  
[   ] ceph-fs-common_0.90-885-ga6f5682-1precise_amd64.deb       2015-01-13 15:37  749K  
[   ] ceph-fuse-dbg_0.90-885-ga6f5682-1precise_amd64.deb        2015-01-13 15:37   21M  
[   ] ceph-fuse_0.90-885-ga6f5682-1precise_amd64.deb            2015-01-13 15:37  2.7M  
[   ] ceph-mds-dbg_0.90-885-ga6f5682-1precise_amd64.deb         2015-01-13 15:37   81M  
[   ] ceph-mds_0.90-885-ga6f5682-1precise_amd64.deb             2015-01-13 15:37  6.8M  
[   ] ceph-resource-agents_0.90-885-ga6f5682-1precise_amd64.deb 2015-01-13 15:37  729K  

Been like this for hours

Actions #3

Updated by Zack Cerza over 9 years ago

  • Status changed from New to 7
  • Assignee set to Zack Cerza

I'm working on a solution using nginx.

Actions #4

Updated by Zack Cerza over 9 years ago

  • Status changed from 7 to In Progress

nginx solution seems to be working well. We just need to stop the periodic mirroring on the host.

Actions #5

Updated by Zack Cerza over 9 years ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF