Project

General

Profile

Actions

Bug #7364

closed

apt fails to update from ceph apt mirror

Added by Alfredo Deza about 10 years ago. Updated about 9 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
-
% Done:

100%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]: # In /tmp/solo-from-scratch.lh1B8EoLMIxF/cookbooks/ceph-qa/recipes/debian.rb
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]: 
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]:  54: execute "apt-get update" do
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]:  55:   command "apt-get update" 
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]:  56: end
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]:  57:
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [0m
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]: 
2014-02-07T02:01:34.113 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [0m
2014-02-07T02:01:34.114 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Compiled Resource:[0m
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]: ------------------[0m
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]: # Declared in /tmp/solo-from-scratch.lh1B8EoLMIxF/cookbooks/ceph-qa/recipes/debian.rb:54:in `from_file'
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]: 
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]: execute("apt-get update") do
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   action "run" 
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   retries 0
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   retry_delay 2
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   command "apt-get update" 
2014-02-07T02:01:34.115 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   backup 5
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   returns 0
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   cookbook_name :"ceph-qa" 
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]:   recipe_name "debian" 
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: end
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [0m
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: 
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [0m
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [2014-02-07T10:01:34+00:00] INFO: Running queued delayed notifications before re-raising exception
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [2014-02-07T10:01:34+00:00] ERROR: Running exception handlers
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [2014-02-07T10:01:34+00:00] ERROR: Exception handlers complete
2014-02-07T02:01:34.116 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [2014-02-07T10:01:34+00:00] FATAL: Stacktrace dumped to /tmp/solo-from-scratch.lh1B8EoLMIxF/solo/chef-stacktrace.out
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [2014-02-07T10:01:34+00:00] ERROR: execute[apt-get update] (ceph-qa::debian line 54) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '100'
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: ---- Begin output of apt-get update ----
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: STDOUT: Get:1 http://gitbuilder.ceph.com wheezy Release.gpg [198 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:2 http://gitbuilder.ceph.com wheezy Release.gpg [198 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:3 http://gitbuilder.ceph.com wheezy Release [5963 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:4 http://apt-mirror.front.sepia.ceph.com wheezy Release.gpg [1672 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:5 http://gitbuilder.ceph.com wheezy Release [5864 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:6 http://apt-mirror.front.sepia.ceph.com wheezy/updates Release.gpg [836 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:7 http://gitbuilder.ceph.com wheezy/main amd64 Packages [4629 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:8 http://apt-mirror.front.sepia.ceph.com wheezy-backports Release.gpg [836 B]
2014-02-07T02:01:34.122 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:9 http://gitbuilder.ceph.com wheezy/main amd64 Packages [732 B]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://gitbuilder.ceph.com wheezy/main Translation-en
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://gitbuilder.ceph.com wheezy/main Translation-en
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:10 http://apt-mirror.front.sepia.ceph.com wheezy Release [168 kB]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:11 http://apt-mirror.front.sepia.ceph.com wheezy/updates Release [102 kB]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:12 http://apt-mirror.front.sepia.ceph.com wheezy-backports Release [147 kB]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:13 http://apt-mirror.front.sepia.ceph.com wheezy/main amd64 Packages [5848 kB]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:14 http://apt-mirror.front.sepia.ceph.com wheezy/contrib amd64 Packages [42.0 kB]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:15 http://apt-mirror.front.sepia.ceph.com wheezy/non-free amd64 Packages [80.8 kB]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:16 http://apt-mirror.front.sepia.ceph.com wheezy/updates/main amd64 Packages [147 kB]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:17 http://apt-mirror.front.sepia.ceph.com wheezy/updates/contrib amd64 Packages [14 B]
2014-02-07T02:01:34.123 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:18 http://apt-mirror.front.sepia.ceph.com wheezy/updates/non-free amd64 Packages [14 B]
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy-backports/main amd64 Packages/DiffIndex
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy-backports/contrib amd64 Packages/DiffIndex
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy-backports/non-free amd64 Packages/DiffIndex
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:19 http://apt-mirror.front.sepia.ceph.com wheezy-backports/contrib Translation-en [5113 B]
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:20 http://apt-mirror.front.sepia.ceph.com wheezy-backports/main Translation-en [184 kB]
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:21 http://apt-mirror.front.sepia.ceph.com wheezy-backports/non-free Translation-en [16.9 kB]
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy/contrib Translation-en
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy/main Translation-en
2014-02-07T02:01:34.124 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy/non-free Translation-en
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy/updates/contrib Translation-en
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy/updates/main Translation-en
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ign http://apt-mirror.front.sepia.ceph.com wheezy/updates/non-free Translation-en
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:22 http://apt-mirror.front.sepia.ceph.com wheezy-backports/main amd64 Packages [284 kB]
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:23 http://apt-mirror.front.sepia.ceph.com wheezy-backports/contrib amd64 Packages [7720 B]
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Get:24 http://apt-mirror.front.sepia.ceph.com wheezy-backports/non-free amd64 Packages [16.6 kB]
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Fetched 7069 kB in 2s (2667 kB/s)
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: STDERR: W: Failed to fetch bzip2:/var/lib/apt/lists/partial/apt-mirror.front.sepia.ceph.com_ftp.us.debian.org_debian_dists_wheezy-backports_main_i18n_Translation-en  Hash Sum mismatch
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: 
2014-02-07T02:01:34.125 INFO:teuthology.orchestra.run.out:[10.214.138.67]: E: Some index files failed to download. They have been ignored, or old ones used instead.
2014-02-07T02:01:34.126 INFO:teuthology.orchestra.run.out:[10.214.138.67]: ---- End output of apt-get update ----
2014-02-07T02:01:34.126 INFO:teuthology.orchestra.run.out:[10.214.138.67]: Ran apt-get update returned 100
2014-02-07T02:01:34.167 INFO:teuthology.orchestra.run.out:[10.214.138.67]: [2014-02-07T10:01:34+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)
Actions #1

Updated by Sandon Van Ness about 10 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

This was a weird one-time issue where a hash check failed (not an actual failure contacting the apt mirror server). Haven't been able to reproduce or seen it again so closing it out.

Actions #2

Updated by Zack Cerza about 9 years ago

  • Status changed from Resolved to In Progress
  • Assignee changed from Sandon Van Ness to Zack Cerza

This has been happening more often. I'm going to implement a workaround causing apt-get update failures to not fail the job. If the job fails later anyway, so be it.

Actions #3

Updated by Zack Cerza about 9 years ago

  • Status changed from In Progress to Fix Under Review
Actions #4

Updated by Zack Cerza about 9 years ago

  • Status changed from Fix Under Review to 7
Actions

Also available in: Atom PDF