Project

General

Profile

Actions
Copy link

Bug #38632

open

"E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial-updates/main/binary-i386/Packages.xz Hash Sum mismatch"

Added by Patrick Donnelly about 5 years ago. Updated about 5 years ago.

Status:
In Progress
Priority:
High
Assignee:
David Galloway
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2019-03-07T07:41:44.772 INFO:teuthology.orchestra.run.smithi132:> sudo apt-get update
2019-03-07T07:41:45.107 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:1 http://archive.ubuntu.com/ubuntu xenial InRelease
2018-03-07T07:41:45.107 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://security.ubuntu.com/ubuntu xenial-security InRelease [109 kB]
2019-03-07T07:41:45.168 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu xenial-updates InRelease [109 kB]
2019-03-07T07:41:45.304 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:4 https://chacra.ceph.com/r/valgrind/latest/HEAD/ubuntu/xenial/flavors/default xenial InRelease
2019-03-07T07:41:45.325 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:5 https://chacra.ceph.com/r/valgrind/latest/HEAD/ubuntu/xenial/flavors/default xenial Release
2019-03-07T07:41:45.367 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:6 https://chacra.ceph.com/r/valgrind/latest/HEAD/ubuntu/xenial/flavors/default xenial Release.gpg
2019-03-07T07:41:45.513 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu xenial-backports InRelease [107 kB]
2019-03-07T07:41:45.554 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages [621 kB]
2019-03-07T07:41:45.664 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [920 kB]
2019-03-07T07:41:45.881 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://security.ubuntu.com/ubuntu xenial-security/main i386 Packages [521 kB]
2019-03-07T07:41:45.926 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://security.ubuntu.com/ubuntu xenial-security/main Translation-en [256 kB]
2019-03-07T07:41:45.969 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [428 kB]
2019-03-07T07:41:46.002 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://security.ubuntu.com/ubuntu xenial-security/universe i386 Packages [373 kB]
2019-03-07T07:41:46.027 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://security.ubuntu.com/ubuntu xenial-security/universe Translation-en [172 kB]
2019-03-07T07:41:46.051 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [5,600 B]
2019-03-07T07:41:46.052 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://security.ubuntu.com/ubuntu xenial-security/multiverse i386 Packages [5,764 B]
2019-03-07T07:41:46.052 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://security.ubuntu.com/ubuntu xenial-security/multiverse Translation-en [2,676 B]
2019-03-07T07:41:46.067 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:18 http://archive.ubuntu.com/ubuntu xenial-updates/main i386 Packages
2019-03-07T07:41:46.153 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu xenial-updates/main Translation-en [370 kB]
2019-03-07T07:41:46.615 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu xenial-updates/restricted amd64 Packages [7,556 B]
2019-03-07T07:41:46.698 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu xenial-updates/restricted i386 Packages [7,524 B]
2019-03-07T07:41:46.780 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:22 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages
2019-03-07T07:41:46.860 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:23 http://archive.ubuntu.com/ubuntu xenial-updates/universe i386 Packages
2019-03-07T07:41:46.942 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [305 kB]
2019-03-07T07:41:47.067 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [16.6 kB]
2019-03-07T07:41:47.149 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse i386 Packages [15.8 kB]
2019-03-07T07:41:47.232 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse Translation-en [8,440 B]
2019-03-07T07:41:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu xenial-backports/main amd64 Packages [7,280 B]
2019-03-07T07:41:47.395 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu xenial-backports/main i386 Packages [7,288 B]
2019-03-07T07:41:47.477 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu xenial-backports/main Translation-en [4,456 B]
2019-03-07T07:41:47.559 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu xenial-backports/universe amd64 Packages [7,804 B]
2019-03-07T07:41:47.640 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu xenial-backports/universe i386 Packages [7,488 B]
2019-03-07T07:41:47.722 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu xenial-backports/universe Translation-en [4,184 B]
2019-03-07T07:41:47.925 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu xenial-updates/main i386 Packages [804 kB]
2019-03-07T07:41:48.050 INFO:teuthology.orchestra.run.smithi132.stdout:Err:18 http://archive.ubuntu.com/ubuntu xenial-updates/main i386 Packages
2019-03-07T07:41:48.050 INFO:teuthology.orchestra.run.smithi132.stdout:  Hash Sum mismatch
2019-03-07T07:41:48.125 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [737 kB]
2019-03-07T07:41:48.163 INFO:teuthology.orchestra.run.smithi132.stdout:Err:22 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages
2019-03-07T07:41:48.164 INFO:teuthology.orchestra.run.smithi132.stdout:
2019-03-07T07:41:48.244 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu xenial-updates/universe i386 Packages [675 kB]
2019-03-07T07:41:48.279 INFO:teuthology.orchestra.run.smithi132.stdout:Err:23 http://archive.ubuntu.com/ubuntu xenial-updates/universe i386 Packages
2019-03-07T07:41:48.280 INFO:teuthology.orchestra.run.smithi132.stdout:
2019-03-07T07:41:48.290 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 6,615 kB in 3s (1,970 kB/s)
2019-03-07T07:41:50.009 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists...
2019-03-07T07:41:50.049 INFO:teuthology.orchestra.run.smithi132.stderr:E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial-updates/main/binary-i386/Packages.xz  Hash Sum mismatch
2019-03-07T07:41:50.049 INFO:teuthology.orchestra.run.smithi132.stderr:E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial-updates/universe/binary-amd64/Packages.xz
2019-03-07T07:41:50.049 INFO:teuthology.orchestra.run.smithi132.stderr:E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial-updates/universe/binary-i386/Packages.xz
2019-03-07T07:41:50.050 INFO:teuthology.orchestra.run.smithi132.stderr:E: Some index files failed to download. They have been ignored, or old ones used instead.
2019-03-07T07:41:50.051 DEBUG:teuthology.orchestra.run:got remote process result: 100
2019-03-07T07:41:50.052 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 86, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 1244, in task
    version = need_to_install_distro(role_remote)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 762, in need_to_install_distro
    newest = get_latest_image_version_deb(remote, distribution)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 1051, in get_latest_image_version_deb
    remote.run(args=['sudo', 'apt-get', 'update'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 193, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 435, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 162, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 184, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed on smithi132 with status 100: 'sudo apt-get update'

From: /ceph/teuthology-archive/pdonnell-2019-03-07_07:21:16-fs-wip-pdonnell-testing-20190307.041917-distro-basic-smithi/3678307/teuthology.log

This is probably a transient error. What's the preferred way to retry this?

Related issues 1 (0 open — 1 closed)

Related to sepia - Bug #12122: massive test install failures on invalid package archiveResolvedZack Cerza06/23/2015

Actions
Actions
Copy link
 #1

Updated by Patrick Donnelly about 5 years ago

  • Related to Bug #12122: massive test install failures on invalid package archive added
Actions
Copy link
 #2

Updated by David Galloway about 5 years ago

  • Status changed from New to In Progress
  • Assignee set to David Galloway

I think the preferred method of handling this is by running our own mirror... which we do. The problem is, if the upstream repo is updated and a job is running while our downstream mirror is syncing, we'll still hit a Hash Sum mismatch.

https://blog.packagecloud.io/eng/2016/09/27/fixing-apt-hash-sum-mismatch-consistent-apt-repositories/

I'm just now learning about the Acquire-by-hash which we might be able to apply to our local apt mirror.

Actions
Copy link

Also available in: Atom PDF