Project

General

Profile

Bug #19456

Hadoop suite failing on missing upstream tarball

Added by Yuri Weinstein almost 7 years ago. Updated about 5 years ago.

Status:
Rejected
Priority:
Low
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
knfs
Component(FS):
Labels (FS):
Java/Hadoop
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

This is jewel v10.2.7 point release candidate
Also true on all branches

Run: http://pulpito.ceph.com/yuriw-2017-03-31_20:16:45-hadoop-jewel-distro-basic-smithi/
Jobs: all
Logs: http://qa-proxy.ceph.com/teuthology/yuriw-2017-03-31_20:16:45-hadoop-jewel-distro-basic-smithi/971486/teuthology.log

2017-04-01T02:41:33.882 INFO:teuthology.orchestra.run.smithi163.stderr:http://apache.osuosl.org/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz:
2017-04-01T02:41:33.882 INFO:teuthology.orchestra.run.smithi163.stderr:2017-04-01 02:41:34 ERROR 404: Not Found.
2017-04-01T02:41:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:http://apache.osuosl.org/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz:
2017-04-01T02:41:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:2017-04-01 02:41:33 ERROR 404: Not Found.
2017-04-01T02:41:33.884 INFO:teuthology.orchestra.run.smithi167.stderr:http://apache.osuosl.org/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz:
2017-04-01T02:41:33.884 INFO:teuthology.orchestra.run.smithi167.stderr:2017-04-01 02:41:33 ERROR 404: Not Found.
2017-04-01T02:41:33.884 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 30, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/hadoop.py", line 200, in install_hadoop
    wait = False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 438, in wait
    proc.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 149, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 171, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed on smithi073 with status 8: 'wget -nv -O /home/ubuntu/cephtest/hadoop.tar.gz http://apache.osuosl.org/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz'

History

#1 Updated by Ken Dreyer almost 7 years ago

Looks like v2.5.2 is too old. It is now in the Apache archive: https://archive.apache.org/dist/hadoop/core/hadoop-2.5.2/hadoop-2.5.2.tar.gz

https://archive.apache.org/ says "Do note that a daily limit of 5GB per IP is being enforced on archive.apache.org, to prevent abuse", so I'm hesitant to just put that URL into Teuthology here.

I don't see much value in testing against an ancient EOL version of Hadoop that users cannot easily download.

#2 Updated by Nathan Cutler almost 7 years ago

I see the hadoop task is in ceph/teuthology - would it make sense to move it to ceph/ceph?

#3 Updated by John Spray almost 7 years ago

  • Project changed from Ceph to CephFS
  • Category set to 48

#4 Updated by John Spray almost 7 years ago

  • Subject changed from "http://apache.osuosl.org/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz" ERROR 404: Not Found in hadoop suite to Hadoop suite failing on missing upstream tarball "http://apache.osuosl.org/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz" ERROR 404: Not Found in hadoop suite
  • Priority changed from Urgent to Low

#5 Updated by John Spray almost 7 years ago

  • Subject changed from Hadoop suite failing on missing upstream tarball "http://apache.osuosl.org/hadoop/common/hadoop-2.5.2/hadoop-2.5.2.tar.gz" ERROR 404: Not Found in hadoop suite to Hadoop suite failing on missing upstream tarball

#6 Updated by Patrick Donnelly about 5 years ago

  • Status changed from New to Rejected

Java/Hadoop testing is no longer a priority.

#7 Updated by Patrick Donnelly about 5 years ago

  • Category deleted (48)
  • Labels (FS) Java/Hadoop added

Also available in: Atom PDF