Feature #10561
closedteuthology: ability to test kernel for RHEL
Added by Tamilarasi muthamizhan over 9 years ago. Updated over 9 years ago.
0%
Description
as we discussed, the solution would be to add an option like "brew:buildId" to the teuthology command that schedules suites or whatever applies inorder to pull the kernel builds from brew and test it on RHEL distros.
Updated by Andrew Schoen over 9 years ago
- Status changed from New to In Progress
- Assignee set to Andrew Schoen
I think we should be able to get the info we need to download packages from brew using koji.
Here's some terminal output with an example on a magna box. I just had to 'sudo yum -y install koji' before I did this.
[ubuntu@magna074 ~]$ python
Python 2.7.5 (default, Feb 11 2014, 07:46:25)
[GCC 4.8.2 20140120 (Red Hat 4.8.2-13)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import koji
>>> hub = koji.ClientSession('http://brewhub.devel.redhat.com/brewhub')
>>> build_info = hub.getBuild(412677)
>>> build_info
{'owner_name': 'kdreyer', 'package_name': 'ceph', 'task_id': 8534149, 'completion_ts': 1421278726.1171, 'creation_event_id': 10486804, 'creation_time': '2015-01-14 18:15:17.003134',
'epoch': None, 'nvr': 'ceph-0.80.5-4.el7ost', 'name': 'ceph', 'completion_time': '2015-01-14 18:38:46.1171', 'state': 1, 'version': '0.80.5', 'volume_name': 'DEFAULT', 'release': '
4.el7ost', 'creation_ts': 1421277317.00313, 'package_id': 34590, 'id': 412677, 'volume_id': 0, 'owner_id': 2826}
>>> base_url = "http://download.devel.redhat.com/brewroot/packages/{name}/{ver}/{release}/{arch}/"
>>> base_url = base_url.format(name=build_info['package_name'], ver=build_info['version'], release=build_info['release'], arch="x86_64")
>>> base_url
'http://download.devel.redhat.com/brewroot/packages/ceph/0.80.5/4.el7ost/x86_64/'
>>> rpm_name = "{name}-{ver}-{release}.{arch}.rpm"
>>> rpm_name = rpm_name.format(name="ceph-common", ver=build_info["version"], release=build_info["release"], arch="x86_64")
>>> rpm_name
'ceph-common-0.80.5-4.el7ost.x86_64.rpm'
>>> download_url = base_url + rpm_name
>>> download_url
'http://download.devel.redhat.com/brewroot/packages/ceph/0.80.5/4.el7ost/x86_64/ceph-common-0.80.5-4.el7ost.x86_64.rpm'
Updated by Andrew Schoen over 9 years ago
I was able to manually install a brew-sourced kernel (https://brewweb.devel.redhat.com/buildinfo?buildID=416058) onto magna074 today using the steps teuthology takes. However, when I ran the kernel task against magna074 again with the kernel stanza set to "distro" it did not uninstall the brew-sourced kernel. Here's the log from that run: http://magna002.ceph.redhat.com/andrewschoen/test-kernel/teuthology.log
We might have a bug here in the teuthology code that decides where or not to re-install a "distro" kernel: https://github.com/ceph/teuthology/blob/master/teuthology/task/kernel.py#L571
If I run those checks need_to_install_distro does on a freshly nuked machine (magna067) it would consider kernel-3.18.0_ceph_11304_gc50def6-1.x86_64 a "distro" kernel which I'm not sure is correct.
Updated by Andrew Schoen over 9 years ago
I reran the kernel task against magna074 with the sha1: "distro" removed from the kernel stanza in the config. This time it did install a different kernel.
Here's the log: http://magna002.ceph.redhat.com/andrewschoen/test-kernel-no-sha1/teuthology.log
Before the run, this is what manga074 reported as the installed kernel.
[ubuntu@magna074 ~]$ uname -a Linux magna074 3.10.0-123.20.1.el7.x86_64 #1 SMP Wed Jan 21 09:45:55 EST 2015 x86_64 x86_64 x86_64 GNU/Linux
After the run:
andrewschoen@magna002:~$ ssh magna074 'uname -a' Linux magna074 3.18.0-rc4-ceph-00015-g388cfdc #1 SMP Thu Nov 13 15:52:32 EST 2014 x86_64 x86_64 x86_64 GNU/Linux
Updated by Andrew Schoen over 9 years ago
I've been running into connection errors with brewhub.devel.redhat.com/brewhub often. I'm not sure if there is a different endpoint I should be using (this is what mojo shows to use) or if we're being rate limited or something. Maybe brewhub just isn't that stable or we've got network issues in octo.
2015-01-23 10:03:55,819.819 INFO:teuthology.orchestra.run.magna067:Running: 'python -c \'import koji; hub = koji.ClientSession("http://brewhub.devel.redhat.com/brewhub"); print hub.
getBuild(416058)\''
2015-01-23 10:03:56,269.269 ERROR:teuthology.task.kernel:Failed to query koji for build 416058
2015-01-23 10:03:56,270.270 ERROR:teuthology.task.kernel:stdout:
2015-01-23 10:03:56,270.270 ERROR:teuthology.task.kernel:stderr: Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 1555, in __call__
return self.__func(self.__name,args,opts)
File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 1898, in _callMethod
return self._sendCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 1809, in _sendCall
return self._sendOneCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 1827, in _sendOneCall
cnx.endheaders()
File "/usr/lib64/python2.7/httplib.py", line 969, in endheaders
self._send_output(message_body)
File "/usr/lib64/python2.7/httplib.py", line 829, in _send_output
self.send(msg)
File "/usr/lib64/python2.7/httplib.py", line 791, in send
self.connect()
File "/usr/lib64/python2.7/httplib.py", line 772, in connect
self.timeout, self.source_address)
File "/usr/lib64/python2.7/socket.py", line 553, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
socket.gaierror: [Errno -2] Name or service not known
Updated by Zack Cerza over 9 years ago
Isn't that a DNS failure? We have a known issue with DNS in that lab.
Updated by Andrew Schoen over 9 years ago
Updated by Andrew Schoen over 9 years ago
We've decided to use 'koji' everywhere we used the term 'brew'. So, now the yaml config will need a 'koji: <build_id>' stanza added to 'kernel' to enable this feature.
Updated by Andrew Schoen over 9 years ago
- Status changed from In Progress to Resolved