Project

General

Profile

Bug #18019

jenkins: do not randomly choose CentOS or Ubuntu slaves when running make check

Added by Loïc Dachary over 7 years ago. Updated over 6 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Some slaves run CentOS other run Ubuntu and they are randomly picked when running make check on pull requests. This introduces a random factor that makes it very difficult to figure out if a test is stable. It may fail because of an operating system difference of because there is a bug, there is no way to tell. A stable environment is necessary to run and diagnose tests.

It is a good idea to run the tests on various operating systems, but it must be done in a way that is not random. For instance a test can be run on CentOS first and if it succeeds it can then be run on other operating systems.

We are working hard to get a stable make check and this newly introduced randomness may be the cause of a recent mysterious instability reported at http://tracker.ceph.com/issues/18018 ... or not. We have no way to know for sure until the random selection of operating systems has been removed from the equation.

History

#1 Updated by Loïc Dachary over 7 years ago

  • Subject changed from jenkins: do not mix CentOS / Ubuntu slaves when running make check to jenkins: do not randomly choose CentOS or Ubuntu slaves when running make check

#2 Updated by Alfredo Deza over 7 years ago

It is not clear what would be the OS of choice from the description. The reason this happens is because the configuration for the job sets a rule of either one of those explicitly.

The way to fix this would be to change that configuration [0] to use the desired distribution.

Do you think you could provide a PR that addresses this to the distribution that you (Ceph PRs) prefer? Once that is merged the change takes effect within minutes.

[0] https://github.com/ceph/ceph-build/blob/master/ceph-pull-requests/config/definitions/ceph-pull-requests.yml#L6

#3 Updated by Alfredo Deza about 7 years ago

  • Status changed from 12 to Need More Info

#4 Updated by Alfredo Deza over 6 years ago

  • Status changed from Need More Info to Closed

Also available in: Atom PDF