Project

General

Profile

HOWTO monitor the automated tests AKA nightlies » History » Version 35

Yuri Weinstein, 11/25/2018 05:00 PM

1 1 Loïc Dachary
h3. Automated tests AKA nightlies
2
3
The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team:
4
5
* [[Sepia]]
6 26 Loïc Dachary
* [[Ovh]]
7 1 Loïc Dachary
8 22 Yuri Weinstein
The following script is used in the above crontabs to schedule @rados@ suite.
9 28 Yuri Weinstein
https://github.com/ceph/ceph-qa-suite/blob/master/machine_types/schedule_rados.sh
10 20 Loïc Dachary
11 12 Yuri Weinstein
h3. List of suites and watchers
12 5 Yuri Weinstein
13 6 Yuri Weinstein
| *Suite*                    | *Watchers* |
14 9 Sage Weil
| smoke                      | Sage, Yuri |
15 33 Yuri Weinstein
| powercycle                 | Neha |
16
| rados                      | Neha, Josh |
17 29 Yuri Weinstein
| rbd                        | Jason |
18 34 Yuri Weinstein
| krbd                       | Ilya  |
19 32 Yuri Weinstein
| rgw                        | Casey, Yehuda |
20 35 Yuri Weinstein
| fs                         | Patrick, Venky |
21
| kcephfs                    | Patrick, Venky |
22
| multimds                   | Patrick, Venky |
23 33 Yuri Weinstein
| ceph-deploy                | Vasu |
24 1 Loïc Dachary
| upgrade/***                | Yuri  |
25 35 Yuri Weinstein
| ceph-ansible               | Brad |
26 27 Yuri Weinstein
| teuthology                 |   ??? |
27 5 Yuri Weinstein
28 33 Yuri Weinstein
*  suites scheduled to run on current set of supported branches: *luminous*, *mimic* and *master*; *master* runs are used primarily for development purposes, *upgrade** tests are not scheduled to run on master.
29
30 7 Yuri Weinstein
31 3 Loïc Dachary
h3. Analyze
32
33 19 Loïc Dachary
* See [[HOWTO forensic analysis of integration and upgrade tests]]
34 3 Loïc Dachary
* sorting out the environmental noise
35
* create new bugs for errors for which there is no match in the tracker
36
* add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs)
37
38 1 Loïc Dachary
h3. The ceph-qa mailing list
39
40 2 Loïc Dachary
The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise.