HOWTO monitor the automated tests AKA nightlies » History » Version 36
Yuri Weinstein, 11/25/2018 05:04 PM
1 | 1 | Loïc Dachary | h3. Automated tests AKA nightlies |
---|---|---|---|
2 | |||
3 | The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team: |
||
4 | |||
5 | * [[Sepia]] |
||
6 | 26 | Loïc Dachary | * [[Ovh]] |
7 | 1 | Loïc Dachary | |
8 | 36 | Yuri Weinstein | The following script is used in the above crontabs (https://github.com/ceph/ceph/blob/master/qa/crontab/teuthology-cronjobs) to schedule @rados@ suite. |
9 | 28 | Yuri Weinstein | https://github.com/ceph/ceph-qa-suite/blob/master/machine_types/schedule_rados.sh |
10 | 20 | Loïc Dachary | |
11 | 12 | Yuri Weinstein | h3. List of suites and watchers |
12 | 5 | Yuri Weinstein | |
13 | 6 | Yuri Weinstein | | *Suite* | *Watchers* | |
14 | 9 | Sage Weil | | smoke | Sage, Yuri | |
15 | 33 | Yuri Weinstein | | powercycle | Neha | |
16 | | rados | Neha, Josh | |
||
17 | 29 | Yuri Weinstein | | rbd | Jason | |
18 | 34 | Yuri Weinstein | | krbd | Ilya | |
19 | 32 | Yuri Weinstein | | rgw | Casey, Yehuda | |
20 | 35 | Yuri Weinstein | | fs | Patrick, Venky | |
21 | | kcephfs | Patrick, Venky | |
||
22 | | multimds | Patrick, Venky | |
||
23 | 33 | Yuri Weinstein | | ceph-deploy | Vasu | |
24 | 1 | Loïc Dachary | | upgrade/*** | Yuri | |
25 | 35 | Yuri Weinstein | | ceph-ansible | Brad | |
26 | 27 | Yuri Weinstein | | teuthology | ??? | |
27 | 5 | Yuri Weinstein | |
28 | 33 | Yuri Weinstein | * suites scheduled to run on current set of supported branches: *luminous*, *mimic* and *master*; *master* runs are used primarily for development purposes, *upgrade** tests are not scheduled to run on master. |
29 | |||
30 | 7 | Yuri Weinstein | |
31 | 3 | Loïc Dachary | h3. Analyze |
32 | |||
33 | 19 | Loïc Dachary | * See [[HOWTO forensic analysis of integration and upgrade tests]] |
34 | 3 | Loïc Dachary | * sorting out the environmental noise |
35 | * create new bugs for errors for which there is no match in the tracker |
||
36 | * add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs) |
||
37 | |||
38 | 1 | Loïc Dachary | h3. The ceph-qa mailing list |
39 | |||
40 | 2 | Loïc Dachary | The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise. |