HOWTO monitor the automated tests AKA nightlies » History » Version 31
Yuri Weinstein, 09/21/2017 08:02 PM
| 1 | 1 | Loïc Dachary | h3. Automated tests AKA nightlies |
|---|---|---|---|
| 2 | |||
| 3 | The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team: |
||
| 4 | |||
| 5 | * [[Sepia]] |
||
| 6 | 26 | Loïc Dachary | * [[Ovh]] |
| 7 | 1 | Loïc Dachary | |
| 8 | 22 | Yuri Weinstein | The following script is used in the above crontabs to schedule @rados@ suite. |
| 9 | 28 | Yuri Weinstein | https://github.com/ceph/ceph-qa-suite/blob/master/machine_types/schedule_rados.sh |
| 10 | 20 | Loïc Dachary | |
| 11 | |||
| 12 | 12 | Yuri Weinstein | h3. List of suites and watchers |
| 13 | 5 | Yuri Weinstein | |
| 14 | 6 | Yuri Weinstein | | *Suite* | *Watchers* | |
| 15 | 9 | Sage Weil | | smoke | Sage, Yuri | |
| 16 | 1 | Loïc Dachary | | powercycle | Yuri | |
| 17 | 29 | Yuri Weinstein | | rados | Sage, Josh | |
| 18 | | rbd | Jason | |
||
| 19 | | krbd | Jason, Ilya | |
||
| 20 | 9 | Sage Weil | | rgw | Yehuda | |
| 21 | 30 | Yuri Weinstein | | fs | Patrick | |
| 22 | 29 | Yuri Weinstein | | kcephfs | Patrick, Zheng | |
| 23 | | knfs | Patrick, Zheng | |
||
| 24 | 30 | Yuri Weinstein | | multimds | Patrick | |
| 25 | | samba | Patrick | |
||
| 26 | 27 | Yuri Weinstein | | ceph-deploy | Alfredo, Yuri | |
| 27 | | upgrade/*** | Yuri | |
||
| 28 | 31 | Yuri Weinstein | | ceph-ansible | Vasu, Sebastian, Andrew, Alfredo | |
| 29 | 27 | Yuri Weinstein | | teuthology | ??? | |
| 30 | 5 | Yuri Weinstein | |
| 31 | 25 | Yuri Weinstein | * suites scheduled to run on current set of supported branches: *hammer*, *infernalis*, *jewel* and *master*; *master* runs are used primarily for development purposes, *upgrade** tests are not scheduled to run on master. |
| 32 | 17 | Yuri Weinstein | * *big* and *powercycle* suites are run manually |
| 33 | 7 | Yuri Weinstein | |
| 34 | 3 | Loïc Dachary | h3. Analyze |
| 35 | |||
| 36 | 19 | Loïc Dachary | * See [[HOWTO forensic analysis of integration and upgrade tests]] |
| 37 | 3 | Loïc Dachary | * sorting out the environmental noise |
| 38 | * create new bugs for errors for which there is no match in the tracker |
||
| 39 | * add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs) |
||
| 40 | |||
| 41 | 1 | Loïc Dachary | h3. The ceph-qa mailing list |
| 42 | |||
| 43 | 2 | Loïc Dachary | The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise. |