HOWTO monitor the automated tests AKA nightlies » History » Version 5
Yuri Weinstein, 05/11/2015 09:48 PM
| 1 | 1 | Loïc Dachary | h3. Automated tests AKA nightlies |
|---|---|---|---|
| 2 | |||
| 3 | The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team: |
||
| 4 | |||
| 5 | * [[Typica]] |
||
| 6 | * [[Sepia]] |
||
| 7 | |||
| 8 | 5 | Yuri Weinstein | h3. List of suite and watchers |
| 9 | |||
| 10 | | *Suite* | *Watchers* | |
||
| 11 | | smoke | ? | |
||
| 12 | | big | ? | |
||
| 13 | | powercycle | Yuri | |
||
| 14 | | rados | Sage, Sam | |
||
| 15 | | rbd | Josh | |
||
| 16 | | rgw | ? | |
||
| 17 | | fs | Greg, John | |
||
| 18 | | krb | Josh | |
||
| 19 | | kcpehfs | Greg, John | |
||
| 20 | | knfs | Greg, John | |
||
| 21 | | multimds | Greg, John | |
||
| 22 | | samba | Greg, John | |
||
| 23 | | ceph-deploy | Travis, Yuri | |
||
| 24 | | upgrade/client-upgrade | | |
||
| 25 | | | | |
||
| 26 | |||
| 27 | 3 | Loïc Dachary | h3. Tools |
| 28 | |||
| 29 | 4 | Loïc Dachary | * https://github.com/jcsp/scrape/blob/master/scrape.py |
| 30 | 3 | Loïc Dachary | |
| 31 | h3. Analyze |
||
| 32 | |||
| 33 | * sorting out the environmental noise |
||
| 34 | * create new bugs for errors for which there is no match in the tracker |
||
| 35 | * add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs) |
||
| 36 | |||
| 37 | 1 | Loïc Dachary | h3. The ceph-qa mailing list |
| 38 | |||
| 39 | 2 | Loïc Dachary | The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise. |