HOWTO monitor the automated tests AKA nightlies » History » Version 4
Loïc Dachary, 05/09/2015 09:30 AM
1 | 1 | Loïc Dachary | h3. Automated tests AKA nightlies |
---|---|---|---|
2 | |||
3 | The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team: |
||
4 | |||
5 | * [[Typica]] |
||
6 | * [[Sepia]] |
||
7 | |||
8 | 3 | Loïc Dachary | h3. Tools |
9 | |||
10 | 4 | Loïc Dachary | * https://github.com/jcsp/scrape/blob/master/scrape.py |
11 | 3 | Loïc Dachary | |
12 | h3. Analyze |
||
13 | |||
14 | * sorting out the environmental noise |
||
15 | * create new bugs for errors for which there is no match in the tracker |
||
16 | * add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs) |
||
17 | |||
18 | 1 | Loïc Dachary | h3. The ceph-qa mailing list |
19 | |||
20 | 2 | Loïc Dachary | The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise. |