HOWTO monitor the automated tests AKA nightlies » History » Version 14
Yuri Weinstein, 05/11/2015 10:20 PM
1 | 1 | Loïc Dachary | h3. Automated tests AKA nightlies |
---|---|---|---|
2 | |||
3 | The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team: |
||
4 | |||
5 | * [[Typica]] |
||
6 | * [[Sepia]] |
||
7 | |||
8 | 12 | Yuri Weinstein | h3. List of suites and watchers |
9 | 5 | Yuri Weinstein | |
10 | 6 | Yuri Weinstein | | *Suite* | *Watchers* | |
11 | 9 | Sage Weil | | smoke | Sage, Yuri | |
12 | | big | Sage, Sam | |
||
13 | 6 | Yuri Weinstein | | powercycle | Yuri | |
14 | | rados | Sage, Sam | |
||
15 | | rbd | Josh | |
||
16 | 11 | Sage Weil | | krbd | Josh, Ilya | |
17 | 9 | Sage Weil | | rgw | Yehuda | |
18 | 6 | Yuri Weinstein | | fs | Greg, John | |
19 | 11 | Sage Weil | | kcephfs | Greg, John, Zheng | |
20 | | knfs | Greg, John, Zheng | |
||
21 | | multimds | Greg, John, Zheng | |
||
22 | 6 | Yuri Weinstein | | samba | Greg, John | |
23 | | ceph-deploy | Travis, Yuri | |
||
24 | | upgrade/client-upgrade | Yuri | |
||
25 | | upgrade/dumpling-firefly-x | Yuri | |
||
26 | | upgrade/firefly-x | Yuri | |
||
27 | | upgrade/giant-x | Yuri | |
||
28 | | upgrade/firefly | Yuri | |
||
29 | | upgrade/hammer | Yuri | |
||
30 | | upgrade/giant | Yuri | |
||
31 | 5 | Yuri Weinstein | |
32 | 8 | Yuri Weinstein | * @suites scheduled to run on current set of supported branches: firefly, giant, hammer, next and master; master runs are used primarily for development purposes, upgrade tests are not scheduled to run on master.@ |
33 | 7 | Yuri Weinstein | |
34 | 3 | Loïc Dachary | h3. Tools |
35 | |||
36 | 4 | Loïc Dachary | * https://github.com/jcsp/scrape/blob/master/scrape.py |
37 | 13 | Yuri Weinstein | ** command line example: |
38 | <pre> |
||
39 | 14 | Yuri Weinstein | user@machine:~$ python ~/<scrape_dir>/scrape.py /a/<run_name> |
40 | 13 | Yuri Weinstein | </pre> |
41 | 3 | Loïc Dachary | |
42 | h3. Analyze |
||
43 | |||
44 | * sorting out the environmental noise |
||
45 | * create new bugs for errors for which there is no match in the tracker |
||
46 | * add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs) |
||
47 | |||
48 | 1 | Loïc Dachary | h3. The ceph-qa mailing list |
49 | |||
50 | 2 | Loïc Dachary | The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise. |