Project

General

Profile

HOWTO monitor the automated tests AKA nightlies » History » Version 6

Yuri Weinstein, 05/11/2015 09:52 PM

1 1 Loïc Dachary
h3. Automated tests AKA nightlies
2
3
The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team:
4
5
* [[Typica]]
6
* [[Sepia]]
7
8 5 Yuri Weinstein
h3. List of suite and watchers
9
10 6 Yuri Weinstein
| *Suite*                    | *Watchers* |
11
| smoke                      | ? |
12
| big                        | ? |
13
| powercycle                 | Yuri |
14
| rados                      | Sage, Sam |
15
| rbd                        | Josh |
16
| rgw                        | ? |
17
| fs                         | Greg, John  |
18
| krb                        | Josh  |
19
| kcpehfs                    | Greg, John |
20
| knfs                       | Greg, John  |
21
| multimds                   | Greg, John  |
22
| samba                      | Greg, John  |
23
| ceph-deploy                | Travis, Yuri |
24
| upgrade/client-upgrade     | Yuri  |
25
| upgrade/dumpling-firefly-x | Yuri  |
26
| upgrade/firefly-x          | Yuri  |
27
| upgrade/giant-x            | Yuri  |
28
| upgrade/firefly            | Yuri  |
29
| upgrade/hammer             | Yuri  |
30
| upgrade/giant              | Yuri  |
31 5 Yuri Weinstein
32 3 Loïc Dachary
h3. Tools
33
34 4 Loïc Dachary
* https://github.com/jcsp/scrape/blob/master/scrape.py
35 3 Loïc Dachary
36
h3. Analyze
37
38
* sorting out the environmental noise
39
* create new bugs for errors for which there is no match in the tracker
40
* add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs)
41
42 1 Loïc Dachary
h3. The ceph-qa mailing list
43
44 2 Loïc Dachary
The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise.