Project

General

Profile

Edit History

HOWTO »

HOWTO monitor the automated tests AKA nightlies » History » Version 10

Sage Weil, 05/11/2015 10:00 PM

1 1 Loïc Dachary 
h3. Automated tests AKA nightlies
2 





    3
    
    
    
The "sepia lab":http://ceph.com/docs/master/dev/sepia/ runs automated teuthology tests on a regular basis. They are sometime called the *nightlies*. The schedule of the nightlies is managed by the QE team:





    4
    
    
    





    5
    
    
    
* [[Typica]]





    6
    
    
    
* [[Sepia]]





    7
    
    
    





    8
    5
    Yuri Weinstein
    
h3. List of suite and watchers





    9
    
    
    





    10
    6
    Yuri Weinstein
    
| *Suite*                    | *Watchers* |





    11
    9
    Sage Weil
    
| smoke                      | Sage, Yuri |





    12
    
    
    
| big                        | Sage, Sam |





    13
    6
    Yuri Weinstein
    
| powercycle                 | Yuri |





    14
    
    
    
| rados                      | Sage, Sam |





    15
    
    
    
| rbd                        | Josh |





    16
    10
    Sage Weil
    
| krbd                        | Josh  |





    17
    9
    Sage Weil
    
| rgw                        | Yehuda |





    18
    6
    Yuri Weinstein
    
| fs                         | Greg, John  |





    19
    10
    Sage Weil
    
| kcephfs                    | Greg, John |





    20
    6
    Yuri Weinstein
    
| knfs                       | Greg, John  |





    21
    
    
    
| multimds                   | Greg, John  |





    22
    
    
    
| samba                      | Greg, John  |





    23
    
    
    
| ceph-deploy                | Travis, Yuri |





    24
    
    
    
| upgrade/client-upgrade     | Yuri  |





    25
    
    
    
| upgrade/dumpling-firefly-x | Yuri  |





    26
    
    
    
| upgrade/firefly-x          | Yuri  |





    27
    
    
    
| upgrade/giant-x            | Yuri  |





    28
    
    
    
| upgrade/firefly            | Yuri  |





    29
    
    
    
| upgrade/hammer             | Yuri  |





    30
    
    
    
| upgrade/giant              | Yuri  |





    31
    5
    Yuri Weinstein
    





    32
    8
    Yuri Weinstein
    
* @suites scheduled to run on current set of supported branches: firefly, giant, hammer, next and master; master runs are used primarily for development purposes, upgrade tests are not scheduled to run on master.@





    33
    7
    Yuri Weinstein
    





    34
    3
    Loïc Dachary
    
h3. Tools





    35
    
    
    





    36
    4
    Loïc Dachary
    
* https://github.com/jcsp/scrape/blob/master/scrape.py





    37
    3
    Loïc Dachary
    





    38
    
    
    
h3. Analyze





    39
    
    
    





    40
    
    
    
* sorting out the environmental noise





    41
    
    
    
* create new bugs for errors for which there is no match in the tracker





    42
    
    
    
* add a link to the failed job in pre-existing issues found in the tracker (useful to figure out the frequency and helps with debug when there are multiple outputs / logs)





    43
    
    
    





    44
    1
    Loïc Dachary
    
h3. The ceph-qa mailing list





    45
    
    
    





    46
    2
    Loïc Dachary
    
The results of the nightlies are published for analysis on the "ceph-qa mailing list":http://lists.ceph.com/listinfo.cgi/ceph-qa-ceph.com/. For a given release, the issues that make a job fail in the nightlies need to be backported with a higher priority to reduce the noise.