Feature #4994
closedTeuthology test suite failure to assign pass/fail needs to be recorded
0%
Description
Teuthology needs to report test suite failures (task timeouts, tasks crashing, tasks failing to load).
Updated by Anonymous almost 11 years ago
- Subject changed from Teuthology test suite failure assign pass/fail needs to be recorded to Teuthology test suite failure to assign pass/fail needs to be recorded
Updated by Anonymous almost 11 years ago
- Target version deleted (
v0.67 - Dumpling)
Updated by Sage Weil almost 11 years ago
- Target version changed from v0.65 to v0.66
Updated by Sage Weil almost 11 years ago
- Target version changed from v0.66 to v0.67 - Dumpling
Updated by Sage Weil almost 11 years ago
- Target version deleted (
v0.67 - Dumpling)
Updated by Anonymous over 10 years ago
As a first pass, I think that we can create a table on teuthology.front.sepia.ceph.com with the following fields:
directory varchar(255) pid integer result enum(success, fail, not-run, hung, hung-with-error) info varchar(255) directory would be the directory in /a corresponding to the suite. pid would be the pid of a specific test. result would be the result of the run: success -- passed (according to results.log) fail -- failed (according to results.log) not-run -- hung (according to results.log) where no other information is available hung-with-error -- hung (according to results.log) where the error can be determined by looking at a left over teuthology.log or summary.yaml file hung -- hung (according to results.log) where teuthology.log or summary.yaml indicates the test had not completed before the timeout) info would contain text that can be gleaned from results.log (in the case of passes and failures) or the summary.yaml and teuthology.log files (in the case of hangs)
A new teuthology command, teuthology-update-db will be used to update the database. It would take the directory to use as input data to the database as a parameter.
A script can be written to populate the database with tests already in /a. After that, a call to teuthology-update-db can be added to schedule_suite.sh to make sure that the database stays up to date as tests are run.
Updated by Anonymous over 10 years ago
Note that this table will be one flat table. After we get this set up, we can probably add other tables extracting index values out of the information in the directory field to be used as quick access keys if we wanted to spiffy things up.
Updated by Sage Weil over 10 years ago
couple thoughts:
- a separate column for the name of the run would be good so it doesn't have to be parsed out of the path
- and autoincrement id column, or should we make the path the primary key?
Updated by Ian Colle over 10 years ago
- Status changed from New to Fix Under Review
Updated by Ian Colle over 10 years ago
- Target version changed from v0.68 - continued to v0.69
Updated by Ian Colle over 10 years ago
- Target version changed from v0.69 to v0.71
Updated by Ian Colle over 10 years ago
- Status changed from Fix Under Review to Resolved