Tools » teuthology

Yet another job that is more complicated than you'd think. Here is a dump of what needs to be done so far:

Everything schedule_suite.sh does needs to be implemented in python so it can be merged with teuthology-suite in teuthology/suite.py.

People apparently use teuthology-ls which is implemented in teuthology/suite.py so I'll probably have to re-implement that somehow.
[Edit: Just kidding, I moved it. https://github.com/ceph/teuthology/commit/2a7de82498602ba5317e2fe74d68efc3e3f5af40]

teuthology/suite.py is what generates the job configs based on the parameters it's passed, and based on the ceph-qa-suite repo. It calls teuthology-schedule automatically (but I'll need to make that optional for testing).

teuthology/schedule.py currently has a giant main() function that does one of three things: print a job, delete a job, schedule a job. Those should be split up.
Printing and deleting are already done by teuthology-queue in teuthology/beanstalk.py (don't let the name fool you; it was designed to be easily ported to use only paddles). Job scheduling can also be added there.

The teuthology-schedule work:
https://github.com/ceph/teuthology/pull/270

Frankly I'm having some trouble figuring out where this should all go. I'll try to write down questions I come up with.

• Does anything use the 'template' feature of schedule_suite.sh ?
• Does anything ever pass multiple --collections to teuthology-suite ?

Zack Cerza wrote:

Frankly I'm having some trouble figuring out where this should all go. I'll try to write down questions I come up with.

• Does anything use the 'template' feature of schedule_suite.sh ?
• Does anything ever pass multiple --collections to teuthology-suite ?

Not that I can find!

So I've been doing a lot of work merging the schedule_suite.sh functionality into teuthology-schedule / teuthology.schedule. My work is almost ready to merge and is located here:
https://github.com/ceph/teuthology/tree/wip-schedule-suite

I opened this PR:
https://github.com/ceph/teuthology/pull/273

I still need to consolidate what update.sh does somewhere into teuthology so that the cronjobs can call teuthology-suite directly. I didn't want to do quite all of that in one go.

Reusing the same branch, I have implemented the repo management stuff so we can almost get rid of those two shellscripts and change the cronjobs to call teuthology-suite directly. I need to get ceph-qa-suite.git put into the ceph.com mirror though - the one that's currently there is way old.