Project

General

Profile

Feature #9937

create a teuthology-supervisor utility

Added by Zack Cerza over 9 years ago. Updated almost 9 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:

Description

Currently, to run scheduled jobs, we have loads of teuthology-worker processes hanging around polling the beanstalkd queue. The number of workers per machine_type is hardcoded and essentially magic. The workers themselves are started by a very basic shell script that lives out-of-tree:

worker_start.sh

This approach often leads to many more jobs running than can actually get ahold of the resources they need. It is also not at all friendly to other organizations. Worse, when workers die we have to notice and start them up again.

What we should have is an in-tree teuthology-supervisor process that gets told how many workers to start, and keeps that many running - or, alternatively, eschews the worker concept altogether.

History

#1 Updated by Zack Cerza over 9 years ago

  • Description updated (diff)

Also available in: Atom PDF