Project

General

Profile

Actions

Bug #44173

closed

mgr/dashboard: run-backend-api-tests script fails with "teuthology.exceptions.CommandFailedError" in Jenkins

Added by Laura Paduano about 4 years ago. Updated about 4 years ago.

Status:
Can't reproduce
Priority:
Normal
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/bin/ceph-mon -i a -c /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/ceph.conf 
2020-02-17T12:12:45.907+0000 7fa3612b2700 -1 error: monitor data filesystem reached concerning levels of available storage space (available: 3% 6.2 GiB)
you may adjust 'mon data avail crit' to a lower value to make this go away (default: 5%)

Using guessed paths /home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/lib/ ['/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/qa', '/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/build/lib/cython_modules/lib.3', '/home/jenkins-build/build/workspace/ceph-dashboard-pr-backend/src/pybind']
Traceback (most recent call last):
  File "../qa/tasks/vstart_runner.py", line 1544, in <module>
    exec_test()
  File "../qa/tasks/vstart_runner.py", line 1364, in exec_test
    remote.run(args, env=vstart_env, timeout=(3 * 60))
  File "../qa/tasks/vstart_runner.py", line 390, in run
    proc.wait()
  File "../qa/tasks/vstart_runner.py", line 190, in wait
    raise CommandFailedError(self.args, self.exitstatus)
teuthology.exceptions.CommandFailedError: Command failed with status 28: ['../src/vstart.sh', '-n', '-d', '--nolockdep']
See:

This is not happening on all builds, so this seems to be related to the machine where the build is executed.

Actions #1

Updated by Laura Paduano about 4 years ago

  • Description updated (diff)
Actions #2

Updated by Kefu Chai about 4 years ago

  • Project changed from mgr to sepia
  • Category deleted (151)

seems the build host is running out of space: "(available: 3% 6.2 GiB)".

Actions #3

Updated by Kefu Chai about 4 years ago

  • Assignee set to David Galloway
Actions #4

Updated by David Galloway about 4 years ago

Is this a vstart cluster? Is it possible to configure the size of the "node" with the mon running on it?

Actions #5

Updated by Laura Paduano about 4 years ago

David Galloway wrote:

Is this a vstart cluster? Is it possible to configure the size of the "node" with the mon running on it?

Yes, it is. We're executing https://github.com/ceph/ceph/blob/master/src/pybind/mgr/dashboard/run-backend-api-tests.sh on Jenkins, which runs

python ../qa/tasks/vstart_runner.py --ignore-missing-binaries $OPTIONS $(echo $TEST_CASES)

Not sure if it's possible to configure the size of the node though.

Actions #6

Updated by Laura Paduano about 4 years ago

  • Status changed from New to Can't reproduce
Actions

Also available in: Atom PDF