Ceph

Newer versions of automake (1.12.0b and later) have reworked make check output so that it, by default,

1) collects stdout/stderr from each test, and while the tests are running, only outputs 'PASS|FAIL: <testname>, which makes it easy to look through the grouping and see which have failed, but

2) with VERBOSE set, will output test-suite.log, which captures each failure along with its stdout/stderr, and a count of total PASS/FAIL/etc.

Here's a snippet of how it looks with automake 1.14:

FAIL: test/ceph-disk.sh
=======================

+ PS4='${FUNCNAME[0]}: $LINENO: '
main: 20: export PATH=:/home/dmick/src/ceph/ice-tools/v/bin:/home/dmick/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/home/dmick/src/ceph/teuthology/virtualenv/bin
main: 20: PATH=:/home/dmick/src/ceph/ice-tools/v/bin:/home/dmick/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/home/dmick/src/ceph/teuthology/virtualenv/bin
main: 21: DIR=test-ceph-disk
main: 22: MON_ID=a
main: 23: MONA=127.0.0.1:7451
main: 24: TEST_POOL=rbd
mmain: 25: uuidgen
main: 25: FSID=0745d9a0-cf08-4fad-ac60-0f604d9ee66d
main: 26: export CEPH_CONF=/dev/null
main: 26: CEPH_CONF=/dev/null
main: 27: export 'CEPH_ARGS=--fsid 0745d9a0-cf08-4fad-ac60-0f604d9ee66d'
main: 27: CEPH_ARGS='--fsid 0745d9a0-cf08-4fad-ac60-0f604d9ee66d'
main: 28: CEPH_ARGS+=' --chdir='
main: 29: CEPH_ARGS+=' --run-dir=test-ceph-disk'
main: 30: CEPH_ARGS+=' --mon-host=127.0.0.1:7451'
main: 31: CEPH_ARGS+=' --log-file=test-ceph-disk/$name.log'
main: 32: CEPH_ARGS+=' --pid-file=test-ceph-disk/$name.pidfile'
main: 33: CEPH_ARGS+=' --auth-supported=none'
main: 34: CEPH_DISK_ARGS=
main: 35: CEPH_DISK_ARGS+=' --statedir=test-ceph-disk'
main: 36: CEPH_DISK_ARGS+=' --sysconfdir=test-ceph-disk'
main: 37: CEPH_DISK_ARGS+=' --prepend-to-path='
main: 38: CEPH_DISK_ARGS+=' --verbose'
main: 39: TIMEOUT=360
mmain: 41: which cat
main: 41: cat=/bin/cat
mmain: 42: which timeout
main: 42: timeout=/usr/bin/timeout
mmain: 43: which diff
main: 43: diff=/usr/bin/diff
main: 45: exit 1

============================================================================
Testsuite summary for ceph 0.82
============================================================================
# TOTAL: 77
# PASS:  69
# SKIP:  0
# XFAIL: 0
# FAIL:  8
# XPASS: 0
# ERROR: 0
============================================================================
See src/test-suite.log
Please report to ceph-devel@vger.kernel.org
============================================================================
make[1]: *** [test-suite.log] Error 1
make[1]: Leaving directory `/home/dmick/src/ceph/ceph/src'
make: *** [check-TESTS] Error 2