Project

General

Profile

Actions

Feature #6026

closed

teuthology: make log output to be more useful

Added by Sage Weil over 10 years ago. Updated over 10 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:
Actions #1

Updated by Sage Weil over 10 years ago

  • Subject changed from teuthology: make logger output to be more useful to teuthology: make log output to be more useful
Actions #2

Updated by Sage Weil over 10 years ago

  • Translation missing: en.field_story_points set to 8.00
Actions #3

Updated by Sage Weil over 10 years ago

  • Status changed from New to 12
Actions #4

Updated by Zack Cerza over 10 years ago

  • Assignee set to Zack Cerza
Actions #5

Updated by Alfredo Deza over 10 years ago

I took some of the output and created this http://fpaste.org/35168/13776203/

I am pasting the output here as the link above may expire

Test Session
=================================================================
logs:   http://teuthology.front.sepia.ceph.com/archive/ubuntu-2013-08-26_20:28:38-smoke-dumpling-testing-basic-vps
passed: 36
failed: 2
hung:   0

Failures
=================================================================

[7353] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml
-----------------------------------------------------------------
time:   405s
log:    http://teuthology.front.sepia.ceph.com/archive/ubuntu-2013-08-26_20:28:38-smoke-dumpling-testing-basic-vps/7353
sentry: http://sentry.front.sepia.ceph.com/inktank/teuthology/search?q=03acb9c4e1664da8ad65741549fdef8b

tasks:rbd_cli_import_export.yaml
    Command failed on 10.214.138.170 with status 139: 'mkdir -p --
        /home/ubuntu/cephtest/7353/mnt.0/client.0/tmp && cd --
        /home/ubuntu/cephtest/7353/mnt.0/client.0/tmp &&
        CEPH_CLI_TEST_DUP_COMMAND=1
        CEPH_REF=b3a280d5af9d06783d2698bd434940de94ab0fda
        TESTDIR="/home/ubuntu/cephtest/7353" CEPH_ID="0" 
        PYTHONPATH="$PYTHONPATH:/home/ubuntu/cephtest/7353/binary/usr/local/lib/python2.7/dist-packages:/home/ubuntu/cephtest/7353/binary/usr/local/lib/python2.6/dist-packages" 
        RBD_CREATE_ARGS=--new-format /home/ubuntu/cephtest/7353/adjust-ulimits
        ceph-coverage /home/ubuntu/cephtest/7353/archive/coverage
        /home/ubuntu/cephtest/7353/workunit.client.0/rbd/import_export.sh'

[7358] collection:multiclient clusters:two_clients.yaml
-----------------------------------------------------------------
time:   389s
log:    http://teuthology.front.sepia.ceph.com/archive/ubuntu-2013-08-26_20:28:38-smoke-dumpling-testing-basic-vps/7358
sentry: http://sentry.front.sepia.ceph.com/inktank/teuthology/search?q=296d6789a0c540eba89ef5153d7788f3

fs:btrfs.yaml tasks:locktest.yaml
    Command failed on 10.214.138.158 with status 1: "mkdir -p
        /home/ubuntu/cephtest/7358/locktest && rm -f
        /home/ubuntu/cephtest/7358/locktest/locktest.c && rm -f
        /home/ubuntu/cephtest/7358/locktest/locktest && rmdir
        '{tdir}/locktest'" 

Passed
=================================================================

[7340] collection: basic clusters:fixed-3.yaml fs:btrfs.yaml            (1147s)
tasks: cfuse_workunit_suites_blogbench.yaml

[7341] collection: basic clusters:fixed-3.yaml fs:btrfs.yaml            (1908s)
tasks: cfuse_workunit_suites_fsstress.yaml

[7342] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml             (2464s)
tasks:cfuse_workunit_suites_iozone.yaml

[7343] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml             (649s)
tasks:cfuse_workunit_suites_pjd.yaml

[7344] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml             (972s)
tasks:kclient_workunit_direct_io.yaml

[7345] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml             (2569s)
tasks:kclient_workunit_suites_dbench.yaml

Actions #6

Updated by Zack Cerza over 10 years ago

This is what I have so far:

Test Run
=================================================================
logs:   http://teuthology.front.sepia.ceph.com/archive/ubuntu-2013-08-26_20:28:38-smoke-dumpling-testing-basic-vps/
failed: 1
hung:   1
passed: 23

Failed
=================================================================
[7358]  collection:multiclient clusters:two_clients.yaml fs:btrfs.yaml tasks:locktest.yaml
-----------------------------------------------------------------
time:   389s
log:    http://teuthology.front.sepia.ceph.com/archive/ubuntu-2013-08-26_20:28:38-smoke-dumpling-testing-basic-vps/7358
sentry: http://sentry.front.sepia.ceph.com/inktank/teuthology/search?q=296d6789a0c540eba89ef5153d7788f3

    Command failed on 10.214.138.158 with status 1: "mkdir -p
    /home/ubuntu/cephtest/7358/locktest && rm -f
    /home/ubuntu/cephtest/7358/locktest/locktest.c && rm -f
    /home/ubuntu/cephtest/7358/locktest/locktest && rmdir '{tdir}/locktest'" 

Hung
=================================================================
[7351]

Passed
=================================================================
[7346] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:kclient_workunit_suites_fsstress.yaml
time:    1063s

[7344] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:kclient_workunit_direct_io.yaml
time:    972s

[7345] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:kclient_workunit_suites_dbench.yaml
time:    2569s

[7342] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:cfuse_workunit_suites_iozone.yaml
time:    2464s

[7343] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:cfuse_workunit_suites_pjd.yaml
time:    649s

[7340] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:cfuse_workunit_suites_blogbench.yaml
time:    1147s

[7341] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:cfuse_workunit_suites_fsstress.yaml
time:    1908s

[7349] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:rados_python.yaml
time:    2687s

[7369] collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:libcephfs_interface_tests.yaml validater:valgrind.yaml
time:    1492s

[7360] collection:multimon clusters:6.yaml tasks:mon_recovery.yaml
time:    1649s

[7361] collection:singleton all:filestore-idempotent.yaml fs:btrfs.yaml
time:    4131s

[7363] collection:singleton all:thrash-rados.yaml fs:btrfs.yaml
time:    1761s

[7364] collection:thrash clusters:6-osd-3-machine.yaml fs:xfs.yaml thrashers:default.yaml workloads:admin_socket_objecter_requests.yaml
time:    823s

[7350] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:rados_workunit_loadgen_mix.yaml
time:    2322s

[7352] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:rbd_api_tests_old_format.yaml
time:    609s

[7355] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:rbd_python_api_tests.yaml
time:    931s

[7354] collection:basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:rbd_cli_import_export_old_format.yaml
time:    1975s

[7373] collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:rados_api_tests.yaml validater:valgrind.yaml
time:    1853s

[7371] collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:mon_recovery.yaml validater:valgrind.yaml
time:    1654s

[7370] collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:mon_recovery.yaml validater:lockdep.yaml
time:    1311s

[7376] collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:rgw_s3tests.yaml validater:lockdep.yaml
time:    902s

[7375] collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:rados_cls_all.yaml validater:valgrind.yaml
time:    1016s

[7374] collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:rados_cls_all.yaml validater:lockdep.yaml
time:    453s

Actions #7

Updated by Zack Cerza over 10 years ago

I have since made the values for time represented as integers :)

Note: I am reusing the same comment rather than posting the output again and again.

Actions #8

Updated by Alfredo Deza over 10 years ago

this looks fantastic.

One minor thing to all this goodness is that I would like the exception/error from the failures to be indented to the right (as in my example) because it is easier to parse.

This is already a massive improvement, thanks for making this changes

Actions #9

Updated by Zack Cerza over 10 years ago

Alfredo Deza wrote:

this looks fantastic.

Thanks@

One minor thing to all this goodness is that I would like the exception/error from the failures to be indented to the right (as in my example) because it is easier to parse.

Just made the change you suggested and updated the comment. It's currently wrapped to 79 characters including the indent. Let me know what you think.

This is already a massive improvement, thanks for making this changes

:)

Actions #10

Updated by Alfredo Deza over 10 years ago

Where do I click to merge teh awesome?

Actions #11

Updated by Zack Cerza over 10 years ago

  • Status changed from 12 to Resolved
Actions

Also available in: Atom PDF