Tools » teuthology

Hopefully the 400 from this log can be correlated with something from the server's logs (timestamps are UK time).

$ teuthology-suite -s fs/basic -t wip-mds-sessions
2014-07-10 14:19:28,396.396 INFO:teuthology.repo_utils:Cloning https://github.com/ceph/ceph-qa-suite.git master from upstream
2014-07-10 14:19:37,122.122 INFO:teuthology.suite:kernel sha1: 20bdcbcb52ac95397901581086368dd79c06091f
2014-07-10 14:19:37,492.492 INFO:teuthology.suite:ceph sha1: bd6ba100428c1a67ccd1bce851e7778cfe21ebb1
2014-07-10 14:19:37,869.869 INFO:teuthology.suite:ceph version: v0.82-516.gbd6ba10
2014-07-10 14:19:39,175.175 INFO:teuthology.suite:s3-tests branch: master
2014-07-10 14:19:39,175.175 INFO:teuthology.suite:teuthology branch: wip-mds-sessions
2014-07-10 14:19:46,121.121 INFO:teuthology.suite:Suite fs/basic in /Users/john/src/ceph-qa-suite_master/suites/fs/basic generated 36 jobs
2014-07-10 14:19:46,130.130 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353065
2014-07-10 14:19:47,858.858 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_misc.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353066
2014-07-10 14:19:49,072.072 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_misc_test_o_trunc.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353067
2014-07-10 14:19:50,280.280 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_blogbench.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353068
2014-07-10 14:19:51,491.491 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_dbench.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353069
2014-07-10 14:19:52,923.923 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_ffsb.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353070
2014-07-10 14:19:54,125.125 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsstress.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353071
2014-07-10 14:19:55,330.330 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsx.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353072
2014-07-10 14:19:56,534.534 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsync.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353073
2014-07-10 14:19:58,084.084 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_iogen.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353074
2014-07-10 14:19:59,329.329 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_iozone.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353075
2014-07-10 14:20:00,596.596 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_pjd.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353076
2014-07-10 14:20:01,857.857 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_tiobench.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353077
2014-07-10 14:20:03,147.147 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_truncate_delay.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353078
2014-07-10 14:20:04,498.498 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_trivial_sync.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353079
2014-07-10 14:20:05,714.714 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/libcephfs_interface_tests.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353080
2014-07-10 14:20:06,924.924 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/libcephfs_java.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353081
2014-07-10 14:20:08,379.379 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/no.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/mds_creation_retry.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353082
2014-07-10 14:20:09,763.763 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353083
2014-07-10 14:20:10,976.976 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_misc.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353084
2014-07-10 14:20:12,223.223 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_misc_test_o_trunc.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353085
2014-07-10 14:20:13,487.487 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_blogbench.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353086
2014-07-10 14:20:14,689.689 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_dbench.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353087
2014-07-10 14:20:28,175.175 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana/jobs/ failed with status 400: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>400 Bad Request</title>
</head><body>
<h1>Bad Request</h1>
<p>Your browser sent a request that this server could not understand.<br />
</p>
<hr>
<address>Apache/2.2.22 (Ubuntu) Server at paddles.front.sepia.ceph.com Port 80</address>
</body></html>

2014-07-10 14:20:28,175.175 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/Users/john/git/teuthology-run/teuthology/report.py", line 437, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/Users/john/git/teuthology-run/teuthology/report.py", line 406, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/Users/john/git/teuthology-run/teuthology/report.py", line 313, in report_job
    response.raise_for_status()
  File "/usr/local/Cellar/python/2.7.5/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/requests/models.py", line 683, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
HTTPError: 400 Client Error: Bad Request
2014-07-10 14:20:28,207.207 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_ffsb.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353088
2014-07-10 14:20:29,596.596 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsstress.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353089
2014-07-10 14:20:30,811.811 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsx.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353090
2014-07-10 14:20:32,021.021 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsync.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353091
2014-07-10 14:20:33,248.248 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_iogen.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353092
2014-07-10 14:20:34,524.524 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_iozone.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353093
2014-07-10 14:20:35,742.742 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_pjd.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353094
2014-07-10 14:20:36,973.973 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_tiobench.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353095
2014-07-10 14:20:38,226.226 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_truncate_delay.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353096
2014-07-10 14:20:39,673.673 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_trivial_sync.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353097
2014-07-10 14:20:40,884.884 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/libcephfs_interface_tests.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353098
2014-07-10 14:20:42,092.092 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/libcephfs_java.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353099
2014-07-10 14:20:43,315.315 INFO:teuthology.suite:Scheduling fs/basic/{clusters/fixed-3.yaml debug/mds_client.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/mds_creation_retry.yaml}
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353100
Job scheduled with name john-2014-07-10_14:19:28-fs:basic-master-testing-basic-plana and ID 353101
(virtualenv)silver:teuthology-run john$