Tools » teuthology

Yuri found this this evening. It's late so here's a paste party:

teuthology@teuthology:~$ teuthology-suite -v -c next -k distro -m plana,burnupi,mira -s upgrade/firefly-x --filter ubuntu_ --dry-run
2015-05-04 17:39:40,732.732 INFO:teuthology.suite:kernel sha1: distro
2015-05-04 17:39:40,732.732 DEBUG:teuthology.suite:Defaults for machine_type plana,burnupi,mira: arch=x86_64, release=rhel7_0, pkg_type=rpm)
2015-05-04 17:39:40,991.991 INFO:teuthology.suite:ceph sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
2015-05-04 17:39:40,991.991 DEBUG:teuthology.suite:Defaults for machine_type plana,burnupi,mira: arch=x86_64, release=rhel7_0, pkg_type=rpm)
2015-05-04 17:39:40,992.992 DEBUG:teuthology.suite:Looking for packages at http://gitbuilder.ceph.com/ceph-rpm-rhel7_0-x86_64-basic/sha1/2ffb030099ccccae9b87404b8af2578b1da07506/version
2015-05-04 17:39:40,998.998 INFO:teuthology.suite:ceph version: v0.94-917.g2ffb030
2015-05-04 17:39:40,998.998 INFO:teuthology.suite:teuthology branch: master
2015-05-04 17:39:41,339.339 INFO:teuthology.suite:ceph-qa-suite branch: next
2015-05-04 17:39:41,352.352 INFO:teuthology.repo_utils:Fetching from upstream into /home/teuthology/src/teuthology_master
2015-05-04 17:39:42,827.827 INFO:teuthology.repo_utils:Resetting repo at /home/teuthology/src/teuthology_master to branch master
2015-05-04 17:39:44,445.445 INFO:teuthology.repo_utils:Bootstrapping /home/teuthology/src/teuthology_master
2015-05-04 17:39:58,392.392 INFO:teuthology.repo_utils:Bootstrap exited with status 0
2015-05-04 17:39:58,441.441 INFO:teuthology.repo_utils:Fetching from upstream into /home/teuthology/src/ceph-qa-suite_next
2015-05-04 17:40:22,052.052 INFO:teuthology.repo_utils:Resetting repo at /home/teuthology/src/ceph-qa-suite_next to branch next
2015-05-04 17:40:27,047.047 DEBUG:teuthology.suite:Base job config:
branch: next
email: ceph-qa@ceph.com
kernel:
  kdb: true
  sha1: distro
machine_type: plana,burnupi,mira
name: teuthology-2015-05-04_17:39:40-upgrade:firefly-x-next-distro-basic-multi
nuke-on-error: true
overrides:
  admin_socket:
    branch: next
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    log-whitelist:
    - slow request
    sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
  ceph-deploy:
    branch:
      dev: next
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
  workunit:
    sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
priority: 1000
sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
suite: upgrade:firefly-x
suite_branch: next
tasks:
- chef: null
- clock.check: null
teuthology_branch: master
2015-05-04 17:40:27,074.074 DEBUG:teuthology.suite:Suite upgrade:firefly-x in /home/teuthology/src/ceph-qa-suite_next/suites/upgrade/firefly-x
2015-05-04 17:40:27,093.093 INFO:teuthology.suite:Suite upgrade:firefly-x in /home/teuthology/src/ceph-qa-suite_next/suites/upgrade/firefly-x generated 63 jobs (not yet filtered)
2015-05-04 17:40:27,358.358 DEBUG:teuthology.suite:Defaults for machine_type plana: arch=x86_64, release=precise, pkg_type=deb)
2015-05-04 17:40:27,359.359 DEBUG:teuthology.suite:Looking for packages at http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/sha1/2ffb030099ccccae9b87404b8af2578b1da07506/version
Traceback (most recent call last):
  File "/home/teuthology/teuthology/virtualenv/bin/teuthology-suite", line 9, in <module>
    load_entry_point('teuthology==0.1.0', 'console_scripts', 'teuthology-suite')()
  File "/home/teuthology/src/teuthology_master/scripts/suite.py", line 86, in main
    teuthology.suite.main(args)
  File "/home/teuthology/src/teuthology_master/teuthology/suite.py", line 111, in main
    subset=subset,
  File "/home/teuthology/src/teuthology_master/teuthology/suite.py", line 293, in prepare_and_schedule
    subset=subset
  File "/home/teuthology/src/teuthology_master/teuthology/suite.py", line 515, in schedule_suite
    raw_yaml = '\n'.join([file(a, 'r').read() for a in fragment_paths])
IOError: [Errno 2] No such file or directory: '/home/teuthology/src/ceph-qa-suite_next/suites/upgrade/firefly-x/parallel/ec-rados-parallel.yaml'

My git bisect results:

9a57759ec3df7a8b9490920538214ac189418c49 is the first bad commit
commit 9a57759ec3df7a8b9490920538214ac189418c49
Author: Samuel Just <sjust@redhat.com>
Date:   Fri Mar 27 10:20:28 2015 -0700

On my personal copy, it's looking for:
/home/zack/src/ceph-qa-suite_next/suites/upgrade/firefly-x/parallel/ec-rados-parallel.yaml

Whereas the actual file is:
/home/zack/src/ceph-qa-suite_next/suites/upgrade/firefly-x/parallel/2-workload/ec-rados-parallel.yaml

I'm going to revert the commit 9a57759; let's try again later with a unit test proving this is fixed!