Tools » teuthology

I seem to remember this used to work. I put:

    os_type: ubuntu
    os_version: '18.04'

into the overrides section, but - alas - teuthology just ignores this (see log excerpt, below). I wonder if this is an unwanted side effect of the new $ symbol for randomly choosing a distro?

2018-07-20T13:22:13.176 INFO:root:teuthology version: 1.0.0-e333800
2018-07-20T13:22:13.177 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.daq8nR.tmp -- --verbose --lock --description rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} --name smithfarm-2018-07-20_13:19:47-rados-master-distro-basic-smithi --block --owner scheduled_smithfarm@teuthology --archive /home/teuthworker/archive/smithfarm-2018-07-20_13:19:47-rados-master-distro-basic-smithi/2800791
2018-07-20T13:22:13.254 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/
2018-07-20T13:22:13.353 DEBUG:teuthology.run:Config:
  archive_path: /home/teuthworker/archive/smithfarm-2018-07-20_13:19:47-rados-master-distro-basic-smithi/2800791
  branch: master
  description: rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}}
  email: ncutler@suse.cz
  job_id: '2800791'
  kernel:
    kdb: true
    sha1: distro
  last_in_suite: false
  machine_type: smithi
  name: smithfarm-2018-07-20_13:19:47-rados-master-distro-basic-smithi
  nuke-on-error: true
  openstack:
  - volumes:
      count: 2
      size: 10
  os_type: centos
  os_version: '7.4'
  overrides:
    admin_socket:
      branch: master
    ceph:
      conf:
        mon:
          debug mon: 20
          debug ms: 1
          debug paxos: 20
        osd:
          debug filestore: 20
          debug journal: 20
          debug ms: 1
          debug osd: 25
          osd debug verify cached snaps: true
          osd debug verify missing on start: true
          osd op queue: debug_random
          osd op queue cut off: debug_random
      log-whitelist:
      - \(MDS_ALL_DOWN\)
      - \(MDS_UP_LESS_THAN_MAX\)
      - MDS in read-only mode
      - force file system read-only
      - overall HEALTH_
      - \(OSDMAP_FLAGS\)
      - \(OSD_FULL\)
      - \(MDS_READ_ONLY\)
      - \(POOL_FULL\)
      sha1: 2365d597bfd56ce090d079a318aa934e869eafba
    ceph-deploy:
      conf:
        client:
          log file: /var/log/ceph/ceph-$name.$pid.log
        mon:
          osd default pool size: 2
    install:
      ceph:
        sha1: 2365d597bfd56ce090d079a318aa934e869eafba
    os_type: ubuntu
    os_version: '18.04'
    workunit:
      branch: wip-15100
      sha1: dc658edff54788ac39848c3fa594fb33e1610adc
  owner: scheduled_smithfarm@teuthology
  priority: 101
  repo: https://github.com/ceph/ceph.git
  roles:
  - - mon.a
    - mds.a
    - mgr.x
    - osd.0
    - osd.1
    - client.0
  sha1: 2365d597bfd56ce090d079a318aa934e869eafba
  suite: rados
  suite_branch: wip-15100
  suite_path: /home/teuthworker/src/github.com_smithfarm_ceph_wip-15100/qa
  suite_relpath: qa
  suite_repo: https://github.com/smithfarm/ceph.git
  suite_sha1: dc658edff54788ac39848c3fa594fb33e1610adc
  tasks:
  - install: null
  - ceph: null
  - exec:
      client.0:
      - DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" 
        -o Dpkg::Options::="--force-confold" install libboost-system-dev
  - workunit:
      clients:
        all:
        - rados/test_librados_build.sh
  teuthology_branch: master
  tube: smithi
  verbose: false
  worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.3923
2018-07-20T13:22:13.353 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_smithfarm_ceph_wip-15100/qa; will attempt to use it
2018-07-20T13:22:13.356 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_smithfarm_ceph_wip-15100/qa/tasks
2018-07-20T13:22:13.357 INFO:teuthology.run_tasks:Running task internal.check_packages...
2018-07-20T13:22:13.360 INFO:teuthology.task.internal:Checking packages...
2018-07-20T13:22:13.377 INFO:teuthology.task.internal:Checking packages for os_type,'centos' flavor 'basic' and ceph hash '2365d597bfd56ce090d079a318aa934e869eafba'
2018-07-20T13:22:13.377 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2018-07-20T13:22:13.377 INFO:teuthology.packaging:ref: None
2018-07-20T13:22:13.377 INFO:teuthology.packaging:tag: None
2018-07-20T13:22:13.377 INFO:teuthology.packaging:branch: master
2018-07-20T13:22:13.377 INFO:teuthology.packaging:sha1: 2365d597bfd56ce090d079a318aa934e869eafba
2018-07-20T13:22:13.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=master
2018-07-20T13:22:14.683 INFO:teuthology.task.internal:Found packages for ceph version 14.0.0-1444.g2365d59
2018-07-20T13:22:14.683 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep...
2018-07-20T13:22:14.740 INFO:teuthology.task.internal:no buildpackages task found
2018-07-20T13:22:14.740 INFO:teuthology.run_tasks:Running task internal.lock_machines...
2018-07-20T13:22:14.795 INFO:teuthology.task.internal.lock_machines:Locking machines...
2018-07-20T13:22:14.795 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/
2018-07-20T13:22:14.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)...
2018-07-20T13:22:24.854 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)...
2018-07-20T13:22:34.888 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)...
2018-07-20T13:22:44.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)...
2018-07-20T13:22:55.170 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)...
2018-07-20T13:23:05.208 DEBUG:teuthology.lock.ops:lock_many request: {'count': 1, 'locked_by': 'scheduled_smithfarm@teuthology', 'description': '/home/teuthworker/archive/smithfarm-2018-07-20_13:19:47-rados-master-distro-basic-smithi/2800791', 'machine_type': 'smithi'}
2018-07-20T13:23:05.237 DEBUG:teuthology.lock.ops:locked ubuntu@smithi114.front.sepia.ceph.com
2018-07-20T13:23:05.350 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f45316f1d10>, func=<function kill_console_loggers at 0x7f45305bb6e0>, signals=[15])
2018-07-20T13:23:05.629 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 7.4
2018-07-20T13:23:06.243 INFO:teuthology.orchestra.console:Power off smithi114
2018-07-20T13:23:06.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2018-07-20T13:23:06.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2018-07-20T13:23:10.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2018-07-20T13:23:14.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2018-07-20T13:23:14.733 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2018-07-20T13:23:14.835 INFO:teuthology.orchestra.console:Power on smithi114
2018-07-20T13:23:14.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2018-07-20T13:23:14.921 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2018-07-20T13:23:18.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2018-07-20T13:23:23.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2018-07-20T13:23:23.313 INFO:teuthology.orchestra.console:Power on for smithi114 completed
2018-07-20T13:23:23.415 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2018-07-20T13:26:09.904 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:26:18.987 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:26:28.046 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:26:37.149 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:26:46.224 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:26:55.307 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:27:04.364 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:27:13.424 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:28:19.429 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:28:19.651 INFO:teuthology.orchestra.run.smithi114:Running: 'hostname'
2018-07-20T13:28:20.186 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114
2018-07-20T13:28:20.187 INFO:teuthology.orchestra.run.smithi114:Running: 'grep smithi114 /etc/hosts'
2018-07-20T13:28:20.293 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2018-07-20T13:28:20.293 INFO:teuthology.orchestra.run.smithi114:Running: 'sudo hostname smithi114'
2018-07-20T13:28:20.415 INFO:teuthology.orchestra.run.smithi114:Running: "sudo sed -i -e 's/smithi114/smithi114/g' /etc/hosts" 
2018-07-20T13:28:20.510 INFO:teuthology.orchestra.run.smithi114:Running: "sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts" 
2018-07-20T13:28:20.589 INFO:teuthology.orchestra.run.smithi114:Running: "sudo sed -i -e 's/smithi114/smithi114/g' /etc/hostname" 
2018-07-20T13:28:20.666 INFO:teuthology.orchestra.run.smithi114:Running: 'sudo hostname smithi114'
2018-07-20T13:28:20.728 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2018-07-20T13:28:20.741 DEBUG:teuthology.parallel:result is None
2018-07-20T13:28:20.886 INFO:teuthology.lock.keys:Checking smithi114.front.sepia.ceph.com
2018-07-20T13:28:20.887 INFO:teuthology.lock.keys:New key found. Updating...
2018-07-20T13:28:20.906 INFO:teuthology.task.internal.lock_machines:1 smithi machines locked this try, 1/1 locked so far
2018-07-20T13:28:20.926 INFO:teuthology.task.internal.lock_machines:Locked targets:
  smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCKYVpQaMBAs3b2NDB1deKySH3KhWtT7QDqD5/nnUBp0+4AenFgyxqZxnFjtAwlu/5+47SkG2gbqGivEMC/scyDvscnuACFcRL/DukXEuW8LBNfWdVi+TrG5HxoPdKMdfE3GbXOoJyv1AgQW8PB2UpB8Ws8xxVtR+YVWvpGPq6N6nRzo86/Nb8+LItzoXiphxN9l6uTNYLHnKi2qe7djpYPGtXH44c+l/76VbXKm5nbTflwhQnpi7v/Bq28V6TnwKP7GI1MNiSs50DXcfuccrIXFtWB4DnweeX29f/1VX02T5js66ijA+IrIexW430jhWwJYZWGQYGFh6YtVXiWPMd
2018-07-20T13:28:20.926 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/
2018-07-20T13:28:20.974 INFO:teuthology.run_tasks:Running task internal.save_config...
2018-07-20T13:28:21.000 INFO:teuthology.task.internal:Saving configuration
2018-07-20T13:28:21.093 INFO:teuthology.run_tasks:Running task internal.check_lock...
2018-07-20T13:28:21.114 INFO:teuthology.task.internal.check_lock:Checking locks...
2018-07-20T13:28:21.129 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2018-07-20 13:23:05.222633', u'locked_by': u'scheduled_smithfarm@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi114.front.sepia.ceph.com', u'os_version': u'16.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCKYVpQaMBAs3b2NDB1deKySH3KhWtT7QDqD5/nnUBp0+4AenFgyxqZxnFjtAwlu/5+47SkG2gbqGivEMC/scyDvscnuACFcRL/DukXEuW8LBNfWdVi+TrG5HxoPdKMdfE3GbXOoJyv1AgQW8PB2UpB8Ws8xxVtR+YVWvpGPq6N6nRzo86/Nb8+LItzoXiphxN9l6uTNYLHnKi2qe7djpYPGtXH44c+l/76VbXKm5nbTflwhQnpi7v/Bq28V6TnwKP7GI1MNiSs50DXcfuccrIXFtWB4DnweeX29f/1VX02T5js66ijA+IrIexW430jhWwJYZWGQYGFh6YtVXiWPMd', u'description': u'/home/teuthworker/archive/smithfarm-2018-07-20_13:19:47-rados-master-distro-basic-smithi/2800791'}
2018-07-20T13:28:21.129 INFO:teuthology.run_tasks:Running task internal.add_remotes...
2018-07-20T13:28:21.145 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0']
2018-07-20T13:28:21.145 INFO:teuthology.run_tasks:Running task console_log...
2018-07-20T13:28:21.219 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f45316f1d10>, func=<function kill_console_loggers at 0x7f45304e6c08>, signals=[15])
2018-07-20T13:28:21.219 INFO:teuthology.run_tasks:Running task internal.connect...
2018-07-20T13:28:21.241 INFO:teuthology.task.internal:Opening connections...
2018-07-20T13:28:21.241 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com
2018-07-20T13:28:21.243 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60}
2018-07-20T13:28:21.359 INFO:teuthology.run_tasks:Running task internal.push_inventory...
2018-07-20T13:28:21.384 INFO:teuthology.orchestra.run.smithi114:Running: 'uname -m'
2018-07-20T13:28:21.684 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2018-07-20T13:28:21.684 INFO:teuthology.orchestra.run.smithi114:Running: "python -c 'import platform; print platform.linux_distribution()'" 
2018-07-20T13:28:21.791 INFO:teuthology.orchestra.run.smithi114.stdout:('CentOS Linux', '7.4.1708', 'Core')