Infrastructure

Run: http://pulpito.ceph.com/teuthology-2018-12-11_02:25:03-upgrade:luminous-x-mimic-distro-basic-ovh/
Jobs: '3326623', '3326626', '3326615', '3326625', '3326618', '3326627', '3326617', '3326619'
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2018-12-11_02:25:03-upgrade:luminous-x-mimic-distro-basic-ovh/3326615/teuthology.log

2018-12-11T03:01:43.887 INFO:teuthology.task.ansible.out:testnode : Install packages ------------------------------------------- 198.77s
users : Create all admin users with sudo access. ----------------------- 29.69s
testnode : Install Amazon::S3. ----------------------------------------- 28.27s
common : Make sure smartmontools is installed -------------------------- 23.85s
users : Update authorized_keys using the keys repo --------------------- 20.31s
testnode : Ensure perl-doc is installed on apt systems. ---------------- 16.58s
testnode : Upgrade packages -------------------------------------------- 11.89s
testnode : Install python-pip on apt based systems. -------------------- 10.56s
testnode : Install ntp package on apt based systems. -------------------- 8.71s
common : Install nrpe package and dependencies (Ubuntu) ----------------- 5.23s
testnode : Zap all non-root disks --------------------------------------- 4.33s
testnode : Update apt cache. -------------------------------------------- 3.21s
Check for /usr/bin/python ----------------------------------------------- 2.64s
common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.18s
ansible-managed : Add authorized keys for the ansible user. ------------- 2.02s
common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.58s
users : Update authorized_keys for each user with literal keys ---------- 1.50s
testnode : Upload a dummy nfs export so that the nfs kernel server starts. --- 1.32s

2018-12-11T03:01:43.889 INFO:teuthology.task.ansible.out:testnode : Set apt preferences ------------------------------------------ 1.30s
testnode : Create the ntp.conf file. ------------------------------------ 1.29s

2018-12-11T03:01:44.149 INFO:teuthology.task.ansible:Archiving ansible failure log at: /home/teuthworker/archive/teuthology-2018-12-11_02:25:03-upgrade:luminous-x-mimic-distro-basic-ovh/3326615/ansible_failures.yaml
2018-12-11T03:01:44.152 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks
    manager.__enter__()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/__init__.py", line 123, in __enter__
    self.begin()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/ansible.py", line 426, in begin
    super(CephLab, self).begin()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/ansible.py", line 268, in begin
    self.execute_playbook()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/ansible.py", line 295, in execute_playbook
    self._handle_failure(command, status)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/ansible.py", line 319, in _handle_failure
    raise AnsibleFailedError(failures)
AnsibleFailedError: {'ovh036.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['/bin/sh: 1: ifdown: not found'], 'cmd': 'ifdown ens3 && ifup ens3', 'end': '2018-12-11 03:01:43.826891', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'ifdown ens3 && ifup ens3', 'removes': None, 'warn': True, '_uses_shell': True, 'stdin': None}}, 'start': '2018-12-11 03:01:43.822591', 'delta': '0:00:00.004300', 'stderr': '/bin/sh: 1: ifdown: not found', 'rc': 127, 'msg': 'non-zero return code', 'stdout_lines': []}, 'ovh002.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['/bin/sh: 1: ifdown: not found'], 'cmd': 'ifdown ens3 && ifup ens3', 'end': '2018-12-11 03:00:58.144939', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'ifdown ens3 && ifup ens3', 'removes': None, 'warn': True, '_uses_shell': True, 'stdin': None}}, 'start': '2018-12-11 03:00:58.142272', 'delta': '0:00:00.002667', 'stderr': '/bin/sh: 1: ifdown: not found', 'rc': 127, 'msg': 'non-zero return code', 'stdout_lines': []}, 'ovh094.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['/bin/sh: 1: ifdown: not found'], 'cmd': 'ifdown ens3 && ifup ens3', 'end': '2018-12-11 03:01:06.137655', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'ifdown ens3 && ifup ens3', 'removes': None, 'warn': True, '_uses_shell': True, 'stdin': None}}, 'start': '2018-12-11 03:01:06.134629', 'delta': '0:00:00.003026', 'stderr': '/bin/sh: 1: ifdown: not found', 'rc': 127, 'msg': 'non-zero return code', 'stdout_lines': []}}