Project

General

Profile

Actions

Feature #12472

closed

ansible failure diagnostic unclear

Added by Loïc Dachary almost 9 years ago. Updated over 8 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:

Description

In the attached log, the teuthology run failed because of an ansible error.

PLAY [cobbler] **************************************************************** 
[0;36mskipping: no hosts matched[0m

PLAY RECAP ******************************************************************** 
           to retry, use: --limit @/home/ubuntu/cephlab.retry

[0;33movh175079.teuthology[0m       : [0;32mok[0m[0;32m=[0m[0;32m73[0m   [0;33mchanged[0m[0;33m=[0m[0;33m50[0m   unreachable=0    failed=0   
[0;31movh175080.teuthology[0m       : [0;32mok[0m[0;32m=[0m[0;32m28[0m   [0;33mchanged[0m[0;33m=[0m[0;33m12[0m   unreachable=0    [0;31mfailed[0m[0;31m=[0m[0;31m1[0m   

2015-07-26T14:45:53.506 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/ubuntu/teuthology/teuthology/run_tasks.py", line 56, in run_tasks
    manager.__enter__()
  File "/home/ubuntu/teuthology/teuthology/task/__init__.py", line 121, in __enter__
    self.begin()
  File "/home/ubuntu/teuthology/teuthology/task/ansible.py", line 221, in begin
    self.execute_playbook()
  File "/home/ubuntu/teuthology/teuthology/task/ansible.py", line 245, in execute_playbook
    raise CommandFailedError(command, status)
CommandFailedError: Command failed with status 2: 'ansible-playbook -v --extra-vars \'{"ansible_ssh_user": "ubuntu"}\' -i /etc/ansible/hosts --limit ovh175079.teuthology,ovh175080.teuthology /home/ubuntu/src/ceph-cm-ansible_master/cephlab.yml'

I'm unclear about the failure though. I found this but it looks like it's ignored. No other match when searching backwards for the fail word.

2015-07-26T14:44:24.790 INFO:teuthology.task.ansible.out:[0;31mfailed: [ovh175079.teuthology] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.082358", "end": "2015-07-26 14:44:24.778441", "rc": 1, "start": "2015-07-26 14:44:24.696083", "stdout_lines": [], "warnings": []}[0m
[0;31mstderr: No documentation found for "Amazon::S3".[0m
[0;36m...ignoring[0m

BTW, it would be great to not have color display in the ansible output.


Files

a.txt (415 KB) a.txt teuthology.log Loïc Dachary, 07/26/2015 03:01 PM
Actions #1

Updated by Loïc Dachary almost 9 years ago

Actions #2

Updated by Kefu Chai almost 9 years ago

BTW, it would be great to not have color display in the ansible output.

we have some discussions going on at https://github.com/ceph/teuthology/pull/573 .

Actions #3

Updated by Zack Cerza over 8 years ago

  • Tracker changed from Bug to Feature
  • Status changed from New to In Progress
  • Assignee set to Andrew Schoen
Actions #4

Updated by Andrew Schoen over 8 years ago

  • Status changed from In Progress to Fix Under Review

We've written a callback plugin for ansible that logs failures. Teuthology will then read that failure log and provide a more meaningful exception.

https://github.com/ceph/ceph-cm-ansible/pull/96

https://github.com/ceph/teuthology/pull/589

Actions

Also available in: Atom PDF