Tools » teuthology

2018-10-30T12:34:14.275 INFO:teuthology.repo_utils:Cloning git://git.ceph.com/git/teuthology.git master from upstream
2018-10-30T12:34:14.279 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-worker", line 11, in <module>
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/scripts/worker.py", line 7, in main
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/worker.py", line 120, in main
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/worker.py", line 156, in prep_job
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/repo_utils.py", line 321, in fetch_teuthology
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/repo_utils.py", line 265, in fetch_repo
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/repo_utils.py", line 84, in enforce_repo_state
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/repo_utils.py", line 121, in clone_repo
  File "/usr/lib/python2.7/subprocess.py", line 711, in __init__
    errread, errwrite)
  File "/usr/lib/python2.7/subprocess.py", line 1235, in _execute_child
    self.pid = os.fork()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/os.py", line 445, in fork
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/os.py", line 174, in fork_gevent
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/hub.py", line 334, in reinit
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/hub.py", line 767, in _get_threadpool
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/hub.py", line 399, in _import
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/hub.py", line 415, in _import
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/builtins.py", line 93, in __import__
ImportError: No module named threadpool
2018-10-30T12:34:14.324 ERROR:teuthology.repo_utils:Git error encountered; retrying
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/repo_utils.py", line 265, in fetch_repo
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/repo_utils.py", line 84, in enforce_repo_state
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/repo_utils.py", line 136, in clone_repo
GitError: git clone failed!

I solve this manually by running

rm -rf /home/teuthworker/src/git.ceph.com_git_teuthology_master && git clone git://git.ceph.com/teuthology.git /home/teuthworker/src/git.ceph.com_git_teuthology_master && cd /home/teuthworker/src/git.ceph.com_git_teuthology_master && ./bootstrap
rm -rf /home/teuthworker/.cache/src/keys

This only happens a couple times a year but is a show stopper until someone (me) catches it. Usually it's a result of a network blip and the repo gets corrupted.