Actions
Bug #9092
closedHung job with TypeError: argument of type 'NoneType' is not iterable
Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
-
% Done:
0%
Source:
other
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):
Description
This guy: reported as dead in pulpito, actually succeeded but threw an exception to teuthology.log during teardown
http://pulpito.ceph.com/teuthology-2014-08-11_23:04:01-fs-master-testing-basic-multi/418285/
(the log is big, you'll want to SSH in and tail it)
2014-08-12T08:46:09.478 INFO:teuthology.lockstatus:GET request to 'http://teuthology.front.sepia.ceph.com/locker/lock/ubuntu@burnupi60.front.sepia.ceph.com' with body 'None' failed with response code 500
2014-08-12T08:46:09.478 ERROR:teuthology.run_tasks:Manager failed: internal.lock_machines
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 113, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/home/teuthworker/src/teuthology_master/teuthology/task/internal.py", line 152, in lock_machines
lock.unlock_one(ctx, machine, ctx.owner)
File "/home/teuthworker/src/teuthology_master/teuthology/lock.py", line 82, in unlock_one
if not destroy_if_vm(ctx, name):
File "/home/teuthworker/src/teuthology_master/teuthology/lock.py", line 506, in destroy_if_vm
phys_host = status_info['vpshost']
TypeError: 'NoneType' object has no attribute '__getitem__'
2014-08-12T08:46:09.527 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: TypeError: 'NoneType' object has no attribute '__getitem__'
2014-08-12T08:46:09.529 INFO:teuthology.nuke:Checking targets against current locks
2014-08-12T08:46:10.579 CRITICAL:root: File "/var/lib/teuthworker/src/teuthology_master/virtualenv/bin/teuthology", line 9, in <module>
load_entry_point('teuthology==0.1.0', 'console_scripts', 'teuthology')()
File "/home/teuthworker/src/teuthology_master/scripts/run.py", line 8, in main
teuthology.run.main(parse_args())
File "/home/teuthworker/src/teuthology_master/teuthology/run.py", line 178, in main
nuke(ctx, ctx.lock)
File "/home/teuthworker/src/teuthology_master/teuthology/nuke.py", line 334, in nuke
if ctx.name not in lock['description']:
2014-08-12T08:46:10.579 CRITICAL:root:TypeError: argument of type 'NoneType' is not iterable
Updated by Zack Cerza over 9 years ago
Lock server failure. Leaving it open, but not putting too much time into it because the lock server is going to be replaced anyway.
From /var/log/apache2/locker-error.log.1:
147227 [Tue Aug 12 08:46:08 2014] [error] scheduled_teuthology@teuthology unlocked ubuntu@burnupi60.front.sepia.ceph.com 147228 # plana19.front.sepia.ceph.com SSH-2.0-OpenSSH_5.9p1 Debian-5ubuntu1.1 147229 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] Traceback (most recent call last): 147230 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/application.py", line 242, in process 147231 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] return self.handle() 147232 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/application.py", line 233, in handle 147233 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] return self._delegate(fn, self.fvars, args) 147234 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/application.py", line 415, in _delegate 147235 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] return handle_class(cls) 147236 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/application.py", line 390, in handle_class 147237 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] return tocall(*args) 147238 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/var/lib/teuthlocker/teuthology/teuthology/locker/api.py", line 45, in GET 147239 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] row = load_machine(name) 147240 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/var/lib/teuthlocker/teuthology/teuthology/locker/api.py", line 10, in load_machine 147241 # plana19.front.sepia.ceph.com SSH-2.0-OpenSSH_5.9p1 Debian-5ubuntu1.1 147242 # plana22.front.sepia.ceph.com SSH-2.0-OpenSSH_5.9p1 Debian-5ubuntu1.3 147243 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] vars=dict(name=name))) 147244 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/db.py", line 649, in select 147245 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] return self.query(qout, processed=True) 147246 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/db.py", line 611, in query 147247 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] self._db_execute(db_cursor, sql_query) 147248 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/db.py", line 570, in _db_execute 147249 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] self.ctx.rollback() 147250 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] File "/usr/lib/pymodules/python2.7/web/db.py", line 510, in rollback 147251 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] ctx.db.rollback() 147252 [Tue Aug 12 08:46:09 2014] [error] [client 127.0.0.1] OperationalError: (2006, 'MySQL server has gone away')
Actions