Actions
Bug #5411
closedteuthology: bad object dereference
Status:
Resolved
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2013-06-18T04:21:39.336 INFO:teuthology.task.ceph:Checking for errors in any valgrind logs...
2013-06-18T04:21:39.337 DEBUG:teuthology.orchestra.run:Running [10.214.133.30]: "sudo grep -r '<kind>' /var/log/ceph/valgrind | sort | uniq"
2013-06-18T04:21:39.340 DEBUG:teuthology.orchestra.run:Running [10.214.133.24]: "sudo grep -r '<kind>' /var/log/ceph/valgrind | sort | uniq"
2013-06-18T04:21:39.376 DEBUG:teuthology.orchestra.run:Running [10.214.133.27]: "sudo grep -r '<kind>' /var/log/ceph/valgrind | sort | uniq"
2013-06-18T04:21:39.379 INFO:teuthology.task.ceph:Removing shipped files: daemon-helper enable-coredump chdir-coredump valgrind.supp kcon_most...
2013-06-18T04:21:39.379 DEBUG:teuthology.orchestra.run:Running [10.214.133.30]: 'rm -rf -- /home/ubuntu/cephtest/38877/daemon-helper /home/ubuntu/cephtest/38877/enable-coredump /home/ubuntu/cephtes
t/38877/chdir-coredump /home/ubuntu/cephtest/38877/valgrind.supp /home/ubuntu/cephtest/38877/kcon_most'
2013-06-18T04:21:39.389 DEBUG:teuthology.orchestra.run:Running [10.214.133.27]: 'rm -rf -- /home/ubuntu/cephtest/38877/daemon-helper /home/ubuntu/cephtest/38877/enable-coredump /home/ubuntu/cephtes
t/38877/chdir-coredump /home/ubuntu/cephtest/38877/valgrind.supp /home/ubuntu/cephtest/38877/kcon_most'
2013-06-18T04:21:39.450 DEBUG:teuthology.orchestra.run:Running [10.214.133.24]: 'rm -rf -- /home/ubuntu/cephtest/38877/daemon-helper /home/ubuntu/cephtest/38877/enable-coredump /home/ubuntu/cephtes
t/38877/chdir-coredump /home/ubuntu/cephtest/38877/valgrind.supp /home/ubuntu/cephtest/38877/kcon_most'
2013-06-18T04:21:39.456 ERROR:teuthology.run_tasks:Manager failed: <contextlib.GeneratorContextManager object at 0x1dd1810>
Traceback (most recent call last):
File "/home/teuthworker/teuthology-next/teuthology/run_tasks.py", line 45, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__
self.gen.throw(type, value, traceback)
File "/home/teuthworker/teuthology-next/teuthology/task/ceph.py", line 1100, in task
yield
File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__
self.gen.throw(type, value, traceback)
File "/home/teuthworker/teuthology-next/teuthology/contextutil.py", line 35, in nested
if exit(*exc):
File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__
self.gen.throw(type, value, traceback)
File "/home/teuthworker/teuthology-next/teuthology/task/ceph.py", line 908, in run_daemon
teuthology.stop_daemons_of_type(ctx, type_)
File "/home/teuthworker/teuthology-next/teuthology/misc.py", line 864, in stop_daemons_of_type
daemon.stop()
File "/home/teuthworker/teuthology-next/teuthology/task/ceph.py", line 35, in stop
run.wait([self.proc])
File "/home/teuthworker/teuthology-next/teuthology/orchestra/run.py", line 281, in wait
proc.exitstatus.get()
File "/home/teuthworker/teuthology-next/virtualenv/local/lib/python2.7/site-packages/gevent/event.py", line 207, in get
raise self._exception
CommandFailedError: Command failed on 10.214.133.24 with status 1: '/home/ubuntu/cephtest/38877/enable-coredump ceph-coverage /home/ubuntu/cephtest/38877/archive/coverage sudo /home/ubuntu/cephtest
/38877/daemon-helper kill ceph-mds -f -i b-s-a'
2013-06-18T04:21:39.456 DEBUG:teuthology.run_tasks:Unwinding manager <contextlib.GeneratorContextManager object at 0x1dd1450>
2013-06-18T04:21:39.456 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
File "/home/teuthworker/teuthology-next/teuthology/contextutil.py", line 27, in nested
yield vars
File "/home/teuthworker/teuthology-next/teuthology/task/install.py", line 735, in task
yield
File "/home/teuthworker/teuthology-next/teuthology/run_tasks.py", line 45, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/home/teuthworker/teuthology-next/teuthology/task/mds_thrash.py", line 317, in task
thrashers[t].do_join()
File "/home/teuthworker/teuthology-next/teuthology/task/mds_thrash.py", line 107, in do_join
self.thread.get()
File "/home/teuthworker/teuthology-next/virtualenv/local/lib/python2.7/site-packages/gevent/greenlet.py", line 308, in get
raise self._exception
TypeError: 'NoneType' object has no attribute '__getitem__'
This is a new issue; I'm not sure if it's because of some valgrind check issue or what, but I have the sad suspicion that maybe we're getting a list back empty when it shouldn't be.
Actions