Ceph

logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-02-04_23:00:02-rados-next-distro-basic-plana/68416/teuthology.log (there are many similar in the same suite failing for several days)

2014-02-05T06:09:35.305 INFO:teuthology.task.ceph:Cleaning ceph cluster...
2014-02-05T06:09:35.305 DEBUG:teuthology.orchestra.run:Running [10.214.131.27]: 'sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/data /home/ubuntu/cephtest/monmap'
2014-02-05T06:09:35.307 DEBUG:teuthology.orchestra.run:Running [10.214.131.18]: 'sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/data /home/ubuntu/cephtest/monmap'
2014-02-05T06:09:35.382 INFO:teuthology.task.ceph:Checking for errors in any valgrind logs...
2014-02-05T06:09:35.383 DEBUG:teuthology.orchestra.run:Running [10.214.131.27]: "sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq" 
2014-02-05T06:09:35.385 DEBUG:teuthology.orchestra.run:Running [10.214.131.18]: "sudo zgrep '<kind>' /var/log/ceph/valgrind/* /dev/null | sort | uniq" 
2014-02-05T06:09:35.453 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/mon.a.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.453 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/mon.a.log.gz
2014-02-05T06:09:35.453 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/mon.c.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.454 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/mon.c.log.gz
2014-02-05T06:09:35.454 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/osd.0.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.454 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/osd.0.log.gz
2014-02-05T06:09:35.454 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/osd.1.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.454 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/osd.1.log.gz
2014-02-05T06:09:35.455 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/osd.2.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.455 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/osd.2.log.gz
2014-02-05T06:09:35.494 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/mds.a.log.gz kind   <kind>Leak_DefinitelyLost</kind>
2014-02-05T06:09:35.495 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/mds.a.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.495 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/mon.b.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.495 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/mon.b.log.gz
2014-02-05T06:09:35.495 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/osd.3.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.496 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/osd.3.log.gz
2014-02-05T06:09:35.496 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/osd.4.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.496 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/osd.4.log.gz
2014-02-05T06:09:35.496 DEBUG:teuthology.task.ceph:file /var/log/ceph/valgrind/osd.5.log.gz kind   <kind>Leak_PossiblyLost</kind>
2014-02-05T06:09:35.497 ERROR:teuthology.task.ceph:saw valgrind issue   <kind>Leak_PossiblyLost</kind> in /var/log/ceph/valgrind/osd.5.log.gz
2014-02-05T06:09:35.497 INFO:teuthology.task.ceph:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/kcon_most...
2014-02-05T06:09:35.497 DEBUG:teuthology.orchestra.run:Running [10.214.131.27]: 'sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/kcon_most'
2014-02-05T06:09:35.500 DEBUG:teuthology.orchestra.run:Running [10.214.131.18]: 'sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/kcon_most'
2014-02-05T06:09:35.546 ERROR:teuthology.run_tasks:Manager failed: <contextlib.GeneratorContextManager object at 0x3114910>
Traceback (most recent call last):
  File "/home/teuthworker/teuthology-next/teuthology/run_tasks.py", line 82, in run_tasks
    suppress = manager.__exit__(*exc_info)
  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
    self.gen.next()
  File "/home/teuthworker/teuthology-next/teuthology/task/ceph.py", line 1360, in task
    yield
  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
    self.gen.next()
  File "/home/teuthworker/teuthology-next/teuthology/contextutil.py", line 35, in nested
    if exit(*exc):
  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
    self.gen.next()
  File "/home/teuthworker/teuthology-next/teuthology/task/ceph.py", line 362, in valgrind_post
    raise valgrind_exception