Ceph

Could not get more info from the crash, so might FYI ticket only.
Run: http://pulpito.ceph.com/teuthology-2015-02-04_17:10:01-upgrade:dumpling-firefly-x-next-distro-basic-multi/
Job: 739855
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2015-02-04_17:10:01-upgrade:dumpling-firefly-x-next-distro-basic-multi/739855/

2015-02-04T21:23:05.429 INFO:tasks.ceph.mds.a.burnupi59.stderr:2015-02-04 21:23:05.438067 7f854bbff800 -1 mds.-1.0 *** one or more OSDs do not support TMAP2OMAP; upgrade OSDs before starting MDS (or downgrade MDS) ***
2015-02-04T21:23:11.347 INFO:tasks.ceph.osd.0:Stopped
2015-02-04T21:23:11.347 INFO:tasks.ceph.osd.0:Restarting daemon
2015-02-04T21:23:11.347 INFO:teuthology.orchestra.run.burnupi59:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 0'
2015-02-04T21:23:11.373 INFO:tasks.ceph.osd.0:Started
2015-02-04T21:23:11.374 DEBUG:tasks.ceph.osd.1:waiting for process to exit
2015-02-04T21:23:11.374 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/parallel.py", line 50, in _run_spawned
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 41, in run_one_task
    return fn(**kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/sequential.py", line 48, in task
    mgr.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/var/lib/teuthworker/src/ceph-qa-suite_next/tasks/ceph.py", line 1060, in restart
    ctx.daemons.get_daemon(type_, id_).stop()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/daemon.py", line 45, in stop
    run.wait([self.proc], timeout=timeout)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 401, in wait
    proc.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed on burnupi59 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 1'
2015-02-04T21:23:11.376 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 98, in next
    result = self.results.get()
  File "/usr/lib/python2.7/dist-packages/gevent/queue.py", line 190, in get
    return waiter.get()
  File "/usr/lib/python2.7/dist-packages/gevent/hub.py", line 321, in get
    return get_hub().switch()
  File "/usr/lib/python2.7/dist-packages/gevent/hub.py", line 164, in switch
    return greenlet.switch(self)
GreenletExit
2015-02-04T21:23:11.376 INFO:tasks.workunit:Stopping ['rados/test-upgrade-firefly.sh', 'cls'] on client.0...
2015-02-04T21:23:11.376 INFO:teuthology.orchestra.run.burnupi29:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.0'
2015-02-04T21:23:11.395 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 53, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 41, in run_one_task
    return fn(**kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/parallel.py", line 43, in task
    p.spawn(_run_spawned, ctx, confg, taskname)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 89, in __exit__
    raise
CommandFailedError: Command failed on burnupi59 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 1'
2015-02-04T21:23:11.408 ERROR:sentry.errors.serializer:vars() argument must have __dict__ attribute
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/virtualenv/lib/python2.7/site-packages/raven-5.1.1-py2.7.egg/raven/utils/serializer/manager.py", line 76, in transform
    return repr(value)
  File "/home/teuthworker/src/teuthology_master/teuthology/config.py", line 87, in __repr__
    return self.__str__()
  File "/home/teuthworker/src/teuthology_master/teuthology/config.py", line 84, in __str__
    return yaml.safe_dump(self._conf, default_flow_style=False).strip()
  File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 218, in safe_dump
    return dump_all([data], stream, Dumper=SafeDumper, **kwds)
  File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 190, in dump_all
    dumper.represent(data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 28, in represent
    node = self.represent_data(data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 57, in represent_data
    node = self.yaml_representers[data_types[0]](self, data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 223, in represent_dict
    return self.represent_mapping(u'tag:yaml.org,2002:map', data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 123, in represent_mapping
    node_value = self.represent_data(item_value)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 41, in represent_data
    if self.ignore_aliases(data):
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 142, in ignore_aliases
    if data in [None, ()]:
  File "/usr/lib/python2.7/argparse.py", line 1158, in __eq__
    return vars(self) == vars(other)
TypeError: vars() argument must have __dict__ attribute
2015-02-04T21:23:11.429 ERROR:sentry.errors.serializer:vars() argument must have __dict__ attribute
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/virtualenv/lib/python2.7/site-packages/raven-5.1.1-py2.7.egg/raven/utils/serializer/manager.py", line 76, in transform
    return repr(value)
  File "/home/teuthworker/src/teuthology_master/teuthology/config.py", line 87, in __repr__
    return self.__str__()
  File "/home/teuthworker/src/teuthology_master/teuthology/config.py", line 84, in __str__
    return yaml.safe_dump(self._conf, default_flow_style=False).strip()
  File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 218, in safe_dump
    return dump_all([data], stream, Dumper=SafeDumper, **kwds)
  File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 190, in dump_all
    dumper.represent(data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 28, in represent
    node = self.represent_data(data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 57, in represent_data
    node = self.yaml_representers[data_types[0]](self, data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 223, in represent_dict
    return self.represent_mapping(u'tag:yaml.org,2002:map', data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 123, in represent_mapping
    node_value = self.represent_data(item_value)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 41, in represent_data
    if self.ignore_aliases(data):
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 142, in ignore_aliases
    if data in [None, ()]:
  File "/usr/lib/python2.7/argparse.py", line 1158, in __eq__
    return vars(self) == vars(other)
TypeError: vars() argument must have __dict__ attribute
2015-02-04T21:23:11.429 ERROR:sentry.errors.serializer:vars() argument must have __dict__ attribute
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/virtualenv/lib/python2.7/site-packages/raven-5.1.1-py2.7.egg/raven/utils/serializer/manager.py", line 76, in transform
    return repr(value)
  File "/home/teuthworker/src/teuthology_master/teuthology/config.py", line 87, in __repr__
    return self.__str__()
  File "/home/teuthworker/src/teuthology_master/teuthology/config.py", line 84, in __str__
    return yaml.safe_dump(self._conf, default_flow_style=False).strip()
  File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 218, in safe_dump
    return dump_all([data], stream, Dumper=SafeDumper, **kwds)
  File "/usr/lib/python2.7/dist-packages/yaml/__init__.py", line 190, in dump_all
    dumper.represent(data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 28, in represent
    node = self.represent_data(data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 57, in represent_data
    node = self.yaml_representers[data_types[0]](self, data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 223, in represent_dict
    return self.represent_mapping(u'tag:yaml.org,2002:map', data)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 123, in represent_mapping
    node_value = self.represent_data(item_value)
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 41, in represent_data
    if self.ignore_aliases(data):
  File "/usr/lib/python2.7/dist-packages/yaml/representer.py", line 142, in ignore_aliases
    if data in [None, ()]:
  File "/usr/lib/python2.7/argparse.py", line 1158, in __eq__
    return vars(self) == vars(other)
TypeError: vars() argument must have __dict__ attribute
2015-02-04T21:23:11.451 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/search?q=83d75344c8f843499502dc956dd1e714
CommandFailedError: Command failed on burnupi59 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage