Bug #8711
Updated by Loïc Dachary almost 10 years ago
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-06-30_19:33:04-upgrade:dumpling-x:parallel-firefly---basic-vps/335479/ http://qa-proxy.ceph.com/teuthology/teuthology-2014-06-30_19:33:04-upgrade:dumpling-x:parallel-firefly---basic-vps/335479/t <pre> 2014-07-01T09:18:54.038 INFO:teuthology.task.ceph.mon.a.vpm077.stdout:starting mon.a rank 0 at 10.214.138.132:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid f9bbf9e3-0521-4a89-88e7-68af5981790c 2014-07-01T09:19:03.043 INFO:teuthology.orchestra.run.vpm077.stderr:unrecognized command 2014-07-01T09:19:03.044 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/teuthology-master/teuthology/contextutil.py", line 27, in nested vars.append(enter()) File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/teuthology-master/teuthology/task/ceph.py", line 450, in cephfs_setup stdout=StringIO()) File "/home/teuthworker/teuthology-master/teuthology/orchestra/remote.py", line 114, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/teuthology-master/teuthology/orchestra/run.py", line 401, in run r.wait() File "/home/teuthworker/teuthology-master/teuthology/orchestra/run.py", line 102, in wait exitstatus=status, node=self.hostname) CommandFailedError: Command failed on vpm077 with status 22: 'sudo ceph --format=json-pretty osd lspools' 2014-07-01T09:19:03.046 INFO:teuthology.misc:Shutting down osd daemons.. </pre> <pre> archive_path: /var/lib/teuthworker/archive/teuthology-2014-06-30_19:33:04-upgrade:dumpling-x:parallel-firefly---basic-vps/335479 branch: firefly description: upgrade/dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml 5-final-workload/rbd_cls.yaml distros/ubuntu_12.04.yaml} email: null job_id: '335479' last_in_suite: false machine_type: vps name: teuthology-2014-06-30_19:33:04-upgrade:dumpling-x:parallel-firefly---basic-vps nuke-on-error: true os_type: ubuntu os_version: '12.04' overrides: admin_socket: branch: firefly ceph: conf: mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on legacy crush tunables: false osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 20 log-whitelist: - slow request - scrub mismatch - ScrubResult sha1: d43e7113dd501aea1db33fdae30d56e96e9c3897 ceph-deploy: branch: dev: firefly conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: debug mon: 1 debug ms: 20 debug paxos: 20 osd default pool size: 2 install: ceph: sha1: d43e7113dd501aea1db33fdae30d56e96e9c3897 s3tests: branch: firefly workunit: sha1: d43e7113dd501aea1db33fdae30d56e96e9c3897 owner: scheduled_teuthology@teuthology priority: 1000 roles: - - mon.a - mds.a - osd.0 - osd.1 - - mon.b - mon.c - osd.2 - osd.3 - - client.0 - client.1 suite: upgrade:dumpling-x:parallel targets: ubuntu@vpm077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUFym2Nl+ih/gtHh0a52mbQjt1U2bnfAfcPZoHEscPCP3Ch8b6jKfNdknOR5/DiNnw6RVQKbvPHE/lRrwGyjoKrulKAarkn7lRFgv2qnjZhJjI+rmCrqKKYKeCo2Cd4RnsY89WpnZOyQRa/4pJcfXyroT0sGYh74F4MBrTL6c4NOFyC150kW7DRR6M/Rf2nQkxnVE90CmszN943mNWOsRBz8XR/jLRzwOUy0eHRQ4VwONQc/NmP/UCZZBmbzHsJAf3j/25fJkXZkjmEQRPHsSVfG/GrLWB6qg0EOaDjb9tr/btMR6QYlYnpSYedEmqi+Y/jI4Ob0GoIO++bFUrAiIX ubuntu@vpm078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIdxoFPzYkBtV7jrCXFquoRPwvmjZWUkuRbIPfEW0zrw9k3U+9HtUyvXfEtJyFH1a2yA2XZOxb5QwXYLrSycjCdUp+QtO2XbPrwcNApBabtdb0qcIziIhcEUydM1NKdR9baavas3bCcIYVO0GmHz3ylNK8vYF7akhCPxkgCy/niX/AQ1TEO1+NwCzgttUAf7JvKAnMSaZ4E4d8Fcet4HjWkakpksOFLI/90YuS+uCzANCFuECN9fW4mJTbFMviNCZANgrBFcXDo8DyVTlXDn/b49iP0HKOSFPoYlOdCse1cnw7GxQcEeGgIxNhhAaSC76jLwzJT9Y0qrg25vG4BSm7 ubuntu@vpm093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYOowmFCI+kKfy5rMaLiOmV11h0SZCjKFsgvpC6KpVF4FY8MwE9cEWVR5Fuw6WaFhcklJsDDJNvj+trb6FXUy18KvZGo1xDLJ+PBA4FT4SeYGS+3jSYMYjduKTx35w2T0NkDydIuXwvspL6U2L0Qd1786HuHY3Ad4YiieMzQFZIQV2FQDJDpXQBP23cADiCWL3e4pyOb8miV+u53xasr4dzRT7PMHbKzKbwbN8n3FdjDlsdPD5AHiNsWkK2I+Ie6bCo7bAHg7SwTWu3Bp99knfmfxbUe0nWb7SA8W+YitU7MdO4WzxeQZn3KwDf3G2snC/BMoOg0l4x2eUFeDT86Ad tasks: - internal.lock_machines: - 3 - vps - internal.save_config: null - internal.check_lock: null - internal.connect: null - internal.serialize_remote_roles: null - internal.check_conflict: null - internal.check_ceph_data: null - internal.vm_setup: null - internal.base: null - internal.archive: null - internal.coredump: null - internal.sudo: null - internal.syslog: null - internal.timer: null - chef: null - clock.check: null - install: branch: cuttlefish - print: '**** done cuttlefish install' - ceph: fs: xfs - print: '**** done ceph' - install.upgrade: all: branch: dumpling - ceph.restart: null - parallel: - workload - upgrade-sequence - print: '**** done parallel' - install.upgrade: client.0: null - print: '**** done install.upgrade' - workunit: clients: client.1: - cls/test_cls_rbd.sh teuthology_branch: master tube: vps upgrade-sequence: sequential: - install.upgrade: mon.a: null mon.b: null - ceph.restart: - mon.a - mon.b - mon.c - mds.a - osd.0 - osd.1 - osd.2 - osd.3 verbose: false worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.12742 workload: sequential: - workunit: branch: dumpling clients: client.0: - rados/load-gen-big.sh </pre> <pre> description: upgrade/dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml 5-final-workload/rbd_cls.yaml distros/ubuntu_12.04.yaml} duration: 227.58310794830322 failure_reason: 'Command failed on vpm077 with status 22: ''sudo ceph --format=json-pretty osd lspools''' flavor: basic owner: scheduled_teuthology@teuthology success: false </pre>