Tools » teuthology

i seem to hit about one of these on each rados run. latest example:

2017-10-26T06:29:47.367 INFO:tasks.ceph:osd.7
2017-10-26T06:29:47.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com
2017-10-26T06:29:47.368 INFO:teuthology.orchestra.run.smithi050:Running: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1'
2017-10-26T06:29:48.456 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1      isize=2048   agcount=4, agsize=11720960 blks
2017-10-26T06:29:48.456 INFO:teuthology.orchestra.run.smithi050.stdout:         =                       sectsz=512   attr=2, projid32bit=0
2017-10-26T06:29:48.456 INFO:teuthology.orchestra.run.smithi050.stdout:data     =                       bsize=4096   blocks=46883840, imaxpct=25
2017-10-26T06:29:48.457 INFO:teuthology.orchestra.run.smithi050.stdout:         =                       sunit=0      swidth=0 blks
2017-10-26T06:29:48.457 INFO:teuthology.orchestra.run.smithi050.stdout:naming   =version 2              bsize=4096   ascii-ci=0
2017-10-26T06:29:48.457 INFO:teuthology.orchestra.run.smithi050.stdout:log      =internal log           bsize=4096   blocks=22892, version=2
2017-10-26T06:29:48.457 INFO:teuthology.orchestra.run.smithi050.stdout:         =                       sectsz=512   sunit=0 blks, lazy-count=1
2017-10-26T06:29:48.457 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none                   extsz=4096   blocks=0, rtextents=0
2017-10-26T06:29:48.461 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime
2017-10-26T06:29:48.461 INFO:teuthology.orchestra.run.smithi050:Running: 'sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7'
2017-10-26T06:29:48.517 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /dev/mapper/vg_nvme-lv_1 already mounted or /var/lib/ceph/osd/ceph-7 busy
2017-10-26T06:29:48.518 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 30, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage2-testing-2017-10-25-2218/qa/tasks/ceph.py", line 760, in cluster
    mnt_point,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 193, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 423, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 155, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 177, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed on smithi050 with status 32: 'sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7'

/a/sage-2017-10-26_05:52:00-rados-wip-sage2-testing-2017-10-25-2218-distro-basic-smithi/1774999