Project

General

Profile

Actions
Copy link

Bug #19735

closed

CommandFailedError: Command failed on smithi101 with status 32: 'sudo mount -t xfs -o noatime /dev/nvme0n1p2 /var/lib/ceph/osd/ceph-3'

Added by Brad Hubbard about 7 years ago. Updated almost 7 years ago.

Status:
Closed
Priority:
Normal
Assignee:
David Galloway
Category:
User access
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Regression:
No
Severity:
4 - irritation
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2017-04-20T22:12:30.684 INFO:tasks.ceph:osd.3
2017-04-20T22:12:30.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/nvme0n1p2 on ubuntu@smithi101.front.sepia.ceph.com
2017-04-20T22:12:30.685 INFO:teuthology.orchestra.run.smithi101:Running: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/nvme0n1p2'
2017-04-20T22:12:31.272 INFO:teuthology.orchestra.run.smithi101.stdout:meta-data=/dev/nvme0n1p2         isize=2048   agcount=4, agsize=6104832 blks
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:         =                       sectsz=512   attr=2, projid32bit=1
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:         =                       crc=1        finobt=1, sparse=0
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:data     =                       bsize=4096   blocks=24419328, imaxpct=25
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:         =                       sunit=0      swidth=0 blks
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:log      =internal log           bsize=4096   blocks=11923, version=2
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:         =                       sectsz=512   sunit=0 blks, lazy-count=1
2017-04-20T22:12:31.273 INFO:teuthology.orchestra.run.smithi101.stdout:realtime =none                   extsz=4096   blocks=0, rtextents=0
2017-04-20T22:12:31.274 INFO:tasks.ceph:mount /dev/nvme0n1p2 on ubuntu@smithi101.front.sepia.ceph.com -o noatime
2017-04-20T22:12:31.274 INFO:teuthology.orchestra.run.smithi101:Running: 'sudo mount -t xfs -o noatime /dev/nvme0n1p2 /var/lib/ceph/osd/ceph-3'
2017-04-20T22:12:31.357 INFO:teuthology.orchestra.run.smithi101.stderr:mount: wrong fs type, bad option, bad superblock on /dev/nvme0n1p2,
2017-04-20T22:12:31.358 INFO:teuthology.orchestra.run.smithi101.stderr:       missing codepage or helper program, or other error
2017-04-20T22:12:31.358 INFO:teuthology.orchestra.run.smithi101.stderr:
2017-04-20T22:12:31.358 INFO:teuthology.orchestra.run.smithi101.stderr:       In some cases useful info is found in syslog - try
2017-04-20T22:12:31.358 INFO:teuthology.orchestra.run.smithi101.stderr:       dmesg | tail or so.
2017-04-20T22:12:31.359 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 30, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-badone-testing/qa/tasks/ceph.py", line 754, in cluster
    mnt_point,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 193, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 414, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 149, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 171, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed on smithi101 with status 32: 'sudo mount -t xfs -o noatime /dev/nvme0n1p2 /var/lib/ceph/osd/ceph-3'

At the same time in syslog.

Apr 20 22:12:31 smithi101 kernel: [  518.735340] xfs: module has bad taint, not creating trace events
Apr 20 22:12:31 smithi101 kernel: [  518.741538] SGI XFS with ACLs, security attributes, realtime, large block/inode numbers, no debug enabled
Apr 20 22:12:31 smithi101 kernel: [  518.743504] XFS (nvme0n1p2): Version 5 superblock detected. This kernel has EXPERIMENTAL support enabled!
Apr 20 22:12:31 smithi101 kernel: [  518.743504] Use of these features in this kernel is at your own risk!
Apr 20 22:12:31 smithi101 kernel: [  518.759613] XFS (nvme0n1p2): Superblock has unknown read-only compatible features (0x1) enabled.
Apr 20 22:12:31 smithi101 kernel: [  518.768470] XFS (nvme0n1p2): Attempted to mount read-only compatible filesystem read-write.
Apr 20 22:12:31 smithi101 kernel: [  518.768470] Filesystem can only be safely mounted read only.
Apr 20 22:12:31 smithi101 kernel: [  518.768488] XFS (nvme0n1p2): SB validate failed with error 22.
Actions
Copy link
 #2

Updated by David Galloway almost 7 years ago

  • Status changed from New to Closed
  • Assignee set to David Galloway

I think it's more likely this was due to the experimental features in the running kernel than hardware failure considering the machine has reliably been passing jobs since ticket was filed.

Actions
Copy link

Also available in: Atom PDF