Project

General

Profile

Actions

Bug #20441

closed

mds: failure during data scan

Added by Patrick Donnelly almost 7 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
Normal
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2017-06-27T21:10:35.249 INFO:teuthology.orchestra.run.smithi175:Running: 'sudo adjust-ulimits daemon-helper kill python -c \'\nimport zlib\npath = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_6"\nf = open(path, \'"\'"\'r\'"\'"\')\nbytes = f.read()\nf.close()\nif len(bytes) != 1572864:\n    raise RuntimeError("Bad length {0} vs. expected {1}".format(\n        len(bytes), 1572864\n    ))\nfor i, b in enumerate(bytes):\n    val = zlib.crc32("%s" % i) & 7\n    if b != chr(val):\n        raise RuntimeError("Bad data at offset {0}".format(i))\n\''
2017-06-27T21:10:35.908 INFO:teuthology.orchestra.run.smithi175:Running: 'cd /home/ubuntu/cephtest/mnt.0 && sudo ls lost+found'
2017-06-27T21:10:37.165 INFO:tasks.ceph.mds.a.smithi068.stderr:2017-06-27 21:10:37.166220 7f3ed3d6e700 -1 log_channel(cluster) log [ERR] : bad backtrace on dir ino 4
2017-06-27T21:10:37.357 INFO:teuthology.orchestra.run.smithi175.stdout:10000000008
2017-06-27T21:10:37.463 INFO:tasks.cephfs.mount:Validating 524288 bytes from lost+found/10000000008
2017-06-27T21:10:37.490 INFO:teuthology.orchestra.run.smithi175:Running: 'sudo adjust-ulimits daemon-helper kill python -c \'\nimport zlib\npath = "/home/ubuntu/cephtest/mnt.0/lost+found/10000000008"\nf = open(path, \'"\'"\'r\'"\'"\')\nbytes = f.read()\nf.close()\nif len(bytes) != 524288:\n    raise RuntimeError("Bad length {0} vs. expected {1}".format(\n        len(bytes), 524288\n    ))\nfor i, b in enumerate(bytes):\n    val = zlib.crc32("%s" % i) & 7\n    if b != chr(val):\n        raise RuntimeError("Bad data at offset {0}".format(i))\n\''
2017-06-27T21:10:37.699 INFO:teuthology.orchestra.run.smithi175.stderr:Traceback (most recent call last):
2017-06-27T21:10:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:  File "<string>", line 14, in <module>
2017-06-27T21:10:37.732 INFO:teuthology.orchestra.run.smithi175.stderr:RuntimeError: Bad data at offset 65536
2017-06-27T21:10:37.854 INFO:teuthology.orchestra.run.smithi175.stderr:daemon-helper: command failed with exit status 1

From: /a/pdonnell-2017-06-27_19:50:40-fs-wip-pdonnell-20170627---basic-smithi/1333735/teuthology.log

Actions #1

Updated by Patrick Donnelly almost 7 years ago

  • Assignee set to Douglas Fuller

Doug, please take a look at this one.

Actions #2

Updated by Douglas Fuller almost 7 years ago

That error is whitelisted; the relevant error is:

failure_reason: '"2017-06-27 21:09:57.713761 mds.a mds.0 172.21.15.68:6806/89893226
1 : cluster [ERR] unmatched rstat on 100, inode has n(v1 rc2017-06-27 21:09:41.277044
10=0+10), dirfrags have n(v0 rc2017-06-27 21:09:41.277044 11=0+11)" in cluster
log'

Actions #3

Updated by Douglas Fuller almost 7 years ago

  • Status changed from New to Fix Under Review
Actions #4

Updated by Douglas Fuller almost 7 years ago

  • Status changed from Fix Under Review to Closed
Actions #5

Updated by Patrick Donnelly almost 7 years ago

  • Status changed from Closed to Resolved
Actions

Also available in: Atom PDF