Actions
Bug #43543
closedmds: scrub on directory with recently created files may fail to load backtraces and report damage
% Done:
0%
Source:
Development
Tags:
Backport:
octopus,nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
scrub
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
On a vstart cluster, copy a directory tree into CephFS and do a recursive scrub concurrently:
$ bin/ceph tell mds.a scrub start / recursive
Then in the MDS log:
2020-01-09T23:03:23.519+0000 7f88482f3700 10 MDSContext::complete: 19MDSIOContextWrapper
2020-01-09T23:03:23.519+0000 7f88482f3700 20 mds.0.cache.ino(0x1000000009f) ondisk_read_retval: -61
2020-01-09T23:03:23.519+0000 7f88482f3700 10 mds.0.cache.ino(0x1000000009f) scrub: inotable ino = 0x1000000009f
2020-01-09T23:03:23.519+0000 7f88482f3700 10 mds.0.cache.ino(0x1000000009f) scrub: inotable free says 0
2020-01-09T23:03:23.519+0000 7f88482f3700 10 MDSContext::complete: 16C_InodeValidated
2020-01-09T23:03:23.519+0000 7f88482f3700 0 log_channel(cluster) log [WRN] : Scrub error on inode 0x1000000009f (/bin/nl-neigh-delete) see mds.a log and `damage ls` output for details
2020-01-09T23:03:23.519+0000 7f88482f3700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000009f [2,head] /bin/nl-neigh-delete auth v364 dirtyparent s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4305=0-4194304@1} caps={4305=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=4305 | request=0 caps=1 dirtyparent=1 scrubqueue=0 dirty=1 0x55fe1bf7f800]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//","memoryvalue":"(2)0x1000000009f:[<0x10000000000/nl-neigh-delete v364>,<0x1/bin v776>]//","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirrstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61}
2020-01-09T23:03:23.519+0000 7f88482f3700 20 mds.0.cache.ino(0x1000000009f) scrub_finished
2020-01-09T23:03:23.519+0000 7f88482f3700 20 mds.0.cache.dir(0x10000000000) scrub_dentry_finished on dn [dentry #0x1/bin/nl-neigh-delete [2,head] auth (dversion lock) v=364 ino=0x1000000009f state=1610612736 | request=0 lock=0 inodepin=1 scrubparent=1 dirty=1 authpin=0 0x55fe1bfa6900]
Actions