Project

General

Profile

Bug #7530

mds: failed anchor assert on replay

Added by Greg Farnum over 5 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
-
Start date:
02/24/2014
Due date:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:

Description

2014-02-21T07:57:58.140 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]: mds/CDentry.cc: In function 'void CDentry::adjust_nested_anchors(int)' thread 7f70b88cc700 time 2014-02-21 07:57:58.137801
2014-02-21T07:57:58.140 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]: mds/CDentry.cc: 427: FAILED assert(nested_anchors >= 0)
2014-02-21T07:57:58.151 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  ceph version 0.76-873-g72f260e (72f260e07cf5f7bc5264a7f8ab292b9dc9ec3222)
2014-02-21T07:57:58.152 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  1: (CDentry::adjust_nested_anchors(int)+0x2ab) [0x74564b]
2014-02-21T07:57:58.152 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  2: (CDir::unlink_inode_work(CDentry*)+0x14c) [0x7524dc]
2014-02-21T07:57:58.152 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  3: (CDir::unlink_inode(CDentry*)+0x70) [0x752570]
2014-02-21T07:57:58.152 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  4: (EMetaBlob::replay(MDS*, LogSegment*, MDSlaveUpdate*)+0x98b) [0x5c23bb]
2014-02-21T07:57:58.152 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  5: (EUpdate::replay(MDS*)+0x3a) [0x5cfeca]
2014-02-21T07:57:58.153 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  6: (MDLog::_replay_thread()+0x4a5) [0x7c6a65]
2014-02-21T07:57:58.153 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  7: (MDLog::ReplayThread::entry()+0xd) [0x5a4d5d]
2014-02-21T07:57:58.153 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  8: (()+0x7e9a) [0x7f70bfadbe9a]
2014-02-21T07:57:58.153 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  9: (clone()+0x6d) [0x7f70be4ed3fd]
2014-02-21T07:57:58.153 INFO:teuthology.task.ceph.mds.a.err:[10.214.132.15]:  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

http://qa-proxy.ceph.com/teuthology/teuthology-2014-02-20_23:02:32-fs-firefly-distro-basic-plana/
[92860] fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/none.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsstress.yaml}
[92861] fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/none.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_pjd.yaml}
[92863] fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/osd-mds-delay.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsstress.yaml}
[92864] fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/osd-mds-delay.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_pjd.yaml}

http://qa-proxy.ceph.com/teuthology/teuthology-2014-02-22_23:02:29-fs-firefly-distro-basic-plana/
[98555] fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/osd-mds-delay.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_pjd.yaml}
[98552] fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/none.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_pjd.yaml}
[98551] fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/none.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsstress.yaml}

ceph-mds.a.log View (1.33 MB) John Spray, 02/25/2014 09:09 AM

ceph-mds.b-s-a.log.gz (7.24 MB) John Spray, 02/25/2014 09:14 AM

Associated revisions

Revision 7ba3200f (diff)
Added by Yan, Zheng over 5 years ago

mds: fix nested_anchors update during journal replay

check if the inode is anchored/unanchored before updating the inode

Fixes: #7530
Signed-off-by: Yan, Zheng <>
Reviewed-by: Greg Farnum <>

History

#1 Updated by Greg Farnum over 5 years ago

  • Description updated (diff)

#2 Updated by John Spray over 5 years ago

  • Status changed from New to In Progress
  • Assignee set to John Spray

#3 Updated by John Spray over 5 years ago

Crashed on first try, log at debug-mds=10 attached

#4 Updated by John Spray over 5 years ago

config used was (suites/fs/thrash/): ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/none.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_fsstress.yaml

#5 Updated by Zheng Yan over 5 years ago

  • Status changed from In Progress to Resolved

#6 Updated by Greg Farnum over 5 years ago

commit:7ba3200f1e91d803cdf84f96777641f7d18d3c01

#7 Updated by Greg Farnum about 3 years ago

  • Component(FS) MDS added

Also available in: Atom PDF