Ceph » CephFS

https://pulpito.ceph.com/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747712/teuthology.log

description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client
  conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1}
  mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root
  overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
duration: 1353.7462682724
failure_reason: 'Test failure: test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery),
  test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery)'
flavor: default
owner: scheduled_vshankar@teuthology
sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1e85e2e3abd34295a176b97128c9363c
status: fail
success: false

2022-03-20T09:40:19.037 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/
2022-03-20T09:40:19.098 INFO:teuthology.run:FAIL

https://pulpito.ceph.com/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747712/remote/smithi082/log/ceph-mds.d.log.gz

    -5> 2022-03-20T09:36:31.501+0000 7f42796f0700  7 mds.0.locker wrlock_finish on (ifile mix w=2) on [inode 0x1 [...2,head] / auth v7 ap=2 snaprealm=0x55b2e78b2a00 DIRTYPARENT f(v0 m2022-03-20T09:35:31.422968+0000 2=2+0) n(v0 rc2022-03-20T09:36:31.498606+0000 3=2+1)/n(v0 rc2022-03-20T09:35:24.345781+0000 1=0+1) (iauth sync r=1) (isnap sync r=3) (inest mix w=2) (ipolicy sync r=2) (ifile mix w=2) (iversion lock) caps={7573=pAsLsXs/pAsLsXsFs@7,8658=pAsLsXs/pAsLsXsFsx@5} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55b2e8501600]
    -4> 2022-03-20T09:36:31.501+0000 7f42796f0700  7 mds.0.locker wrlock_finish on (inest mix w=2) on [inode 0x1 [...2,head] / auth v7 ap=2 snaprealm=0x55b2e78b2a00 DIRTYPARENT f(v0 m2022-03-20T09:35:31.422968+0000 2=2+0) n(v0 rc2022-03-20T09:36:31.498606+0000 3=2+1)/n(v0 rc2022-03-20T09:35:24.345781+0000 1=0+1) (iauth sync r=1) (isnap sync r=3) (inest mix w=2) (ipolicy sync r=2) (ifile mix w=1) (iversion lock) caps={7573=pAsLsXs/pAsLsXsFs@7,8658=pAsLsXs/pAsLsXsFsx@5} | request=0 lock=5 dirfrag=1 caps=1 dirtyparent=1 dirty=1 waiter=0 authpin=1 0x55b2e8501600]
    -3> 2022-03-20T09:36:31.501+0000 7f42796f0700  7 mds.0.locker local_wrlock_finish  on (iversion lock w=1 last_client=7573) on [inode 0x10000000000 [2,head] /background_file-1 auth v10 ap=3 DIRTYPARENT s=0 n(v0 rc2022-03-20T09:36:31.498606+0000 1=1+0) (iauth excl) (ifile excl->lock x=1) (ixattr excl) (iversion lock w=1 last_client=7573) cr={7573=0-4194304@1} caps={7573=pAsxLsXsxFcb/pAsxLsXsxFsxcrwb/pAsxXsxFxwb@8,8658=pLs/-@203667},l=7573 | ptrwaiter=0 request=2 lock=3 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x55b2e871c580]
    -2> 2022-03-20T09:36:31.501+0000 7f42796f0700 10 mds.0.locker xlock_finish on (ifile excl->lock x=1) [inode 0x10000000000 [2,head] /background_file-1 auth v10 ap=3 DIRTYPARENT s=0 n(v0 rc2022-03-20T09:36:31.498606+0000 1=1+0) (iauth excl) (ifile excl->lock x=1) (ixattr excl) (iversion lock) cr={7573=0-4194304@1} caps={7573=pAsxLsXsxFcb/pAsxLsXsxFsxcrwb/pAsxXsxFxwb@8,8658=pLs/-@203667},l=7573 | ptrwaiter=0 request=2 lock=2 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 0x55b2e871c580]
    -1> 2022-03-20T09:36:31.503+0000 7f42796f0700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11208-gd3799b8c/rpm/el8/BUILD/ceph-17.0.0-11208-gd3799b8c/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f42796f0700 time 2022-03-20T09:36:31.503461+0000
/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-11208-gd3799b8c/rpm/el8/BUILD/ceph-17.0.0-11208-gd3799b8c/src/mds/SimpleLock.h: 419: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock())

 ceph version 17.0.0-11208-gd3799b8c (d3799b8cfa5046465710eadeea2bed7bb4681409) quincy (dev)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f4287f1b074]
 2: /usr/lib64/ceph/libceph-common.so.2(+0x284295) [0x7f4287f1b295]
 3: (SimpleLock::put_xlock()+0x10e) [0x55b2e6236b5e]
 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator<MutationImpl::LockOp> const&, MutationImpl*, bool*)+0x94) [0x55b2e6224414]
 5: (Locker::_drop_locks(MutationImpl*, std::set<CInode*, std::less<CInode*>, std::allocator<CInode*> >*, bool)+0x20a) [0x55b2e6224aca]
 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set<CInode*, std::less<CInode*>, std::allocator<CInode*> >*)+0x5e) [0x55b2e62250be]
 7: (Server::reply_client_request(boost::intrusive_ptr<MDRequestImpl>&, boost::intrusive_ptr<MClientReply> const&)+0x54c) [0x55b2e608372c]
 8: (Server::respond_to_request(boost::intrusive_ptr<MDRequestImpl>&, int)+0x463) [0x55b2e6084543]
 9: (C_MDS_inode_update_finish::finish(int)+0xb2) [0x55b2e6117932]
 10: (MDSContext::complete(int)+0x203) [0x55b2e6352443]
 11: (MDSIOContextBase::complete(int)+0x69c) [0x55b2e6352bdc]
 12: (MDSLogContextBase::complete(int)+0x44) [0x55b2e6352e54]
 13: (Finisher::finisher_thread_entry()+0x19d) [0x7f4287fc66dd]
 14: /lib64/libpthread.so.0(+0x814a) [0x7f4286ef414a]
 15: clone()

     0> 2022-03-20T09:36:31.504+0000 7f42796f0700 -1 *** Caught signal (Aborted) **
 in thread 7f42796f0700 thread_name:MR_Finisher