Project

General

Profile

Actions

Bug #41835

closed

mds: cache drop command does not drive cap recall

Added by Patrick Donnelly over 4 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Normal
Category:
-
Target version:
% Done:

0%

Source:
Development
Tags:
Backport:
nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2019-09-15T14:21:08.393 INFO:teuthology.orchestra.run.smithi155.stdout:{
2019-09-15T14:21:08.393 INFO:teuthology.orchestra.run.smithi155.stdout:    "client_recall": {
2019-09-15T14:21:08.393 INFO:teuthology.orchestra.run.smithi155.stdout:        "return_code": 0,
2019-09-15T14:21:08.394 INFO:teuthology.orchestra.run.smithi155.stdout:        "message": "(0) Success",
2019-09-15T14:21:08.394 INFO:teuthology.orchestra.run.smithi155.stdout:        "recalled": 0
2019-09-15T14:21:08.394 INFO:teuthology.orchestra.run.smithi155.stdout:    },
2019-09-15T14:21:08.394 INFO:teuthology.orchestra.run.smithi155.stdout:    "flush_journal": {
2019-09-15T14:21:08.394 INFO:teuthology.orchestra.run.smithi155.stdout:        "return_code": 0,
2019-09-15T14:21:08.394 INFO:teuthology.orchestra.run.smithi155.stdout:        "message": "" 
2019-09-15T14:21:08.395 INFO:teuthology.orchestra.run.smithi155.stdout:    },
2019-09-15T14:21:08.395 INFO:teuthology.orchestra.run.smithi155.stdout:    "trim_cache": {
2019-09-15T14:21:08.395 INFO:teuthology.orchestra.run.smithi155.stdout:        "trimmed": 0
2019-09-15T14:21:08.395 INFO:teuthology.orchestra.run.smithi155.stdout:    },
2019-09-15T14:21:08.395 INFO:teuthology.orchestra.run.smithi155.stdout:    "cache": {
2019-09-15T14:21:08.396 INFO:teuthology.orchestra.run.smithi155.stdout:        "pool": {
2019-09-15T14:21:08.396 INFO:teuthology.orchestra.run.smithi155.stdout:            "items": 19662,
2019-09-15T14:21:08.396 INFO:teuthology.orchestra.run.smithi155.stdout:            "bytes": 2922160
2019-09-15T14:21:08.396 INFO:teuthology.orchestra.run.smithi155.stdout:        }
2019-09-15T14:21:08.397 INFO:teuthology.orchestra.run.smithi155.stdout:    },
2019-09-15T14:21:08.397 INFO:teuthology.orchestra.run.smithi155.stdout:    "duration": 1.7005697900000001
2019-09-15T14:21:08.397 INFO:teuthology.orchestra.run.smithi155.stdout:}
2019-09-15T14:21:08.398 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 -- 172.21.15.155:0/1613064656 >> [v2:172.21.15.158:6800/12136,v1:172.21.15.158:6801/12136] conn(0x7efdac025330 msgr2=0x7efdac027830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2019-09-15T14:21:08.398 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 --2- 172.21.15.155:0/1613064656 >> [v2:172.21.15.158:6800/12136,v1:172.21.15.158:6801/12136] conn(0x7efdac025330 0x7efdac027830 crc :-1 s=READY pgs=196 cs=0 l=1 rx=0 tx=0).stop
2019-09-15T14:21:08.398 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 -- 172.21.15.155:0/1613064656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdcc128530 msgr2=0x7efdcc128950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2019-09-15T14:21:08.399 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 --2- 172.21.15.155:0/1613064656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdcc128530 0x7efdcc128950 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7efdc4001210 tx=0x7efdcc129410).stop
2019-09-15T14:21:08.399 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 -- 172.21.15.155:0/1613064656 shutdown_connections
2019-09-15T14:21:08.399 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 --2- 172.21.15.155:0/1613064656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdcc128530 0x7efdcc128950 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop
2019-09-15T14:21:08.399 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 --2- 172.21.15.155:0/1613064656 >> [v2:172.21.15.158:6800/12136,v1:172.21.15.158:6801/12136] conn(0x7efdac025330 0x7efdac027830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop
2019-09-15T14:21:08.399 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 --2- 172.21.15.155:0/1613064656 >> v2:172.21.15.158:3300/0 conn(0x7efdcc12dc20 0x7efdcc12e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop
2019-09-15T14:21:08.399 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 -- 172.21.15.155:0/1613064656 shutdown_connections
2019-09-15T14:21:08.399 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 -- 172.21.15.155:0/1613064656 wait complete.
2019-09-15T14:21:08.400 INFO:teuthology.orchestra.run.smithi155.stderr:2019-09-15T14:21:08.391+0000 7efdd23b0700  1 -- 172.21.15.155:0/1613064656 >> 172.21.15.155:0/1613064656 conn(0x7efdcc07ddc0 msgr2=0x7efdcc0ad510 unknown :-1 s=STATE_NONE l=0).mark_down
2019-09-15T14:21:08.401 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... FAIL
...
2019-09-15T14:21:10.287 INFO:tasks.cephfs_test_runner:======================================================================
2019-09-15T14:21:10.288 INFO:tasks.cephfs_test_runner:FAIL: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop)
2019-09-15T14:21:10.288 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2019-09-15T14:21:10.288 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2019-09-15T14:21:10.288 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20190915.030958/qa/tasks/cephfs/test_misc.py", line 232, in test_drop_cache_command
2019-09-15T14:21:10.288 INFO:tasks.cephfs_test_runner:    self.assertGreaterEqual(result['trim_cache']['trimmed'], 1000-2*mds_min_caps_per_client)
2019-09-15T14:21:10.288 INFO:tasks.cephfs_test_runner:AssertionError: 0 not greater than or equal to 800

From: /ceph/teuthology-archive/pdonnell-2019-09-15_06:11:06-fs-wip-pdonnell-testing-20190915.030958-distro-basic-smithi/4308664/teuthology.log

Introduced-by: be49866a150e04438cef971dec7948eaf34852fc


Related issues 2 (0 open2 closed)

Related to CephFS - Feature #22446: mds: ask idle client to trim more capsResolvedPatrick Donnelly

Actions
Copied to CephFS - Backport #41899: nautilus: mds: cache drop command does not drive cap recallResolvedNathan CutlerActions
Actions #1

Updated by Patrick Donnelly over 4 years ago

  • Description updated (diff)
Actions #2

Updated by Patrick Donnelly over 4 years ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 30389
Actions #3

Updated by Patrick Donnelly over 4 years ago

  • Related to Feature #22446: mds: ask idle client to trim more caps added
Actions #4

Updated by Patrick Donnelly over 4 years ago

  • Backport changed from nautilus,mimic to nautilus

Backport of #22446 is only for nautilus.

Actions #5

Updated by Venky Shankar over 4 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions #6

Updated by Nathan Cutler over 4 years ago

  • Copied to Backport #41899: nautilus: mds: cache drop command does not drive cap recall added
Actions #7

Updated by Nathan Cutler over 4 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Actions

Also available in: Atom PDF