Project

General

Profile

Actions
Copy link

Bug #48808

closed

mon/MDSMonitor: `fs rm` is not idempotent

Added by Patrick Donnelly over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
Patrick Donnelly
Category:
-
Target version:
Ceph - v16.0.0
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDSMonitor
Labels (FS):
qa-failure
Pull request ID:
38835
Crash signature (v1):
Crash signature (v2):

Description

2021-01-08T06:06:58.237 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a31dfd700  1 -- 172.21.15.134:0/1965623813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9a2c062920 con 0x7f9a100050c0
2021-01-08T06:06:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 -- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a100050c0 msgr2=0x7f9a2c13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16
2021-01-08T06:06:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 -- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a100050c0 msgr2=0x7f9a2c13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed
2021-01-08T06:06:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a100050c0 0x7f9a2c13fc90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f9a2000ef40 tx=0x7f9a20007b70).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2021-01-08T06:06:58.238 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a100050c0 0x7f9a2c13fc90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f9a2000ef40 tx=0x7f9a20007b70).stop
2021-01-08T06:06:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 -- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a100050c0 msgr2=0x7f9a2c13fc90 unknown :-1 s=STATE_CLOSED l=1).mark_down
2021-01-08T06:06:58.239 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a100050c0 0x7f9a2c13fc90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2021-01-08T06:06:58.241 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a2c14e590 0x7f9a0c05f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2021-01-08T06:06:58.241 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a0c05fcf0 0x7f9a0c062180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2021-01-08T06:06:58.241 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 0x7f9a0c0647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect
2021-01-08T06:06:58.241 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 -- 172.21.15.134:0/1965623813 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c064cb0 con 0x7f9a2c14e590
2021-01-08T06:06:58.242 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 -- 172.21.15.134:0/1965623813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c064df0 con 0x7f9a0c05fcf0
2021-01-08T06:06:58.242 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a28ff9700  1 -- 172.21.15.134:0/1965623813 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c064f80 con 0x7f9a2c140320
2021-01-08T06:06:58.242 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a315fc700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a0c05fcf0 0x7f9a0c062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2021-01-08T06:06:58.242 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a2c14e590 0x7f9a0c05f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2021-01-08T06:06:58.242 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 0x7f9a0c0647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2021-01-08T06:06:58.243 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 -- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 msgr2=0x7f9a0c0647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 22
2021-01-08T06:06:58.243 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 -- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 msgr2=0x7f9a0c0647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed
2021-01-08T06:06:58.243 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 0x7f9a0c0647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted)
2021-01-08T06:06:58.243 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a315fc700  1 -- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 msgr2=0x7f9a0c0647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2021-01-08T06:06:58.243 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a30dfb700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 0x7f9a0c0647a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000
2021-01-08T06:06:58.244 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a315fc700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9a2c140320 0x7f9a0c0647a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2021-01-08T06:06:58.244 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a315fc700  1 -- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a2c14e590 msgr2=0x7f9a0c05f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2021-01-08T06:06:58.244 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a315fc700  1 --2- 172.21.15.134:0/1965623813 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a2c14e590 0x7f9a0c05f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop
2021-01-08T06:06:58.244 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a315fc700  1 -- 172.21.15.134:0/1965623813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) v3 -- 0x7f9a0c065200 con 0x7f9a0c05fcf0
2021-01-08T06:06:58.245 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.238+0000 7f9a315fc700  1 -- 172.21.15.134:0/1965623813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9a10003230 con 0x7f9a0c05fcf0
...
2021-01-08T06:06:58.246 INFO:teuthology.orchestra.run.smithi134.stderr:2021-01-08T06:06:58.242+0000 7f9a28ff9700  1 -- 172.21.15.134:0/1965623813 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=-2 Filesystem not found: 'cephfs' v8) v1 ==== 134+0+0 (secure 0 0 0) 0x7f9a24046fe0 con 0x7f9a0c05fcf0
2021-01-08T06:06:58.247 INFO:teuthology.orchestra.run.smithi134.stderr:Error ENOENT: Filesystem not found: 'cephfs'

From: /ceph/teuthology-archive/pdonnell-2021-01-08_05:07:01-fs-wip-pdonnell-testing-20210107.220115-distro-basic-smithi/5764512/teuthology.log

Actions
Copy link
 #1

Updated by Patrick Donnelly over 3 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 38835
Actions
Copy link
 #2

Updated by Patrick Donnelly over 3 years ago

  • Status changed from Fix Under Review to Resolved
  • Backport deleted (octopus,nautilus)
Actions
Copy link

Also available in: Atom PDF