Ceph

Hi,

There are some redundant OSDs that got created in Crush map with no associated mount points in any of the host. I am trying to remove those OSDs from crush map to have clean system. However, although I am able to find OSD in crush map, remove command is not able to find the same OSD.

[ceph@MYOPTPDN01 ~]$ ceph osd find 67 { "osd": 67,
"ip": "10.115.1.140:6807\/11185",
"crush_location": {}}
[ceph@MYOPTPDN01 ~]$ sudo ceph osd crush remove osd.67
device 'osd.67' does not appear in the crush map
[ceph@MYOPTPDN01 ~]$ ceph osd find 68 { "osd": 68,
"ip": "10.115.1.156:6800\/3098",
"crush_location": {}}
[ceph@MYOPTPDN01 ~]$ sudo ceph osd crush remove osd.68
device 'osd.68' does not appear in the crush map
[ceph@MYOPTPDN01 ~]$ ceph osd find 66 { "osd": 66,
"ip": "10.115.1.137:6830\/2182250",
"crush_location": { "chassis": "CHASSIS1",
"host": "MYOPTPDN02",
"root": "CEPH CLUSTER1"}}
[ceph@MYOPTPDN01 ~]$ sudo ceph osd crush set osd.68 2.73 root=CEPH CLUSTER1 host=MYOPTPDN17
Error ENOENT: unable to set item id 68 name 'osd.68' weight 2.73 at location {host=MYOPTPDN17,root=CEPH CLUSTER1}: does not exist
[ceph@MYOPTPDN01 ~]$ ceph osd tree

1. id weight type name up/down reweight
   -51 406.4 root CEPH CLUSTER1
   -9 30.03 chassis CHASSIS6
   -11 30.03 host MYOPTPDN17
   75 2.73 osd.75 up 1
   76 2.73 osd.76 up 1
   77 2.73 osd.77 up 1
   78 2.73 osd.78 up 1
   79 2.73 osd.79 up 1
   80 2.73 osd.80 up 1
   81 2.73 osd.81 up 1
   82 2.73 osd.82 up 1
   83 2.73 osd.83 up 1
   84 2.73 osd.84 up 1
   85 2.73 osd.85 up 1
   67 0 osd.67 down 0
   68 0 osd.68 down 0
   69 0 osd.69 down 0
   70 0 osd.70 down 0
   71 0 osd.71 down 0
   72 0 osd.72 down 0
   73 0 osd.73 down 0
   74 0 osd.74 down 0

Is this a known bug?