Project

General

Profile

Bug #47831

ceph-volume reject md-devices [rejected reason: Insufficient space <5GB]

Added by Stefan Ludwig 13 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
% Done:

0%

Source:
Tags:
ceph-volume
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

Until ceph v14.2.7 it was possible to use md-devices (MDADM) as OSDs.

-------------------- MD-Device --------------------
$ sudo mdadm --detail /dev/md127
/dev/md127:
Version : 1.2
Creation Time : Fri Oct 9 11:35:43 2020
Raid Level : linear
Array Size : 52395008 (49.97 GiB 53.65 GB)
Raid Devices : 1
Total Devices : 1
Persistence : Superblock is persistent

Update Time : Fri Oct  9 11:35:43 2020
State : clean
Active Devices : 1
Working Devices : 1
Failed Devices : 0
Spare Devices : 0
Rounding : 0K

Consistency Policy : none

Name : dockertest01:md-sdb  (local to host dockertest01)
UUID : 92b86926:786b8c57:9d3bf28d:d8a0b0e4
Events : 0
Number   Major   Minor   RaidDevice State
0 8 16 0 active sync /dev/sdb
-------------------- MD-Device --------------------

-------------------- ceph v14.2.7 --------------------
Description: With Ceph 14.2.7 the /dev/md127 is usable by ceph-volume

$ sudo docker run --device=/dev/sdb --device=/dev/sdc --device=/dev/md127 --device=/dev/md/md-sdb --name=ceph-14-2-7 -it -d ceph/ceph:v14.2.7-20200819
3047b0977f8a89fa485ea0c1f7b5fd70767834ec0575c7ae6db520b4d3476044
[2020-10-09 11:36:56 user@dockertest01 ~]
$ sudo docker exec -it ceph-14-2-7 bash
[root@3047b0977f8a /]# ceph-volume inventory /dev/sdc

====== Device report /dev/sdc ======

available                 True
rejected reasons
path /dev/sdc
device id
scheduler mode deadline
rotational 1
vendor VMware
human readable size 50.00 GB
sas address
removable 0
model Virtual disk
ro 0
[root@3047b0977f8a /]# ceph-volume inventory /dev/md127

====== Device report /dev/md127 ======

available                 True
rejected reasons
path /dev/md127
device id
scheduler mode
rotational 1
vendor
human readable size 49.97 GB
sas address
removable 0
model
ro 0
[root@3047b0977f8a /]# exit
exit
[2020-10-09 11:37:44 user@dockertest01 ~]
$ sudo docker stop ceph-14-2-7
ceph-14-2-7
[2020-10-09 11:38:02 user@dockertest01 ~]
$
-------------------- ceph v14.2.7 --------------------

-------------------- ceph v14.2.8 and higher --------------------
Description: With Ceph 14.2.8 and higher the /dev/md127 is blocked by ceph-volume

[2020-10-09 11:45:16 user@dockertest01 ~]
$ sudo docker run --device=/dev/sdb --device=/dev/sdc --device=/dev/md127 --device=/dev/md/md-sdb --name=ceph-14-2-8 -it -d ceph/ceph:v14.2.8-20200819
Unable to find image 'ceph/ceph:v14.2.8-20200819' locally
v14.2.8-20200819: Pulling from ceph/ceph
524b0c1e57f8: Already exists
8c71722a08d2: Pull complete
Digest: sha256:9d52d92b8209c912eeeddaad4c52efb14f681da60d2d1a543062e0efc5a35c2e
Status: Downloaded newer image for ceph/ceph:v14.2.8-20200819
de86ebe065712e2302d5187c5435b6a69e323ac9ded3034950cc21e5a0f6bd16
[2020-10-09 11:45:59 user@dockertest01 ~]
$ sudo docker exec -it ceph-14-2-8 bash
[root@de86ebe06571 /]# ceph-volume inventory /dev/sdc

====== Device report /dev/sdc ======

available                 True
rejected reasons
path /dev/sdc
device id
scheduler mode deadline
rotational 1
vendor VMware
human readable size 50.00 GB
sas address
removable 0
model Virtual disk
ro 0
[root@de86ebe06571 /]# ceph-volume inventory /dev/md127

====== Device report /dev/md127 ======

available                 False
rejected reasons Insufficient space (&lt;5GB)
path /dev/md127
device id
[root@de86ebe06571 /]# ceph-volume inventory /dev/sdb

====== Device report /dev/sdb ======

available                 False
rejected reasons locked
path /dev/sdb
device id
scheduler mode deadline
rotational 1
vendor VMware
human readable size 50.00 GB
sas address
removable 0
model Virtual disk
ro 0
[root@de86ebe06571 /]# exit
exit
[2020-10-09 11:47:01 user@dockertest01 ~]
$ sudo docker stop ceph-14-2-8
ceph-14-2-8
[2020-10-09 11:47:15 user@dockertest01 ~]
$
-------------------- ceph v14.2.8 and higher --------------------

Also available in: Atom PDF