Project

General

Profile

Actions

Bug #63862

open

Used mpath devices are not returned in the inventory

Added by Paul Cuzner 4 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

I am expecting orch device ls to show all devices, but for mpath devices that have been used for osds they are not listed

ceph version 18.2.0-1252-g6a0590bd

for example;

root@storage-13-09002:/var/lib/ceph/b46162de-9d48-11ee-8c88-2fbb19f34eb8/home# ceph orch device ls storage-16-09072
HOST              PATH          TYPE  DEVICE ID                                          SIZE  AVAILABLE  REFRESHED  REJECT REASONS
storage-16-09072  /dev/nvme0n1  ssd   Dell_Ent_NVMe_PM1735a_MU_1.6TB_S6UVNE0TA01903     1490G  No         15s ago    LVM detected, locked
storage-16-09072  /dev/nvme1n1  ssd   Dell_Ent_NVMe_PM1735a_MU_1.6TB_S6UVNE0TA01915     1490G  No         15s ago    LVM detected, locked
storage-16-09072  /dev/nvme2n1  ssd   Dell_Ent_NVMe_PM1735a_MU_1.6TB_S6UVNE0TA01912     1490G  No         15s ago    LVM detected, locked
storage-16-09072  /dev/nvme3n1  ssd   Dell_Ent_NVMe_PM1735a_MU_1.6TB_S6UVNE0TA01916     1490G  No         15s ago    LVM detected, locked
storage-16-09072  /dev/sda      ssd   PERC_H740P_Mini_6f4ee080543d4c002be90901fca09f22   446G  No         15s ago    Has GPT headers, Has partitions, locked

which shows the NVMe's as consumed, but the HDDs are missing. Looking at lsblk on the node shows

lsblk -o name,size,type
NAME                                                                                                      SIZE TYPE
loop0                                                                                                    63.5M loop
loop1                                                                                                    91.9M loop
loop2                                                                                                    40.9M loop
loop3                                                                                                    63.9M loop
sda                                                                                                     446.6G disk
├─sda1                                                                                                    488M part
└─sda2                                                                                                  446.2G part
sdb                                                                                                        20T disk
└─mpatha                                                                                                   20T mpath
└─ceph--7c7eb905--1bc0--49b2--876d--10b30ac49688-osd--block--e36d08f7--5d8e--4516--a381--84a2774421f8    20T lvm
sdc                                                                                                        20T disk
└─mpathb                                                                                                   20T mpath
└─ceph--0314ba65--7aec--42dc--b528--ff5330a903ef-osd--block--7026a506--43af--447b--9bd7--2b9a26910230    20T lvm
sdd                                                                                                        20T disk
└─mpathm                                                                                                   20T mpath
└─ceph--a8f56ffa--3710--41a7--99d8--929be5ed19aa-osd--block--c3c5062f--7c41--4b07--a327--c2441abf5774    20T lvm
sde                                                                                                        20T disk
└─mpathx                                                                                                   20T mpath
└─ceph--87ab2527--5cea--49b5--9f3b--7e289352d3a5-osd--block--f9e07259--a77d--48ca--b0fb--504707968da1    20T lvm

ceph-volume on the host shows

root@storage-16-09072:/# ceph-volume inventory

Device Path               Size         Device nodes    rotates available Model name
/dev/nvme0n1              1.46 TB      nvme0n1         False   False     Dell Ent NVMe PM1735a MU 1.6TB
/dev/nvme1n1              1.46 TB      nvme1n1         False   False     Dell Ent NVMe PM1735a MU 1.6TB
/dev/nvme2n1              1.46 TB      nvme2n1         False   False     Dell Ent NVMe PM1735a MU 1.6TB
/dev/nvme3n1              1.46 TB      nvme3n1         False   False     Dell Ent NVMe PM1735a MU 1.6TB
/dev/sda                  446.62 GB    sda             False   False     PERC H740P Mini

So it would appear that once the mpath devices have been used, they are no longer returned to the mgr and consequently not visible in the ceph orch device command

No data to display

Actions

Also available in: Atom PDF