Project

General

Profile

Actions
Copy link

Bug #45094

closed

ceph-volume inventory does not read mpath properly

Added by Sébastien Han about 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
octopus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
36241
Crash signature (v1):
Crash signature (v2):

Description

It seems that the inventory command reports a device with insufficient space.

c-v log:

[2020-04-14 10:27:44,274][ceph_volume.main][INFO  ] Running command: ceph-volume  inventory --format json /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:27:44,275][ceph_volume.process][INFO  ] Running command: /usr/bin/lsblk -plno KNAME,NAME,TYPE
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/sda   /dev/sda                                        disk
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/sda1  /dev/sda1                                       part
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/sda2  /dev/sda2                                       part
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/sda3  /dev/sda3                                       part
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/sdb   /dev/sdb                                        disk
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/sdb1  /dev/sdb1                                       part
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/dm-0  /dev/mapper/3600605b000ac584025e796031b286cb8   mpath
[2020-04-14 10:27:44,721][ceph_volume.process][INFO  ] stdout /dev/dm-1  /dev/mapper/3600605b000ac584025e796031b286cb8p1 part
[2020-04-14 10:27:44,722][ceph_volume.process][INFO  ] stdout /dev/dm-2  /dev/mapper/docker_data                         crypt
[2020-04-14 10:27:44,722][ceph_volume.process][INFO  ] stdout /dev/sdc   /dev/sdc                                        disk
[2020-04-14 10:27:44,722][ceph_volume.process][INFO  ] stdout /dev/dm-3  /dev/mapper/3600605b000ac584025e796091b840018   mpath
[2020-04-14 10:27:44,722][ceph_volume.process][INFO  ] stdout /dev/loop0 /dev/loop0                                      loop
[2020-04-14 10:27:44,727][ceph_volume.process][INFO  ] Running command: /usr/sbin/lvs --noheadings --readonly --separator=";" -a -o lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size
[2020-04-14 10:27:45,183][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will manage logical volume symlinks in device directory.
[2020-04-14 10:27:45,183][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will obtain device list by scanning device directory.
[2020-04-14 10:27:45,183][ceph_volume.process][INFO  ] stderr WARNING: Failed to connect to lvmetad. Falling back to device scanning.
[2020-04-14 10:27:45,183][ceph_volume.process][INFO  ] Running command: /usr/bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:27:45,620][ceph_volume.process][INFO  ] stdout NAME="3600605b000ac584025e796091b840018" KNAME="dm-3" MAJ:MIN="253:3" FSTYPE="" MOUNTPOINT="" LABEL="" UUID="" RO="0" RM="0" MODEL="" SIZE="3.5T" STATE="running" OWNER="root" GROUP="disk" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="4096" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="mpath" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="" PARTLABEL="" 
[2020-04-14 10:27:45,620][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:27:46,066][ceph_volume.process][INFO  ] Running command: /usr/bin/ceph-bluestore-tool show-label --dev /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:27:46,550][ceph_volume.process][INFO  ] stderr unable to read label for /dev/mapper/3600605b000ac584025e796091b840018: (2) No such file or directory
[2020-04-14 10:27:46,550][ceph_volume.process][INFO  ] Running command: /usr/bin/ceph-bluestore-tool show-label --dev /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:27:47,023][ceph_volume.process][INFO  ] stderr unable to read label for /dev/mapper/3600605b000ac584025e796091b840018: (2) No such file or directory
[2020-04-14 10:27:47,023][ceph_volume.process][INFO  ] Running command: /usr/sbin/udevadm info --query=property /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/disk/by-id/dm-name-3600605b000ac584025e796091b840018 /dev/disk/by-id/dm-uuid-mpath-3600605b000ac584025e796091b840018 /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/dm-3
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DEVPATH=/devices/virtual/block/dm-3
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DEVTYPE=disk
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DM_NAME=3600605b000ac584025e796091b840018
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DM_SUSPENDED=0
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DM_UDEV_DISABLE_LIBRARY_FALLBACK_FLAG=1
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DM_UDEV_PRIMARY_SOURCE_FLAG=1
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DM_UDEV_RULES_VSN=2
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout DM_UUID=mpath-3600605b000ac584025e796091b840018
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout MAJOR=253
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout MINOR=3
[2020-04-14 10:27:47,453][ceph_volume.process][INFO  ] stdout MPATH_SBIN_PATH=/sbin
[2020-04-14 10:27:47,454][ceph_volume.process][INFO  ] stdout SUBSYSTEM=block
[2020-04-14 10:27:47,454][ceph_volume.process][INFO  ] stdout TAGS=:systemd:
[2020-04-14 10:27:47,454][ceph_volume.process][INFO  ] stdout USEC_INITIALIZED=151353765118
[2020-04-14 10:27:47,643][ceph_volume.main][INFO  ] Running command: ceph-volume  lvm list  --format json
[2020-04-14 10:27:47,644][ceph_volume.process][INFO  ] Running command: /usr/sbin/lvs --noheadings --readonly --separator=";" -a -S  -o lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size
[2020-04-14 10:27:48,130][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will manage logical volume symlinks in device directory.
[2020-04-14 10:27:48,131][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will obtain device list by scanning device directory.
[2020-04-14 10:27:48,131][ceph_volume.process][INFO  ] stderr WARNING: Failed to connect to lvmetad. Falling back to device scanning.
[2020-04-14 10:27:48,213][ceph_volume.main][INFO  ] Running command: ceph-volume  raw list /mnt/set1-data-0-cg98z --format json
[2020-04-14 10:27:48,214][ceph_volume.devices.raw.list][DEBUG ] Examining /mnt/set1-data-0-cg98z
[2020-04-14 10:27:48,214][ceph_volume.process][INFO  ] Running command: /usr/bin/ceph-bluestore-tool show-label --dev /mnt/set1-data-0-cg98z
[2020-04-14 10:27:48,705][ceph_volume.process][INFO  ] stderr unable to read label for /mnt/set1-data-0-cg98z: (2) No such file or directory
[2020-04-14 10:27:48,705][ceph_volume.devices.raw.list][DEBUG ] No label on /mnt/set1-data-0-cg98z
[2020-04-14 10:57:27,211][ceph_volume.main][INFO  ] Running command: ceph-volume  inventory --format json /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:57:27,212][ceph_volume.process][INFO  ] Running command: /usr/bin/lsblk -plno KNAME,NAME,TYPE
[2020-04-14 10:57:27,674][ceph_volume.process][INFO  ] stdout /dev/sda   /dev/sda                                        disk
[2020-04-14 10:57:27,674][ceph_volume.process][INFO  ] stdout /dev/sda1  /dev/sda1                                       part
[2020-04-14 10:57:27,674][ceph_volume.process][INFO  ] stdout /dev/sda2  /dev/sda2                                       part
[2020-04-14 10:57:27,674][ceph_volume.process][INFO  ] stdout /dev/sda3  /dev/sda3                                       part
[2020-04-14 10:57:27,674][ceph_volume.process][INFO  ] stdout /dev/sdb   /dev/sdb                                        disk
[2020-04-14 10:57:27,674][ceph_volume.process][INFO  ] stdout /dev/sdb1  /dev/sdb1                                       part
[2020-04-14 10:57:27,675][ceph_volume.process][INFO  ] stdout /dev/dm-0  /dev/mapper/3600605b000ac584025e796031b286cb8   mpath
[2020-04-14 10:57:27,675][ceph_volume.process][INFO  ] stdout /dev/dm-1  /dev/mapper/3600605b000ac584025e796031b286cb8p1 part
[2020-04-14 10:57:27,675][ceph_volume.process][INFO  ] stdout /dev/dm-2  /dev/mapper/docker_data                         crypt
[2020-04-14 10:57:27,675][ceph_volume.process][INFO  ] stdout /dev/sdc   /dev/sdc                                        disk
[2020-04-14 10:57:27,675][ceph_volume.process][INFO  ] stdout /dev/dm-3  /dev/mapper/3600605b000ac584025e796091b840018   mpath
[2020-04-14 10:57:27,675][ceph_volume.process][INFO  ] stdout /dev/loop0 /dev/loop0                                      loop
[2020-04-14 10:57:27,679][ceph_volume.process][INFO  ] Running command: /usr/sbin/lvs --noheadings --readonly --separator=";" -a -o lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size
[2020-04-14 10:57:28,139][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will manage logical volume symlinks in device directory.
[2020-04-14 10:57:28,139][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will obtain device list by scanning device directory.
[2020-04-14 10:57:28,139][ceph_volume.process][INFO  ] stderr WARNING: Failed to connect to lvmetad. Falling back to device scanning.
[2020-04-14 10:57:28,140][ceph_volume.process][INFO  ] Running command: /usr/bin/lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:57:28,573][ceph_volume.process][INFO  ] stdout NAME="3600605b000ac584025e796091b840018" KNAME="dm-3" MAJ:MIN="253:3" FSTYPE="" MOUNTPOINT="" LABEL="" UUID="" RO="0" RM="0" MODEL="" SIZE="3.5T" STATE="running" OWNER="root" GROUP="disk" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="4096" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="mpath" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="" PARTLABEL="" 
[2020-04-14 10:57:28,573][ceph_volume.process][INFO  ] Running command: /usr/sbin/blkid -p /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:57:29,025][ceph_volume.process][INFO  ] Running command: /usr/bin/ceph-bluestore-tool show-label --dev /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:57:29,511][ceph_volume.process][INFO  ] stderr unable to read label for /dev/mapper/3600605b000ac584025e796091b840018: (2) No such file or directory
[2020-04-14 10:57:29,511][ceph_volume.process][INFO  ] Running command: /usr/bin/ceph-bluestore-tool show-label --dev /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:57:29,983][ceph_volume.process][INFO  ] stderr unable to read label for /dev/mapper/3600605b000ac584025e796091b840018: (2) No such file or directory
[2020-04-14 10:57:29,984][ceph_volume.process][INFO  ] Running command: /usr/sbin/udevadm info --query=property /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DEVLINKS=/dev/disk/by-id/dm-name-3600605b000ac584025e796091b840018 /dev/disk/by-id/dm-uuid-mpath-3600605b000ac584025e796091b840018 /dev/mapper/3600605b000ac584025e796091b840018
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DEVNAME=/dev/dm-3
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DEVPATH=/devices/virtual/block/dm-3
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DEVTYPE=disk
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DM_NAME=3600605b000ac584025e796091b840018
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DM_SUSPENDED=0
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DM_UDEV_DISABLE_LIBRARY_FALLBACK_FLAG=1
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DM_UDEV_PRIMARY_SOURCE_FLAG=1
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DM_UDEV_RULES_VSN=2
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout DM_UUID=mpath-3600605b000ac584025e796091b840018
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout MAJOR=253
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout MINOR=3
[2020-04-14 10:57:30,417][ceph_volume.process][INFO  ] stdout MPATH_SBIN_PATH=/sbin
[2020-04-14 10:57:30,418][ceph_volume.process][INFO  ] stdout SUBSYSTEM=block
[2020-04-14 10:57:30,418][ceph_volume.process][INFO  ] stdout TAGS=:systemd:
[2020-04-14 10:57:30,418][ceph_volume.process][INFO  ] stdout USEC_INITIALIZED=151353765118
[2020-04-14 10:57:30,596][ceph_volume.main][INFO  ] Running command: ceph-volume  lvm list  --format json
[2020-04-14 10:57:30,597][ceph_volume.process][INFO  ] Running command: /usr/sbin/lvs --noheadings --readonly --separator=";" -a -S  -o lv_tags,lv_path,lv_name,vg_name,lv_uuid,lv_size
[2020-04-14 10:57:31,041][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will manage logical volume symlinks in device directory.
[2020-04-14 10:57:31,041][ceph_volume.process][INFO  ] stderr Udev is running and DM_DISABLE_UDEV environment variable is set. Bypassing udev, LVM will obtain device list by scanning device directory.
[2020-04-14 10:57:31,041][ceph_volume.process][INFO  ] stderr WARNING: Failed to connect to lvmetad. Falling back to device scanning.
[2020-04-14 10:57:31,121][ceph_volume.main][INFO  ] Running command: ceph-volume  raw list /mnt/set1-data-0-cg98z --format json
[2020-04-14 10:57:31,122][ceph_volume.devices.raw.list][DEBUG ] Examining /mnt/set1-data-0-cg98z
[2020-04-14 10:57:31,122][ceph_volume.process][INFO  ] Running command: /usr/bin/ceph-bluestore-tool show-label --dev /mnt/set1-data-0-cg98z
[2020-04-14 10:57:31,596][ceph_volume.process][INFO  ] stderr unable to read label for /mnt/set1-data-0-cg98z: (2) No such file or directory
[2020-04-14 10:57:31,597][ceph_volume.devices.raw.list][DEBUG ] No label on /mnt/set1-data-0-cg98z

Related issues 1 (0 open — 1 closed)

Copied to ceph-volume - Backport #47237: octopus: ceph-volume inventory does not read mpath properlyResolvedJan FajerskiActions
Actions
Copy link

Also available in: Atom PDF