Project

General

Profile

Actions

Bug #56031

closed

batch compute a lower size than what it should be for blockdb with multiple fast device

Added by Arthur Outhenin-Chalandre almost 2 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Target version:
-
% Done:

0%

Source:
Tags:
backport_processed
Backport:
quincy,pacific,octopus
Regression:
Yes
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

We have 4 nvme and 48 hosts on one of our node running 16.2.9.
ceph-volume batch want to create 12 blockdb per nvme which is correct but want to take 2% of the size of each nvme (instead of ~8%).

ceph-volume lvm batch /dev/sd* --db-devices /dev/nvme{1..4}n1
--> passed data devices: 48 physical, 0 LVM
--> relative data size: 1.0
--> passed block_db devices: 4 physical, 0 LVM
requested_slots: 12
len(vg_devices): 4
slots_for_vg: 48
dev_size: 3840753532928
abs_size: 74.52 GB
requested_slots: 12
len(vg_devices): 4
slots_for_vg: 48
dev_size: 3840753532928
abs_size: 74.52 GB
requested_slots: 12
len(vg_devices): 4
slots_for_vg: 48
dev_size: 1920383057920
abs_size: 37.26 GB
requested_slots: 12
len(vg_devices): 4
slots_for_vg: 48
dev_size: 1920383057920
abs_size: 37.26 GB
[('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme1n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme2n1', 0.020833333333159756, <Size(74.52 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme3n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12), ('/dev/nvme4n1', 0.020833333333159756, <Size(37.26 GB)>, 12)]

Total OSDs: 48

  Type            Path                                                    LV Size         % of device
----------------------------------------------------------------------------------------------------
  data            /dev/sda                                                12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdaa                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdab                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdac                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdad                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdae                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdaf                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdag                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdah                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdai                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdaj                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdak                                               12.73 TB        100.00%
  block_db        /dev/nvme4n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdal                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdam                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdan                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdao                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdap                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdaq                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdar                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdas                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdat                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdau                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdav                                               12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdb                                                12.73 TB        100.00%
  block_db        /dev/nvme3n1                                            37.26 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdc                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdd                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sde                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdf                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdg                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdh                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdi                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdj                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdk                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdl                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdm                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdn                                                12.73 TB        100.00%
  block_db        /dev/nvme2n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdo                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdp                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdq                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdr                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sds                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdt                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdu                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdv                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdw                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdx                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdy                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
----------------------------------------------------------------------------------------------------
  data            /dev/sdz                                                12.73 TB        100.00%
  block_db        /dev/nvme1n1                                            74.52 GB        2.08%
--> The above OSDs would be created if the operation continues
--> do you want to proceed? (yes/no)

Related issues 3 (0 open3 closed)

Copied to ceph-volume - Backport #56629: pacific: batch compute a lower size than what it should be for blockdb with multiple fast deviceResolvedArthur Outhenin-ChalandreActions
Copied to ceph-volume - Backport #56630: quincy: batch compute a lower size than what it should be for blockdb with multiple fast deviceResolvedArthur Outhenin-ChalandreActions
Copied to ceph-volume - Backport #56631: octopus: batch compute a lower size than what it should be for blockdb with multiple fast deviceResolvedArthur Outhenin-ChalandreActions
Actions #1

Updated by Arthur Outhenin-Chalandre almost 2 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 46666
Actions #2

Updated by Arthur Outhenin-Chalandre almost 2 years ago

  • Backport set to quincy,pacific,octopus
  • Regression changed from No to Yes
Actions #3

Updated by Guillaume Abrioux almost 2 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions #4

Updated by Backport Bot almost 2 years ago

  • Copied to Backport #56629: pacific: batch compute a lower size than what it should be for blockdb with multiple fast device added
Actions #5

Updated by Backport Bot almost 2 years ago

  • Copied to Backport #56630: quincy: batch compute a lower size than what it should be for blockdb with multiple fast device added
Actions #6

Updated by Backport Bot almost 2 years ago

  • Copied to Backport #56631: octopus: batch compute a lower size than what it should be for blockdb with multiple fast device added
Actions #7

Updated by Backport Bot over 1 year ago

  • Tags set to backport_processed
Actions #8

Updated by Guillaume Abrioux over 1 year ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF