Project

General

Profile

Actions
Copy link

Bug #51366

open

cephadm: Super hard to use loopback devices for OSDs

Added by Sebastian Wagner almost 3 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Bootstrap the cluster
h3. losetup

#  fallocate -l 6G disk1.img
#  fallocate -l 6G disk2.img
#  fallocate -l 6G disk3.img
#  sudo losetup $(sudo losetup -f) disk1.img
#  sudo losetup $(sudo losetup -f) disk2.img
#  sudo losetup $(sudo losetup -f) disk3.img
#  sudo wipefs -a /dev/loop0
#  sudo wipefs -a /dev/loop1
#  sudo wipefs -a /dev/loop2
#  lsblk

start ceph-volume container

Run

sudo ./cephadm ceph-volume lvm create --data /dev/loop0

This won't work. Instead copy the podman command and:

  • Remove --entrypoint /usr/sbin/ceph-volume
  • Add -it
  • Add -v /etc/ceph:/etc/ceph

execute the podman command

patch ceph-volume

In file /usr/lib/python3.6/site-packages/ceph_volume/util/disk.py * add *loop

[root@sebastians-laptop /]# grep -C 5 loop /usr/lib/python3.6/site-packages/ceph_volume/util/disk.py 
    if not os.path.exists(dev):
        return False
    # use lsblk first, fall back to using stat
    TYPE = lsblk(dev).get('TYPE')
    if TYPE:
        return TYPE in ['disk', 'mpath', 'loop']

ceph-volume lvm create

# mkdir -p /var/lib/ceph/bootstrap-osd/
# ceph auth get client.bootstrap-osd > /var/lib/ceph/bootstrap-osd/ceph.keyring   
# CEPH_VOLUME_DEBUG=true ceph-volume  lvm create --data /dev/loop0 --no-systemd

activate doesn't work:

[root@sebastians-laptop /]# ceph cephadm osd activate sebastians-laptop
Created osd(s) 0 on host 'sebastians-laptop'

Instead, you need to follow the manual steps: https://tracker.ceph.com/issues/46691#note-1

No data to display

Actions
Copy link

Also available in: Atom PDF