Project

General

Profile

Bug #58063

osd encryption is failing on ubuntu 22.04

Added by Alex Karl 2 months ago. Updated 2 months ago.

Status:
In Progress
Priority:
Normal
Category:
cephadm/osd
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Hallo folks,

i am deploying a quincy ceph cluster 17.2.0 on openstack vm with ubuntu
22.04 minimal with cephadm.
I was able too boostrap the cluster and add the hosts and the mons, but
when i apply the osd spec with the encryption option enabled, it fails
```
service_type: osd
service_id: osd_spec
placement:
host_pattern: "*"
spec:
data_devices:
paths: ['/dev/sdb', '/dev/sdc']
db_devices:
paths: ['/dev/sdd']
filter_logic: AND
objectstore: bluestore
block_db_size: 20G
encrypted: true

```

The logs of cephadm are showing the following:
```
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/bin/ceph-authtool --gen-print-key
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --batch-mode --key-size 512
--key-file - luksFormat /dev/ceph-2fe55820-3869-42c5-8dcf-2bf56d7c3d67/o
sd-block-fb93d350-106b-4627-9b90-d2340a990350
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --key-size 512 --key-file -
--allow-discards luksOpen /dev/ceph-2fe55820-3869-42c5-8dcf-2bf56d7c3d67
/osd-block-fb93d350-106b-4627-9b90-d2340a990350
2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
stderr: device-mapper: reload ioctl on
2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh (253:4) failed: Invalid argument
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --batch-mode --key-size 512
--key-file - luksFormat /dev/ceph-921b0645-88f4-42a9-a711-0a10d96c308e/o
sd-db-80b42d32-3ba6-4d24-8887-e2da568a7cc8
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/sbin/cryptsetup --key-size 512 --key-file -
--allow-discards luksOpen /dev/ceph-921b0645-88f4-42a9-a711-0a10d96c308e
/osd-db-80b42d32-3ba6-4d24-8887-e2da568a7cc8
fcfI01-vCFV-0Uxb-ulEf-4BDZ-KWFZ-Lu31BE
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
stderr: device-mapper: reload ioctl on
fcfI01-vCFV-0Uxb-ulEf-4BDZ-KWFZ-Lu31BE (253:4) failed: Invalid argument
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-4
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
Running command: /usr/bin/chown -R ceph:ceph
/dev/mapper/2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr
stderr: chown: cannot access
'/dev/mapper/2Pm86C-MJ1I-uKVx-WWVk-M0ix-vpWN-dIDXfh': No such file or
directory
2022-11-22 17:32:30,408 7fb201442000 INFO /usr/bin/podman: stderr -->
Was unable to complete a new OSD, will rollback changes
```

Seems to be an issue with the device-mapper.
Without the encryption option, the osds are being deployed.

History

#1 Updated by Alex Karl 2 months ago

This issue is only reproducible on ubuntu 22.04 mini.

#2 Updated by Alex Karl 2 months ago

Ubuntu 22.04 minimal**

#3 Updated by Guillaume Abrioux 2 months ago

  • Status changed from New to In Progress
  • Assignee set to Guillaume Abrioux

Also available in: Atom PDF