Ceph » RADOS

On 12.2.3, my `ceph-osd` has nondeterministic output. I'm running it s root.

Sometimes it prints "created object store", sometimes it doesn't. Is that expected?

[root@node-1:~]# ceph-osd -i 0 --mkfs --osd-uuid 22a6bdf7-d728-4276-b024-62f6f755004d --osd-objectstore bluestore
2018-05-04 01:17:59.301177 7f4eaabafe80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid
2018-05-04 01:18:00.864178 7f4eaabafe80 -1 created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 478b062f-a6e4-4ddf-96e0-7cdad91816e4

[root@node-1:~]# ceph-osd -i 0 --mkfs --osd-uuid 22a6bdf7-d728-4276-b024-62f6f755004d --osd-objectstore bluestore
2018-05-04 01:18:06.395206 7f1d8571ce80 -1 created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 478b062f-a6e4-4ddf-96e0-7cdad91816e4

[root@node-1:~]# ceph-osd -i 0 --mkfs --osd-uuid 22a6bdf7-d728-4276-b024-62f6f755004d --osd-objectstore bluestore
2018-05-04 01:18:11.271088 7f5f356fce80 -1 created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 478b062f-a6e4-4ddf-96e0-7cdad91816e4

[root@node-1:~]# ceph-osd -i 0 --mkfs --osd-uuid 22a6bdf7-d728-4276-b024-62f6f755004d --osd-objectstore bluestore

When I pass `--setuser` and `--setgroup`, it also fails nondeterministically:

[root@node-1:~]# ceph-osd -i 0 --mkfs --osd-uuid 22a6bdf7-d728-4276-b024-62f6f755004d --setuser ceph --setgroup ceph --osd-objectstore bluestore

[root@node-1:~]# ceph-osd -i 0 --mkfs --osd-uuid 22a6bdf7-d728-4276-b024-62f6f755004d --setuser ceph --setgroup ceph --osd-objectstore bluestore

[root@node-1:~]# ceph-osd -i 0 --mkfs --osd-uuid 22a6bdf7-d728-4276-b024-62f6f755004d --setuser ceph --setgroup ceph --osd-objectstore bluestore
2018-05-04 01:13:58.894723 7fb0953cce80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (13) Permission denied
2018-05-04 01:13:58.894735 7fb0953cce80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (13) Permission denied
2018-05-04 01:13:58.894742 7fb0953cce80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (13) Permission denied
2018-05-04 01:13:58.894750 7fb0953cce80 -1 OSD::mkfs: ObjectStore::mkfs failed with error (13) Permission denied
2018-05-04 01:13:58.894802 7fb0953cce80 -1  ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-0: (13) Permission denied

I am not sure whats going on here. Is it a race condition, or maybe something is changing some permissions in the background?