Ceph

This is a 2 node test cluster, single mon, running on the latest jewel release candidate with debian jessie.

In my config, I mount the osds, store the mon data and mds data to a directory under /srv/ceph/osd/osd.$id, /srv/ceph/mon/mon.$id, /srv/ceph/mds/mds.$id, respectively.

systemd fails to start any osds on my second node (the one running osds only), looking at the output of systemctl status ceph-osd@7, etc. I see that it is trying to use the default directories instead of the ones specified in /etc/ceph/ceph.conf.

I have another 3 node production firefly cluster that works perfectly with this config on debian wheezy.

in order to start the osd daemons, I have to run ceph-osd -i 7 --setuser ceph --setgroup ceph (for each OSD).

I also had this issue on infernalis, but I used some dirty hacks in the init scripts to temporarily work around the issue.

I do not use ceph deploy anywhere on my setup.