Ceph

After a Hammer -> Jewel upgrade, OSD daemons will not start. The upstart logs show:

/proc/self/fd/9: 8: /proc/self/fd/9: /usr/libexec/ceph/ceph-osd-prestart.sh: not found


The correct Jewel init script seems to be in place:

$ sudo grep prestart /etc/init/ceph-osd.conf
/usr/lib/ceph/ceph-osd-prestart.sh --cluster="${cluster:-ceph}" -i "$id"

However it would seem that open FDs are ensuring the Hammer-era init script is used which references the incorrect location for ceph-osd-prestart.sh. This forces us to upgrade a node at a time which is more destructive than we'd like to be.

It should be noted that changes like this affect upgrade plans, and perhaps noted in documentation that single OSD rolling restarts are not possible if upstart changes are pushed.