Ceph » devops

Something like

grep osd/<clustername>-<id> /proc/mounts >> /etc/fstab

could work after the OSD filesystem has been mounted.

udev shoudl trigger ceph-disk active after the reboot to bring the osd back up; no fstab entry should be necessary (provided GPT partitoins are being used)

Then a component is missing on my test system (Debian 7 wheezy).

After rebooting the filesystem is not mounted when not in /etc/fstab.

There is nothing returned from "grep -r ceph /etc/udev".
There is a /lib/udev/rules.d/95-ceph-osd.rules, when I link that into /etc/udev/rules.d udev still does not recogize the filesystem.

what happens if you do 'ceph-disk-active /dev/sdb1' (or whatever the xfs patition is)? what about 'partprobe /dev/sdb' (or whatever the disk device is)?

is it a gpt partition that ceph-deploy created, or did you partition the disk yourself? the udev stuff will only trigger basic on GPT partition labels...

Sage Weil wrote:

what happens if you do 'ceph-disk-active /dev/sdb1' (or whatever the xfs patition is)? what about 'partprobe /dev/sdb' (or whatever the disk device is)?

root@ceph03-test:~# cat /proc/partitions
major minor #blocks name

8        0   10485760 sda
   8        1     248832 sda1
   8        2          1 sda2
   8        5   10233856 sda5
   8       16   16777216 sdb
   8       17   16776175 sdb1
   8       32    1048576 sdc
   8       33    1047552 sdc1
   8       48   16777216 sdd
   8       49   16776175 sdd1
   8       64    1048576 sde
   8       65    1047552 sde1

"partprobe /dev/sdb" and "partprobe /dev/sdd" mounts the filesystems.

is it a gpt partition that ceph-deploy created, or did you partition the disk yourself? the udev stuff will only trigger basic on GPT partition labels...

Both have been created with ceph-deploy:

Model: VMware Virtual disk (scsi)
Disk /dev/sdb: 17.2GB
Sector size (logical/physical): 512B/512B
Partition Table: gpt

Number Start End Size File system Name Flags
1 1049kB 17.2GB 17.2GB xfs ceph data

Hi Sage,

this was a clean reboot of the cluster node.

As the filesystems have not been mounted automatically no OSD has been started.

They get started by udev as soon as I issue the partprobe commands.

Sage Weil wrote:

Can you grab

https://github.com/ceph/ceph/blob/master/src/ceph-disk and copy it to /usr/sbin
https://github.com/ceph/ceph/blob/master/udev/95-ceph-osd.rules for /lib/udev/rules.d

and see if the problem is resolved?

Hi Sage,

I am sorry but I still have to run partprobe manually after a reboot.

Can you generate and attach a udev log after the reboot? Actually, ideally,

- reboot
- note the time
- run partprobe

and send the log along so i can tell what activity resulted from partprobe (tho i guess it'll be obvious).

Thanks! (Also if you'r eon irc right now that'd be quicker to debug this.. #ceph on irc.oftc.net)

rhel seems to be working, fedora18 is acting very strange.

update:

• wheezy is working well.
• fedora is failing only because the mon doesn't start on boot. see #5369
• rhel needs to be retested.

I want to point out on regression in this in debian jessie. As a temporary workaround I placed the corresponding lines to /etc/fstab to mount the XFS partitions at boot. After that all works and the OSD daemons are started automatically. I tried the partprobe without any success.

I can generate the logs if needed.

Thanks. Rene

René, the Debian Jessie issue is known and is being addressed by http://tracker.ceph.com/issues/16351

ok, Nathan, thanks for the link.