[ajdev0@osd1 ~]$ sudo ceph-disk zap /dev/sdc Caution: invalid backup GPT header, but valid main header; regenerating backup header from main header. Warning! Main and backup partition tables differ! Use the 'c' and 'e' options on the recovery & transformation menu to examine the two tables. Warning! One or more CRCs don't match. You should repair the disk! **************************************************************************** Caution: Found protective or hybrid MBR and corrupt GPT. Using GPT, but disk verification and recovery are STRONGLY recommended. **************************************************************************** GPT data structures destroyed! You may now partition the disk using fdisk or other utilities. Creating new GPT entries. The operation has completed successfully. [ajdev0@osd1 ~]$ sudo ceph-disk zap /dev/sdd Caution: invalid backup GPT header, but valid main header; regenerating backup header from main header. **************************************************************************** Caution: Found protective or hybrid MBR and corrupt GPT. Using GPT, but disk verification and recovery are STRONGLY recommended. **************************************************************************** GPT data structures destroyed! You may now partition the disk using fdisk or other utilities. Creating new GPT entries. The operation has completed successfully. [ajdev0@osd1 ~]$ sudo ceph-disk zap /dev/sde Caution: invalid backup GPT header, but valid main header; regenerating backup header from main header. **************************************************************************** Caution: Found protective or hybrid MBR and corrupt GPT. Using GPT, but disk verification and recovery are STRONGLY recommended. **************************************************************************** GPT data structures destroyed! You may now partition the disk using fdisk or other utilities. Creating new GPT entries. The operation has completed successfully. ################################################################################################################### [ajdev0@osd1 ~]$ sudo ceph-disk list /dev/sda : /dev/sda1 other, ext3, mounted on / /dev/sda2 other, 0x0 /dev/sda3 other, swap /dev/sda4 other, 0x0 /dev/sdb other, unknown /dev/sdc other, unknown /dev/sdd other, unknown /dev/sde other, unknown ################################################################################################################### [ajdev0@osd1 ~]$ sudo rm -f /tmp/foo [ajdev0@osd1 ~]$ sudo ceph-disk --verbose prepare /dev/sdc /tmp/foo command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid command: Running command: /usr/bin/ceph-osd --check-allows-journal -i 0 --cluster ceph command: Running command: /usr/bin/ceph-osd --check-wants-journal -i 0 --cluster ceph command: Running command: /usr/bin/ceph-osd --check-needs-journal -i 0 --cluster ceph get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_type command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_type command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs prepare_file: Creating journal file /tmp/foo with size 0 (ceph-osd will resize and allocate) command: Running command: /sbin/restorecon -R /tmp/foo command: Running command: /usr/bin/chown -R ceph:ceph /tmp/foo prepare_file: Journal is file /tmp/foo prepare_file: OSD will not be hot-swappable if journal is not the same device as the osd data get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid set_data_partition: Creating osd partition on /dev/sdc get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid ptype_tobe_for_name: name = data get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid create_partition: Creating data partition num 1 size 0 on /dev/sdc command_check_call: Running command: /sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e1ce1830-93bb-49ba-add8-56886dbdd6f6 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be --mbrtogpt -- /dev/sdc The operation has completed successfully. update_partition: Calling partprobe on created device /dev/sdc command_check_call: Running command: /usr/bin/udevadm settle --timeout=600 command: Running command: /usr/bin/flock -s /dev/sdc /sbin/partprobe /dev/sdc command_check_call: Running command: /usr/bin/udevadm settle --timeout=600 get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid get_dm_uuid: get_dm_uuid /dev/sdc1 uuid path is /sys/dev/block/8:33/dm/uuid populate_data_path_device: Creating xfs fs on /dev/sdc1 command_check_call: Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdc1 specified blocksize 4096 is less than device physical sector size 8192 switching to logical sector size 512 meta-data=/dev/sdc1 isize=2048 agcount=4, agsize=7324095 blks = sectsz=512 attr=2, projid32bit=1 = crc=0 finobt=0 data = bsize=4096 blocks=29296379, imaxpct=25 = sunit=0 swidth=0 blks naming =version 2 bsize=4096 ascii-ci=0 ftype=0 log =internal log bsize=4096 blocks=14304, version=2 = sectsz=512 sunit=0 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 mount: Mounting /dev/sdc1 on /var/lib/ceph/tmp/mnt.0gVvHi with options noatime,inode64 command_check_call: Running command: /usr/bin/mount -t xfs -o noatime,inode64 -- /dev/sdc1 /var/lib/ceph/tmp/mnt.0gVvHi command: Running command: /sbin/restorecon /var/lib/ceph/tmp/mnt.0gVvHi populate_data_path: Preparing osd data dir /var/lib/ceph/tmp/mnt.0gVvHi command: Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt.0gVvHi/ceph_fsid.74254.tmp command: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.0gVvHi/ceph_fsid.74254.tmp command: Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt.0gVvHi/fsid.74254.tmp command: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.0gVvHi/fsid.74254.tmp command: Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt.0gVvHi/magic.74254.tmp command: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.0gVvHi/magic.74254.tmp command: Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt.0gVvHi/journal_uuid.74254.tmp command: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.0gVvHi/journal_uuid.74254.tmp adjust_symlink: Creating symlink /var/lib/ceph/tmp/mnt.0gVvHi/journal -> /tmp/foo command: Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt.0gVvHi command: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.0gVvHi unmount: Unmounting /var/lib/ceph/tmp/mnt.0gVvHi command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.0gVvHi get_dm_uuid: get_dm_uuid /dev/sdc uuid path is /sys/dev/block/8:32/dm/uuid command_check_call: Running command: /sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdc The operation has completed successfully. update_partition: Calling partprobe on prepared device /dev/sdc command_check_call: Running command: /usr/bin/udevadm settle --timeout=600 command: Running command: /usr/bin/flock -s /dev/sdc /sbin/partprobe /dev/sdc command_check_call: Running command: /usr/bin/udevadm settle --timeout=600 command_check_call: Running command: /usr/bin/udevadm trigger --action=add --sysname-match sdc1 ################################################################################################################################## [ajdev0@osd1 ~]$ sleep 10 [ajdev0@osd1 ~]$ sudo ceph-disk list /dev/sda : /dev/sda1 other, ext3, mounted on / /dev/sda2 other, 0x0 /dev/sda3 other, swap /dev/sda4 other, 0x0 /dev/sdb other, unknown /dev/sdc : /dev/sdc1 ceph data, active, cluster ceph, osd.4 /dev/sdd other, unknown /dev/sde other, unknown ################################################################################################################################### [ajdev0@osd1 ~]$ sudo ceph-disk --verbose activate /dev/sdc1 main_activate: path = /dev/sdc1 get_dm_uuid: get_dm_uuid /dev/sdc1 uuid path is /sys/dev/block/8:33/dm/uuid command: Running command: /sbin/blkid -o udev -p /dev/sdc1 command: Running command: /sbin/blkid -p -s TYPE -o value -- /dev/sdc1 command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs mount: Mounting /dev/sdc1 on /var/lib/ceph/tmp/mnt.obAZHD with options noatime,inode64 command_check_call: Running command: /usr/bin/mount -t xfs -o noatime,inode64 -- /dev/sdc1 /var/lib/ceph/tmp/mnt.obAZHD command: Running command: /sbin/restorecon /var/lib/ceph/tmp/mnt.obAZHD activate: Cluster uuid is 066f558c-6789-4a93-aaf1-5af1ba01a3ad command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid activate: Cluster name is ceph activate: OSD uuid is e1ce1830-93bb-49ba-add8-56886dbdd6f6 activate: OSD id is 4 command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup init command: Running command: /usr/bin/ceph-detect-init --default sysvinit activate: Marking with init system systemd command: Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt.obAZHD/systemd command: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.obAZHD/systemd activate: ceph osd.4 data dir is ready at /var/lib/ceph/tmp/mnt.obAZHD mount_activate: ceph osd.4 already mounted in position; unmounting ours. unmount: Unmounting /var/lib/ceph/tmp/mnt.obAZHD command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.obAZHD start_daemon: Starting ceph osd.4... command_check_call: Running command: /usr/bin/systemctl enable ceph-osd@4 command_check_call: Running command: /usr/bin/systemctl start ceph-osd@4