Ceph » ceph-volume

To make debugging easier, ceph-volume should log exact commands run in ceph-volume.log

For example:

[2018-02-14 12:11:22,482][ceph_volume.process][INFO  ] Running command: lvs --noheadings --separator=";" -o lv_tags,lv_path,lv_name,vg_name,lv_uuid
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ceph.block_device=/dev/ceph-28f7427e-5558-4ffd-ae1a-51ec3042759a/osd-block-d9bd8d1b-f4aa-4881-9a89-426187d78687,ceph.block_uuid=F5JD0q-mHzy-YnsH-0sAn-rV8q-ZqLZ-q9mNrK,ceph.cephx_lockbox_secret=,ceph.cluster_fsid=28f7427e-5558-4ffd-ae1a-51ec3042759a,ceph.cluster_name=ceph,ceph.crush_device_class=None,ceph.encrypted=0,ceph.osd_fsid=d9bd8d1b-f4aa-4881-9a89-426187d78687,ceph.osd_id=95,ceph.type=block";"/dev/ceph-28f7427e-5558-4ffd-ae1a-51ec3042759a/osd-block-d9bd8d1b-f4aa-4881-9a89-426187d78687";"osd-block-d9bd8d1b-f4aa-4881-9a89-426187d78687";"ceph-28f7427e-5558-4ffd-ae1a-51ec3042759a";"F5JD0q-mHzy-YnsH-0sAn-rV8q-ZqLZ-q9mNrK
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol0";"lvol0";"journals";"iQRkFG-9e6l-apTk-y8ya-4pVV-yO4y-Nn0VMa
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol1";"lvol1";"journals";"qVV2va-aFIi-qQUb-6GFC-BCIA-VzzW-lbo0R8
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol10";"lvol10";"journals";"zrz2Os-4WRf-hWak-4JcM-iNal-lKSk-8Y26xa
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol11";"lvol11";"journals";"PAxJDJ-1fIZ-uZg4-dbNo-oNhu-0zW7-BCdjOE
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol2";"lvol2";"journals";"w4gSbj-F0oU-okNB-JFtM-L31s-TlDY-ua9sB1
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol3";"lvol3";"journals";"kl2U9Q-16fp-5G0N-b8EZ-XwsD-RMos-zqaFL7
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol4";"lvol4";"journals";"en3lhs-mXxe-5tI0-6EGg-Weli-2cJd-bZE6nh
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol5";"lvol5";"journals";"seu6qx-057a-dpJH-JDq0-IpBP-YSuJ-pMf5fz
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol6";"lvol6";"journals";"fu1hbv-rnpW-lbim-9qDF-MXOb-RRc7-ruTyue
[2018-02-14 12:11:22,505][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol7";"lvol7";"journals";"Bcn1GG-i7Hs-7oZl-dzRY-bhR6-7DoR-WGZpu1
[2018-02-14 12:11:22,506][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol8";"lvol8";"journals";"WkwaMF-8pB3-UYqh-sFJi-t7ft-27hv-9WpHPc
[2018-02-14 12:11:22,506][ceph_volume.process][INFO  ] stdout ";"/dev/journals/lvol9";"lvol9";"journals";"vGFlva-bmiV-EAau-NAEv-D7Bz-WFQP-kbDBhQ
[2018-02-14 12:11:22,508][ceph_volume.devices.lvm.activate][DEBUG ] Found block device (osd-block-d9bd8d1b-f4aa-4881-9a89-426187d78687) with encryption: False
[2018-02-14 12:11:22,508][ceph_volume.devices.lvm.activate][DEBUG ] Found block device (osd-block-d9bd8d1b-f4aa-4881-9a89-426187d78687) with encryption: False
[2018-02-14 12:11:22,508][ceph_volume.process][INFO  ] Running command: ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/ceph-28f7427e-5558-4ffd-ae1a-51ec3042759a/osd-block-d9bd8d1b-f4aa-4881-9a89-426187d78687 --path /var/lib/ceph/osd/ceph-95
[2018-02-14 12:11:22,548][ceph_volume.process][INFO  ] Running command: ln -snf /dev/ceph-28f7427e-5558-4ffd-ae1a-51ec3042759a/osd-block-d9bd8d1b-f4aa-4881-9a89-426187d78687 /var/lib/ceph/osd/ceph-95/block
[2018-02-14 12:11:22,551][ceph_volume.process][INFO  ] Running command: chown -R ceph:ceph /dev/dm-12
[2018-02-14 12:11:22,555][ceph_volume.process][INFO  ] Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-95
[2018-02-14 12:11:22,558][ceph_volume.process][INFO  ] Running command: systemctl enable ceph-volume@lvm-95-d9bd8d1b-f4aa-4881-9a89-426187d78687
[2018-02-14 12:11:22,565][ceph_volume.process][INFO  ] stderr Created symlink from /etc/systemd/system/multi-user.target.wants/ceph-volume@lvm-95-d9bd8d1b-f4aa-4881-9a89-426187d78687.service to /lib/systemd/system/ceph-volume@.service.
[2018-02-14 12:11:22,626][ceph_volume.process][INFO  ] Running command: systemctl start ceph-osd@95

Something here like "Command run: ceph-volume lvm create --bluestore --data /dev/sdb --journal journals/lvol1" 

[2018-02-14 12:34:10,545][ceph_volume.process][INFO  ] Running command: ceph-authtool --gen-print-key
[2018-02-14 12:34:10,572][ceph_volume.process][INFO  ] stdout AQASc4RaaPf8IRAA5ZZJ2M8TztiLoVywTklNuA==
[2018-02-14 12:34:10,573][ceph_volume.process][INFO  ] Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new 600ce70d-fcf6-4507-a261-ec78138d3598
[2018-02-14 12:34:10,882][ceph_volume.process][INFO  ] stdout 94
[2018-02-14 12:34:10,882][ceph_volume.process][INFO  ] Running command: lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb
[2018-02-14 12:34:10,889][ceph_volume.process][INFO  ] stdout NAME="sdb" KNAME="sdb" MAJ:MIN="8:16" FSTYPE="" MOUNTPOINT="" LABEL="" UUID="" RO="0" RM="0" MODEL="ST4000NM0025    " SIZE="3.7T" STATE="running" OWNER="root" GROUP="disk" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="disk" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="" PARTLABEL="" 
[2018-02-14 12:34:10,889][ceph_volume.process][INFO  ] Running command: lsblk --nodeps -P -o NAME,KNAME,MAJ:MIN,FSTYPE,MOUNTPOINT,LABEL,UUID,RO,RM,MODEL,SIZE,STATE,OWNER,GROUP,MODE,ALIGNMENT,PHY-SEC,LOG-SEC,ROTA,SCHED,TYPE,DISC-ALN,DISC-GRAN,DISC-MAX,DISC-ZERO,PKNAME,PARTLABEL /dev/sdb
[2018-02-14 12:34:10,895][ceph_volume.process][INFO  ] stdout NAME="sdb" KNAME="sdb" MAJ:MIN="8:16" FSTYPE="" MOUNTPOINT="" LABEL="" UUID="" RO="0" RM="0" MODEL="ST4000NM0025    " SIZE="3.7T" STATE="running" OWNER="root" GROUP="disk" MODE="brw-rw----" ALIGNMENT="0" PHY-SEC="512" LOG-SEC="512" ROTA="1" SCHED="deadline" TYPE="disk" DISC-ALN="0" DISC-GRAN="0B" DISC-MAX="0B" DISC-ZERO="0" PKNAME="" PARTLABEL="" 
[2018-02-14 12:34:10,895][ceph_volume.process][INFO  ] Running command: vgs --noheadings --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free
[2018-02-14 12:34:10,915][ceph_volume.process][INFO  ] stdout ceph-28f7427e-5558-4ffd-ae1a-51ec3042759a";"1";"1";"0";"wz--n-";"3.64t";"0
[2018-02-14 12:34:10,915][ceph_volume.process][INFO  ] stdout journals";"1";"12";"0";"wz--n-";"372.60g";"616.00m
[2018-02-14 12:34:10,915][ceph_volume.process][INFO  ] stdout osd";"1";"0";"0";"wz--n-";"365.15g";"365.15g
[2018-02-14 12:34:10,916][ceph_volume.process][INFO  ] Running command: vgcreate --force --yes ceph-f24a32cd-ab28-44da-a72b-bf2e81fd9bcf /dev/sdb
[2018-02-14 12:34:10,988][ceph_volume.process][INFO  ] stdout Physical volume "/dev/sdb" successfully created
[2018-02-14 12:34:11,005][ceph_volume.process][INFO  ] stdout Volume group "ceph-f24a32cd-ab28-44da-a72b-bf2e81fd9bcf" successfully created

... etc.