login as: root root@172.17.2.100's password: Last login: Sun Jul 13 11:55:31 2014 from 192.168.3.7 [root@jktcb2cpstg01p ~]# ceph-deploy purge jktcb2ndstg01p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy purge jktcb2ndst g01p [ceph_deploy.install][INFO ] note that some dependencies *will not* be removed because they can cause issues with qemu-kvm [ceph_deploy.install][INFO ] like: librbd1 and librados2 [ceph_deploy.install][DEBUG ] Purging from cluster ceph hosts jktcb2ndstg01p [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2ndstg01p ... [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][INFO ] purging host ... jktcb2ndstg01p [jktcb2ndstg01p][INFO ] Running command: yum -y -q remove ceph ceph-release [jktcb2ndstg01p][WARNIN] No Match for argument: ceph [jktcb2ndstg01p][WARNIN] No Match for argument: ceph-release [jktcb2ndstg01p][INFO ] Running command: yum clean all [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Cleaning repos: base epel extras updates [jktcb2ndstg01p][DEBUG ] Cleaning up Everything [jktcb2ndstg01p][DEBUG ] Cleaning up list of fastest mirrors [root@jktcb2cpstg01p ~]# ceph-deploy purgedata jktcb2ndstg01p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy purgedata jktcb2 ndstg01p [ceph_deploy.install][DEBUG ] Purging data from cluster ceph hosts jktcb2ndstg01 p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [jktcb2ndstg01p][DEBUG ] find the location of an executable [ceph_deploy.install][ERROR ] ceph is still installed on: ['jktcb2ndstg01p'] [ceph_deploy][ERROR ] RuntimeError: refusing to purge data while ceph is still i nstalled [root@jktcb2cpstg01p ~]# ceph-deploy purge -h usage: ceph-deploy purge [-h] HOST [HOST ...] Remove Ceph packages from remote hosts and purge all data. positional arguments: HOST hosts to purge Ceph from optional arguments: -h, --help show this help message and exit [root@jktcb2cpstg01p ~]# ceph-deploy purge --h usage: ceph-deploy purge [-h] HOST [HOST ...] Remove Ceph packages from remote hosts and purge all data. positional arguments: HOST hosts to purge Ceph from optional arguments: -h, --help show this help message and exit [root@jktcb2cpstg01p ~]# ceph-deplop ==h -bash: ceph-deplop: command not found [root@jktcb2cpstg01p ~]# ceph-deplop --h -bash: ceph-deplop: command not found [root@jktcb2cpstg01p ~]# ceph-deplopy --h -bash: ceph-deplopy: command not found [root@jktcb2cpstg01p ~]# ceph-deploy --h usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME] [--overwrite-conf] [--cluster NAME] COMMAND ... Easy Ceph deployment -^- / \ |O o| ceph-deploy v1.5.7 ).-.( '/|||\` | '|` | '|` Full documentation can be found at: http://ceph.com/ceph-deploy/docs optional arguments: -h, --help show this help message and exit -v, --verbose be more verbose -q, --quiet be less verbose --version the current installed version of ceph-deploy --username USERNAME the username to connect to the remote host --overwrite-conf overwrite an existing conf file on remote host (if present) --cluster NAME name of the cluster commands: COMMAND description new Start deploying a new cluster, and write a CLUSTER.conf and keyring for it. install Install Ceph packages on remote hosts. mds Deploy ceph MDS on remote hosts. mon Deploy ceph monitor on remote hosts. gatherkeys Gather authentication keys for provisioning new nodes. disk Manage disks on a remote host. osd Prepare a data disk on remote host. admin Push configuration and client.admin key to a remote host. config Push configuration file to a remote host. uninstall Remove Ceph packages from remote hosts. purgedata Purge (delete, destroy, discard, shred) any Ceph data from /var/lib/ceph purge Remove Ceph packages from remote hosts and purge all data. forgetkeys Remove authentication keys from the local directory. pkg Manage packages on remote hosts. calamari Install and configure Calamari nodes [root@jktcb2cpstg01p ~]# ceph-deploy uninstall jktcb2ndstg01p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy uninstall jktcb2 ndstg01p [ceph_deploy.install][INFO ] note that some dependencies *will not* be removed because they can cause issues with qemu-kvm [ceph_deploy.install][INFO ] like: librbd1 and librados2 [ceph_deploy.install][DEBUG ] Uninstalling on cluster ceph hosts jktcb2ndstg01p [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2ndstg01p ... [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][INFO ] uninstalling ceph on jktcb2ndstg01p [jktcb2ndstg01p][INFO ] Running command: yum -y -q remove ceph ceph-release [jktcb2ndstg01p][WARNIN] No Match for argument: ceph [jktcb2ndstg01p][WARNIN] No Match for argument: ceph-release [jktcb2ndstg01p][INFO ] Running command: yum clean all [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Cleaning repos: base epel extras updates [jktcb2ndstg01p][DEBUG ] Cleaning up Everything [jktcb2ndstg01p][DEBUG ] Cleaning up list of fastest mirrors [root@jktcb2cpstg01p ~]# ssh stg01 Last login: Sun Jul 13 23:54:26 2014 from panel [root@jktcb2ndstg01p ~]# ceph-deploy uninstall jktcb2ndstg01p -bash: ceph-deploy: command not found [root@jktcb2ndstg01p ~]# exit logout Connection to stg01 closed. [root@jktcb2cpstg01p ~]# ceph-deploy uninstall jktcb2ndstg01p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy uninstall jktcb2 ndstg01p [ceph_deploy.install][INFO ] note that some dependencies *will not* be removed because they can cause issues with qemu-kvm [ceph_deploy.install][INFO ] like: librbd1 and librados2 [ceph_deploy.install][DEBUG ] Uninstalling on cluster ceph hosts jktcb2ndstg01p [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2ndstg01p ... [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][INFO ] uninstalling ceph on jktcb2ndstg01p [jktcb2ndstg01p][INFO ] Running command: yum -y -q remove ceph ceph-release [jktcb2ndstg01p][WARNIN] No Match for argument: ceph [jktcb2ndstg01p][WARNIN] No Match for argument: ceph-release [jktcb2ndstg01p][INFO ] Running command: yum clean all [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Cleaning repos: base epel extras updates [jktcb2ndstg01p][DEBUG ] Cleaning up Everything [jktcb2ndstg01p][DEBUG ] Cleaning up list of fastest mirrors [root@jktcb2cpstg01p ~]# [root@jktcb2cpstg01p ~]# ceph-deploy uninstall jktcb2ndstg01p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy uninstall jktcb2 ndstg01p [ceph_deploy.install][INFO ] note that some dependencies *will not* be removed because they can cause issues with qemu-kvm [ceph_deploy.install][INFO ] like: librbd1 and librados2 [ceph_deploy.install][DEBUG ] Uninstalling on cluster ceph hosts jktcb2ndstg01p [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2ndstg01p ... [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][INFO ] uninstalling ceph on jktcb2ndstg01p [jktcb2ndstg01p][INFO ] Running command: yum -y -q remove ceph ceph-release [jktcb2ndstg01p][WARNIN] Existing lock /var/run/yum.pid: another copy is running as pid 1508. [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 34 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:29 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 34 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:31 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:33 ago [jktcb2ndstg01p][WARNIN] State : Running, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:35 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:37 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:39 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:41 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:43 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:45 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:47 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:49 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:51 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:53 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:55 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 38 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:57 ago [jktcb2ndstg01p][WARNIN] State : Sleeping, pid: 1508 [jktcb2ndstg01p][WARNIN] Another app is currently holding the yum lock; waiting for it to exit... [jktcb2ndstg01p][WARNIN] The other application is: yum [jktcb2ndstg01p][WARNIN] Memory : 41 M RSS (1.2 GB VSZ) [jktcb2ndstg01p][WARNIN] Started: Mon Jul 14 00:01:32 2014 - 01:59 ago [jktcb2ndstg01p][WARNIN] State : Running, pid: 1508 [jktcb2ndstg01p][WARNIN] No Match for argument: ceph [jktcb2ndstg01p][WARNIN] No Match for argument: ceph-release [jktcb2ndstg01p][INFO ] Running command: yum clean all [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Cleaning repos: base epel extras updates [jktcb2ndstg01p][DEBUG ] Cleaning up Everything [jktcb2ndstg01p][DEBUG ] Cleaning up list of fastest mirrors [root@jktcb2cpstg01p ~]# ceph-deploy purgedata jktcb2ndstg{01,02,03}p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy purgedata jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.install][DEBUG ] Purging data from cluster ceph hosts jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [jktcb2ndstg01p][DEBUG ] find the location of an executable [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [jktcb2ndstg02p][DEBUG ] find the location of an executable [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [jktcb2ndstg03p][DEBUG ] find the location of an executable [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][INFO ] purging data on jktcb2ndstg01p [jktcb2ndstg01p][INFO ] Running command: rm -rf --one-file-system -- /var/lib/ceph [jktcb2ndstg01p][INFO ] Running command: rm -rf --one-file-system -- /etc/ceph/ [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][INFO ] purging data on jktcb2ndstg02p [jktcb2ndstg02p][INFO ] Running command: rm -rf --one-file-system -- /var/lib/ceph [jktcb2ndstg02p][INFO ] Running command: rm -rf --one-file-system -- /etc/ceph/ [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][INFO ] purging data on jktcb2ndstg03p [jktcb2ndstg03p][INFO ] Running command: rm -rf --one-file-system -- /var/lib/ceph [jktcb2ndstg03p][INFO ] Running command: rm -rf --one-file-system -- /etc/ceph/ [root@jktcb2cpstg01p ~]# ceph-deploy forgetkeys jktcb2ndstg{01,02,03}p usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME] [--overwrite-conf] [--cluster NAME] COMMAND ... ceph-deploy: error: unrecognized arguments: jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [root@jktcb2cpstg01p ~]# ceph-deploy forgetkeys [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy forgetkeys [root@jktcb2cpstg01p ~]# ls anaconda-ks.cfg epel-release-6-8.noarch.rpm epel-release-6-8.noarch.rpm.3 install.log.syslog ceph.conf epel-release-6-8.noarch.rpm.1 epel-release-6-8.noarch.rpm.4 ceph.log epel-release-6-8.noarch.rpm.2 install.log [root@jktcb2cpstg01p ~]# rm ceph.conf rm: remove regular file `ceph.conf'? yes [root@jktcb2cpstg01p ~]# rm ceph.log rm: remove regular file `ceph.log'? yes [root@jktcb2cpstg01p ~]# ls anaconda-ks.cfg epel-release-6-8.noarch.rpm.2 install.log epel-release-6-8.noarch.rpm epel-release-6-8.noarch.rpm.3 install.log.syslog epel-release-6-8.noarch.rpm.1 epel-release-6-8.noarch.rpm.4 [root@jktcb2cpstg01p ~]# ceph-deploy new jktcb2ndstg{01,02,03}p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy new jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.new][DEBUG ] Creating new cluster named ceph [ceph_deploy.new][DEBUG ] Resolving host jktcb2ndstg01p [ceph_deploy.new][DEBUG ] Monitor jktcb2ndstg01p at 172.17.2.101 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2ndstg01p][INFO ] Running command: ssh -CT -o BatchMode=yes jktcb2ndstg01p [ceph_deploy.new][DEBUG ] Resolving host jktcb2ndstg02p [ceph_deploy.new][DEBUG ] Monitor jktcb2ndstg02p at 172.17.2.102 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2ndstg02p][INFO ] Running command: ssh -CT -o BatchMode=yes jktcb2ndstg02p [ceph_deploy.new][DEBUG ] Resolving host jktcb2ndstg03p [ceph_deploy.new][DEBUG ] Monitor jktcb2ndstg03p at 172.17.2.103 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2ndstg03p][INFO ] Running command: ssh -CT -o BatchMode=yes jktcb2ndstg03p [ceph_deploy.new][DEBUG ] Monitor initial members are ['jktcb2ndstg01p', 'jktcb2ndstg02p', 'jktcb2ndstg03p'] [ceph_deploy.new][DEBUG ] Monitor addrs are ['172.17.2.101', '172.17.2.102', '172.17.2.103'] [ceph_deploy.new][DEBUG ] Creating a random mon key... [ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf... [ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring... [root@jktcb2cpstg01p ~]# vi ceph.conf [root@jktcb2cpstg01p ~]# ceph-deploy install jktcb2cpstg01p jktcb2ndstg{01,02,03}p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy install jktcb2cpstg01p jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.install][DEBUG ] Installing stable version firefly on cluster ceph hosts jktcb2cpstg01p jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2cpstg01p ... [jktcb2cpstg01p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2cpstg01p][DEBUG ] detect platform information from remote host [jktcb2cpstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2cpstg01p][INFO ] installing ceph on jktcb2cpstg01p [jktcb2cpstg01p][INFO ] Running command: yum clean all [jktcb2cpstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2cpstg01p][DEBUG ] Cleaning repos: Ceph Ceph-noarch base ceph-source epel extras updates [jktcb2cpstg01p][DEBUG ] Cleaning up Everything [jktcb2cpstg01p][DEBUG ] Cleaning up list of fastest mirrors [jktcb2cpstg01p][INFO ] Running command: yum -y install wget [jktcb2cpstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2cpstg01p][DEBUG ] Determining fastest mirrors [jktcb2cpstg01p][DEBUG ] * base: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] * epel: epel.mirror.srv.co.ge [jktcb2cpstg01p][DEBUG ] * extras: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] * updates: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] 45 packages excluded due to repository priority protections [jktcb2cpstg01p][DEBUG ] Setting up Install Process [jktcb2cpstg01p][DEBUG ] Package wget-1.12-1.11.el6_5.x86_64 already installed and latest version [jktcb2cpstg01p][DEBUG ] Nothing to do [jktcb2cpstg01p][INFO ] adding EPEL repository [jktcb2cpstg01p][INFO ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2cpstg01p][WARNIN] --2014-07-14 00:25:57-- http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2cpstg01p][WARNIN] Resolving dl.fedoraproject.org... 209.132.181.25, 209.132.181.24, 209.132.181.27, ... [jktcb2cpstg01p][WARNIN] Connecting to dl.fedoraproject.org|209.132.181.25|:80... connected. [jktcb2cpstg01p][WARNIN] HTTP request sent, awaiting response... 200 OK [jktcb2cpstg01p][WARNIN] Length: 14540 (14K) [application/x-rpm] [jktcb2cpstg01p][WARNIN] Saving to: `epel-release-6-8.noarch.rpm.5' [jktcb2cpstg01p][WARNIN] [jktcb2cpstg01p][WARNIN] 0K .......... .... 100% 67.5K=0.2s [jktcb2cpstg01p][WARNIN] [jktcb2cpstg01p][WARNIN] 2014-07-14 00:26:03 (67.5 KB/s) - `epel-release-6-8.noarch.rpm.5' saved [14540/14540] [jktcb2cpstg01p][WARNIN] [jktcb2cpstg01p][INFO ] Running command: rpm -Uvh --replacepkgs epel-release-6*.rpm [jktcb2cpstg01p][DEBUG ] Preparing... ################################################## [jktcb2cpstg01p][DEBUG ] epel-release ################################################## [jktcb2cpstg01p][INFO ] Running command: yum -y install yum-plugin-priorities [jktcb2cpstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2cpstg01p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2cpstg01p][DEBUG ] * base: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] * epel: epel.mirror.srv.co.ge [jktcb2cpstg01p][DEBUG ] * extras: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] * updates: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] 45 packages excluded due to repository priority protections [jktcb2cpstg01p][DEBUG ] Setting up Install Process [jktcb2cpstg01p][DEBUG ] Package yum-plugin-priorities-1.1.30-17.el6_5.noarch already installed and latest version [jktcb2cpstg01p][DEBUG ] Nothing to do [jktcb2cpstg01p][INFO ] Running command: rpm --import https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc [jktcb2cpstg01p][INFO ] Running command: rpm -Uvh --replacepkgs http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2cpstg01p][DEBUG ] Retrieving http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2cpstg01p][DEBUG ] Preparing... ################################################## [jktcb2cpstg01p][DEBUG ] ceph-release ################################################## [jktcb2cpstg01p][WARNIN] ensuring that /etc/yum.repos.d/ceph.repo contains a high pririty [jktcb2cpstg01p][WARNIN] altered ceph.repo priorities to contain: priority=1 [jktcb2cpstg01p][INFO ] Running command: yum -y install ceph [jktcb2cpstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2cpstg01p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2cpstg01p][DEBUG ] * base: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] * epel: epel.mirror.srv.co.ge [jktcb2cpstg01p][DEBUG ] * extras: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] * updates: centos.mirror.secureax.com [jktcb2cpstg01p][DEBUG ] 45 packages excluded due to repository priority protections [jktcb2cpstg01p][DEBUG ] Setting up Install Process [jktcb2cpstg01p][DEBUG ] Package ceph-0.80.3-0.el6.x86_64 already installed and latest version [jktcb2cpstg01p][DEBUG ] Nothing to do [jktcb2cpstg01p][INFO ] Running command: ceph --version [jktcb2cpstg01p][DEBUG ] ceph version 0.80.3 (a129e85cdc3446a427fffffe4c31617d49024946) [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2ndstg01p ... [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][INFO ] installing ceph on jktcb2ndstg01p [jktcb2ndstg01p][INFO ] Running command: yum clean all [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Cleaning repos: base epel extras updates [jktcb2ndstg01p][DEBUG ] Cleaning up Everything [jktcb2ndstg01p][INFO ] Running command: yum -y install wget [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Determining fastest mirrors [jktcb2ndstg01p][DEBUG ] * base: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] * epel: mirrors.vinahost.vn [jktcb2ndstg01p][DEBUG ] * extras: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] * updates: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] Setting up Install Process [jktcb2ndstg01p][DEBUG ] Package wget-1.12-1.11.el6_5.x86_64 already installed and latest version [jktcb2ndstg01p][DEBUG ] Nothing to do [jktcb2ndstg01p][INFO ] adding EPEL repository [jktcb2ndstg01p][INFO ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2ndstg01p][WARNIN] --2014-07-14 00:26:56-- http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2ndstg01p][WARNIN] Resolving dl.fedoraproject.org... 209.132.181.25, 209.132.181.24, 209.132.181.27, ... [jktcb2ndstg01p][WARNIN] Connecting to dl.fedoraproject.org|209.132.181.25|:80... connected. [jktcb2ndstg01p][WARNIN] HTTP request sent, awaiting response... 200 OK [jktcb2ndstg01p][WARNIN] Length: 14540 (14K) [application/x-rpm] [jktcb2ndstg01p][WARNIN] Saving to: `epel-release-6-8.noarch.rpm.17' [jktcb2ndstg01p][WARNIN] [jktcb2ndstg01p][WARNIN] 0K .......... .... 100% 63.3K=0.2s [jktcb2ndstg01p][WARNIN] [jktcb2ndstg01p][WARNIN] 2014-07-14 00:26:57 (63.3 KB/s) - `epel-release-6-8.noarch.rpm.17' saved [14540/14540] [jktcb2ndstg01p][WARNIN] [jktcb2ndstg01p][INFO ] Running command: rpm -Uvh --replacepkgs epel-release-6*.rpm [jktcb2ndstg01p][DEBUG ] Preparing... ################################################## [jktcb2ndstg01p][DEBUG ] epel-release ################################################## [jktcb2ndstg01p][INFO ] Running command: yum -y install yum-plugin-priorities [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2ndstg01p][DEBUG ] * base: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] * epel: mirrors.vinahost.vn [jktcb2ndstg01p][DEBUG ] * extras: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] * updates: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] Setting up Install Process [jktcb2ndstg01p][DEBUG ] Package yum-plugin-priorities-1.1.30-17.el6_5.noarch already installed and latest version [jktcb2ndstg01p][DEBUG ] Nothing to do [jktcb2ndstg01p][INFO ] Running command: rpm --import https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc [jktcb2ndstg01p][INFO ] Running command: rpm -Uvh --replacepkgs http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2ndstg01p][DEBUG ] Retrieving http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2ndstg01p][DEBUG ] Preparing... ################################################## [jktcb2ndstg01p][DEBUG ] ceph-release ################################################## [jktcb2ndstg01p][WARNIN] ensuring that /etc/yum.repos.d/ceph.repo contains a high pririty [jktcb2ndstg01p][WARNIN] altered ceph.repo priorities to contain: priority=1 [jktcb2ndstg01p][INFO ] Running command: yum -y install ceph [jktcb2ndstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg01p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2ndstg01p][DEBUG ] * base: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] * epel: mirrors.vinahost.vn [jktcb2ndstg01p][DEBUG ] * extras: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] * updates: centos.exabytes.com.my [jktcb2ndstg01p][DEBUG ] 45 packages excluded due to repository priority protections [jktcb2ndstg01p][DEBUG ] Setting up Install Process [jktcb2ndstg01p][DEBUG ] Resolving Dependencies [jktcb2ndstg01p][DEBUG ] --> Running transaction check [jktcb2ndstg01p][DEBUG ] ---> Package ceph.x86_64 0:0.80.3-0.el6 will be installed [jktcb2ndstg01p][DEBUG ] --> Processing Dependency: ceph-common = 0.80.3-0.el6 for package: ceph-0.80.3-0.el6.x86_64 [jktcb2ndstg01p][DEBUG ] --> Running transaction check [jktcb2ndstg01p][DEBUG ] ---> Package ceph-common.x86_64 0:0.80.3-0.el6 will be installed [jktcb2ndstg01p][DEBUG ] --> Finished Dependency Resolution [jktcb2ndstg01p][DEBUG ] [jktcb2ndstg01p][DEBUG ] Dependencies Resolved [jktcb2ndstg01p][DEBUG ] [jktcb2ndstg01p][DEBUG ] ================================================================================ [jktcb2ndstg01p][DEBUG ] Package Arch Version Repository Size [jktcb2ndstg01p][DEBUG ] ================================================================================ [jktcb2ndstg01p][DEBUG ] Installing: [jktcb2ndstg01p][DEBUG ] ceph x86_64 0.80.3-0.el6 Ceph 10 M [jktcb2ndstg01p][DEBUG ] Installing for dependencies: [jktcb2ndstg01p][DEBUG ] ceph-common x86_64 0.80.3-0.el6 Ceph 6.1 M [jktcb2ndstg01p][DEBUG ] [jktcb2ndstg01p][DEBUG ] Transaction Summary [jktcb2ndstg01p][DEBUG ] ================================================================================ [jktcb2ndstg01p][DEBUG ] Install 2 Package(s) [jktcb2ndstg01p][DEBUG ] [jktcb2ndstg01p][DEBUG ] Total download size: 16 M [jktcb2ndstg01p][DEBUG ] Installed size: 65 M [jktcb2ndstg01p][DEBUG ] Downloading Packages: [jktcb2ndstg01p][DEBUG ] -------------------------------------------------------------------------------- [jktcb2ndstg01p][DEBUG ] Total 289 kB/s | 16 MB 00:58 [jktcb2ndstg01p][DEBUG ] Running rpm_check_debug [jktcb2ndstg01p][DEBUG ] Running Transaction Test [jktcb2ndstg01p][DEBUG ] Transaction Test Succeeded [jktcb2ndstg01p][DEBUG ] Running Transaction Installing : ceph-common-0.80.3-0.el6.x86_64 1/2 Installing : ceph-0.80.3-0.el6.x86_64 2/2 Verifying : ceph-common-0.80.3-0.el6.x86_64 1/2 Verifying : ceph-0.80.3-0.el6.x86_64 2/2 [jktcb2ndstg01p][DEBUG ] [jktcb2ndstg01p][DEBUG ] Installed: [jktcb2ndstg01p][DEBUG ] ceph.x86_64 0:0.80.3-0.el6 [jktcb2ndstg01p][DEBUG ] [jktcb2ndstg01p][DEBUG ] Dependency Installed: [jktcb2ndstg01p][DEBUG ] ceph-common.x86_64 0:0.80.3-0.el6 [jktcb2ndstg01p][DEBUG ] [jktcb2ndstg01p][DEBUG ] Complete! [jktcb2ndstg01p][WARNIN] Warning: RPMDB altered outside of yum. [jktcb2ndstg01p][INFO ] Running command: ceph --version [jktcb2ndstg01p][DEBUG ] ceph version 0.80.3 (a129e85cdc3446a427fffffe4c31617d49024946) [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2ndstg02p ... [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][INFO ] installing ceph on jktcb2ndstg02p [jktcb2ndstg02p][INFO ] Running command: yum clean all [jktcb2ndstg02p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg02p][DEBUG ] Cleaning repos: base epel extras updates [jktcb2ndstg02p][DEBUG ] Cleaning up Everything [jktcb2ndstg02p][INFO ] Running command: yum -y install wget [jktcb2ndstg02p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg02p][DEBUG ] Determining fastest mirrors [jktcb2ndstg02p][DEBUG ] * base: repo.apiknet.co.id [jktcb2ndstg02p][DEBUG ] * epel: mirrors.vinahost.vn [jktcb2ndstg02p][DEBUG ] * extras: repo.apiknet.co.id [jktcb2ndstg02p][DEBUG ] * updates: centos.exabytes.com.my [jktcb2ndstg02p][DEBUG ] Setting up Install Process [jktcb2ndstg02p][DEBUG ] Package wget-1.12-1.11.el6_5.x86_64 already installed and latest version [jktcb2ndstg02p][DEBUG ] Nothing to do [jktcb2ndstg02p][INFO ] adding EPEL repository [jktcb2ndstg02p][INFO ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2ndstg02p][WARNIN] --2014-07-14 00:29:01-- http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2ndstg02p][WARNIN] Resolving dl.fedoraproject.org... 209.132.181.26, 209.132.181.27, 209.132.181.25, ... [jktcb2ndstg02p][WARNIN] Connecting to dl.fedoraproject.org|209.132.181.26|:80... connected. [jktcb2ndstg02p][WARNIN] HTTP request sent, awaiting response... 200 OK [jktcb2ndstg02p][WARNIN] Length: 14540 (14K) [application/x-rpm] [jktcb2ndstg02p][WARNIN] Saving to: `epel-release-6-8.noarch.rpm.16' [jktcb2ndstg02p][WARNIN] [jktcb2ndstg02p][WARNIN] 0K .......... .... 100% 63.4K=0.2s [jktcb2ndstg02p][WARNIN] [jktcb2ndstg02p][WARNIN] 2014-07-14 00:29:07 (63.4 KB/s) - `epel-release-6-8.noarch.rpm.16' saved [14540/14540] [jktcb2ndstg02p][WARNIN] [jktcb2ndstg02p][INFO ] Running command: rpm -Uvh --replacepkgs epel-release-6*.rpm [jktcb2ndstg02p][DEBUG ] Preparing... ################################################## [jktcb2ndstg02p][DEBUG ] epel-release ################################################## [jktcb2ndstg02p][INFO ] Running command: yum -y install yum-plugin-priorities [jktcb2ndstg02p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg02p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2ndstg02p][DEBUG ] * base: repo.apiknet.co.id [jktcb2ndstg02p][DEBUG ] * epel: mirrors.vinahost.vn [jktcb2ndstg02p][DEBUG ] * extras: repo.apiknet.co.id [jktcb2ndstg02p][DEBUG ] * updates: centos.exabytes.com.my [jktcb2ndstg02p][DEBUG ] Setting up Install Process [jktcb2ndstg02p][DEBUG ] Package yum-plugin-priorities-1.1.30-17.el6_5.noarch already installed and latest version [jktcb2ndstg02p][DEBUG ] Nothing to do [jktcb2ndstg02p][INFO ] Running command: rpm --import https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc [jktcb2ndstg02p][INFO ] Running command: rpm -Uvh --replacepkgs http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2ndstg02p][DEBUG ] Retrieving http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2ndstg02p][DEBUG ] Preparing... ################################################## [jktcb2ndstg02p][DEBUG ] ceph-release ################################################## [jktcb2ndstg02p][WARNIN] ensuring that /etc/yum.repos.d/ceph.repo contains a high pririty [jktcb2ndstg02p][WARNIN] altered ceph.repo priorities to contain: priority=1 [jktcb2ndstg02p][INFO ] Running command: yum -y install ceph [jktcb2ndstg02p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg02p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2ndstg02p][DEBUG ] * base: repo.apiknet.co.id [jktcb2ndstg02p][DEBUG ] * epel: mirrors.vinahost.vn [jktcb2ndstg02p][DEBUG ] * extras: repo.apiknet.co.id [jktcb2ndstg02p][DEBUG ] * updates: centos.exabytes.com.my [jktcb2ndstg02p][DEBUG ] 45 packages excluded due to repository priority protections [jktcb2ndstg02p][DEBUG ] Setting up Install Process [jktcb2ndstg02p][DEBUG ] Resolving Dependencies [jktcb2ndstg02p][DEBUG ] --> Running transaction check [jktcb2ndstg02p][DEBUG ] ---> Package ceph.x86_64 0:0.80.3-0.el6 will be installed [jktcb2ndstg02p][DEBUG ] --> Processing Dependency: ceph-common = 0.80.3-0.el6 for package: ceph-0.80.3-0.el6.x86_64 [jktcb2ndstg02p][DEBUG ] --> Running transaction check [jktcb2ndstg02p][DEBUG ] ---> Package ceph-common.x86_64 0:0.80.3-0.el6 will be installed [jktcb2ndstg02p][DEBUG ] --> Finished Dependency Resolution [jktcb2ndstg02p][DEBUG ] [jktcb2ndstg02p][DEBUG ] Dependencies Resolved [jktcb2ndstg02p][DEBUG ] [jktcb2ndstg02p][DEBUG ] ================================================================================ [jktcb2ndstg02p][DEBUG ] Package Arch Version Repository Size [jktcb2ndstg02p][DEBUG ] ================================================================================ [jktcb2ndstg02p][DEBUG ] Installing: [jktcb2ndstg02p][DEBUG ] ceph x86_64 0.80.3-0.el6 Ceph 10 M [jktcb2ndstg02p][DEBUG ] Installing for dependencies: [jktcb2ndstg02p][DEBUG ] ceph-common x86_64 0.80.3-0.el6 Ceph 6.1 M [jktcb2ndstg02p][DEBUG ] [jktcb2ndstg02p][DEBUG ] Transaction Summary [jktcb2ndstg02p][DEBUG ] ================================================================================ [jktcb2ndstg02p][DEBUG ] Install 2 Package(s) [jktcb2ndstg02p][DEBUG ] [jktcb2ndstg02p][DEBUG ] Total download size: 16 M [jktcb2ndstg02p][DEBUG ] Installed size: 65 M [jktcb2ndstg02p][DEBUG ] Downloading Packages: [jktcb2ndstg02p][DEBUG ] -------------------------------------------------------------------------------- [jktcb2ndstg02p][DEBUG ] Total 269 kB/s | 16 MB 01:02 [jktcb2ndstg02p][DEBUG ] Running rpm_check_debug [jktcb2ndstg02p][DEBUG ] Running Transaction Test [jktcb2ndstg02p][DEBUG ] Transaction Test Succeeded [jktcb2ndstg02p][DEBUG ] Running Transaction Installing : ceph-common-0.80.3-0.el6.x86_64 1/2 Installing : ceph-0.80.3-0.el6.x86_64 2/2 Verifying : ceph-common-0.80.3-0.el6.x86_64 1/2 Verifying : ceph-0.80.3-0.el6.x86_64 2/2 [jktcb2ndstg02p][DEBUG ] [jktcb2ndstg02p][DEBUG ] Installed: [jktcb2ndstg02p][DEBUG ] ceph.x86_64 0:0.80.3-0.el6 [jktcb2ndstg02p][DEBUG ] [jktcb2ndstg02p][DEBUG ] Dependency Installed: [jktcb2ndstg02p][DEBUG ] ceph-common.x86_64 0:0.80.3-0.el6 [jktcb2ndstg02p][DEBUG ] [jktcb2ndstg02p][DEBUG ] Complete! [jktcb2ndstg02p][WARNIN] Warning: RPMDB altered outside of yum. [jktcb2ndstg02p][INFO ] Running command: ceph --version [jktcb2ndstg02p][DEBUG ] ceph version 0.80.3 (a129e85cdc3446a427fffffe4c31617d49024946) [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2ndstg03p ... [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][INFO ] installing ceph on jktcb2ndstg03p [jktcb2ndstg03p][INFO ] Running command: yum clean all [jktcb2ndstg03p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg03p][DEBUG ] Cleaning repos: base epel extras updates [jktcb2ndstg03p][DEBUG ] Cleaning up Everything [jktcb2ndstg03p][INFO ] Running command: yum -y install wget [jktcb2ndstg03p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg03p][DEBUG ] Determining fastest mirrors [jktcb2ndstg03p][DEBUG ] * base: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] * epel: mirrors.ispros.com.bd [jktcb2ndstg03p][DEBUG ] * extras: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] * updates: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] Setting up Install Process [jktcb2ndstg03p][DEBUG ] Package wget-1.12-1.11.el6_5.x86_64 already installed and latest version [jktcb2ndstg03p][DEBUG ] Nothing to do [jktcb2ndstg03p][INFO ] adding EPEL repository [jktcb2ndstg03p][INFO ] Running command: wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2ndstg03p][WARNIN] --2014-07-14 00:30:55-- http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [jktcb2ndstg03p][WARNIN] Resolving dl.fedoraproject.org... 209.132.181.25, 209.132.181.27, 209.132.181.23, ... [jktcb2ndstg03p][WARNIN] Connecting to dl.fedoraproject.org|209.132.181.25|:80... connected. [jktcb2ndstg03p][WARNIN] HTTP request sent, awaiting response... 200 OK [jktcb2ndstg03p][WARNIN] Length: 14540 (14K) [application/x-rpm] [jktcb2ndstg03p][WARNIN] Saving to: `epel-release-6-8.noarch.rpm.14' [jktcb2ndstg03p][WARNIN] [jktcb2ndstg03p][WARNIN] 0K .......... .... 100% 67.0K=0.2s [jktcb2ndstg03p][WARNIN] [jktcb2ndstg03p][WARNIN] 2014-07-14 00:30:55 (67.0 KB/s) - `epel-release-6-8.noarch.rpm.14' saved [14540/14540] [jktcb2ndstg03p][WARNIN] [jktcb2ndstg03p][INFO ] Running command: rpm -Uvh --replacepkgs epel-release-6*.rpm [jktcb2ndstg03p][DEBUG ] Preparing... ################################################## [jktcb2ndstg03p][DEBUG ] epel-release ################################################## [jktcb2ndstg03p][INFO ] Running command: yum -y install yum-plugin-priorities [jktcb2ndstg03p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg03p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2ndstg03p][DEBUG ] * base: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] * epel: mirrors.ispros.com.bd [jktcb2ndstg03p][DEBUG ] * extras: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] * updates: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] Setting up Install Process [jktcb2ndstg03p][DEBUG ] Package yum-plugin-priorities-1.1.30-17.el6_5.noarch already installed and latest version [jktcb2ndstg03p][DEBUG ] Nothing to do [jktcb2ndstg03p][INFO ] Running command: rpm --import https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc [jktcb2ndstg03p][INFO ] Running command: rpm -Uvh --replacepkgs http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2ndstg03p][DEBUG ] Retrieving http://ceph.com/rpm-firefly/el6/noarch/ceph-release-1-0.el6.noarch.rpm [jktcb2ndstg03p][DEBUG ] Preparing... ################################################## [jktcb2ndstg03p][DEBUG ] ceph-release ################################################## [jktcb2ndstg03p][WARNIN] ensuring that /etc/yum.repos.d/ceph.repo contains a high pririty [jktcb2ndstg03p][WARNIN] altered ceph.repo priorities to contain: priority=1 [jktcb2ndstg03p][INFO ] Running command: yum -y install ceph [jktcb2ndstg03p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2ndstg03p][DEBUG ] Loading mirror speeds from cached hostfile [jktcb2ndstg03p][DEBUG ] * base: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] * epel: mirrors.ispros.com.bd [jktcb2ndstg03p][DEBUG ] * extras: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] * updates: mirror.dionipe.net [jktcb2ndstg03p][DEBUG ] 45 packages excluded due to repository priority protections [jktcb2ndstg03p][DEBUG ] Setting up Install Process [jktcb2ndstg03p][DEBUG ] Resolving Dependencies [jktcb2ndstg03p][DEBUG ] --> Running transaction check [jktcb2ndstg03p][DEBUG ] ---> Package ceph.x86_64 0:0.80.3-0.el6 will be installed [jktcb2ndstg03p][DEBUG ] --> Processing Dependency: ceph-common = 0.80.3-0.el6 for package: ceph-0.80.3-0.el6.x86_64 [jktcb2ndstg03p][DEBUG ] --> Running transaction check [jktcb2ndstg03p][DEBUG ] ---> Package ceph-common.x86_64 0:0.80.3-0.el6 will be installed [jktcb2ndstg03p][DEBUG ] --> Finished Dependency Resolution [jktcb2ndstg03p][DEBUG ] [jktcb2ndstg03p][DEBUG ] Dependencies Resolved [jktcb2ndstg03p][DEBUG ] [jktcb2ndstg03p][DEBUG ] ================================================================================ [jktcb2ndstg03p][DEBUG ] Package Arch Version Repository Size [jktcb2ndstg03p][DEBUG ] ================================================================================ [jktcb2ndstg03p][DEBUG ] Installing: [jktcb2ndstg03p][DEBUG ] ceph x86_64 0.80.3-0.el6 Ceph 10 M [jktcb2ndstg03p][DEBUG ] Installing for dependencies: [jktcb2ndstg03p][DEBUG ] ceph-common x86_64 0.80.3-0.el6 Ceph 6.1 M [jktcb2ndstg03p][DEBUG ] [jktcb2ndstg03p][DEBUG ] Transaction Summary [jktcb2ndstg03p][DEBUG ] ================================================================================ [jktcb2ndstg03p][DEBUG ] Install 2 Package(s) [jktcb2ndstg03p][DEBUG ] [jktcb2ndstg03p][DEBUG ] Total download size: 16 M [jktcb2ndstg03p][DEBUG ] Installed size: 65 M [jktcb2ndstg03p][DEBUG ] Downloading Packages: [jktcb2ndstg03p][DEBUG ] -------------------------------------------------------------------------------- [jktcb2ndstg03p][DEBUG ] Total 286 kB/s | 16 MB 00:58 [jktcb2ndstg03p][DEBUG ] Running rpm_check_debug [jktcb2ndstg03p][DEBUG ] Running Transaction Test [jktcb2ndstg03p][DEBUG ] Transaction Test Succeeded [jktcb2ndstg03p][DEBUG ] Running Transaction Installing : ceph-common-0.80.3-0.el6.x86_64 1/2 Installing : ceph-0.80.3-0.el6.x86_64 2/2 Verifying : ceph-common-0.80.3-0.el6.x86_64 1/2 Verifying : ceph-0.80.3-0.el6.x86_64 2/2 [jktcb2ndstg03p][DEBUG ] [jktcb2ndstg03p][DEBUG ] Installed: [jktcb2ndstg03p][DEBUG ] ceph.x86_64 0:0.80.3-0.el6 [jktcb2ndstg03p][DEBUG ] [jktcb2ndstg03p][DEBUG ] Dependency Installed: [jktcb2ndstg03p][DEBUG ] ceph-common.x86_64 0:0.80.3-0.el6 [jktcb2ndstg03p][DEBUG ] [jktcb2ndstg03p][DEBUG ] Complete! [jktcb2ndstg03p][WARNIN] Warning: RPMDB altered outside of yum. [jktcb2ndstg03p][INFO ] Running command: ceph --version [jktcb2ndstg03p][DEBUG ] ceph version 0.80.3 (a129e85cdc3446a427fffffe4c31617d49024946) [root@jktcb2cpstg01p ~]# ceph-deploy mon create-initial [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.mon][DEBUG ] detecting platform for host jktcb2ndstg01p ... [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.mon][INFO ] distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] determining if provided host has same hostname in remote [jktcb2ndstg01p][DEBUG ] get remote short hostname [jktcb2ndstg01p][DEBUG ] deploying mon to jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] get remote short hostname [jktcb2ndstg01p][DEBUG ] remote hostname: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [jktcb2ndstg01p][DEBUG ] create the mon path if it does not exist [jktcb2ndstg01p][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-jktcb2ndstg01p/done [jktcb2ndstg01p][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-jktcb2ndstg01p/done [jktcb2ndstg01p][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-jktcb2ndstg01p.mon.keyring [jktcb2ndstg01p][DEBUG ] create the monitor keyring file [jktcb2ndstg01p][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i jktcb2ndstg01p --keyring /var/lib/ceph/tmp/ceph-jktcb2ndstg01p.mon.keyring [jktcb2ndstg01p][DEBUG ] ceph-mon: renaming mon.noname-a 172.17.2.101:6789/0 to mon.jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] ceph-mon: set fsid to 0d522f68-be26-424b-bf6f-ab14dcd30618 [jktcb2ndstg01p][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-jktcb2ndstg01p for mon.jktcb2ndstg01p [jktcb2ndstg01p][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-jktcb2ndstg01p.mon.keyring [jktcb2ndstg01p][DEBUG ] create a done file to avoid re-doing the mon deployment [jktcb2ndstg01p][DEBUG ] create the init path if it does not exist [jktcb2ndstg01p][DEBUG ] locating the `service` executable... [jktcb2ndstg01p][INFO ] Running command: /sbin/service ceph -c /etc/ceph/ceph.conf start mon.jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] === mon.jktcb2ndstg01p === [jktcb2ndstg01p][DEBUG ] Starting Ceph mon.jktcb2ndstg01p on jktcb2ndstg01p... [jktcb2ndstg01p][DEBUG ] Starting ceph-create-keys on jktcb2ndstg01p... [jktcb2ndstg01p][WARNIN] No data was received after 7 seconds, disconnecting... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg01p.asok mon_status [jktcb2ndstg01p][DEBUG ] ******************************************************************************** [jktcb2ndstg01p][DEBUG ] status for monitor: mon.jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] { [jktcb2ndstg01p][DEBUG ] "election_epoch": 0, [jktcb2ndstg01p][DEBUG ] "extra_probe_peers": [ [jktcb2ndstg01p][DEBUG ] "172.17.2.102:6789/0", [jktcb2ndstg01p][DEBUG ] "172.17.2.103:6789/0" [jktcb2ndstg01p][DEBUG ] ], [jktcb2ndstg01p][DEBUG ] "monmap": { [jktcb2ndstg01p][DEBUG ] "created": "0.000000", [jktcb2ndstg01p][DEBUG ] "epoch": 0, [jktcb2ndstg01p][DEBUG ] "fsid": "0d522f68-be26-424b-bf6f-ab14dcd30618", [jktcb2ndstg01p][DEBUG ] "modified": "0.000000", [jktcb2ndstg01p][DEBUG ] "mons": [ [jktcb2ndstg01p][DEBUG ] { [jktcb2ndstg01p][DEBUG ] "addr": "172.17.2.101:6789/0", [jktcb2ndstg01p][DEBUG ] "name": "jktcb2ndstg01p", [jktcb2ndstg01p][DEBUG ] "rank": 0 [jktcb2ndstg01p][DEBUG ] }, [jktcb2ndstg01p][DEBUG ] { [jktcb2ndstg01p][DEBUG ] "addr": "0.0.0.0:0/1", [jktcb2ndstg01p][DEBUG ] "name": "jktcb2ndstg02p", [jktcb2ndstg01p][DEBUG ] "rank": 1 [jktcb2ndstg01p][DEBUG ] }, [jktcb2ndstg01p][DEBUG ] { [jktcb2ndstg01p][DEBUG ] "addr": "0.0.0.0:0/2", [jktcb2ndstg01p][DEBUG ] "name": "jktcb2ndstg03p", [jktcb2ndstg01p][DEBUG ] "rank": 2 [jktcb2ndstg01p][DEBUG ] } [jktcb2ndstg01p][DEBUG ] ] [jktcb2ndstg01p][DEBUG ] }, [jktcb2ndstg01p][DEBUG ] "name": "jktcb2ndstg01p", [jktcb2ndstg01p][DEBUG ] "outside_quorum": [ [jktcb2ndstg01p][DEBUG ] "jktcb2ndstg01p" [jktcb2ndstg01p][DEBUG ] ], [jktcb2ndstg01p][DEBUG ] "quorum": [], [jktcb2ndstg01p][DEBUG ] "rank": 0, [jktcb2ndstg01p][DEBUG ] "state": "probing", [jktcb2ndstg01p][DEBUG ] "sync_provider": [] [jktcb2ndstg01p][DEBUG ] } [jktcb2ndstg01p][DEBUG ] ******************************************************************************** [jktcb2ndstg01p][INFO ] monitor: mon.jktcb2ndstg01p is running [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg01p.asok mon_status [ceph_deploy.mon][DEBUG ] detecting platform for host jktcb2ndstg02p ... [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.mon][INFO ] distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] determining if provided host has same hostname in remote [jktcb2ndstg02p][DEBUG ] get remote short hostname [jktcb2ndstg02p][DEBUG ] deploying mon to jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] get remote short hostname [jktcb2ndstg02p][DEBUG ] remote hostname: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [jktcb2ndstg02p][DEBUG ] create the mon path if it does not exist [jktcb2ndstg02p][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-jktcb2ndstg02p/done [jktcb2ndstg02p][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-jktcb2ndstg02p/done [jktcb2ndstg02p][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-jktcb2ndstg02p.mon.keyring [jktcb2ndstg02p][DEBUG ] create the monitor keyring file [jktcb2ndstg02p][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i jktcb2ndstg02p --keyring /var/lib/ceph/tmp/ceph-jktcb2ndstg02p.mon.keyring [jktcb2ndstg02p][DEBUG ] ceph-mon: renaming mon.noname-b 172.17.2.102:6789/0 to mon.jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] ceph-mon: set fsid to 0d522f68-be26-424b-bf6f-ab14dcd30618 [jktcb2ndstg02p][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-jktcb2ndstg02p for mon.jktcb2ndstg02p [jktcb2ndstg02p][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-jktcb2ndstg02p.mon.keyring [jktcb2ndstg02p][DEBUG ] create a done file to avoid re-doing the mon deployment [jktcb2ndstg02p][DEBUG ] create the init path if it does not exist [jktcb2ndstg02p][DEBUG ] locating the `service` executable... [jktcb2ndstg02p][INFO ] Running command: /sbin/service ceph -c /etc/ceph/ceph.conf start mon.jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] === mon.jktcb2ndstg02p === [jktcb2ndstg02p][DEBUG ] Starting Ceph mon.jktcb2ndstg02p on jktcb2ndstg02p... [jktcb2ndstg02p][DEBUG ] Starting ceph-create-keys on jktcb2ndstg02p... [jktcb2ndstg02p][WARNIN] No data was received after 7 seconds, disconnecting... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg02p.asok mon_status [jktcb2ndstg02p][DEBUG ] ******************************************************************************** [jktcb2ndstg02p][DEBUG ] status for monitor: mon.jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] { [jktcb2ndstg02p][DEBUG ] "election_epoch": 1, [jktcb2ndstg02p][DEBUG ] "extra_probe_peers": [ [jktcb2ndstg02p][DEBUG ] "172.17.2.101:6789/0", [jktcb2ndstg02p][DEBUG ] "172.17.2.103:6789/0" [jktcb2ndstg02p][DEBUG ] ], [jktcb2ndstg02p][DEBUG ] "monmap": { [jktcb2ndstg02p][DEBUG ] "created": "0.000000", [jktcb2ndstg02p][DEBUG ] "epoch": 0, [jktcb2ndstg02p][DEBUG ] "fsid": "0d522f68-be26-424b-bf6f-ab14dcd30618", [jktcb2ndstg02p][DEBUG ] "modified": "0.000000", [jktcb2ndstg02p][DEBUG ] "mons": [ [jktcb2ndstg02p][DEBUG ] { [jktcb2ndstg02p][DEBUG ] "addr": "172.17.2.101:6789/0", [jktcb2ndstg02p][DEBUG ] "name": "jktcb2ndstg01p", [jktcb2ndstg02p][DEBUG ] "rank": 0 [jktcb2ndstg02p][DEBUG ] }, [jktcb2ndstg02p][DEBUG ] { [jktcb2ndstg02p][DEBUG ] "addr": "172.17.2.102:6789/0", [jktcb2ndstg02p][DEBUG ] "name": "jktcb2ndstg02p", [jktcb2ndstg02p][DEBUG ] "rank": 1 [jktcb2ndstg02p][DEBUG ] }, [jktcb2ndstg02p][DEBUG ] { [jktcb2ndstg02p][DEBUG ] "addr": "0.0.0.0:0/2", [jktcb2ndstg02p][DEBUG ] "name": "jktcb2ndstg03p", [jktcb2ndstg02p][DEBUG ] "rank": 2 [jktcb2ndstg02p][DEBUG ] } [jktcb2ndstg02p][DEBUG ] ] [jktcb2ndstg02p][DEBUG ] }, [jktcb2ndstg02p][DEBUG ] "name": "jktcb2ndstg02p", [jktcb2ndstg02p][DEBUG ] "outside_quorum": [], [jktcb2ndstg02p][DEBUG ] "quorum": [], [jktcb2ndstg02p][DEBUG ] "rank": 1, [jktcb2ndstg02p][DEBUG ] "state": "electing", [jktcb2ndstg02p][DEBUG ] "sync_provider": [] [jktcb2ndstg02p][DEBUG ] } [jktcb2ndstg02p][DEBUG ] ******************************************************************************** [jktcb2ndstg02p][INFO ] monitor: mon.jktcb2ndstg02p is running [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg02p.asok mon_status [ceph_deploy.mon][DEBUG ] detecting platform for host jktcb2ndstg03p ... [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.mon][INFO ] distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] determining if provided host has same hostname in remote [jktcb2ndstg03p][DEBUG ] get remote short hostname [jktcb2ndstg03p][DEBUG ] deploying mon to jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] get remote short hostname [jktcb2ndstg03p][DEBUG ] remote hostname: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [jktcb2ndstg03p][DEBUG ] create the mon path if it does not exist [jktcb2ndstg03p][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-jktcb2ndstg03p/done [jktcb2ndstg03p][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-jktcb2ndstg03p/done [jktcb2ndstg03p][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-jktcb2ndstg03p.mon.keyring [jktcb2ndstg03p][DEBUG ] create the monitor keyring file [jktcb2ndstg03p][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i jktcb2ndstg03p --keyring /var/lib/ceph/tmp/ceph-jktcb2ndstg03p.mon.keyring [jktcb2ndstg03p][DEBUG ] ceph-mon: renaming mon.noname-c 172.17.2.103:6789/0 to mon.jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] ceph-mon: set fsid to 0d522f68-be26-424b-bf6f-ab14dcd30618 [jktcb2ndstg03p][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-jktcb2ndstg03p for mon.jktcb2ndstg03p [jktcb2ndstg03p][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-jktcb2ndstg03p.mon.keyring [jktcb2ndstg03p][DEBUG ] create a done file to avoid re-doing the mon deployment [jktcb2ndstg03p][DEBUG ] create the init path if it does not exist [jktcb2ndstg03p][DEBUG ] locating the `service` executable... [jktcb2ndstg03p][INFO ] Running command: /sbin/service ceph -c /etc/ceph/ceph.conf start mon.jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] === mon.jktcb2ndstg03p === [jktcb2ndstg03p][DEBUG ] Starting Ceph mon.jktcb2ndstg03p on jktcb2ndstg03p... [jktcb2ndstg03p][DEBUG ] Starting ceph-create-keys on jktcb2ndstg03p... [jktcb2ndstg03p][WARNIN] No data was received after 7 seconds, disconnecting... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg03p.asok mon_status [jktcb2ndstg03p][DEBUG ] ******************************************************************************** [jktcb2ndstg03p][DEBUG ] status for monitor: mon.jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] { [jktcb2ndstg03p][DEBUG ] "election_epoch": 1, [jktcb2ndstg03p][DEBUG ] "extra_probe_peers": [ [jktcb2ndstg03p][DEBUG ] "172.17.2.101:6789/0", [jktcb2ndstg03p][DEBUG ] "172.17.2.102:6789/0" [jktcb2ndstg03p][DEBUG ] ], [jktcb2ndstg03p][DEBUG ] "monmap": { [jktcb2ndstg03p][DEBUG ] "created": "0.000000", [jktcb2ndstg03p][DEBUG ] "epoch": 0, [jktcb2ndstg03p][DEBUG ] "fsid": "0d522f68-be26-424b-bf6f-ab14dcd30618", [jktcb2ndstg03p][DEBUG ] "modified": "0.000000", [jktcb2ndstg03p][DEBUG ] "mons": [ [jktcb2ndstg03p][DEBUG ] { [jktcb2ndstg03p][DEBUG ] "addr": "172.17.2.101:6789/0", [jktcb2ndstg03p][DEBUG ] "name": "jktcb2ndstg01p", [jktcb2ndstg03p][DEBUG ] "rank": 0 [jktcb2ndstg03p][DEBUG ] }, [jktcb2ndstg03p][DEBUG ] { [jktcb2ndstg03p][DEBUG ] "addr": "172.17.2.102:6789/0", [jktcb2ndstg03p][DEBUG ] "name": "jktcb2ndstg02p", [jktcb2ndstg03p][DEBUG ] "rank": 1 [jktcb2ndstg03p][DEBUG ] }, [jktcb2ndstg03p][DEBUG ] { [jktcb2ndstg03p][DEBUG ] "addr": "172.17.2.103:6789/0", [jktcb2ndstg03p][DEBUG ] "name": "jktcb2ndstg03p", [jktcb2ndstg03p][DEBUG ] "rank": 2 [jktcb2ndstg03p][DEBUG ] } [jktcb2ndstg03p][DEBUG ] ] [jktcb2ndstg03p][DEBUG ] }, [jktcb2ndstg03p][DEBUG ] "name": "jktcb2ndstg03p", [jktcb2ndstg03p][DEBUG ] "outside_quorum": [], [jktcb2ndstg03p][DEBUG ] "quorum": [], [jktcb2ndstg03p][DEBUG ] "rank": 2, [jktcb2ndstg03p][DEBUG ] "state": "electing", [jktcb2ndstg03p][DEBUG ] "sync_provider": [] [jktcb2ndstg03p][DEBUG ] } [jktcb2ndstg03p][DEBUG ] ******************************************************************************** [jktcb2ndstg03p][INFO ] monitor: mon.jktcb2ndstg03p is running [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg03p.asok mon_status [ceph_deploy.mon][INFO ] processing monitor mon.jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg01p.asok mon_status [ceph_deploy.mon][WARNIN] mon.jktcb2ndstg01p monitor is not yet in quorum, tries left: 5 [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg01p.asok mon_status [ceph_deploy.mon][INFO ] mon.jktcb2ndstg01p monitor has reached quorum! [ceph_deploy.mon][INFO ] processing monitor mon.jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg02p.asok mon_status [ceph_deploy.mon][INFO ] mon.jktcb2ndstg02p monitor has reached quorum! [ceph_deploy.mon][INFO ] processing monitor mon.jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg03p.asok mon_status [ceph_deploy.mon][WARNIN] mon.jktcb2ndstg03p monitor is not yet in quorum, tries left: 5 [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.jktcb2ndstg03p.asok mon_status [ceph_deploy.mon][INFO ] mon.jktcb2ndstg03p monitor has reached quorum! [ceph_deploy.mon][INFO ] all initial monitors are running and have formed quorum [ceph_deploy.mon][INFO ] Running gatherkeys... [ceph_deploy.gatherkeys][DEBUG ] Checking jktcb2ndstg01p for /etc/ceph/ceph.client.admin.keyring [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [jktcb2ndstg01p][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Got ceph.client.admin.keyring key from jktcb2ndstg01p. [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring [ceph_deploy.gatherkeys][DEBUG ] Checking jktcb2ndstg01p for /var/lib/ceph/bootstrap-osd/ceph.keyring [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [jktcb2ndstg01p][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Checking jktcb2ndstg02p for /var/lib/ceph/bootstrap-osd/ceph.keyring [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [jktcb2ndstg02p][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Got ceph.bootstrap-osd.keyring key from jktcb2ndstg02p. [ceph_deploy.gatherkeys][DEBUG ] Checking jktcb2ndstg01p for /var/lib/ceph/bootstrap-mds/ceph.keyring [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [jktcb2ndstg01p][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Checking jktcb2ndstg02p for /var/lib/ceph/bootstrap-mds/ceph.keyring [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [jktcb2ndstg02p][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][DEBUG ] Got ceph.bootstrap-mds.keyring key from jktcb2ndstg02p. [root@jktcb2cpstg01p ~]# ceph-deploy disk zap jktcb2ndstg{01,02,03}p:sd{a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t,u,v,w,x,y,z,aa,ab,ac,ad,ae,af,ag,ah,ai,aj,ak,al,am,an,ao,ap,aq,ar,as,at,au,av,aw,ax,ay,az,ba,bb,bc,bd} [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy disk zap jktcb2ndstg01p:sda jktcb2ndstg01p:sdb jktcb2ndstg01p:sdc jktcb2ndstg01p:sdd jktcb2ndstg01p:sde jktcb2ndstg01p:sdf jktcb2ndstg01p:sdg jktcb2ndstg01p:sdh jktcb2ndstg01p:sdi jktcb2ndstg01p:sdj jktcb2ndstg01p:sdk jktcb2ndstg01p:sdl jktcb2ndstg01p:sdm jktcb2ndstg01p:sdn jktcb2ndstg01p:sdo jktcb2ndstg01p:sdp jktcb2ndstg01p:sdq jktcb2ndstg01p:sdr jktcb2ndstg01p:sds jktcb2ndstg01p:sdt jktcb2ndstg01p:sdu jktcb2ndstg01p:sdv jktcb2ndstg01p:sdw jktcb2ndstg01p:sdx jktcb2ndstg01p:sdy jktcb2ndstg01p:sdz jktcb2ndstg01p:sdaa jktcb2ndstg01p:sdab jktcb2ndstg01p:sdac jktcb2ndstg01p:sdad jktcb2ndstg01p:sdae jktcb2ndstg01p:sdaf jktcb2ndstg01p:sdag jktcb2ndstg01p:sdah jktcb2ndstg01p:sdai jktcb2ndstg01p:sdaj jktcb2ndstg01p:sdak jktcb2ndstg01p:sdal jktcb2ndstg01p:sdam jktcb2ndstg01p:sdan jktcb2ndstg01p:sdao jktcb2ndstg01p:sdap jktcb2ndstg01p:sdaq jktcb2ndstg01p:sdar jktcb2ndstg01p:sdas jktcb2ndstg01p:sdat jktcb2ndstg01p:sdau jktcb2ndstg01p:sdav jktcb2ndstg01p:sdaw jktcb2ndstg01p:sdax jktcb2ndstg01p:sday jktcb2ndstg01p:sdaz jktcb2ndstg01p:sdba jktcb2ndstg01p:sdbb jktcb2ndstg01p:sdbc jktcb2ndstg01p:sdbd jktcb2ndstg02p:sda jktcb2ndstg02p:sdb jktcb2ndstg02p:sdc jktcb2ndstg02p:sdd jktcb2ndstg02p:sde jktcb2ndstg02p:sdf jktcb2ndstg02p:sdg jktcb2ndstg02p:sdh jktcb2ndstg02p:sdi jktcb2ndstg02p:sdj jktcb2ndstg02p:sdk jktcb2ndstg02p:sdl jktcb2ndstg02p:sdm jktcb2ndstg02p:sdn jktcb2ndstg02p:sdo jktcb2ndstg02p:sdp jktcb2ndstg02p:sdq jktcb2ndstg02p:sdr jktcb2ndstg02p:sds jktcb2ndstg02p:sdt jktcb2ndstg02p:sdu jktcb2ndstg02p:sdv jktcb2ndstg02p:sdw jktcb2ndstg02p:sdx jktcb2ndstg02p:sdy jktcb2ndstg02p:sdz jktcb2ndstg02p:sdaa jktcb2ndstg02p:sdab jktcb2ndstg02p:sdac jktcb2ndstg02p:sdad jktcb2ndstg02p:sdae jktcb2ndstg02p:sdaf jktcb2ndstg02p:sdag jktcb2ndstg02p:sdah jktcb2ndstg02p:sdai jktcb2ndstg02p:sdaj jktcb2ndstg02p:sdak jktcb2ndstg02p:sdal jktcb2ndstg02p:sdam jktcb2ndstg02p:sdan jktcb2ndstg02p:sdao jktcb2ndstg02p:sdap jktcb2ndstg02p:sdaq jktcb2ndstg02p:sdar jktcb2ndstg02p:sdas jktcb2ndstg02p:sdat jktcb2ndstg02p:sdau jktcb2ndstg02p:sdav jktcb2ndstg02p:sdaw jktcb2ndstg02p:sdax jktcb2ndstg02p:sday jktcb2ndstg02p:sdaz jktcb2ndstg02p:sdba jktcb2ndstg02p:sdbb jktcb2ndstg02p:sdbc jktcb2ndstg02p:sdbd jktcb2ndstg03p:sda jktcb2ndstg03p:sdb jktcb2ndstg03p:sdc jktcb2ndstg03p:sdd jktcb2ndstg03p:sde jktcb2ndstg03p:sdf jktcb2ndstg03p:sdg jktcb2ndstg03p:sdh jktcb2ndstg03p:sdi jktcb2ndstg03p:sdj jktcb2ndstg03p:sdk jktcb2ndstg03p:sdl jktcb2ndstg03p:sdm jktcb2ndstg03p:sdn jktcb2ndstg03p:sdo jktcb2ndstg03p:sdp jktcb2ndstg03p:sdq jktcb2ndstg03p:sdr jktcb2ndstg03p:sds jktcb2ndstg03p:sdt jktcb2ndstg03p:sdu jktcb2ndstg03p:sdv jktcb2ndstg03p:sdw jktcb2ndstg03p:sdx jktcb2ndstg03p:sdy jktcb2ndstg03p:sdz jktcb2ndstg03p:sdaa jktcb2ndstg03p:sdab jktcb2ndstg03p:sdac jktcb2ndstg03p:sdad jktcb2ndstg03p:sdae jktcb2ndstg03p:sdaf jktcb2ndstg03p:sdag jktcb2ndstg03p:sdah jktcb2ndstg03p:sdai jktcb2ndstg03p:sdaj jktcb2ndstg03p:sdak jktcb2ndstg03p:sdal jktcb2ndstg03p:sdam jktcb2ndstg03p:sdan jktcb2ndstg03p:sdao jktcb2ndstg03p:sdap jktcb2ndstg03p:sdaq jktcb2ndstg03p:sdar jktcb2ndstg03p:sdas jktcb2ndstg03p:sdat jktcb2ndstg03p:sdau jktcb2ndstg03p:sdav jktcb2ndstg03p:sdaw jktcb2ndstg03p:sdax jktcb2ndstg03p:sday jktcb2ndstg03p:sdaz jktcb2ndstg03p:sdba jktcb2ndstg03p:sdbb jktcb2ndstg03p:sdbc jktcb2ndstg03p:sdbd [ceph_deploy.osd][DEBUG ] zapping /dev/sda on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sda [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sda [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdb [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdc on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdc [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdd on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdd [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdd [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sde on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sde [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sde [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdf on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdf [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdf [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdg on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdg [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdg [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdh on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdh [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdh [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdi on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdi [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdi [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdj on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdj [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdj [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdk on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdk [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdk [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdl on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdl [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdl [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdm on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdm [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdm [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdn on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdn [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdn [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdo on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdo [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdo [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdp on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdp [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdp [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdq on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdq [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdq [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdr on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdr [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdr [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sds on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sds [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sds [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdt on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdt [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdt [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdu on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdu [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdu [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdv on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdv [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdv [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdw on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdw [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdw [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdx on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdx [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdx [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdy on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdy [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdy [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdz on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdz [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdz [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaa on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaa [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaa [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdab on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdab [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdab [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdac on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdac [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdad on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdad [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdae on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdae [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaf on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaf [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaf [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdag on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdag [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdag [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdah on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdah [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdah [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdai on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdai [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdai [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaj on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaj [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaj [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdak on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdak [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdak [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdal on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdal [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdal [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdam on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdam [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdam [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdan on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdan [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdan [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdao on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdao [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdao [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdap on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdap [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdap [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaq on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaq [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaq [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdar on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdar [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdar [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdas on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdas [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdas [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdat on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdat [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdat [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdau on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdau [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdau [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdav on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdav [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdav [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaw on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaw [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaw [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdax on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdax [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdax [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sday on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sday [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sday [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaz on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaz [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaz [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdba on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdba [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdba [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbb on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbb [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbb [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbc on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbc [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbc [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbd on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbd [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbd [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sda on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sda [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sda [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdb [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdc on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdc [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdd on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdd [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdd [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sde on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sde [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sde [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdf on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdf [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdf [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdg on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdg [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdg [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdh on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdh [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdh [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdi on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdi [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdi [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdj on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdj [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdj [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdk on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdk [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdk [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdl on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdl [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdl [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdm on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdm [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdm [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdn on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdn [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdn [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdo on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdo [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdo [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdp on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdp [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdp [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdq on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdq [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdq [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdr on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdr [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdr [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sds on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sds [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sds [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdt on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdt [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdt [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdu on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdu [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdu [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdv on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdv [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdv [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdw on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdw [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdw [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdx on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdx [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdx [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdy on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdy [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdy [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdz on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdz [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdz [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaa on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaa [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaa [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdab on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdab [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdab [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdac on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdac [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdad on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdad [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdae on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdae [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaf on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaf [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaf [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdag on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdag [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdag [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdah on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdah [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdah [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdai on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdai [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdai [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaj on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaj [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaj [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdak on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdak [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdak [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdal on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdal [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdal [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdam on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdam [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdam [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdan on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdan [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdan [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdao on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdao [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdao [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdap on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdap [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdap [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaq on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaq [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaq [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdar on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdar [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdar [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdas on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdas [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdas [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdat on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdat [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdat [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdau on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdau [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdau [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdav on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdav [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdav [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaw on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaw [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaw [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdax on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdax [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdax [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sday on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sday [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sday [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaz on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaz [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaz [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdba on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdba [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdba [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbb on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbb [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbb [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbc on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbc [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbc [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbd on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbd [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbd [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sda on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sda [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sda [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdb [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdc on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdc [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdd on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdd [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdd [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sde on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sde [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sde [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdf on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdf [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdf [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdg on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdg [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdg [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdh on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdh [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdh [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdi on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdi [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdi [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdj on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdj [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdj [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdk on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdk [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdk [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdl on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdl [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdl [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdm on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdm [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdm [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdn on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdn [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdn [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdo on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdo [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdo [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdp on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdp [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdp [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdq on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdq [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdq [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdr on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdr [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdr [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sds on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sds [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sds [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdt on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdt [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdt [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdu on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdu [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdu [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdv on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdv [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdv [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdw on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdw [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdw [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdx on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdx [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdx [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdy on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdy [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdy [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdz on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdz [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdz [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaa on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaa [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaa [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdab on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdab [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdab [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdac on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdac [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdad on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdad [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdae on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdae [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaf on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaf [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaf [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdag on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdag [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdag [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdah on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdah [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdah [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdai on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdai [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdai [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaj on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaj [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaj [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdak on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdak [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdak [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdal on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdal [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdal [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdam on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdam [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdam [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdan on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdan [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdan [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdao on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdao [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdao [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdap on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdap [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdap [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaq on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaq [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaq [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdar on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdar [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdar [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdas on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdas [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdas [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdat on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdat [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdat [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdau on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdau [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdau [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdav on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdav [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdav [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaw on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaw [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaw [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdax on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdax [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdax [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sday on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sday [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sday [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaz on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaz [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaz [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdba on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdba [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdba [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbb on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbb [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbb [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbc on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbc [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbc [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbd on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbd [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbd [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [root@jktcb2cpstg01p ~]# ceph-deploy osd activate jktcb2ndstg{01,02,03}p:sd{d,e,f,g,h,i,j,k,l}:/dev/sda jktcb2ndstg{01,02,03}p:sd{m,n,o,p,q,r,s,t}:/dev/sdb jktcb2ndstg{01,02,03}p:sd{u,v,w,x,y,z,aa,ab}:/dev/sdc jktcb2ndstg{01,02,03}p:sd{af,ag,ah,ai,aj,ak,al,am,an}:/dev/sdac jktcb2ndstg{01,02,03}p:sd{ao,ap,aq,ar,as,at,au,av}:/dev/sdad jktcb2ndstg{01,02,03}p:sd{aw,ax,ay,az,ba,bb,bc,bd}:/dev/sdae [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy osd activate jktcb2ndstg01p:sdd:/dev/sda jktcb2ndstg01p:sde:/dev/sda jktcb2ndstg01p:sdf:/dev/sda jktcb2ndstg01p:sdg:/dev/sda jktcb2ndstg01p:sdh:/dev/sda jktcb2ndstg01p:sdi:/dev/sda jktcb2ndstg01p:sdj:/dev/sda jktcb2ndstg01p:sdk:/dev/sda jktcb2ndstg01p:sdl:/dev/sda jktcb2ndstg02p:sdd:/dev/sda jktcb2ndstg02p:sde:/dev/sda jktcb2ndstg02p:sdf:/dev/sda jktcb2ndstg02p:sdg:/dev/sda jktcb2ndstg02p:sdh:/dev/sda jktcb2ndstg02p:sdi:/dev/sda jktcb2ndstg02p:sdj:/dev/sda jktcb2ndstg02p:sdk:/dev/sda jktcb2ndstg02p:sdl:/dev/sda jktcb2ndstg03p:sdd:/dev/sda jktcb2ndstg03p:sde:/dev/sda jktcb2ndstg03p:sdf:/dev/sda jktcb2ndstg03p:sdg:/dev/sda jktcb2ndstg03p:sdh:/dev/sda jktcb2ndstg03p:sdi:/dev/sda jktcb2ndstg03p:sdj:/dev/sda jktcb2ndstg03p:sdk:/dev/sda jktcb2ndstg03p:sdl:/dev/sda jktcb2ndstg01p:sdm:/dev/sdb jktcb2ndstg01p:sdn:/dev/sdb jktcb2ndstg01p:sdo:/dev/sdb jktcb2ndstg01p:sdp:/dev/sdb jktcb2ndstg01p:sdq:/dev/sdb jktcb2ndstg01p:sdr:/dev/sdb jktcb2ndstg01p:sds:/dev/sdb jktcb2ndstg01p:sdt:/dev/sdb jktcb2ndstg02p:sdm:/dev/sdb jktcb2ndstg02p:sdn:/dev/sdb jktcb2ndstg02p:sdo:/dev/sdb jktcb2ndstg02p:sdp:/dev/sdb jktcb2ndstg02p:sdq:/dev/sdb jktcb2ndstg02p:sdr:/dev/sdb jktcb2ndstg02p:sds:/dev/sdb jktcb2ndstg02p:sdt:/dev/sdb jktcb2ndstg03p:sdm:/dev/sdb jktcb2ndstg03p:sdn:/dev/sdb jktcb2ndstg03p:sdo:/dev/sdb jktcb2ndstg03p:sdp:/dev/sdb jktcb2ndstg03p:sdq:/dev/sdb jktcb2ndstg03p:sdr:/dev/sdb jktcb2ndstg03p:sds:/dev/sdb jktcb2ndstg03p:sdt:/dev/sdb jktcb2ndstg01p:sdu:/dev/sdc jktcb2ndstg01p:sdv:/dev/sdc jktcb2ndstg01p:sdw:/dev/sdc jktcb2ndstg01p:sdx:/dev/sdc jktcb2ndstg01p:sdy:/dev/sdc jktcb2ndstg01p:sdz:/dev/sdc jktcb2ndstg01p:sdaa:/dev/sdc jktcb2ndstg01p:sdab:/dev/sdc jktcb2ndstg02p:sdu:/dev/sdc jktcb2ndstg02p:sdv:/dev/sdc jktcb2ndstg02p:sdw:/dev/sdc jktcb2ndstg02p:sdx:/dev/sdc jktcb2ndstg02p:sdy:/dev/sdc jktcb2ndstg02p:sdz:/dev/sdc jktcb2ndstg02p:sdaa:/dev/sdc jktcb2ndstg02p:sdab:/dev/sdc jktcb2ndstg03p:sdu:/dev/sdc jktcb2ndstg03p:sdv:/dev/sdc jktcb2ndstg03p:sdw:/dev/sdc jktcb2ndstg03p:sdx:/dev/sdc jktcb2ndstg03p:sdy:/dev/sdc jktcb2ndstg03p:sdz:/dev/sdc jktcb2ndstg03p:sdaa:/dev/sdc jktcb2ndstg03p:sdab:/dev/sdc jktcb2ndstg01p:sdaf:/dev/sdac jktcb2ndstg01p:sdag:/dev/sdac jktcb2ndstg01p:sdah:/dev/sdac jktcb2ndstg01p:sdai:/dev/sdac jktcb2ndstg01p:sdaj:/dev/sdac jktcb2ndstg01p:sdak:/dev/sdac jktcb2ndstg01p:sdal:/dev/sdac jktcb2ndstg01p:sdam:/dev/sdac jktcb2ndstg01p:sdan:/dev/sdac jktcb2ndstg02p:sdaf:/dev/sdac jktcb2ndstg02p:sdag:/dev/sdac jktcb2ndstg02p:sdah:/dev/sdac jktcb2ndstg02p:sdai:/dev/sdac jktcb2ndstg02p:sdaj:/dev/sdac jktcb2ndstg02p:sdak:/dev/sdac jktcb2ndstg02p:sdal:/dev/sdac jktcb2ndstg02p:sdam:/dev/sdac jktcb2ndstg02p:sdan:/dev/sdac jktcb2ndstg03p:sdaf:/dev/sdac jktcb2ndstg03p:sdag:/dev/sdac jktcb2ndstg03p:sdah:/dev/sdac jktcb2ndstg03p:sdai:/dev/sdac jktcb2ndstg03p:sdaj:/dev/sdac jktcb2ndstg03p:sdak:/dev/sdac jktcb2ndstg03p:sdal:/dev/sdac jktcb2ndstg03p:sdam:/dev/sdac jktcb2ndstg03p:sdan:/dev/sdac jktcb2ndstg01p:sdao:/dev/sdad jktcb2ndstg01p:sdap:/dev/sdad jktcb2ndstg01p:sdaq:/dev/sdad jktcb2ndstg01p:sdar:/dev/sdad jktcb2ndstg01p:sdas:/dev/sdad jktcb2ndstg01p:sdat:/dev/sdad jktcb2ndstg01p:sdau:/dev/sdad jktcb2ndstg01p:sdav:/dev/sdad jktcb2ndstg02p:sdao:/dev/sdad jktcb2ndstg02p:sdap:/dev/sdad jktcb2ndstg02p:sdaq:/dev/sdad jktcb2ndstg02p:sdar:/dev/sdad jktcb2ndstg02p:sdas:/dev/sdad jktcb2ndstg02p:sdat:/dev/sdad jktcb2ndstg02p:sdau:/dev/sdad jktcb2ndstg02p:sdav:/dev/sdad jktcb2ndstg03p:sdao:/dev/sdad jktcb2ndstg03p:sdap:/dev/sdad jktcb2ndstg03p:sdaq:/dev/sdad jktcb2ndstg03p:sdar:/dev/sdad jktcb2ndstg03p:sdas:/dev/sdad jktcb2ndstg03p:sdat:/dev/sdad jktcb2ndstg03p:sdau:/dev/sdad jktcb2ndstg03p:sdav:/dev/sdad jktcb2ndstg01p:sdaw:/dev/sdae jktcb2ndstg01p:sdax:/dev/sdae jktcb2ndstg01p:sday:/dev/sdae jktcb2ndstg01p:sdaz:/dev/sdae jktcb2ndstg01p:sdba:/dev/sdae jktcb2ndstg01p:sdbb:/dev/sdae jktcb2ndstg01p:sdbc:/dev/sdae jktcb2ndstg01p:sdbd:/dev/sdae jktcb2ndstg02p:sdaw:/dev/sdae jktcb2ndstg02p:sdax:/dev/sdae jktcb2ndstg02p:sday:/dev/sdae jktcb2ndstg02p:sdaz:/dev/sdae jktcb2ndstg02p:sdba:/dev/sdae jktcb2ndstg02p:sdbb:/dev/sdae jktcb2ndstg02p:sdbc:/dev/sdae jktcb2ndstg02p:sdbd:/dev/sdae jktcb2ndstg03p:sdaw:/dev/sdae jktcb2ndstg03p:sdax:/dev/sdae jktcb2ndstg03p:sday:/dev/sdae jktcb2ndstg03p:sdaz:/dev/sdae jktcb2ndstg03p:sdba:/dev/sdae jktcb2ndstg03p:sdbb:/dev/sdae jktcb2ndstg03p:sdbc:/dev/sdae jktcb2ndstg03p:sdbd:/dev/sdae [ceph_deploy.osd][DEBUG ] Activating cluster ceph disks jktcb2ndstg01p:/dev/sdd:/dev/sda jktcb2ndstg01p:/dev/sde:/dev/sda jktcb2ndstg01p:/dev/sdf:/dev/sda jktcb2ndstg01p:/dev/sdg:/dev/sda jktcb2ndstg01p:/dev/sdh:/dev/sda jktcb2ndstg01p:/dev/sdi:/dev/sda jktcb2ndstg01p:/dev/sdj:/dev/sda jktcb2ndstg01p:/dev/sdk:/dev/sda jktcb2ndstg01p:/dev/sdl:/dev/sda jktcb2ndstg02p:/dev/sdd:/dev/sda jktcb2ndstg02p:/dev/sde:/dev/sda jktcb2ndstg02p:/dev/sdf:/dev/sda jktcb2ndstg02p:/dev/sdg:/dev/sda jktcb2ndstg02p:/dev/sdh:/dev/sda jktcb2ndstg02p:/dev/sdi:/dev/sda jktcb2ndstg02p:/dev/sdj:/dev/sda jktcb2ndstg02p:/dev/sdk:/dev/sda jktcb2ndstg02p:/dev/sdl:/dev/sda jktcb2ndstg03p:/dev/sdd:/dev/sda jktcb2ndstg03p:/dev/sde:/dev/sda jktcb2ndstg03p:/dev/sdf:/dev/sda jktcb2ndstg03p:/dev/sdg:/dev/sda jktcb2ndstg03p:/dev/sdh:/dev/sda jktcb2ndstg03p:/dev/sdi:/dev/sda jktcb2ndstg03p:/dev/sdj:/dev/sda jktcb2ndstg03p:/dev/sdk:/dev/sda jktcb2ndstg03p:/dev/sdl:/dev/sda jktcb2ndstg01p:/dev/sdm:/dev/sdb jktcb2ndstg01p:/dev/sdn:/dev/sdb jktcb2ndstg01p:/dev/sdo:/dev/sdb jktcb2ndstg01p:/dev/sdp:/dev/sdb jktcb2ndstg01p:/dev/sdq:/dev/sdb jktcb2ndstg01p:/dev/sdr:/dev/sdb jktcb2ndstg01p:/dev/sds:/dev/sdb jktcb2ndstg01p:/dev/sdt:/dev/sdb jktcb2ndstg02p:/dev/sdm:/dev/sdb jktcb2ndstg02p:/dev/sdn:/dev/sdb jktcb2ndstg02p:/dev/sdo:/dev/sdb jktcb2ndstg02p:/dev/sdp:/dev/sdb jktcb2ndstg02p:/dev/sdq:/dev/sdb jktcb2ndstg02p:/dev/sdr:/dev/sdb jktcb2ndstg02p:/dev/sds:/dev/sdb jktcb2ndstg02p:/dev/sdt:/dev/sdb jktcb2ndstg03p:/dev/sdm:/dev/sdb jktcb2ndstg03p:/dev/sdn:/dev/sdb jktcb2ndstg03p:/dev/sdo:/dev/sdb jktcb2ndstg03p:/dev/sdp:/dev/sdb jktcb2ndstg03p:/dev/sdq:/dev/sdb jktcb2ndstg03p:/dev/sdr:/dev/sdb jktcb2ndstg03p:/dev/sds:/dev/sdb jktcb2ndstg03p:/dev/sdt:/dev/sdb jktcb2ndstg01p:/dev/sdu:/dev/sdc jktcb2ndstg01p:/dev/sdv:/dev/sdc jktcb2ndstg01p:/dev/sdw:/dev/sdc jktcb2ndstg01p:/dev/sdx:/dev/sdc jktcb2ndstg01p:/dev/sdy:/dev/sdc jktcb2ndstg01p:/dev/sdz:/dev/sdc jktcb2ndstg01p:/dev/sdaa:/dev/sdc jktcb2ndstg01p:/dev/sdab:/dev/sdc jktcb2ndstg02p:/dev/sdu:/dev/sdc jktcb2ndstg02p:/dev/sdv:/dev/sdc jktcb2ndstg02p:/dev/sdw:/dev/sdc jktcb2ndstg02p:/dev/sdx:/dev/sdc jktcb2ndstg02p:/dev/sdy:/dev/sdc jktcb2ndstg02p:/dev/sdz:/dev/sdc jktcb2ndstg02p:/dev/sdaa:/dev/sdc jktcb2ndstg02p:/dev/sdab:/dev/sdc jktcb2ndstg03p:/dev/sdu:/dev/sdc jktcb2ndstg03p:/dev/sdv:/dev/sdc jktcb2ndstg03p:/dev/sdw:/dev/sdc jktcb2ndstg03p:/dev/sdx:/dev/sdc jktcb2ndstg03p:/dev/sdy:/dev/sdc jktcb2ndstg03p:/dev/sdz:/dev/sdc jktcb2ndstg03p:/dev/sdaa:/dev/sdc jktcb2ndstg03p:/dev/sdab:/dev/sdc jktcb2ndstg01p:/dev/sdaf:/dev/sdac jktcb2ndstg01p:/dev/sdag:/dev/sdac jktcb2ndstg01p:/dev/sdah:/dev/sdac jktcb2ndstg01p:/dev/sdai:/dev/sdac jktcb2ndstg01p:/dev/sdaj:/dev/sdac jktcb2ndstg01p:/dev/sdak:/dev/sdac jktcb2ndstg01p:/dev/sdal:/dev/sdac jktcb2ndstg01p:/dev/sdam:/dev/sdac jktcb2ndstg01p:/dev/sdan:/dev/sdac jktcb2ndstg02p:/dev/sdaf:/dev/sdac jktcb2ndstg02p:/dev/sdag:/dev/sdac jktcb2ndstg02p:/dev/sdah:/dev/sdac jktcb2ndstg02p:/dev/sdai:/dev/sdac jktcb2ndstg02p:/dev/sdaj:/dev/sdac jktcb2ndstg02p:/dev/sdak:/dev/sdac jktcb2ndstg02p:/dev/sdal:/dev/sdac jktcb2ndstg02p:/dev/sdam:/dev/sdac jktcb2ndstg02p:/dev/sdan:/dev/sdac jktcb2ndstg03p:/dev/sdaf:/dev/sdac jktcb2ndstg03p:/dev/sdag:/dev/sdac jktcb2ndstg03p:/dev/sdah:/dev/sdac jktcb2ndstg03p:/dev/sdai:/dev/sdac jktcb2ndstg03p:/dev/sdaj:/dev/sdac jktcb2ndstg03p:/dev/sdak:/dev/sdac jktcb2ndstg03p:/dev/sdal:/dev/sdac jktcb2ndstg03p:/dev/sdam:/dev/sdac jktcb2ndstg03p:/dev/sdan:/dev/sdac jktcb2ndstg01p:/dev/sdao:/dev/sdad jktcb2ndstg01p:/dev/sdap:/dev/sdad jktcb2ndstg01p:/dev/sdaq:/dev/sdad jktcb2ndstg01p:/dev/sdar:/dev/sdad jktcb2ndstg01p:/dev/sdas:/dev/sdad jktcb2ndstg01p:/dev/sdat:/dev/sdad jktcb2ndstg01p:/dev/sdau:/dev/sdad jktcb2ndstg01p:/dev/sdav:/dev/sdad jktcb2ndstg02p:/dev/sdao:/dev/sdad jktcb2ndstg02p:/dev/sdap:/dev/sdad jktcb2ndstg02p:/dev/sdaq:/dev/sdad jktcb2ndstg02p:/dev/sdar:/dev/sdad jktcb2ndstg02p:/dev/sdas:/dev/sdad jktcb2ndstg02p:/dev/sdat:/dev/sdad jktcb2ndstg02p:/dev/sdau:/dev/sdad jktcb2ndstg02p:/dev/sdav:/dev/sdad jktcb2ndstg03p:/dev/sdao:/dev/sdad jktcb2ndstg03p:/dev/sdap:/dev/sdad jktcb2ndstg03p:/dev/sdaq:/dev/sdad jktcb2ndstg03p:/dev/sdar:/dev/sdad jktcb2ndstg03p:/dev/sdas:/dev/sdad jktcb2ndstg03p:/dev/sdat:/dev/sdad jktcb2ndstg03p:/dev/sdau:/dev/sdad jktcb2ndstg03p:/dev/sdav:/dev/sdad jktcb2ndstg01p:/dev/sdaw:/dev/sdae jktcb2ndstg01p:/dev/sdax:/dev/sdae jktcb2ndstg01p:/dev/sday:/dev/sdae jktcb2ndstg01p:/dev/sdaz:/dev/sdae jktcb2ndstg01p:/dev/sdba:/dev/sdae jktcb2ndstg01p:/dev/sdbb:/dev/sdae jktcb2ndstg01p:/dev/sdbc:/dev/sdae jktcb2ndstg01p:/dev/sdbd:/dev/sdae jktcb2ndstg02p:/dev/sdaw:/dev/sdae jktcb2ndstg02p:/dev/sdax:/dev/sdae jktcb2ndstg02p:/dev/sday:/dev/sdae jktcb2ndstg02p:/dev/sdaz:/dev/sdae jktcb2ndstg02p:/dev/sdba:/dev/sdae jktcb2ndstg02p:/dev/sdbb:/dev/sdae jktcb2ndstg02p:/dev/sdbc:/dev/sdae jktcb2ndstg02p:/dev/sdbd:/dev/sdae jktcb2ndstg03p:/dev/sdaw:/dev/sdae jktcb2ndstg03p:/dev/sdax:/dev/sdae jktcb2ndstg03p:/dev/sday:/dev/sdae jktcb2ndstg03p:/dev/sdaz:/dev/sdae jktcb2ndstg03p:/dev/sdba:/dev/sdae jktcb2ndstg03p:/dev/sdbb:/dev/sdae jktcb2ndstg03p:/dev/sdbc:/dev/sdae jktcb2ndstg03p:/dev/sdbd:/dev/sdae [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] activating host jktcb2ndstg01p disk /dev/sdd [ceph_deploy.osd][DEBUG ] will use init type: sysvinit [jktcb2ndstg01p][INFO ] Running command: ceph-disk-activate --mark-init sysvinit --mount /dev/sdd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -p -s TYPE -ovalue -- /dev/sdd [jktcb2ndstg01p][WARNIN] ceph-disk: Cannot discover filesystem type: device /dev/sdd: Line is truncated: [jktcb2ndstg01p][ERROR ] RuntimeError: command returned non-zero exit status: 1 [ceph_deploy][ERROR ] RuntimeError: Failed to execute command: ceph-disk-activate --mark-init sysvinit --mount /dev/sdd [root@jktcb2cpstg01p ~]# ceph-deploy osd activate jktcb2ndstg{01,02,03}p:sd{d,e,f,g,h,i,j,k,l}1:/dev/sda jktcb2ndstg{01,02,03}p:sd{m,n,o,p,q,r,s,t}1:/dev/sdb jktcb2ndstg{01,02,03}p:sd{u,v,w,x,y,z,aa,ab}1:/dev/sdc jktcb2ndstg{01,02,03}p:sd{af,ag,ah,ai,aj,ak,al,am,an}1:/dev/sdac jktcb2ndstg{01,02,03}p:sd{ao,ap,aq,ar,as,at,au,av}1:/dev/sdad jktcb2ndstg{01,02,03}p:sd{aw,ax,ay,az,ba,bb,bc,bd}1:/dev/sdae [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy osd activate jktcb2ndstg01p:sdd1:/dev/sda jktcb2ndstg01p:sde1:/dev/sda jktcb2ndstg01p:sdf1:/dev/sda jktcb2ndstg01p:sdg1:/dev/sda jktcb2ndstg01p:sdh1:/dev/sda jktcb2ndstg01p:sdi1:/dev/sda jktcb2ndstg01p:sdj1:/dev/sda jktcb2ndstg01p:sdk1:/dev/sda jktcb2ndstg01p:sdl1:/dev/sda jktcb2ndstg02p:sdd1:/dev/sda jktcb2ndstg02p:sde1:/dev/sda jktcb2ndstg02p:sdf1:/dev/sda jktcb2ndstg02p:sdg1:/dev/sda jktcb2ndstg02p:sdh1:/dev/sda jktcb2ndstg02p:sdi1:/dev/sda jktcb2ndstg02p:sdj1:/dev/sda jktcb2ndstg02p:sdk1:/dev/sda jktcb2ndstg02p:sdl1:/dev/sda jktcb2ndstg03p:sdd1:/dev/sda jktcb2ndstg03p:sde1:/dev/sda jktcb2ndstg03p:sdf1:/dev/sda jktcb2ndstg03p:sdg1:/dev/sda jktcb2ndstg03p:sdh1:/dev/sda jktcb2ndstg03p:sdi1:/dev/sda jktcb2ndstg03p:sdj1:/dev/sda jktcb2ndstg03p:sdk1:/dev/sda jktcb2ndstg03p:sdl1:/dev/sda jktcb2ndstg01p:sdm1:/dev/sdb jktcb2ndstg01p:sdn1:/dev/sdb jktcb2ndstg01p:sdo1:/dev/sdb jktcb2ndstg01p:sdp1:/dev/sdb jktcb2ndstg01p:sdq1:/dev/sdb jktcb2ndstg01p:sdr1:/dev/sdb jktcb2ndstg01p:sds1:/dev/sdb jktcb2ndstg01p:sdt1:/dev/sdb jktcb2ndstg02p:sdm1:/dev/sdb jktcb2ndstg02p:sdn1:/dev/sdb jktcb2ndstg02p:sdo1:/dev/sdb jktcb2ndstg02p:sdp1:/dev/sdb jktcb2ndstg02p:sdq1:/dev/sdb jktcb2ndstg02p:sdr1:/dev/sdb jktcb2ndstg02p:sds1:/dev/sdb jktcb2ndstg02p:sdt1:/dev/sdb jktcb2ndstg03p:sdm1:/dev/sdb jktcb2ndstg03p:sdn1:/dev/sdb jktcb2ndstg03p:sdo1:/dev/sdb jktcb2ndstg03p:sdp1:/dev/sdb jktcb2ndstg03p:sdq1:/dev/sdb jktcb2ndstg03p:sdr1:/dev/sdb jktcb2ndstg03p:sds1:/dev/sdb jktcb2ndstg03p:sdt1:/dev/sdb jktcb2ndstg01p:sdu1:/dev/sdc jktcb2ndstg01p:sdv1:/dev/sdc jktcb2ndstg01p:sdw1:/dev/sdc jktcb2ndstg01p:sdx1:/dev/sdc jktcb2ndstg01p:sdy1:/dev/sdc jktcb2ndstg01p:sdz1:/dev/sdc jktcb2ndstg01p:sdaa1:/dev/sdc jktcb2ndstg01p:sdab1:/dev/sdc jktcb2ndstg02p:sdu1:/dev/sdc jktcb2ndstg02p:sdv1:/dev/sdc jktcb2ndstg02p:sdw1:/dev/sdc jktcb2ndstg02p:sdx1:/dev/sdc jktcb2ndstg02p:sdy1:/dev/sdc jktcb2ndstg02p:sdz1:/dev/sdc jktcb2ndstg02p:sdaa1:/dev/sdc jktcb2ndstg02p:sdab1:/dev/sdc jktcb2ndstg03p:sdu1:/dev/sdc jktcb2ndstg03p:sdv1:/dev/sdc jktcb2ndstg03p:sdw1:/dev/sdc jktcb2ndstg03p:sdx1:/dev/sdc jktcb2ndstg03p:sdy1:/dev/sdc jktcb2ndstg03p:sdz1:/dev/sdc jktcb2ndstg03p:sdaa1:/dev/sdc jktcb2ndstg03p:sdab1:/dev/sdc jktcb2ndstg01p:sdaf1:/dev/sdac jktcb2ndstg01p:sdag1:/dev/sdac jktcb2ndstg01p:sdah1:/dev/sdac jktcb2ndstg01p:sdai1:/dev/sdac jktcb2ndstg01p:sdaj1:/dev/sdac jktcb2ndstg01p:sdak1:/dev/sdac jktcb2ndstg01p:sdal1:/dev/sdac jktcb2ndstg01p:sdam1:/dev/sdac jktcb2ndstg01p:sdan1:/dev/sdac jktcb2ndstg02p:sdaf1:/dev/sdac jktcb2ndstg02p:sdag1:/dev/sdac jktcb2ndstg02p:sdah1:/dev/sdac jktcb2ndstg02p:sdai1:/dev/sdac jktcb2ndstg02p:sdaj1:/dev/sdac jktcb2ndstg02p:sdak1:/dev/sdac jktcb2ndstg02p:sdal1:/dev/sdac jktcb2ndstg02p:sdam1:/dev/sdac jktcb2ndstg02p:sdan1:/dev/sdac jktcb2ndstg03p:sdaf1:/dev/sdac jktcb2ndstg03p:sdag1:/dev/sdac jktcb2ndstg03p:sdah1:/dev/sdac jktcb2ndstg03p:sdai1:/dev/sdac jktcb2ndstg03p:sdaj1:/dev/sdac jktcb2ndstg03p:sdak1:/dev/sdac jktcb2ndstg03p:sdal1:/dev/sdac jktcb2ndstg03p:sdam1:/dev/sdac jktcb2ndstg03p:sdan1:/dev/sdac jktcb2ndstg01p:sdao1:/dev/sdad jktcb2ndstg01p:sdap1:/dev/sdad jktcb2ndstg01p:sdaq1:/dev/sdad jktcb2ndstg01p:sdar1:/dev/sdad jktcb2ndstg01p:sdas1:/dev/sdad jktcb2ndstg01p:sdat1:/dev/sdad jktcb2ndstg01p:sdau1:/dev/sdad jktcb2ndstg01p:sdav1:/dev/sdad jktcb2ndstg02p:sdao1:/dev/sdad jktcb2ndstg02p:sdap1:/dev/sdad jktcb2ndstg02p:sdaq1:/dev/sdad jktcb2ndstg02p:sdar1:/dev/sdad jktcb2ndstg02p:sdas1:/dev/sdad jktcb2ndstg02p:sdat1:/dev/sdad jktcb2ndstg02p:sdau1:/dev/sdad jktcb2ndstg02p:sdav1:/dev/sdad jktcb2ndstg03p:sdao1:/dev/sdad jktcb2ndstg03p:sdap1:/dev/sdad jktcb2ndstg03p:sdaq1:/dev/sdad jktcb2ndstg03p:sdar1:/dev/sdad jktcb2ndstg03p:sdas1:/dev/sdad jktcb2ndstg03p:sdat1:/dev/sdad jktcb2ndstg03p:sdau1:/dev/sdad jktcb2ndstg03p:sdav1:/dev/sdad jktcb2ndstg01p:sdaw1:/dev/sdae jktcb2ndstg01p:sdax1:/dev/sdae jktcb2ndstg01p:sday1:/dev/sdae jktcb2ndstg01p:sdaz1:/dev/sdae jktcb2ndstg01p:sdba1:/dev/sdae jktcb2ndstg01p:sdbb1:/dev/sdae jktcb2ndstg01p:sdbc1:/dev/sdae jktcb2ndstg01p:sdbd1:/dev/sdae jktcb2ndstg02p:sdaw1:/dev/sdae jktcb2ndstg02p:sdax1:/dev/sdae jktcb2ndstg02p:sday1:/dev/sdae jktcb2ndstg02p:sdaz1:/dev/sdae jktcb2ndstg02p:sdba1:/dev/sdae jktcb2ndstg02p:sdbb1:/dev/sdae jktcb2ndstg02p:sdbc1:/dev/sdae jktcb2ndstg02p:sdbd1:/dev/sdae jktcb2ndstg03p:sdaw1:/dev/sdae jktcb2ndstg03p:sdax1:/dev/sdae jktcb2ndstg03p:sday1:/dev/sdae jktcb2ndstg03p:sdaz1:/dev/sdae jktcb2ndstg03p:sdba1:/dev/sdae jktcb2ndstg03p:sdbb1:/dev/sdae jktcb2ndstg03p:sdbc1:/dev/sdae jktcb2ndstg03p:sdbd1:/dev/sdae [ceph_deploy.osd][DEBUG ] Activating cluster ceph disks jktcb2ndstg01p:/dev/sdd1:/dev/sda jktcb2ndstg01p:/dev/sde1:/dev/sda jktcb2ndstg01p:/dev/sdf1:/dev/sda jktcb2ndstg01p:/dev/sdg1:/dev/sda jktcb2ndstg01p:/dev/sdh1:/dev/sda jktcb2ndstg01p:/dev/sdi1:/dev/sda jktcb2ndstg01p:/dev/sdj1:/dev/sda jktcb2ndstg01p:/dev/sdk1:/dev/sda jktcb2ndstg01p:/dev/sdl1:/dev/sda jktcb2ndstg02p:/dev/sdd1:/dev/sda jktcb2ndstg02p:/dev/sde1:/dev/sda jktcb2ndstg02p:/dev/sdf1:/dev/sda jktcb2ndstg02p:/dev/sdg1:/dev/sda jktcb2ndstg02p:/dev/sdh1:/dev/sda jktcb2ndstg02p:/dev/sdi1:/dev/sda jktcb2ndstg02p:/dev/sdj1:/dev/sda jktcb2ndstg02p:/dev/sdk1:/dev/sda jktcb2ndstg02p:/dev/sdl1:/dev/sda jktcb2ndstg03p:/dev/sdd1:/dev/sda jktcb2ndstg03p:/dev/sde1:/dev/sda jktcb2ndstg03p:/dev/sdf1:/dev/sda jktcb2ndstg03p:/dev/sdg1:/dev/sda jktcb2ndstg03p:/dev/sdh1:/dev/sda jktcb2ndstg03p:/dev/sdi1:/dev/sda jktcb2ndstg03p:/dev/sdj1:/dev/sda jktcb2ndstg03p:/dev/sdk1:/dev/sda jktcb2ndstg03p:/dev/sdl1:/dev/sda jktcb2ndstg01p:/dev/sdm1:/dev/sdb jktcb2ndstg01p:/dev/sdn1:/dev/sdb jktcb2ndstg01p:/dev/sdo1:/dev/sdb jktcb2ndstg01p:/dev/sdp1:/dev/sdb jktcb2ndstg01p:/dev/sdq1:/dev/sdb jktcb2ndstg01p:/dev/sdr1:/dev/sdb jktcb2ndstg01p:/dev/sds1:/dev/sdb jktcb2ndstg01p:/dev/sdt1:/dev/sdb jktcb2ndstg02p:/dev/sdm1:/dev/sdb jktcb2ndstg02p:/dev/sdn1:/dev/sdb jktcb2ndstg02p:/dev/sdo1:/dev/sdb jktcb2ndstg02p:/dev/sdp1:/dev/sdb jktcb2ndstg02p:/dev/sdq1:/dev/sdb jktcb2ndstg02p:/dev/sdr1:/dev/sdb jktcb2ndstg02p:/dev/sds1:/dev/sdb jktcb2ndstg02p:/dev/sdt1:/dev/sdb jktcb2ndstg03p:/dev/sdm1:/dev/sdb jktcb2ndstg03p:/dev/sdn1:/dev/sdb jktcb2ndstg03p:/dev/sdo1:/dev/sdb jktcb2ndstg03p:/dev/sdp1:/dev/sdb jktcb2ndstg03p:/dev/sdq1:/dev/sdb jktcb2ndstg03p:/dev/sdr1:/dev/sdb jktcb2ndstg03p:/dev/sds1:/dev/sdb jktcb2ndstg03p:/dev/sdt1:/dev/sdb jktcb2ndstg01p:/dev/sdu1:/dev/sdc jktcb2ndstg01p:/dev/sdv1:/dev/sdc jktcb2ndstg01p:/dev/sdw1:/dev/sdc jktcb2ndstg01p:/dev/sdx1:/dev/sdc jktcb2ndstg01p:/dev/sdy1:/dev/sdc jktcb2ndstg01p:/dev/sdz1:/dev/sdc jktcb2ndstg01p:/dev/sdaa1:/dev/sdc jktcb2ndstg01p:/dev/sdab1:/dev/sdc jktcb2ndstg02p:/dev/sdu1:/dev/sdc jktcb2ndstg02p:/dev/sdv1:/dev/sdc jktcb2ndstg02p:/dev/sdw1:/dev/sdc jktcb2ndstg02p:/dev/sdx1:/dev/sdc jktcb2ndstg02p:/dev/sdy1:/dev/sdc jktcb2ndstg02p:/dev/sdz1:/dev/sdc jktcb2ndstg02p:/dev/sdaa1:/dev/sdc jktcb2ndstg02p:/dev/sdab1:/dev/sdc jktcb2ndstg03p:/dev/sdu1:/dev/sdc jktcb2ndstg03p:/dev/sdv1:/dev/sdc jktcb2ndstg03p:/dev/sdw1:/dev/sdc jktcb2ndstg03p:/dev/sdx1:/dev/sdc jktcb2ndstg03p:/dev/sdy1:/dev/sdc jktcb2ndstg03p:/dev/sdz1:/dev/sdc jktcb2ndstg03p:/dev/sdaa1:/dev/sdc jktcb2ndstg03p:/dev/sdab1:/dev/sdc jktcb2ndstg01p:/dev/sdaf1:/dev/sdac jktcb2ndstg01p:/dev/sdag1:/dev/sdac jktcb2ndstg01p:/dev/sdah1:/dev/sdac jktcb2ndstg01p:/dev/sdai1:/dev/sdac jktcb2ndstg01p:/dev/sdaj1:/dev/sdac jktcb2ndstg01p:/dev/sdak1:/dev/sdac jktcb2ndstg01p:/dev/sdal1:/dev/sdac jktcb2ndstg01p:/dev/sdam1:/dev/sdac jktcb2ndstg01p:/dev/sdan1:/dev/sdac jktcb2ndstg02p:/dev/sdaf1:/dev/sdac jktcb2ndstg02p:/dev/sdag1:/dev/sdac jktcb2ndstg02p:/dev/sdah1:/dev/sdac jktcb2ndstg02p:/dev/sdai1:/dev/sdac jktcb2ndstg02p:/dev/sdaj1:/dev/sdac jktcb2ndstg02p:/dev/sdak1:/dev/sdac jktcb2ndstg02p:/dev/sdal1:/dev/sdac jktcb2ndstg02p:/dev/sdam1:/dev/sdac jktcb2ndstg02p:/dev/sdan1:/dev/sdac jktcb2ndstg03p:/dev/sdaf1:/dev/sdac jktcb2ndstg03p:/dev/sdag1:/dev/sdac jktcb2ndstg03p:/dev/sdah1:/dev/sdac jktcb2ndstg03p:/dev/sdai1:/dev/sdac jktcb2ndstg03p:/dev/sdaj1:/dev/sdac jktcb2ndstg03p:/dev/sdak1:/dev/sdac jktcb2ndstg03p:/dev/sdal1:/dev/sdac jktcb2ndstg03p:/dev/sdam1:/dev/sdac jktcb2ndstg03p:/dev/sdan1:/dev/sdac jktcb2ndstg01p:/dev/sdao1:/dev/sdad jktcb2ndstg01p:/dev/sdap1:/dev/sdad jktcb2ndstg01p:/dev/sdaq1:/dev/sdad jktcb2ndstg01p:/dev/sdar1:/dev/sdad jktcb2ndstg01p:/dev/sdas1:/dev/sdad jktcb2ndstg01p:/dev/sdat1:/dev/sdad jktcb2ndstg01p:/dev/sdau1:/dev/sdad jktcb2ndstg01p:/dev/sdav1:/dev/sdad jktcb2ndstg02p:/dev/sdao1:/dev/sdad jktcb2ndstg02p:/dev/sdap1:/dev/sdad jktcb2ndstg02p:/dev/sdaq1:/dev/sdad jktcb2ndstg02p:/dev/sdar1:/dev/sdad jktcb2ndstg02p:/dev/sdas1:/dev/sdad jktcb2ndstg02p:/dev/sdat1:/dev/sdad jktcb2ndstg02p:/dev/sdau1:/dev/sdad jktcb2ndstg02p:/dev/sdav1:/dev/sdad jktcb2ndstg03p:/dev/sdao1:/dev/sdad jktcb2ndstg03p:/dev/sdap1:/dev/sdad jktcb2ndstg03p:/dev/sdaq1:/dev/sdad jktcb2ndstg03p:/dev/sdar1:/dev/sdad jktcb2ndstg03p:/dev/sdas1:/dev/sdad jktcb2ndstg03p:/dev/sdat1:/dev/sdad jktcb2ndstg03p:/dev/sdau1:/dev/sdad jktcb2ndstg03p:/dev/sdav1:/dev/sdad jktcb2ndstg01p:/dev/sdaw1:/dev/sdae jktcb2ndstg01p:/dev/sdax1:/dev/sdae jktcb2ndstg01p:/dev/sday1:/dev/sdae jktcb2ndstg01p:/dev/sdaz1:/dev/sdae jktcb2ndstg01p:/dev/sdba1:/dev/sdae jktcb2ndstg01p:/dev/sdbb1:/dev/sdae jktcb2ndstg01p:/dev/sdbc1:/dev/sdae jktcb2ndstg01p:/dev/sdbd1:/dev/sdae jktcb2ndstg02p:/dev/sdaw1:/dev/sdae jktcb2ndstg02p:/dev/sdax1:/dev/sdae jktcb2ndstg02p:/dev/sday1:/dev/sdae jktcb2ndstg02p:/dev/sdaz1:/dev/sdae jktcb2ndstg02p:/dev/sdba1:/dev/sdae jktcb2ndstg02p:/dev/sdbb1:/dev/sdae jktcb2ndstg02p:/dev/sdbc1:/dev/sdae jktcb2ndstg02p:/dev/sdbd1:/dev/sdae jktcb2ndstg03p:/dev/sdaw1:/dev/sdae jktcb2ndstg03p:/dev/sdax1:/dev/sdae jktcb2ndstg03p:/dev/sday1:/dev/sdae jktcb2ndstg03p:/dev/sdaz1:/dev/sdae jktcb2ndstg03p:/dev/sdba1:/dev/sdae jktcb2ndstg03p:/dev/sdbb1:/dev/sdae jktcb2ndstg03p:/dev/sdbc1:/dev/sdae jktcb2ndstg03p:/dev/sdbd1:/dev/sdae [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] activating host jktcb2ndstg01p disk /dev/sdd1 [ceph_deploy.osd][DEBUG ] will use init type: sysvinit [jktcb2ndstg01p][INFO ] Running command: ceph-disk-activate --mark-init sysvinit --mount /dev/sdd1 [jktcb2ndstg01p][WARNIN] ceph-disk: Error: /dev/sdd1 does not exist [jktcb2ndstg01p][ERROR ] RuntimeError: command returned non-zero exit status: 1 [ceph_deploy][ERROR ] RuntimeError: Failed to execute command: ceph-disk-activate --mark-init sysvinit --mount /dev/sdd1 [root@jktcb2cpstg01p ~]# ceph-deploy disk zap jktcb2ndstg01p:sdd [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy disk zap jktcb2ndstg01p:sdd [ceph_deploy.osd][DEBUG ] zapping /dev/sdd on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdd [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdd [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [root@jktcb2cpstg01p ~]# ceph-deploy disk zap jktcb2ndstg{01,02,03}p:sd{a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t,u,v,w,x,y,z,aa,ab,ac,ad,ae,af,ag,ah,ai,aj,ak,al,am,an,ao,ap,aq,ar,as,at,au,av,aw,ax,ay,az,ba,bb,bc,bd} [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy disk zap jktcb2ndstg01p:sda jktcb2ndstg01p:sdb jktcb2ndstg01p:sdc jktcb2ndstg01p:sdd jktcb2ndstg01p:sde jktcb2ndstg01p:sdf jktcb2ndstg01p:sdg jktcb2ndstg01p:sdh jktcb2ndstg01p:sdi jktcb2ndstg01p:sdj jktcb2ndstg01p:sdk jktcb2ndstg01p:sdl jktcb2ndstg01p:sdm jktcb2ndstg01p:sdn jktcb2ndstg01p:sdo jktcb2ndstg01p:sdp jktcb2ndstg01p:sdq jktcb2ndstg01p:sdr jktcb2ndstg01p:sds jktcb2ndstg01p:sdt jktcb2ndstg01p:sdu jktcb2ndstg01p:sdv jktcb2ndstg01p:sdw jktcb2ndstg01p:sdx jktcb2ndstg01p:sdy jktcb2ndstg01p:sdz jktcb2ndstg01p:sdaa jktcb2ndstg01p:sdab jktcb2ndstg01p:sdac jktcb2ndstg01p:sdad jktcb2ndstg01p:sdae jktcb2ndstg01p:sdaf jktcb2ndstg01p:sdag jktcb2ndstg01p:sdah jktcb2ndstg01p:sdai jktcb2ndstg01p:sdaj jktcb2ndstg01p:sdak jktcb2ndstg01p:sdal jktcb2ndstg01p:sdam jktcb2ndstg01p:sdan jktcb2ndstg01p:sdao jktcb2ndstg01p:sdap jktcb2ndstg01p:sdaq jktcb2ndstg01p:sdar jktcb2ndstg01p:sdas jktcb2ndstg01p:sdat jktcb2ndstg01p:sdau jktcb2ndstg01p:sdav jktcb2ndstg01p:sdaw jktcb2ndstg01p:sdax jktcb2ndstg01p:sday jktcb2ndstg01p:sdaz jktcb2ndstg01p:sdba jktcb2ndstg01p:sdbb jktcb2ndstg01p:sdbc jktcb2ndstg01p:sdbd jktcb2ndstg02p:sda jktcb2ndstg02p:sdb jktcb2ndstg02p:sdc jktcb2ndstg02p:sdd jktcb2ndstg02p:sde jktcb2ndstg02p:sdf jktcb2ndstg02p:sdg jktcb2ndstg02p:sdh jktcb2ndstg02p:sdi jktcb2ndstg02p:sdj jktcb2ndstg02p:sdk jktcb2ndstg02p:sdl jktcb2ndstg02p:sdm jktcb2ndstg02p:sdn jktcb2ndstg02p:sdo jktcb2ndstg02p:sdp jktcb2ndstg02p:sdq jktcb2ndstg02p:sdr jktcb2ndstg02p:sds jktcb2ndstg02p:sdt jktcb2ndstg02p:sdu jktcb2ndstg02p:sdv jktcb2ndstg02p:sdw jktcb2ndstg02p:sdx jktcb2ndstg02p:sdy jktcb2ndstg02p:sdz jktcb2ndstg02p:sdaa jktcb2ndstg02p:sdab jktcb2ndstg02p:sdac jktcb2ndstg02p:sdad jktcb2ndstg02p:sdae jktcb2ndstg02p:sdaf jktcb2ndstg02p:sdag jktcb2ndstg02p:sdah jktcb2ndstg02p:sdai jktcb2ndstg02p:sdaj jktcb2ndstg02p:sdak jktcb2ndstg02p:sdal jktcb2ndstg02p:sdam jktcb2ndstg02p:sdan jktcb2ndstg02p:sdao jktcb2ndstg02p:sdap jktcb2ndstg02p:sdaq jktcb2ndstg02p:sdar jktcb2ndstg02p:sdas jktcb2ndstg02p:sdat jktcb2ndstg02p:sdau jktcb2ndstg02p:sdav jktcb2ndstg02p:sdaw jktcb2ndstg02p:sdax jktcb2ndstg02p:sday jktcb2ndstg02p:sdaz jktcb2ndstg02p:sdba jktcb2ndstg02p:sdbb jktcb2ndstg02p:sdbc jktcb2ndstg02p:sdbd jktcb2ndstg03p:sda jktcb2ndstg03p:sdb jktcb2ndstg03p:sdc jktcb2ndstg03p:sdd jktcb2ndstg03p:sde jktcb2ndstg03p:sdf jktcb2ndstg03p:sdg jktcb2ndstg03p:sdh jktcb2ndstg03p:sdi jktcb2ndstg03p:sdj jktcb2ndstg03p:sdk jktcb2ndstg03p:sdl jktcb2ndstg03p:sdm jktcb2ndstg03p:sdn jktcb2ndstg03p:sdo jktcb2ndstg03p:sdp jktcb2ndstg03p:sdq jktcb2ndstg03p:sdr jktcb2ndstg03p:sds jktcb2ndstg03p:sdt jktcb2ndstg03p:sdu jktcb2ndstg03p:sdv jktcb2ndstg03p:sdw jktcb2ndstg03p:sdx jktcb2ndstg03p:sdy jktcb2ndstg03p:sdz jktcb2ndstg03p:sdaa jktcb2ndstg03p:sdab jktcb2ndstg03p:sdac jktcb2ndstg03p:sdad jktcb2ndstg03p:sdae jktcb2ndstg03p:sdaf jktcb2ndstg03p:sdag jktcb2ndstg03p:sdah jktcb2ndstg03p:sdai jktcb2ndstg03p:sdaj jktcb2ndstg03p:sdak jktcb2ndstg03p:sdal jktcb2ndstg03p:sdam jktcb2ndstg03p:sdan jktcb2ndstg03p:sdao jktcb2ndstg03p:sdap jktcb2ndstg03p:sdaq jktcb2ndstg03p:sdar jktcb2ndstg03p:sdas jktcb2ndstg03p:sdat jktcb2ndstg03p:sdau jktcb2ndstg03p:sdav jktcb2ndstg03p:sdaw jktcb2ndstg03p:sdax jktcb2ndstg03p:sday jktcb2ndstg03p:sdaz jktcb2ndstg03p:sdba jktcb2ndstg03p:sdbb jktcb2ndstg03p:sdbc jktcb2ndstg03p:sdbd [ceph_deploy.osd][DEBUG ] zapping /dev/sda on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sda [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sda [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdb [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdc on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdc [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdd on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdd [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdd [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sde on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sde [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sde [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdf on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdf [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdf [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdg on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdg [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdg [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdh on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdh [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdh [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdi on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdi [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdi [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdj on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdj [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdj [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdk on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdk [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdk [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdl on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdl [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdl [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdm on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdm [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdm [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdn on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdn [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdn [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdo on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdo [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdo [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdp on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdp [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdp [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdq on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdq [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdq [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdr on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdr [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdr [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sds on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sds [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sds [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdt on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdt [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdt [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdu on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdu [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdu [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdv on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdv [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdv [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdw on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdw [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdw [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdx on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdx [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdx [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdy on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdy [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdy [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdz on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdz [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdz [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaa on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaa [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaa [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdab on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdab [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdab [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdac on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdac [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdad on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdad [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdae on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdae [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaf on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaf [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaf [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdag on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdag [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdag [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdah on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdah [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdah [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdai on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdai [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdai [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaj on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaj [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaj [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdak on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdak [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdak [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdal on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdal [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdal [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdam on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdam [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdam [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdan on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdan [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdan [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdao on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdao [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdao [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdap on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdap [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdap [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaq on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaq [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaq [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdar on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdar [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdar [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdas on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdas [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdas [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdat on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdat [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdat [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdau on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdau [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdau [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdav on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdav [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdav [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaw on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaw [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaw [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdax on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdax [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdax [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sday on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sday [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sday [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaz on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaz [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaz [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdba on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdba [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdba [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbb on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbb [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbb [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbc on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbc [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbc [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbd on jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg01p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg01p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbd [jktcb2ndstg01p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg01p][DEBUG ] other utilities. [jktcb2ndstg01p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbd [jktcb2ndstg01p][DEBUG ] Creating new GPT entries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sda on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sda [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sda [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdb [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdc on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdc [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdd on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdd [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdd [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sde on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sde [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sde [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdf on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdf [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdf [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdg on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdg [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdg [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdh on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdh [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdh [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdi on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdi [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdi [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdj on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdj [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdj [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdk on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdk [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdk [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdl on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdl [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdl [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdm on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdm [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdm [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdn on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdn [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdn [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdo on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdo [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdo [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdp on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdp [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdp [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdq on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdq [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdq [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdr on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdr [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdr [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sds on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sds [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sds [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdt on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdt [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdt [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdu on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdu [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdu [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdv on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdv [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdv [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdw on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdw [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdw [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdx on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdx [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdx [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdy on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdy [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdy [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdz on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdz [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdz [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaa on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaa [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaa [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdab on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdab [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdab [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdac on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdac [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdad on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdad [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdae on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdae [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaf on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaf [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaf [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdag on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdag [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdag [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdah on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdah [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdah [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdai on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdai [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdai [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaj on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaj [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaj [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdak on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdak [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdak [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdal on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdal [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdal [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdam on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdam [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdam [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdan on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdan [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdan [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdao on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdao [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdao [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdap on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdap [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdap [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaq on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaq [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaq [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdar on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdar [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdar [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdas on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdas [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdas [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdat on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdat [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdat [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdau on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdau [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdau [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdav on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdav [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdav [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaw on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaw [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaw [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdax on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdax [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdax [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sday on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sday [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sday [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaz on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaz [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaz [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdba on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdba [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdba [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbb on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbb [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbb [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbc on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbc [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbc [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbd on jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg02p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg02p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbd [jktcb2ndstg02p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg02p][DEBUG ] other utilities. [jktcb2ndstg02p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbd [jktcb2ndstg02p][DEBUG ] Creating new GPT entries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sda on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sda [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sda [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdb on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdb [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdc on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdc [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdd on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdd [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdd [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sde on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sde [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sde [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdf on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdf [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdf [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdg on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdg [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdg [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdh on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdh [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdh [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdi on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdi [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdi [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdj on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdj [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdj [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdk on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdk [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdk [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdl on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdl [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdl [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdm on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdm [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdm [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdn on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdn [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdn [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdo on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdo [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdo [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdp on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdp [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdp [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdq on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdq [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdq [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdr on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdr [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdr [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sds on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sds [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sds [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdt on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdt [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdt [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdu on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdu [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdu [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdv on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdv [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdv [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdw on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdw [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdw [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdx on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdx [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdx [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdy on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdy [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdy [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdz on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdz [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdz [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaa on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaa [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaa [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdab on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdab [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdab [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdac on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdac [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdad on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdad [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdae on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdae [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaf on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaf [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaf [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdag on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdag [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdag [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdah on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdah [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdah [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdai on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdai [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdai [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaj on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaj [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaj [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdak on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdak [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdak [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdal on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdal [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdal [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdam on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdam [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdam [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdan on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdan [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdan [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdao on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdao [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdao [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdap on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdap [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdap [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaq on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaq [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaq [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdar on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdar [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdar [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdas on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdas [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdas [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdat on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdat [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdat [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdau on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdau [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdau [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdav on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdav [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdav [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaw on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaw [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaw [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdax on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdax [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdax [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sday on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sday [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sday [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdaz on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdaz [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdaz [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdba on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdba [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdba [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbb on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbb [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbb [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbc on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbc [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbc [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [ceph_deploy.osd][DEBUG ] zapping /dev/sdbd on jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [jktcb2ndstg03p][DEBUG ] zeroing last few blocks of device [jktcb2ndstg03p][INFO ] Running command: sgdisk --zap-all -- /dev/sdbd [jktcb2ndstg03p][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or [jktcb2ndstg03p][DEBUG ] other utilities. [jktcb2ndstg03p][INFO ] Running command: sgdisk --clear --mbrtogpt -- /dev/sdbd [jktcb2ndstg03p][DEBUG ] Creating new GPT entries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [root@jktcb2cpstg01p ~]# ceph-deploy disk list usage: ceph-deploy disk [-h] [--zap-disk] [--fs-type FS_TYPE] [--dmcrypt] [--dmcrypt-key-dir KEYDIR] SUBCOMMAND HOST:DISK [HOST:DISK ...] ceph-deploy disk: error: too few arguments [root@jktcb2cpstg01p ~]# ceph-deploy list disk usage: ceph-deploy [-h] [-v | -q] [--version] [--username USERNAME] [--overwrite-conf] [--cluster NAME] COMMAND ... ceph-deploy: error: argument COMMAND: invalid choice: 'list' (choose from 'purgedata', 'pkg', 'mds', 'forgetkeys', 'calamari', 'purge', 'admin', 'mon', 'install', 'gatherkeys', 'new', 'disk', 'config', 'osd', 'uninstall') [root@jktcb2cpstg01p ~]# ceph-deploy disk list jktcb2ndstg01p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy disk list jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Listing disks on jktcb2ndstg01p... [jktcb2ndstg01p][INFO ] Running command: ceph-disk list [jktcb2ndstg01p][DEBUG ] /dev/sda other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdaa other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdab other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdac other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdad other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdae other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdaf other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdag other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdah other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdai other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdaj other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdak other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdal other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdam other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdan other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdao other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdap other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdaq other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdar other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdas other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdat other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdau other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdav other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdaw other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdax other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sday other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdaz other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdb other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdba other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdbb other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdbc other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdbd other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdbe other, isw_raid_member [jktcb2ndstg01p][DEBUG ] /dev/sdbf other, isw_raid_member [jktcb2ndstg01p][DEBUG ] /dev/sdc other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdd other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sde other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdf other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdg other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdh other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdi other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdj other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdk other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdl other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdm other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdn other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdo other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdp other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdq other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdr other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sds other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdt other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdu other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdv other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdw other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdx other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdy other, unknown [jktcb2ndstg01p][DEBUG ] /dev/sdz other, unknown [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdaa [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdab [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdaf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdag [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdah [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdai [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdaj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdak [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdal [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdam [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdan [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdao [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdap [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdaq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdar [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdas [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdat [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdau [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdav [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdaw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdax [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sday [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdaz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdba [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdbb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdbc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdbd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdbe [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdbf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sde [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdg [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdh [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdi [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdk [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdm [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdn [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdo [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdp [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdr [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sds [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdt [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdv [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdx [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/blkid -s TYPE /dev/sdz [root@jktcb2cpstg01p ~]# ceph-deploy osd create jktcb2ndstg{01,02,03}p:sd{d,e,f,g,h,i,j,k,l}:/dev/sda jktcb2ndstg{01,02,03}p:sd{m,n,o,p,q,r,s,t}:/dev/sdb jktcb2ndstg{01,02,03}p:sd{u,v,w,x,y,z,aa,ab}:/dev/sdc jktcb2ndstg{01,02,03}p:sd{af,ag,ah,ai,aj,ak,al,am,an}:/dev/sdac jktcb2ndstg{01,02,03}p:sd{ao,ap,aq,ar,as,at,au,av}:/dev/sdad jktcb2ndstg{01,02,03}p:sd{aw,ax,ay,az,ba,bb,bc,bd}:/dev/sdae [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy osd create jktcb2ndstg01p:sdd:/dev/sda jktcb2ndstg01p:sde:/dev/sda jktcb2ndstg01p:sdf:/dev/sda jktcb2ndstg01p:sdg:/dev/sda jktcb2ndstg01p:sdh:/dev/sda jktcb2ndstg01p:sdi:/dev/sda jktcb2ndstg01p:sdj:/dev/sda jktcb2ndstg01p:sdk:/dev/sda jktcb2ndstg01p:sdl:/dev/sda jktcb2ndstg02p:sdd:/dev/sda jktcb2ndstg02p:sde:/dev/sda jktcb2ndstg02p:sdf:/dev/sda jktcb2ndstg02p:sdg:/dev/sda jktcb2ndstg02p:sdh:/dev/sda jktcb2ndstg02p:sdi:/dev/sda jktcb2ndstg02p:sdj:/dev/sda jktcb2ndstg02p:sdk:/dev/sda jktcb2ndstg02p:sdl:/dev/sda jktcb2ndstg03p:sdd:/dev/sda jktcb2ndstg03p:sde:/dev/sda jktcb2ndstg03p:sdf:/dev/sda jktcb2ndstg03p:sdg:/dev/sda jktcb2ndstg03p:sdh:/dev/sda jktcb2ndstg03p:sdi:/dev/sda jktcb2ndstg03p:sdj:/dev/sda jktcb2ndstg03p:sdk:/dev/sda jktcb2ndstg03p:sdl:/dev/sda jktcb2ndstg01p:sdm:/dev/sdb jktcb2ndstg01p:sdn:/dev/sdb jktcb2ndstg01p:sdo:/dev/sdb jktcb2ndstg01p:sdp:/dev/sdb jktcb2ndstg01p:sdq:/dev/sdb jktcb2ndstg01p:sdr:/dev/sdb jktcb2ndstg01p:sds:/dev/sdb jktcb2ndstg01p:sdt:/dev/sdb jktcb2ndstg02p:sdm:/dev/sdb jktcb2ndstg02p:sdn:/dev/sdb jktcb2ndstg02p:sdo:/dev/sdb jktcb2ndstg02p:sdp:/dev/sdb jktcb2ndstg02p:sdq:/dev/sdb jktcb2ndstg02p:sdr:/dev/sdb jktcb2ndstg02p:sds:/dev/sdb jktcb2ndstg02p:sdt:/dev/sdb jktcb2ndstg03p:sdm:/dev/sdb jktcb2ndstg03p:sdn:/dev/sdb jktcb2ndstg03p:sdo:/dev/sdb jktcb2ndstg03p:sdp:/dev/sdb jktcb2ndstg03p:sdq:/dev/sdb jktcb2ndstg03p:sdr:/dev/sdb jktcb2ndstg03p:sds:/dev/sdb jktcb2ndstg03p:sdt:/dev/sdb jktcb2ndstg01p:sdu:/dev/sdc jktcb2ndstg01p:sdv:/dev/sdc jktcb2ndstg01p:sdw:/dev/sdc jktcb2ndstg01p:sdx:/dev/sdc jktcb2ndstg01p:sdy:/dev/sdc jktcb2ndstg01p:sdz:/dev/sdc jktcb2ndstg01p:sdaa:/dev/sdc jktcb2ndstg01p:sdab:/dev/sdc jktcb2ndstg02p:sdu:/dev/sdc jktcb2ndstg02p:sdv:/dev/sdc jktcb2ndstg02p:sdw:/dev/sdc jktcb2ndstg02p:sdx:/dev/sdc jktcb2ndstg02p:sdy:/dev/sdc jktcb2ndstg02p:sdz:/dev/sdc jktcb2ndstg02p:sdaa:/dev/sdc jktcb2ndstg02p:sdab:/dev/sdc jktcb2ndstg03p:sdu:/dev/sdc jktcb2ndstg03p:sdv:/dev/sdc jktcb2ndstg03p:sdw:/dev/sdc jktcb2ndstg03p:sdx:/dev/sdc jktcb2ndstg03p:sdy:/dev/sdc jktcb2ndstg03p:sdz:/dev/sdc jktcb2ndstg03p:sdaa:/dev/sdc jktcb2ndstg03p:sdab:/dev/sdc jktcb2ndstg01p:sdaf:/dev/sdac jktcb2ndstg01p:sdag:/dev/sdac jktcb2ndstg01p:sdah:/dev/sdac jktcb2ndstg01p:sdai:/dev/sdac jktcb2ndstg01p:sdaj:/dev/sdac jktcb2ndstg01p:sdak:/dev/sdac jktcb2ndstg01p:sdal:/dev/sdac jktcb2ndstg01p:sdam:/dev/sdac jktcb2ndstg01p:sdan:/dev/sdac jktcb2ndstg02p:sdaf:/dev/sdac jktcb2ndstg02p:sdag:/dev/sdac jktcb2ndstg02p:sdah:/dev/sdac jktcb2ndstg02p:sdai:/dev/sdac jktcb2ndstg02p:sdaj:/dev/sdac jktcb2ndstg02p:sdak:/dev/sdac jktcb2ndstg02p:sdal:/dev/sdac jktcb2ndstg02p:sdam:/dev/sdac jktcb2ndstg02p:sdan:/dev/sdac jktcb2ndstg03p:sdaf:/dev/sdac jktcb2ndstg03p:sdag:/dev/sdac jktcb2ndstg03p:sdah:/dev/sdac jktcb2ndstg03p:sdai:/dev/sdac jktcb2ndstg03p:sdaj:/dev/sdac jktcb2ndstg03p:sdak:/dev/sdac jktcb2ndstg03p:sdal:/dev/sdac jktcb2ndstg03p:sdam:/dev/sdac jktcb2ndstg03p:sdan:/dev/sdac jktcb2ndstg01p:sdao:/dev/sdad jktcb2ndstg01p:sdap:/dev/sdad jktcb2ndstg01p:sdaq:/dev/sdad jktcb2ndstg01p:sdar:/dev/sdad jktcb2ndstg01p:sdas:/dev/sdad jktcb2ndstg01p:sdat:/dev/sdad jktcb2ndstg01p:sdau:/dev/sdad jktcb2ndstg01p:sdav:/dev/sdad jktcb2ndstg02p:sdao:/dev/sdad jktcb2ndstg02p:sdap:/dev/sdad jktcb2ndstg02p:sdaq:/dev/sdad jktcb2ndstg02p:sdar:/dev/sdad jktcb2ndstg02p:sdas:/dev/sdad jktcb2ndstg02p:sdat:/dev/sdad jktcb2ndstg02p:sdau:/dev/sdad jktcb2ndstg02p:sdav:/dev/sdad jktcb2ndstg03p:sdao:/dev/sdad jktcb2ndstg03p:sdap:/dev/sdad jktcb2ndstg03p:sdaq:/dev/sdad jktcb2ndstg03p:sdar:/dev/sdad jktcb2ndstg03p:sdas:/dev/sdad jktcb2ndstg03p:sdat:/dev/sdad jktcb2ndstg03p:sdau:/dev/sdad jktcb2ndstg03p:sdav:/dev/sdad jktcb2ndstg01p:sdaw:/dev/sdae jktcb2ndstg01p:sdax:/dev/sdae jktcb2ndstg01p:sday:/dev/sdae jktcb2ndstg01p:sdaz:/dev/sdae jktcb2ndstg01p:sdba:/dev/sdae jktcb2ndstg01p:sdbb:/dev/sdae jktcb2ndstg01p:sdbc:/dev/sdae jktcb2ndstg01p:sdbd:/dev/sdae jktcb2ndstg02p:sdaw:/dev/sdae jktcb2ndstg02p:sdax:/dev/sdae jktcb2ndstg02p:sday:/dev/sdae jktcb2ndstg02p:sdaz:/dev/sdae jktcb2ndstg02p:sdba:/dev/sdae jktcb2ndstg02p:sdbb:/dev/sdae jktcb2ndstg02p:sdbc:/dev/sdae jktcb2ndstg02p:sdbd:/dev/sdae jktcb2ndstg03p:sdaw:/dev/sdae jktcb2ndstg03p:sdax:/dev/sdae jktcb2ndstg03p:sday:/dev/sdae jktcb2ndstg03p:sdaz:/dev/sdae jktcb2ndstg03p:sdba:/dev/sdae jktcb2ndstg03p:sdbb:/dev/sdae jktcb2ndstg03p:sdbc:/dev/sdae jktcb2ndstg03p:sdbd:/dev/sdae [ceph_deploy.osd][DEBUG ] Preparing cluster ceph disks jktcb2ndstg01p:/dev/sdd:/dev/sda jktcb2ndstg01p:/dev/sde:/dev/sda jktcb2ndstg01p:/dev/sdf:/dev/sda jktcb2ndstg01p:/dev/sdg:/dev/sda jktcb2ndstg01p:/dev/sdh:/dev/sda jktcb2ndstg01p:/dev/sdi:/dev/sda jktcb2ndstg01p:/dev/sdj:/dev/sda jktcb2ndstg01p:/dev/sdk:/dev/sda jktcb2ndstg01p:/dev/sdl:/dev/sda jktcb2ndstg02p:/dev/sdd:/dev/sda jktcb2ndstg02p:/dev/sde:/dev/sda jktcb2ndstg02p:/dev/sdf:/dev/sda jktcb2ndstg02p:/dev/sdg:/dev/sda jktcb2ndstg02p:/dev/sdh:/dev/sda jktcb2ndstg02p:/dev/sdi:/dev/sda jktcb2ndstg02p:/dev/sdj:/dev/sda jktcb2ndstg02p:/dev/sdk:/dev/sda jktcb2ndstg02p:/dev/sdl:/dev/sda jktcb2ndstg03p:/dev/sdd:/dev/sda jktcb2ndstg03p:/dev/sde:/dev/sda jktcb2ndstg03p:/dev/sdf:/dev/sda jktcb2ndstg03p:/dev/sdg:/dev/sda jktcb2ndstg03p:/dev/sdh:/dev/sda jktcb2ndstg03p:/dev/sdi:/dev/sda jktcb2ndstg03p:/dev/sdj:/dev/sda jktcb2ndstg03p:/dev/sdk:/dev/sda jktcb2ndstg03p:/dev/sdl:/dev/sda jktcb2ndstg01p:/dev/sdm:/dev/sdb jktcb2ndstg01p:/dev/sdn:/dev/sdb jktcb2ndstg01p:/dev/sdo:/dev/sdb jktcb2ndstg01p:/dev/sdp:/dev/sdb jktcb2ndstg01p:/dev/sdq:/dev/sdb jktcb2ndstg01p:/dev/sdr:/dev/sdb jktcb2ndstg01p:/dev/sds:/dev/sdb jktcb2ndstg01p:/dev/sdt:/dev/sdb jktcb2ndstg02p:/dev/sdm:/dev/sdb jktcb2ndstg02p:/dev/sdn:/dev/sdb jktcb2ndstg02p:/dev/sdo:/dev/sdb jktcb2ndstg02p:/dev/sdp:/dev/sdb jktcb2ndstg02p:/dev/sdq:/dev/sdb jktcb2ndstg02p:/dev/sdr:/dev/sdb jktcb2ndstg02p:/dev/sds:/dev/sdb jktcb2ndstg02p:/dev/sdt:/dev/sdb jktcb2ndstg03p:/dev/sdm:/dev/sdb jktcb2ndstg03p:/dev/sdn:/dev/sdb jktcb2ndstg03p:/dev/sdo:/dev/sdb jktcb2ndstg03p:/dev/sdp:/dev/sdb jktcb2ndstg03p:/dev/sdq:/dev/sdb jktcb2ndstg03p:/dev/sdr:/dev/sdb jktcb2ndstg03p:/dev/sds:/dev/sdb jktcb2ndstg03p:/dev/sdt:/dev/sdb jktcb2ndstg01p:/dev/sdu:/dev/sdc jktcb2ndstg01p:/dev/sdv:/dev/sdc jktcb2ndstg01p:/dev/sdw:/dev/sdc jktcb2ndstg01p:/dev/sdx:/dev/sdc jktcb2ndstg01p:/dev/sdy:/dev/sdc jktcb2ndstg01p:/dev/sdz:/dev/sdc jktcb2ndstg01p:/dev/sdaa:/dev/sdc jktcb2ndstg01p:/dev/sdab:/dev/sdc jktcb2ndstg02p:/dev/sdu:/dev/sdc jktcb2ndstg02p:/dev/sdv:/dev/sdc jktcb2ndstg02p:/dev/sdw:/dev/sdc jktcb2ndstg02p:/dev/sdx:/dev/sdc jktcb2ndstg02p:/dev/sdy:/dev/sdc jktcb2ndstg02p:/dev/sdz:/dev/sdc jktcb2ndstg02p:/dev/sdaa:/dev/sdc jktcb2ndstg02p:/dev/sdab:/dev/sdc jktcb2ndstg03p:/dev/sdu:/dev/sdc jktcb2ndstg03p:/dev/sdv:/dev/sdc jktcb2ndstg03p:/dev/sdw:/dev/sdc jktcb2ndstg03p:/dev/sdx:/dev/sdc jktcb2ndstg03p:/dev/sdy:/dev/sdc jktcb2ndstg03p:/dev/sdz:/dev/sdc jktcb2ndstg03p:/dev/sdaa:/dev/sdc jktcb2ndstg03p:/dev/sdab:/dev/sdc jktcb2ndstg01p:/dev/sdaf:/dev/sdac jktcb2ndstg01p:/dev/sdag:/dev/sdac jktcb2ndstg01p:/dev/sdah:/dev/sdac jktcb2ndstg01p:/dev/sdai:/dev/sdac jktcb2ndstg01p:/dev/sdaj:/dev/sdac jktcb2ndstg01p:/dev/sdak:/dev/sdac jktcb2ndstg01p:/dev/sdal:/dev/sdac jktcb2ndstg01p:/dev/sdam:/dev/sdac jktcb2ndstg01p:/dev/sdan:/dev/sdac jktcb2ndstg02p:/dev/sdaf:/dev/sdac jktcb2ndstg02p:/dev/sdag:/dev/sdac jktcb2ndstg02p:/dev/sdah:/dev/sdac jktcb2ndstg02p:/dev/sdai:/dev/sdac jktcb2ndstg02p:/dev/sdaj:/dev/sdac jktcb2ndstg02p:/dev/sdak:/dev/sdac jktcb2ndstg02p:/dev/sdal:/dev/sdac jktcb2ndstg02p:/dev/sdam:/dev/sdac jktcb2ndstg02p:/dev/sdan:/dev/sdac jktcb2ndstg03p:/dev/sdaf:/dev/sdac jktcb2ndstg03p:/dev/sdag:/dev/sdac jktcb2ndstg03p:/dev/sdah:/dev/sdac jktcb2ndstg03p:/dev/sdai:/dev/sdac jktcb2ndstg03p:/dev/sdaj:/dev/sdac jktcb2ndstg03p:/dev/sdak:/dev/sdac jktcb2ndstg03p:/dev/sdal:/dev/sdac jktcb2ndstg03p:/dev/sdam:/dev/sdac jktcb2ndstg03p:/dev/sdan:/dev/sdac jktcb2ndstg01p:/dev/sdao:/dev/sdad jktcb2ndstg01p:/dev/sdap:/dev/sdad jktcb2ndstg01p:/dev/sdaq:/dev/sdad jktcb2ndstg01p:/dev/sdar:/dev/sdad jktcb2ndstg01p:/dev/sdas:/dev/sdad jktcb2ndstg01p:/dev/sdat:/dev/sdad jktcb2ndstg01p:/dev/sdau:/dev/sdad jktcb2ndstg01p:/dev/sdav:/dev/sdad jktcb2ndstg02p:/dev/sdao:/dev/sdad jktcb2ndstg02p:/dev/sdap:/dev/sdad jktcb2ndstg02p:/dev/sdaq:/dev/sdad jktcb2ndstg02p:/dev/sdar:/dev/sdad jktcb2ndstg02p:/dev/sdas:/dev/sdad jktcb2ndstg02p:/dev/sdat:/dev/sdad jktcb2ndstg02p:/dev/sdau:/dev/sdad jktcb2ndstg02p:/dev/sdav:/dev/sdad jktcb2ndstg03p:/dev/sdao:/dev/sdad jktcb2ndstg03p:/dev/sdap:/dev/sdad jktcb2ndstg03p:/dev/sdaq:/dev/sdad jktcb2ndstg03p:/dev/sdar:/dev/sdad jktcb2ndstg03p:/dev/sdas:/dev/sdad jktcb2ndstg03p:/dev/sdat:/dev/sdad jktcb2ndstg03p:/dev/sdau:/dev/sdad jktcb2ndstg03p:/dev/sdav:/dev/sdad jktcb2ndstg01p:/dev/sdaw:/dev/sdae jktcb2ndstg01p:/dev/sdax:/dev/sdae jktcb2ndstg01p:/dev/sday:/dev/sdae jktcb2ndstg01p:/dev/sdaz:/dev/sdae jktcb2ndstg01p:/dev/sdba:/dev/sdae jktcb2ndstg01p:/dev/sdbb:/dev/sdae jktcb2ndstg01p:/dev/sdbc:/dev/sdae jktcb2ndstg01p:/dev/sdbd:/dev/sdae jktcb2ndstg02p:/dev/sdaw:/dev/sdae jktcb2ndstg02p:/dev/sdax:/dev/sdae jktcb2ndstg02p:/dev/sday:/dev/sdae jktcb2ndstg02p:/dev/sdaz:/dev/sdae jktcb2ndstg02p:/dev/sdba:/dev/sdae jktcb2ndstg02p:/dev/sdbb:/dev/sdae jktcb2ndstg02p:/dev/sdbc:/dev/sdae jktcb2ndstg02p:/dev/sdbd:/dev/sdae jktcb2ndstg03p:/dev/sdaw:/dev/sdae jktcb2ndstg03p:/dev/sdax:/dev/sdae jktcb2ndstg03p:/dev/sday:/dev/sdae jktcb2ndstg03p:/dev/sdaz:/dev/sdae jktcb2ndstg03p:/dev/sdba:/dev/sdae jktcb2ndstg03p:/dev/sdbb:/dev/sdae jktcb2ndstg03p:/dev/sdbc:/dev/sdae jktcb2ndstg03p:/dev/sdbd:/dev/sdae [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Deploying osd to jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdd journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdd /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdd1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:1859a9dd-c077-410c-940d-d58ca5043b91 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:f3b88ce3-c761-4066-a83e-925b984fc9f0 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdd [jktcb2ndstg01p][WARNIN] Warning: WARNING: the kernel failed to re-read the partition table on /dev/sdd (Device or resource busy). As a result, it may not reflect all of your changes until after reboot. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdd1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdd1 /var/lib/ceph/tmp/mnt.YFWo4m [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.YFWo4m [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdd [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sde journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sde /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sde1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:c43d575a-e90f-43f8-936c-9fe3847e2bf0 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:b39294cd-1388-4a06-a623-0cf8824670f8 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sde [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sde [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sde1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sde1 /var/lib/ceph/tmp/mnt.mLaE4J [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.mLaE4J [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sde [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sde [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sde [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdf journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdf /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdf1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:955812ee-4c82-4df6-9d15-e53b0831bafd --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e3883992-b675-4d18-a3c4-b10f910f8d9b --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdf1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdf1 /var/lib/ceph/tmp/mnt.U7r20O [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.U7r20O [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdf [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdg journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdg /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdg1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:6cb7bb9a-3100-410c-829f-7ab9156ff23b --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:66964290-462d-4190-ad94-9a43a2711501 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdg [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdg [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdg1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdg1 /var/lib/ceph/tmp/mnt.0gewnN [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.0gewnN [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdg [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdg [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdg [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdh journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdh /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdh1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:46110649-6bf9-40fb-bf6b-3bf24836875f --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:fd255341-4335-42f8-8429-66f9fa8867cd --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdh [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdh [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdh1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdh1 /var/lib/ceph/tmp/mnt.HemQvC [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.HemQvC [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdh [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdh [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdh [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdi journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdi /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdi1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:05480a14-32d4-4cdc-b88f-40a148436b23 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:221303ff-889d-465f-989e-916a41b07d14 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdi [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdi [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdi1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdi1 /var/lib/ceph/tmp/mnt.ImbiWy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.ImbiWy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdi [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdi [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdi [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdj journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdj /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdj1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:224c1368-8a69-4d9e-b72a-558d228addf5 --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:5344ed67-eb47-4281-9a56-5695b4faacd3 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdj1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdj1 /var/lib/ceph/tmp/mnt.2fyixR [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.2fyixR [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdj [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdk journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdk /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdk1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:1fbb0a96-4d51-405a-9f0f-6e4e2264d17a --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:f0092397-7066-482f-a036-c4cff5e6c535 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdk [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdk [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdk1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdk1 /var/lib/ceph/tmp/mnt.hHkSzN [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.hHkSzN [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdk [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdk [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdk [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdl journal /dev/sda activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdl /dev/sda [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 327680034 to 327682048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdl1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=9:0:+20000M --change-name=9:ceph journal --partition-guid=9:ac2d9464-9c5a-4e44-bf5a-3fcd57a886e2 --typecode=9:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 8 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:c8521ce0-2d59-4af0-81a7-3de882e54007 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdl1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdl1 /var/lib/ceph/tmp/mnt.AXT5j9 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.AXT5j9 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdl [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Deploying osd to jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdd journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdd /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdd1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:94bf9aa2-2ef5-455b-a898-331f20cc4939 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:3f3ee88d-84d5-4286-b792-13dfa2f4cf2d --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdd [jktcb2ndstg02p][WARNIN] Warning: WARNING: the kernel failed to re-read the partition table on /dev/sdd (Device or resource busy). As a result, it may not reflect all of your changes until after reboot. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdd1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdd1 /var/lib/ceph/tmp/mnt.RHe6ZF [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.RHe6ZF [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdd [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sde journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sde /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sde1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:535cfaec-7f22-441d-a74f-0ea7934b6dfb --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:aee917f1-6688-4c27-b8ba-78616fc7e2f2 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sde [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sde [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sde1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sde1 /var/lib/ceph/tmp/mnt.IQfXGP [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.IQfXGP [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sde [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sde [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sde [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdf journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdf /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdf1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:f565eceb-1ffc-4e19-aad7-cbe9548c84d7 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:3ccc1ac9-8032-4c12-af2f-18fcdf6303d2 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdf1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdf1 /var/lib/ceph/tmp/mnt.JL9jJV [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.JL9jJV [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdf [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdg journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdg /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdg1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:d70c1454-1874-407e-890f-026fec21737c --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:d9e47bff-4b03-4d0b-bf09-c848c893771f --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdg [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdg [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdg1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdg1 /var/lib/ceph/tmp/mnt.hyrPNd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.hyrPNd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdg [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdg [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdg [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdh journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdh /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdh1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:b1c8cfd0-31c3-4aef-8335-f6a106ae9b71 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:02dafd19-2afb-4229-a3dd-d751f5b933c6 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdh [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdh [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdh1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdh1 /var/lib/ceph/tmp/mnt.qp0tqQ [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.qp0tqQ [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdh [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdh [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdh [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdi journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdi /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdi1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:6b3cb28a-cb45-4293-bc11-971f323148f3 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:03e61e6d-479d-407e-9e1a-cede2f485889 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdi [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdi [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdi1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdi1 /var/lib/ceph/tmp/mnt.7R6c5L [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.7R6c5L [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdi [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdi [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdi [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdj journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdj /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdj1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:f453f7da-fbc1-4ea7-bfbd-a30d9eba5a2a --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:dab80154-a1d5-4854-b953-0b54760ed3b4 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdj1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdj1 /var/lib/ceph/tmp/mnt.V8nAqj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.V8nAqj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdj [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdk journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdk /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdk1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:f8c83868-281c-4924-90f9-85cd4dc1b574 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:da0dfd81-b161-49ad-b911-629cffe3e107 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdk1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdk1 /var/lib/ceph/tmp/mnt.hzKJmG [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.hzKJmG [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdk [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdl journal /dev/sda activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdl /dev/sda [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 327680034 to 327682048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdl1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=9:0:+20000M --change-name=9:ceph journal --partition-guid=9:659682d0-f764-41e8-8abb-8b840834ab28 --typecode=9:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 8 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:39246a8d-4682-456e-8dc8-684cc608b7b6 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdl [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdl [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdl1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdl1 /var/lib/ceph/tmp/mnt.bKyp47 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.bKyp47 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdl [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdl [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdl [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Deploying osd to jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdd journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdd /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdd1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:9c454e72-bb84-4104-8ade-921672883226 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:3917ddeb-5dee-4a30-a456-3afc3bc811e4 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdd [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdd [jktcb2ndstg03p][WARNIN] Warning: WARNING: the kernel failed to re-read the partition table on /dev/sdd (Device or resource busy). As a result, it may not reflect all of your changes until after reboot. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdd1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdd1 /var/lib/ceph/tmp/mnt.lvOhr7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.lvOhr7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdd [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdd [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdd [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sde journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sde /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sde1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:2424cb77-7077-4d8d-9f55-4b9404e8c98f --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e1228cb6-66ef-42b5-a473-fa6649988687 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sde [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sde [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sde1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sde1 /var/lib/ceph/tmp/mnt.80gDKb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.80gDKb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sde [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sde [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sde [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdf journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdf /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdf1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:507b5174-7ad6-4b6e-a422-5ae7f6802c16 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:f51c3d09-4e1a-4896-87d9-72305d86e914 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdf1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdf1 /var/lib/ceph/tmp/mnt.4VuiIv [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.4VuiIv [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdf [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdg journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdg /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdg1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:d2491f7e-ba76-4f3a-9387-21d680a707ec --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:caf28803-86a2-4306-a905-040f4dad301d --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdg [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdg [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdg1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdg1 /var/lib/ceph/tmp/mnt.qDuBFI [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.qDuBFI [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdg [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdg [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdg [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdh journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdh /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdh1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:bc9e42b7-0dce-4a4d-ac33-067976698fab --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:966ba5e5-0a24-4c68-80b7-96f3b12ae99a --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdh [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdh [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdh1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdh1 /var/lib/ceph/tmp/mnt.CvOL0K [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.CvOL0K [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdh [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdh [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdh [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdi journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdi /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdi1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:d0b1a759-535b-4ff6-b178-55bb8821410b --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:57f9b192-abff-4104-868c-90280ad7a0f8 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdi [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdi [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdi1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdi1 /var/lib/ceph/tmp/mnt.knm2uG [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.knm2uG [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdi [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdi [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdi [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdj journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdj /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdj1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:7695d8d3-043b-48b8-9b48-97ae72da616b --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:f22ece32-e881-4a0f-a576-920d3ead7ec8 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdj1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdj1 /var/lib/ceph/tmp/mnt.aXz83G [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.aXz83G [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdj [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdk journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdk /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdk1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:5ddb043e-023a-4dc8-ad22-0cabcac7d2b5 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:59b9ba37-7012-48b7-8b92-ba49b81709b3 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdk [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdk [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdk1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdk1 /var/lib/ceph/tmp/mnt.YzDgb0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.YzDgb0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdk [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdk [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdk [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdl journal /dev/sda activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdl /dev/sda [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 327680034 to 327682048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdl1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sda print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=9:0:+20000M --change-name=9:ceph journal --partition-guid=9:7bb79ac8-4d17-46bb-9b2f-2ffa10e38446 --typecode=9:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sda [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sda [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 8 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:fe5491af-7e62-460c-8c40-cc1c5480360a --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdl [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdl [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdl1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdl1 /var/lib/ceph/tmp/mnt.WcRAMK [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.WcRAMK [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdl [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdl [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdl [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdm journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdm /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdm1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:353efae7-a261-44f2-b193-cdf58f7f41c0 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:360ed9be-74c3-4ac8-8dbf-f551fc33d0d5 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdm [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdm [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdm1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdm1 /var/lib/ceph/tmp/mnt.6JkgVm [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.6JkgVm [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdm [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdm [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdm [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdn journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdn /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdn1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:fb99f69c-0039-40b5-a0eb-95a93f087d5c --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:dd6ec013-a35f-47bf-a7a0-4b0f7b582296 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdn [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdn [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdn1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdn1 /var/lib/ceph/tmp/mnt.YmnHY1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.YmnHY1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdn [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdn [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdn [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdo journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdo /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdo1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:8914d30e-d176-4410-87d2-3e5b933cd176 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:bb9fc725-bd18-49fd-98fa-f28d9a61bf15 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdo [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdo [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdo1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdo1 /var/lib/ceph/tmp/mnt.j0h2bo [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.j0h2bo [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdo [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdo [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdo [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdp journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdp /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdp1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:64281f2e-83ae-4415-9d57-5e739fc74a03 --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:28627a6f-dd1a-4f52-bb9a-4876e69e39f0 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdp [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdp [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdp1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdp1 /var/lib/ceph/tmp/mnt.jsXGAB [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.jsXGAB [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdp [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdp [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdp [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdq journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdq /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdq1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:6be084fd-6afc-4630-a8ac-97ba9b9f4158 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:a08621bd-ff6c-449b-99cd-40611b373b27 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdq1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdq1 /var/lib/ceph/tmp/mnt.teBIi9 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.teBIi9 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdq [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdr journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdr /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdr1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:79da6b3a-815b-4ddf-8f55-ad8186cb818f --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:5f5515e9-8b4b-4232-92f6-2a58a94dc5e9 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdr [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdr [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdr1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdr1 /var/lib/ceph/tmp/mnt.2vWxp_ [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.2vWxp_ [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdr [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdr [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdr [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sds journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sds /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sds1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:0f8f33eb-66cb-4779-bbd0-3463d306b8ee --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:265ed209-9d48-44e1-9258-adb877dd7561 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sds [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sds [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sds1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sds1 /var/lib/ceph/tmp/mnt.M3kSK7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.M3kSK7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sds [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sds [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sds [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdt journal /dev/sdb activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdt /dev/sdb [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdt1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:c3366253-b947-4d9e-8cf7-07d8e73cd89d --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:bf36641a-9794-46ca-91f9-a467d31f672f --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdt [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdt [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdt1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdt1 /var/lib/ceph/tmp/mnt.7vtscL [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.7vtscL [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdt [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdt [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdt [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdm journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdm /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdm1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:7a892d6a-a3ea-4f02-ba23-9131419a6ba0 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:13db3191-852b-4f3d-b85a-9bd27a5078de --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdm [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdm [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdm1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdm1 /var/lib/ceph/tmp/mnt.zK4un9 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.zK4un9 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdm [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdm [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdm [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdn journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdn /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdn1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:07e13837-a557-4125-9963-04abd6364961 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:31bc953c-7868-4d54-8f95-3baa23c186d3 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdn [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdn [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdn1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdn1 /var/lib/ceph/tmp/mnt.0Aj0FZ [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.0Aj0FZ [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdn [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdn [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdn [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdo journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdo /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdo1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:8e8b7f0d-f25d-4d3b-9594-c98f93a8948e --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:faf54dcb-d55a-4ae1-9e5e-f48592a8be02 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdo [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdo [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdo1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdo1 /var/lib/ceph/tmp/mnt.8YX0o_ [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.8YX0o_ [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdo [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdo [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdo [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdp journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdp /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdp1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:65a9525b-9407-4446-8cd8-f0208887adfc --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:16d6516a-08dc-4a99-92e7-9f810e5d91de --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdp [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdp [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdp1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdp1 /var/lib/ceph/tmp/mnt.VOKIml [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.VOKIml [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdp [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdp [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdp [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdq journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdq /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdq1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:bfca9d86-70d8-4502-b2c5-122f88a5f176 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e7a92cd0-ce51-4f1e-8342-369c8a403d8f --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdq1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdq1 /var/lib/ceph/tmp/mnt.i4jFov [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.i4jFov [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdq [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdr journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdr /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdr1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:80c86f0a-7615-433e-ab62-eb02c52b346c --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:2d2d29bf-6384-4691-aec6-8b2925fded7e --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdr [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdr [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdr1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdr1 /var/lib/ceph/tmp/mnt.JDkU3D [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.JDkU3D [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdr [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdr [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdr [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sds journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sds /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sds1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:f345c613-aef3-422e-ba5b-f924e4c7bfc5 --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:0dad4bc6-1377-4fff-9cbb-4de0b1ceca49 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sds [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sds [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sds1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sds1 /var/lib/ceph/tmp/mnt.1SVCsm [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.1SVCsm [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sds [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sds [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sds [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdt journal /dev/sdb activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdt /dev/sdb [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdt1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:010f81de-bb22-453a-a6f2-b9ad25a7bd82 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:368f967d-ab92-425d-900b-5734fd169734 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdt [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdt [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdt1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdt1 /var/lib/ceph/tmp/mnt.aPsD5c [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.aPsD5c [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdt [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdt [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdt [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdm journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdm /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdm1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:0865c932-86c8-478f-99a7-6556f906b668 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:51132962-11ba-4466-9a54-c228bab82a04 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdm [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdm [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdm1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdm1 /var/lib/ceph/tmp/mnt.kE2h9y [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.kE2h9y [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdm [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdm [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdm [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdn journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdn /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdn1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:5c36a99e-9522-4a36-ace7-19c754f62b84 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:279aaced-03f4-4f1c-9bd0-7ecea3163b73 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdn [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdn [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdn1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdn1 /var/lib/ceph/tmp/mnt.R3FDNl [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.R3FDNl [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdn [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdn [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdn [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdo journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdo /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdo1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:9752b498-166f-4981-8144-ecd28ea10d7d --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:037abf3e-35a7-4150-85a0-54405f0f04c5 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdo [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdo [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdo1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdo1 /var/lib/ceph/tmp/mnt.MhIVn8 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.MhIVn8 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdo [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdo [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdo [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdp journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdp /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdp1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:a9fe4f0c-8e7a-4ad4-91cd-15496e2194ef --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:3e622b75-9fd4-44af-a8ae-5efae22c4a52 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdp [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdp [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdp1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdp1 /var/lib/ceph/tmp/mnt.FfLuEu [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.FfLuEu [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdp [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdp [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdp [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdq journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdq /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdq1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:7ce38ee8-9395-42f5-9d0f-da4ae262c163 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:406eb6c3-bdfc-4236-a1d0-daac2e464e22 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdq1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdq1 /var/lib/ceph/tmp/mnt.u_UMnV [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.u_UMnV [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdq [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdr journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdr /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdr1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:c84616a6-89ad-4c5d-972d-b89933f24767 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:60599ed4-d674-4358-9a0d-f9629e37e953 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdr [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdr [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdr1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdr1 /var/lib/ceph/tmp/mnt.3khMTJ [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.3khMTJ [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdr [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdr [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdr [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sds journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sds /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sds1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:70bcd11c-3e26-4464-8204-c5a53249e49a --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:534a0440-adc6-40df-a690-cf37d61376e8 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sds [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sds [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sds1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sds1 /var/lib/ceph/tmp/mnt.OlH0UL [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.OlH0UL [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sds [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sds [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sds [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdt journal /dev/sdb activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdt /dev/sdb [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdt1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdb print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:bbe3132a-7d0c-4327-8111-a0b89b550df1 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:055e28e4-6d6f-4b38-b0a4-56f7e70f4891 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdt [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdt [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdt1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdt1 /var/lib/ceph/tmp/mnt.7BGsK3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.7BGsK3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdt [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdt [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdt [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdu journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdu /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdu1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:56491f1d-3b16-4518-b76f-4be34fac5dc0 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:af235d8a-5876-4c8f-bbc0-2cb3962a957f --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdu1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdu1 /var/lib/ceph/tmp/mnt.TeBxtS [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.TeBxtS [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdu [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdv journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdv /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdv1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:9b555366-4a98-45b0-b8ba-a3e2c017a494 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:83aabda3-88b3-4f89-b839-fb79b396d466 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdv [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdv [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdv1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdv1 /var/lib/ceph/tmp/mnt.oaooNu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.oaooNu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdv [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdv [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdv [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdw journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdw /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdw1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:c8a73978-3bea-46a4-99dc-897ba9e32a43 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e3839ffe-7d54-4916-8ec8-177f4b527810 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdw1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdw1 /var/lib/ceph/tmp/mnt.2bpixl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.2bpixl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdw [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdx journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdx /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdx1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:47b088b9-8270-473f-be84-5f9124df27b6 --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:1ad59aa3-4930-4a8f-ae5f-b9800c34a8bd --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdx [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdx [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdx1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdx1 /var/lib/ceph/tmp/mnt.zQraSl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.zQraSl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdx [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdx [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdx [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdy journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdy /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdy1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:b1cd700d-7838-4c62-b051-554659936eab --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:59bfeab3-6158-4a82-8461-c8ff1b25f5cb --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdy1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdy1 /var/lib/ceph/tmp/mnt.BiJBnc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.BiJBnc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdy [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdz journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdz /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdz1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:cf0549e4-fdbd-443d-9c53-4b56ac532e39 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:592ec023-57c0-4d6d-9427-2e4ba84aa7dc --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdz1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdz1 /var/lib/ceph/tmp/mnt.YtHafP [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.YtHafP [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdz [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdaa journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaa /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdaa1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:6f597555-2db5-40e5-bf31-dc30d0acff1e --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:54e9bbe3-d31b-4fb1-b0d8-9feb69a92b58 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaa [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaa [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaa1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaa1 /var/lib/ceph/tmp/mnt._n73KG [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt._n73KG [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaa [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaa [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaa [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdab journal /dev/sdc activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdab /dev/sdc [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdab1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:db6b9890-8a2e-495e-a46a-a4fa93828a68 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:b6fbc8ae-2865-4d08-a764-d59ed2b6b906 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdab [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdab [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdab1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdab1 /var/lib/ceph/tmp/mnt.9x8ccP [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.9x8ccP [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdab [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdab [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdab [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdu journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdu /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdu1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:f75b4caa-634d-4a64-84ef-e18560cf94e5 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:7a61f4a1-b08a-45f7-83d1-c8ce3e22eb05 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdu [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdu [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdu1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdu1 /var/lib/ceph/tmp/mnt.9T9pYy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.9T9pYy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdu [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdu [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdu [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdv journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdv /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdv1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:ace46026-2a48-476b-832b-00b1a5ff0020 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:9380f199-345c-4069-992b-3ba2242537ad --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdv [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdv [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdv1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdv1 /var/lib/ceph/tmp/mnt.M5eGt0 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.M5eGt0 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdv [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdv [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdv [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdw journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdw /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdw1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:2fac9116-8b4d-48a4-8e23-e36ab0bbc079 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:69b6a0de-a325-47eb-9cf7-43d3f3ab9ca7 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdw1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdw1 /var/lib/ceph/tmp/mnt.jLZMZp [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.jLZMZp [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdw [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdx journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdx /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdx1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:30b7c61c-38a6-4e34-a580-a61baa4345b2 --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:db2be7ff-7237-4400-8465-c16614d2a555 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdx [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdx [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdx1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdx1 /var/lib/ceph/tmp/mnt.vuDs0x [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.vuDs0x [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdx [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdx [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdx [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdy journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdy /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdy1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:0e6c25d1-0286-4faa-8d23-69dadb9d9272 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:ef7a6cdf-b0be-4b3b-8dc5-c6705625a590 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdy1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdy1 /var/lib/ceph/tmp/mnt.cJeeM5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.cJeeM5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdy [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdz journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdz /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdz1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:f321fe18-b9fd-4c4e-8667-312eebe004b4 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:58be1e1b-c08a-4d23-85db-4adb56b27e58 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdz1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdz1 /var/lib/ceph/tmp/mnt.8v7MDk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.8v7MDk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdz [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdaa journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaa /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdaa1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:6123aef6-c44e-4861-8c6f-2342ae662fab --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:da673610-7852-46e9-8266-3f05986a72d3 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaa [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaa [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaa1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaa1 /var/lib/ceph/tmp/mnt.RTcuSo [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.RTcuSo [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaa [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaa [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaa [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdab journal /dev/sdc activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdab /dev/sdc [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdab1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:8d5b3d31-1d27-4984-bafb-793ba9d3c8f9 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:2c9437f2-162b-45b4-a6c3-5accf0c077a0 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdab [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdab [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdab1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdab1 /var/lib/ceph/tmp/mnt.S1i8NM [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.S1i8NM [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdab [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdab [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdab [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdu journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdu /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdu1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:23141b7f-29fd-4d68-81cf-5c63a1829888 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:671d70d0-7c6f-4a40-9396-f21f6499f129 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdu [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdu [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdu1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdu1 /var/lib/ceph/tmp/mnt.kei53z [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.kei53z [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdu [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdu [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdu [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdv journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdv /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdv1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:b8e63c9a-3b01-439d-9882-8c858a60f7ce --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e0365888-3efd-4481-a697-a3f93c71e3c1 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdv [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdv [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdv1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdv1 /var/lib/ceph/tmp/mnt.uDEAML [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.uDEAML [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdv [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdv [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdv [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdw journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdw /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdw1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:4bbcc35d-4ab4-47a1-8585-8cb41fac15ec --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:0fbdd408-629a-4005-a59e-67d104af65f6 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdw1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdw1 /var/lib/ceph/tmp/mnt.Bcz2G0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.Bcz2G0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdw [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdx journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdx /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdx1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:4608276c-9550-423a-8b2d-521f23b9c79a --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:6613eb94-4223-44e8-ab00-ac2ddbe5d1a5 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdx [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdx [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdx1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdx1 /var/lib/ceph/tmp/mnt.WKuLYK [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.WKuLYK [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdx [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdx [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdx [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdy journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdy /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdy1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:5af03b78-b179-407f-839b-057d967f326d --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:869c012d-ac44-4686-9186-94d0a2df71c5 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdy [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdy [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdy1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdy1 /var/lib/ceph/tmp/mnt.GbcPAJ [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.GbcPAJ [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdy [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdy [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdy [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdz journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdz /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdz1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:aea7d88d-eef9-4145-8274-31d696e44585 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:6185380e-f154-4cc3-a1b5-bdf3bebffef2 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdz1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdz1 /var/lib/ceph/tmp/mnt.m2m1B5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.m2m1B5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdz [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdaa journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaa /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdaa1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:804b1c55-de10-4c66-b48a-0d5f5bfe1c78 --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:a5573982-1de2-4fee-8d67-ba20b3a0d7d0 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaa [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaa [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaa1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaa1 /var/lib/ceph/tmp/mnt.39YhZ0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.39YhZ0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaa [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaa [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaa [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdab journal /dev/sdc activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdab /dev/sdc [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdab1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdc print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:aa9533c9-d257-41c9-8732-ae72d4a46400 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:038e7ca2-8cb3-45c4-8a9c-e99eacfeccf5 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdab [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdab [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdab1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdab1 /var/lib/ceph/tmp/mnt.fbWjFC [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.fbWjFC [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdab [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdab [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdab [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdaf journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaf /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdaf1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:59b7b554-e777-42d3-8ad3-314ee9a0c482 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:802b5668-ae54-44e3-b3c7-1b503f571839 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaf1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaf1 /var/lib/ceph/tmp/mnt.XSAXPw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.XSAXPw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaf [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdag journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdag /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdag1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:e5317c12-a113-4aa2-b302-3d33766ca982 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:39b7ae9a-37d3-41d1-b790-644b33c4e3ff --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdag [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdag [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdag1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdag1 /var/lib/ceph/tmp/mnt.knLCnM [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.knLCnM [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdag [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdag [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdag [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdah journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdah /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdah1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:16c8e25a-daf4-40f9-8216-03ab53fc5c33 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:c62dbf05-ab16-4cc9-b512-c9fdd205ecff --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdah [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdah [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdah1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdah1 /var/lib/ceph/tmp/mnt.tifuna [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.tifuna [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdah [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdah [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdah [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdai journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdai /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdai1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:548b4403-19b9-4e7f-8b8f-4cf47c8fafc6 --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e5ae202f-7abd-4181-ba78-b015faeb8de9 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdai [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdai [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdai1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdai1 /var/lib/ceph/tmp/mnt.HIeKHb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.HIeKHb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdai [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdai [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdai [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdaj journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaj /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdaj1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:48e46ece-17a4-4e01-9f18-bd1bc4483d6f --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:7dc0f6e9-57c2-444a-8148-1fed310a1a0f --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaj1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaj1 /var/lib/ceph/tmp/mnt.U5oTpI [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.U5oTpI [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaj [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaj [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdak journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdak /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdak1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:d4ca317c-614f-4329-8ad3-48061fec89e5 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:f5d90e21-2803-4ee4-b294-e71ea9f3e96b --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdak [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdak [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdak1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdak1 /var/lib/ceph/tmp/mnt.PeyTuP [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.PeyTuP [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdak [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdak [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdak [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdal journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdal /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdal1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:a24ef040-11ec-4a28-8f00-2607c226bd7e --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:54ad19e7-7b59-4471-ad5d-097052f461e0 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdal [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdal [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdal1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdal1 /var/lib/ceph/tmp/mnt.mmFa_M [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.mmFa_M [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdal [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdal [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdal [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdam journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdam /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdam1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:0d7da3b6-219a-4d30-9130-56988e824fe2 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:b248a6ee-f399-421e-84b7-32015303e8c3 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdam [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdam [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdam1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdam1 /var/lib/ceph/tmp/mnt.eNkMIf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.eNkMIf [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdam [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdam [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdam [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdan journal /dev/sdac activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdan /dev/sdac [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 327680034 to 327682048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdan1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=9:0:+20000M --change-name=9:ceph journal --partition-guid=9:a0cabea5-4a6e-49f5-9914-25b79cd92923 --typecode=9:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 8 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:021c41d3-57ef-4102-9060-570164010a95 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdan [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdan [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdan1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdan1 /var/lib/ceph/tmp/mnt.THCytu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.THCytu [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdan [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdan [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdan [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdaf journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaf /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdaf1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:0da1080b-bfa3-43bb-a0cc-f71141c60981 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:74749bb3-dcd9-458e-b763-f19c3fac1e3a --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaf1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaf1 /var/lib/ceph/tmp/mnt.N9pamb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.N9pamb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaf [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdag journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdag /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdag1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:b337f489-20ce-4c27-971a-d69ae8938f82 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:a6d27cf5-32f3-4121-8b48-1e53b77f760c --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdag [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdag [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdag1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdag1 /var/lib/ceph/tmp/mnt.hywPye [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.hywPye [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdag [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdag [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdag [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdah journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdah /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdah1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:7bb670db-56fe-4423-87b6-c2135a508237 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:b37b6f52-680c-4d89-af91-29715465133f --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdah [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdah [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdah1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdah1 /var/lib/ceph/tmp/mnt.60wIqv [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.60wIqv [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdah [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdah [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdah [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdai journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdai /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdai1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:ab6f36b1-568e-4849-b946-3ef85618520a --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:5c357bad-595a-4c38-8f58-cd39de2711b1 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdai [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdai [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdai1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdai1 /var/lib/ceph/tmp/mnt.Dpx688 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.Dpx688 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdai [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdai [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdai [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdaj journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaj /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdaj1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:acc70d18-dc0e-4581-bb44-9a5a7db96aed --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:4a903b04-25e4-4a46-975a-ba868cb0b3ec --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaj1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaj1 /var/lib/ceph/tmp/mnt.H__v00 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.H__v00 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaj [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaj [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdak journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdak /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdak1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:ee0b14e4-5d75-4a21-af28-642b10a3b486 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:29a9ff57-d9ae-4fc8-9fcc-8b6ac3689222 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdak [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdak [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdak1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdak1 /var/lib/ceph/tmp/mnt.1VdGpP [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.1VdGpP [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdak [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdak [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdak [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdal journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdal /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdal1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:bbfa35a4-f570-400f-bf0c-aa7fe18da66d --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:be0c52ad-52d5-4ccf-b13f-dff872b69277 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdal [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdal [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdal1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdal1 /var/lib/ceph/tmp/mnt.oFqp6I [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.oFqp6I [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdal [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdal [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdal [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdam journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdam /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdam1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:88db7f61-e705-4dd0-86fc-a148ff5063aa --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:b56bc89c-aca7-4845-8e8f-29298a0b886b --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdam [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdam [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdam1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdam1 /var/lib/ceph/tmp/mnt.w1OOvk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.w1OOvk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdam [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdam [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdam [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdan journal /dev/sdac activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdan /dev/sdac [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 327680034 to 327682048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdan1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=9:0:+20000M --change-name=9:ceph journal --partition-guid=9:734f1b47-32d1-49fe-a721-474f279717d3 --typecode=9:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 8 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:40e6e19d-3385-41b4-9199-49d1e8314fcc --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdan [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdan [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdan1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdan1 /var/lib/ceph/tmp/mnt.vVe2Fh [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.vVe2Fh [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdan [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdan [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdan [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdaf journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaf /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdaf1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:220754be-3dec-4de7-8baa-c322118a0540 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:d6fe9768-f969-418d-9ccf-c5ad2e496438 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaf1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaf1 /var/lib/ceph/tmp/mnt.1m3mDL [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.1m3mDL [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaf [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdag journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdag /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdag1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:0a0f6048-6257-4884-8b74-875d1bc0f341 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e1800ba9-023d-4cc6-ac80-db130d72d017 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdag [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdag [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdag1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdag1 /var/lib/ceph/tmp/mnt.2OBlQz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.2OBlQz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdag [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdag [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdag [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdah journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdah /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdah1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:e13ba7c3-5d89-45c8-b700-dc0c6bd4d191 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:96dd19a9-42f2-429d-9ce4-8645a6d5fd1c --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdah [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdah [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdah1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdah1 /var/lib/ceph/tmp/mnt.v2Z3lN [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.v2Z3lN [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdah [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdah [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdah [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdai journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdai /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdai1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:e0927e3a-f44b-40bb-853a-d055b143f9f7 --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:8b4777ad-4cfd-4756-b7e0-cbfe0430694f --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdai [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdai [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdai1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdai1 /var/lib/ceph/tmp/mnt.k6tagP [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.k6tagP [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdai [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdai [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdai [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdaj journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaj /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdaj1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:f9354062-34b5-4c07-917f-5a0f54d71f5b --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:2d29d0f7-ce06-465d-a328-b48de66007e6 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaj1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaj1 /var/lib/ceph/tmp/mnt.GhcHn9 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.GhcHn9 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaj [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaj [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdak journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdak /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdak1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:fe367ebe-978c-4bad-be4a-2d11b6801b5d --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:41bdd9dc-6b3f-4a52-8b13-6504d2deb6dc --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdak [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdak [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdak1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdak1 /var/lib/ceph/tmp/mnt.r7Qsz1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.r7Qsz1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdak [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdak [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdak [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdal journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdal /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdal1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:cace200f-5b12-418e-9987-92bbbf66921a --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:9ebcf40b-408b-4172-8e9e-5a03e0eb7e41 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdal [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdal [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdal1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdal1 /var/lib/ceph/tmp/mnt.4e_w8Q [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.4e_w8Q [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdal [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdal [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdal [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdam journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdam /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdam1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:1bacc4af-b4cb-4aae-bfde-01efb85c89ae --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:67a48c51-16dc-4a8c-8b16-2bb79bfa0257 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdam [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdam [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdam1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdam1 /var/lib/ceph/tmp/mnt.S7lLN3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.S7lLN3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdam [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdam [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdam [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdan journal /dev/sdac activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdan /dev/sdac [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 327680034 to 327682048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdan1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdac print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=9:0:+20000M --change-name=9:ceph journal --partition-guid=9:05fbc3fe-f248-4f52-8a93-2a88cb8ad56b --typecode=9:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdac [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdac [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 8 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:4461fdfc-7a50-4b06-8470-1c317daa38bd --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdan [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdan [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdan1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdan1 /var/lib/ceph/tmp/mnt.AnyN2J [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.AnyN2J [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdan [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdan [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdan [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdao journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdao /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdao1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:ad57c81e-8fb4-4c2e-bb90-eda4e53c777b --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e42a3900-7a94-4f71-aa0d-40ceb2829d68 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdao [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdao [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdao1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdao1 /var/lib/ceph/tmp/mnt.QWxIzn [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.QWxIzn [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdao [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdao [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdao [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdap journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdap /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdap1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:04695843-6c65-420d-a63f-f648a8123531 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:720fbc82-fcf5-4754-bc61-7c04129c5d13 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdap [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdap [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdap1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdap1 /var/lib/ceph/tmp/mnt.vTMpE4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.vTMpE4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdap [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdap [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdap [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdaq journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaq /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdaq1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:17fd28ab-35e5-4fdf-9bb2-3845e8c008c2 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:7a9bf923-d8a3-4359-b0e9-bd12564623ce --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaq1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaq1 /var/lib/ceph/tmp/mnt.oHxVGk [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.oHxVGk [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaq [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaq [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdar journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdar /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdar1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:08a69a37-4b04-4aad-8b55-c0b7c8cbf81c --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:1b370ac4-dc89-4522-8776-243ba807670e --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdar [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdar [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdar1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdar1 /var/lib/ceph/tmp/mnt.MDVr9a [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.MDVr9a [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdar [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdar [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdar [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdas journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdas /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdas1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:3fc5ce42-0863-40a1-b94b-52288867c5d9 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:61e432e1-1873-495a-9424-ef31977370df --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdas [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdas [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdas1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdas1 /var/lib/ceph/tmp/mnt.3ULwTC [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.3ULwTC [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdas [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdas [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdas [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdat journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdat /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdat1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:0e962d6d-ed73-433f-abdd-9886f178e4ea --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:74240818-f571-4147-9768-910d83a5ac05 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdat [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdat [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdat1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdat1 /var/lib/ceph/tmp/mnt.jCi2tl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.jCi2tl [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdat [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdat [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdat [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdau journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdau /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdau1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:093fd9a3-0cad-486f-a58c-70fd4b8d199c --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:6156250e-a801-45eb-a3c4-911c98723755 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdau [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdau [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdau1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdau1 /var/lib/ceph/tmp/mnt.sKeboZ [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.sKeboZ [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdau [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdau [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdau [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdav journal /dev/sdad activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdav /dev/sdad [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdav1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:9a92ea2c-9251-4097-b4b6-bba84058d7de --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:8c449085-a359-498c-9836-c76e9dfd71e8 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdav [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdav [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdav1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdav1 /var/lib/ceph/tmp/mnt.QZ552n [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.QZ552n [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdav [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdav [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdav [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdao journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdao /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdao1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:49fcff29-72b3-41bd-848a-38720946e791 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:740a0816-26d9-465c-b5f1-9814cbe60473 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdao [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdao [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdao1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdao1 /var/lib/ceph/tmp/mnt.ayFmGI [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.ayFmGI [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdao [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdao [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdao [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdap journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdap /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdap1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:8f70e42f-a762-44d4-ad0b-ba43be68ab91 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:30585bcf-aa02-449b-a503-af0f67635c99 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdap [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdap [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdap1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdap1 /var/lib/ceph/tmp/mnt.5Yux6i [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.5Yux6i [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdap [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdap [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdap [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdaq journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaq /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdaq1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:7b52106b-d50a-45d5-977a-4e5b9139d6e2 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:632a318a-5604-4bbd-bbbf-1e775c4e2b76 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaq1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaq1 /var/lib/ceph/tmp/mnt.1kpmHd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.1kpmHd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaq [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaq [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdar journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdar /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdar1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:bb418a60-fa63-42ae-9c64-36be7224c69c --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e4dccc25-3617-4018-8835-a4644b50c5f1 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdar [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdar [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdar1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdar1 /var/lib/ceph/tmp/mnt.jEtKpf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.jEtKpf [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdar [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdar [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdar [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdas journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdas /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdas1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:d1bdf982-4426-4b21-9071-6b137b975ae6 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:9feb8137-e578-46e4-9158-353fc9902099 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdas [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdas [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdas1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdas1 /var/lib/ceph/tmp/mnt.282RcE [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.282RcE [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdas [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdas [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdas [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdat journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdat /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdat1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:83d5410e-e7a0-4f29-9432-b9923b4b994e --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:eb59e951-38db-4931-b435-b3d43269ad06 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdat [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdat [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdat1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdat1 /var/lib/ceph/tmp/mnt.tbTNH1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.tbTNH1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdat [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdat [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdat [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdau journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdau /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdau1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:df8212bb-36e4-49a4-90f9-e0b3224d35a0 --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:60050768-f14c-4bae-bb4d-7ed9ca9987e7 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdau [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdau [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdau1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdau1 /var/lib/ceph/tmp/mnt.V4DFwe [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.V4DFwe [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdau [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdau [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdau [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdav journal /dev/sdad activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdav /dev/sdad [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdav1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:1e9c99fe-fc02-489c-8b88-3b398a0ec4fd --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:0e211a71-d0db-4a4b-a854-ab3b1578989c --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdav [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdav [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdav1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdav1 /var/lib/ceph/tmp/mnt.zri4cy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.zri4cy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdav [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdav [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdav [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdao journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdao /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdao1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:fba3c5f7-02d1-42e8-974b-37fab8bc8800 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:33b07107-c1dd-4daf-a8e1-c46c23cdd648 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdao [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdao [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdao1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdao1 /var/lib/ceph/tmp/mnt.ni7lE0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.ni7lE0 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdao [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdao [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdao [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdap journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdap /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdap1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:2015c55f-cce9-4912-ab4e-53fafeedc9a7 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:95fb42ea-f7fc-4ba7-9160-66aba13389da --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdap [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdap [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdap1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdap1 /var/lib/ceph/tmp/mnt.1NyhlO [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.1NyhlO [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdap [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdap [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdap [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdaq journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaq /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdaq1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:d3a47528-1b1b-4e5a-936d-d949d37a1876 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:8d32ce2c-d77d-4db4-8cee-7a4fdddbf717 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaq1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaq1 /var/lib/ceph/tmp/mnt.Z9G5_J [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.Z9G5_J [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaq [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaq [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdar journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdar /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdar1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:bb2481ec-a8fc-4450-8345-3ee954bd193b --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:d5eabbf2-fe87-4804-97cb-802c8aca2fd6 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdar [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdar [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdar1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdar1 /var/lib/ceph/tmp/mnt.o0CSZF [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.o0CSZF [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdar [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdar [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdar [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdas journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdas /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdas1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:c0073ecb-61a0-413d-ada6-37edcf7cbf52 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:780b027b-f084-41e9-850e-189417f2fe53 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdas [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdas [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdas1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdas1 /var/lib/ceph/tmp/mnt.Hr7rJ3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.Hr7rJ3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdas [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdas [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdas [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdat journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdat /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdat1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:66c0337f-aa50-4e61-9499-2b9025f96a22 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:35d38d75-9756-44ec-8156-6908bb4f3c62 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdat [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdat [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdat1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdat1 /var/lib/ceph/tmp/mnt.glCA8F [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.glCA8F [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdat [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdat [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdat [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdau journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdau /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdau1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:5ade468c-5de7-4a40-b56a-c87836ce992f --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:8b8e2bf6-926c-4465-9f6a-0a2bbd518326 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdau [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdau [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdau1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdau1 /var/lib/ceph/tmp/mnt.BUnfRw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.BUnfRw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdau [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdau [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdau [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdav journal /dev/sdad activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdav /dev/sdad [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdav1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdad print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:9bff8a89-3180-46d7-84f7-d57617c687e2 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdad [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdad [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:1a253057-dd6c-4d14-a202-0300862d5d16 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdav [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdav [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdav1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdav1 /var/lib/ceph/tmp/mnt.uCy1Sf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.uCy1Sf [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdav [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdav [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdav [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdaw journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaw /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdaw1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:6dcfc74b-3c20-489b-bdf4-7708ce458928 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:403a8f61-92a5-4842-adc0-9c7303b8cd2c --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaw1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaw1 /var/lib/ceph/tmp/mnt.wG_XeO [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.wG_XeO [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaw [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaw [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdax journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdax /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdax1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:baad6505-4607-4407-81e6-97632dc02201 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:5810d709-69ca-4ded-b240-dba7b1a65816 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdax [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdax [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdax1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdax1 /var/lib/ceph/tmp/mnt.p1xFtb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.p1xFtb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdax [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdax [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdax [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sday journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sday /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sday1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:1eb0e619-380c-481c-a0e7-1d027db8bccc --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:41bf6d8c-4371-4b66-931e-854366f5c9dd --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sday [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sday [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sday1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sday1 /var/lib/ceph/tmp/mnt.jgRTY6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.jgRTY6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sday [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sday [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sday [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdaz journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaz /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdaz1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:c29a2965-e6a3-4ba7-b1d7-c8b3e5d4afee --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:bb59a04d-1b0e-4997-b371-21872268febc --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaz1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaz1 /var/lib/ceph/tmp/mnt.SyDhrV [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.SyDhrV [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaz [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaz [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdba journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdba /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdba1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:49f3ce3c-b539-494f-a0ef-cb3001848e14 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:7a35fece-dbdf-4d2d-a26d-2fd8dca5ed51 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdba [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdba [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdba1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdba1 /var/lib/ceph/tmp/mnt.Lzxugx [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.Lzxugx [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdba [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdba [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdba [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdbb journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbb /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdbb1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:664cae5d-d7ad-479c-ac68-0b4c0fe3f548 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:cd322867-26ce-4439-a024-7c474431b705 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbb1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbb1 /var/lib/ceph/tmp/mnt.7J9D48 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.7J9D48 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbb [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbb [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdbc journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbc /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdbc1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:fa6584cc-7934-48ab-b560-e971e154dcc8 --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:abb6958c-448b-4cd4-b306-66baa554b39a --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbc1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbc1 /var/lib/ceph/tmp/mnt.D5mcRy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.D5mcRy [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbc [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbc [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg01p disk /dev/sdbd journal /dev/sdae activate True [jktcb2ndstg01p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbd /dev/sdae [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg01p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg01p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][DEBUG ] meta-data=/dev/sdbd1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg01p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg01p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg01p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg01p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg01p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg01p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg01p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg01p][DEBUG ] The operation has completed successfully. [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg01p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:a6b09fb2-12ae-486d-ab5a-7db439084808 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 2 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 3 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 4 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 5 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 6 [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 7 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:3139ba2c-dc8d-4ee8-bbc5-3156d55d914a --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbd1 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbd1 /var/lib/ceph/tmp/mnt._0gBh5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt._0gBh5 [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbd [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg01p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbd [jktcb2ndstg01p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg01p][WARNIN] error adding partition 1 [jktcb2ndstg01p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg01p][INFO ] checking OSD status... [jktcb2ndstg01p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg01p][WARNIN] there is 1 OSD down [jktcb2ndstg01p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg01p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdaw journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaw /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdaw1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:26e21e4c-d3ed-4b25-aabb-d7efbf62aac7 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:9779a279-86e2-46a4-93b8-767c2c906309 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaw1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaw1 /var/lib/ceph/tmp/mnt.610svD [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.610svD [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaw [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaw [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdax journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdax /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdax1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:a20a7bc5-1e69-4a4b-b74c-111644a1e43c --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:59addf92-521d-4e0c-9c79-e7fc31230dad --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdax [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdax [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdax1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdax1 /var/lib/ceph/tmp/mnt.GDZ51C [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.GDZ51C [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdax [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdax [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdax [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sday journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sday /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sday1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:5b30ba9b-826a-4a40-8154-feb712d00b0a --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:5ff7655a-bd9b-4aa9-870c-2f12c0e9a8c7 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sday [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sday [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sday1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sday1 /var/lib/ceph/tmp/mnt.iALhJk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.iALhJk [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sday [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sday [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sday [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdaz journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaz /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdaz1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:467cf5b9-8c6c-4fe5-8f86-c8b9de2a59cf --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:c6a0a137-7533-4873-9157-a4bf9df4cba0 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaz1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaz1 /var/lib/ceph/tmp/mnt.OuGLBF [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.OuGLBF [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaz [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaz [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdba journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdba /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdba1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:546d4503-dee1-46cb-bbee-130751ec0135 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:18e2673a-0230-4dfe-98d4-eeff79fe2dd4 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdba [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdba [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdba1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdba1 /var/lib/ceph/tmp/mnt.PHCQfy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.PHCQfy [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdba [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdba [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdba [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdbb journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbb /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdbb1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:0e02e4f8-fbdc-430e-9d17-24d6a4bdde84 --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:1cfa60a7-97ee-43f4-8e64-9de8bba77b68 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbb1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbb1 /var/lib/ceph/tmp/mnt.zg9IVS [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.zg9IVS [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbb [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbb [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdbc journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbc /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdbc1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:4ca079bd-043d-4391-9988-d99c11c11707 --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:559d87bf-bb07-4840-a9a7-5e3b43932614 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbc1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbc1 /var/lib/ceph/tmp/mnt.K1eSfN [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.K1eSfN [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbc [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbc [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg02p][WARNIN] there is 1 OSD down [jktcb2ndstg02p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg02p disk /dev/sdbd journal /dev/sdae activate True [jktcb2ndstg02p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbd /dev/sdae [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg02p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg02p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][DEBUG ] meta-data=/dev/sdbd1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg02p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg02p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg02p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg02p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg02p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg02p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg02p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg02p][DEBUG ] The operation has completed successfully. [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg02p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:c480cf2f-832d-47a5-803f-3b267ba1e0a1 --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 2 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 3 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 4 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 5 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 6 [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 7 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:9c5da6b5-faf4-4396-b678-9fd67b771eec --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbd1 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbd1 /var/lib/ceph/tmp/mnt.0tUl72 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.0tUl72 [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbd [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg02p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbd [jktcb2ndstg02p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg02p][WARNIN] error adding partition 1 [jktcb2ndstg02p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg02p][INFO ] checking OSD status... [jktcb2ndstg02p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg02p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdaw journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaw /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdaw1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=1:0:+20000M --change-name=1:ceph journal --partition-guid=1:ebf15ead-d947-4fc3-8056-796ecbdc1068 --typecode=1:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:464e950b-3680-4a45-a21a-7f0a797be735 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaw1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaw1 /var/lib/ceph/tmp/mnt.s10O4W [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.s10O4W [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaw [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaw [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdax journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdax /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 40960034 to 40962048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdax1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=2:0:+20000M --change-name=2:ceph journal --partition-guid=2:fcb4b73a-8048-4f67-a984-cf14ee6099a5 --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:cba6a961-b852-48c8-89b2-0931cc03ae57 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdax [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdax [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdax1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdax1 /var/lib/ceph/tmp/mnt.8W1mrI [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.8W1mrI [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdax [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdax [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdax [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sday journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sday /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 81920034 to 81922048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sday1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=3:0:+20000M --change-name=3:ceph journal --partition-guid=3:4dab0193-96c1-496b-8f8d-9d3985d71804 --typecode=3:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:6e0c8c68-ccb6-459b-b083-e44940931f95 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sday [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sday [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sday1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sday1 /var/lib/ceph/tmp/mnt.IHbXeV [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.IHbXeV [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sday [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sday [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sday [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdaz journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdaz /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 122880034 to 122882048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdaz1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=4:0:+20000M --change-name=4:ceph journal --partition-guid=4:8259f995-aab5-41fb-bdc7-162a3fad27d2 --typecode=4:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:8f15701d-eb8d-4c86-a549-127b8c147da7 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdaz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdaz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdaz1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdaz1 /var/lib/ceph/tmp/mnt.83zN0j [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.83zN0j [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdaz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdaz [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdaz [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdba journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdba /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 163840034 to 163842048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdba1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=5:0:+20000M --change-name=5:ceph journal --partition-guid=5:43fff5a8-431d-498e-aca6-f3aa19259826 --typecode=5:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:11a310c5-22a4-470f-9d5b-7eec4811a7f8 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdba [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdba [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdba1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdba1 /var/lib/ceph/tmp/mnt.nUQcPg [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.nUQcPg [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdba [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdba [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdba [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdbb journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbb /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 204800034 to 204802048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdbb1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=6:0:+20000M --change-name=6:ceph journal --partition-guid=6:7844e46e-b0d7-41c5-b318-1b2be898cc9b --typecode=6:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:af17b2db-df25-4767-87ce-61ea29417abe --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbb1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbb1 /var/lib/ceph/tmp/mnt.uMPXLO [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.uMPXLO [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbb [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbb [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [jktcb2ndstg03p][WARNIN] there is 1 OSD down [jktcb2ndstg03p][WARNIN] there is 1 OSD out [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdbc journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbc /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 245760034 to 245762048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdbc1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=7:0:+20000M --change-name=7:ceph journal --partition-guid=7:31ae8d65-988f-4c53-987e-0a4743c2bfb2 --typecode=7:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:98842223-bae2-4d73-89e0-3a940a1fe30a --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbc1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbc1 /var/lib/ceph/tmp/mnt.7tXZyc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.7tXZyc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbc [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbc [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [ceph_deploy.osd][INFO ] Distro info: CentOS 6.5 Final [ceph_deploy.osd][DEBUG ] Preparing host jktcb2ndstg03p disk /dev/sdbd journal /dev/sdae activate True [jktcb2ndstg03p][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdbd /dev/sdae [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 286720034 to 286722048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] Warning: The kernel is still using the old partition table. [jktcb2ndstg03p][DEBUG ] The new table will be used at the next reboot. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] Information: Moved requested sector from 34 to 2048 in [jktcb2ndstg03p][DEBUG ] order to align on 2048-sector boundaries. [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][DEBUG ] meta-data=/dev/sdbd1 isize=2048 agcount=32, agsize=7630950 blks [jktcb2ndstg03p][DEBUG ] = sectsz=4096 attr=2, projid32bit=0 [jktcb2ndstg03p][DEBUG ] data = bsize=4096 blocks=244190385, imaxpct=25 [jktcb2ndstg03p][DEBUG ] = sunit=0 swidth=0 blks [jktcb2ndstg03p][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0 [jktcb2ndstg03p][DEBUG ] log =internal log bsize=4096 blocks=119233, version=2 [jktcb2ndstg03p][DEBUG ] = sectsz=4096 sunit=1 blks, lazy-count=1 [jktcb2ndstg03p][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0 [jktcb2ndstg03p][DEBUG ] The operation has completed successfully. [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/parted --machine -- /dev/sdae print [jktcb2ndstg03p][WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --new=8:0:+20000M --change-name=8:ceph journal --partition-guid=8:5c82c632-abc8-426a-b65a-e52caf530e7e --typecode=8:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdae [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdae [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 2 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 3 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 4 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 5 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 6 [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 7 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:db575139-d618-45a4-8892-2f002fc0cd80 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be -- /dev/sdbd [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdbd [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/udevadm settle [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdbd1 [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdbd1 /var/lib/ceph/tmp/mnt.ZdBgeR [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.ZdBgeR [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /usr/sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdbd [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:calling partx on prepared device /dev/sdbd [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:re-reading known partitions will display errors [jktcb2ndstg03p][WARNIN] INFO:ceph-disk:Running command: /sbin/partx -a /dev/sdbd [jktcb2ndstg03p][WARNIN] BLKPG: Device or resource busy [jktcb2ndstg03p][WARNIN] error adding partition 1 [jktcb2ndstg03p][INFO ] Running command: udevadm trigger --subsystem-match=block --action=add [jktcb2ndstg03p][INFO ] checking OSD status... [jktcb2ndstg03p][INFO ] Running command: ceph --cluster=ceph osd stat --format=json [ceph_deploy.osd][DEBUG ] Host jktcb2ndstg03p is now ready for osd use. [root@jktcb2cpstg01p ~]# ceph-deploy admin jktcb2cpstg01p jktcb2ndstg{01,02,03}p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy admin jktcb2cpstg01p jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2cpstg01p [jktcb2cpstg01p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2cpstg01p][DEBUG ] detect platform information from remote host [jktcb2cpstg01p][DEBUG ] detect machine type [jktcb2cpstg01p][DEBUG ] get remote short hostname [jktcb2cpstg01p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][ERROR ] RuntimeError: config file /etc/ceph/ceph.conf exists with different content; use --overwrite-conf to overwrite [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [jktcb2ndstg01p][DEBUG ] get remote short hostname [jktcb2ndstg01p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [jktcb2ndstg02p][DEBUG ] get remote short hostname [jktcb2ndstg02p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [jktcb2ndstg03p][DEBUG ] get remote short hostname [jktcb2ndstg03p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy][ERROR ] GenericError: Failed to configure 1 admin hosts [root@jktcb2cpstg01p ~]# ceph-deploy --overwrite-conf admin jktcb2cpstg01p jktcb2ndstg{01,02,03}p [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy --overwrite-conf admin jktcb2cpstg01p jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2cpstg01p [jktcb2cpstg01p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2cpstg01p][DEBUG ] detect platform information from remote host [jktcb2cpstg01p][DEBUG ] detect machine type [jktcb2cpstg01p][DEBUG ] get remote short hostname [jktcb2cpstg01p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2ndstg01p [jktcb2ndstg01p][DEBUG ] detect platform information from remote host [jktcb2ndstg01p][DEBUG ] detect machine type [jktcb2ndstg01p][DEBUG ] get remote short hostname [jktcb2ndstg01p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2ndstg02p [jktcb2ndstg02p][DEBUG ] detect platform information from remote host [jktcb2ndstg02p][DEBUG ] detect machine type [jktcb2ndstg02p][DEBUG ] get remote short hostname [jktcb2ndstg02p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2ndstg03p [jktcb2ndstg03p][DEBUG ] detect platform information from remote host [jktcb2ndstg03p][DEBUG ] detect machine type [jktcb2ndstg03p][DEBUG ] get remote short hostname [jktcb2ndstg03p][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [root@jktcb2cpstg01p ~]# sudo chmod +r /etc/ceph/ceph.client.admin.keyring [root@jktcb2cpstg01p ~]# ceph health HEALTH_WARN too few pgs per osd (1 < min 20) [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 up 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 up 1 30 0.91 osd.30 up 1 31 0.91 osd.31 up 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 up 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 up 1 55 0.91 osd.55 up 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 up 1 75 0.91 osd.75 up 1 76 0.91 osd.76 up 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 up 1 102 0.91 osd.102 up 1 103 0.91 osd.103 up 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 up 1 107 0.91 osd.107 up 1 108 0.91 osd.108 up 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 up 1 128 0.91 osd.128 up 1 129 0.91 osd.129 up 1 130 0.91 osd.130 up 1 131 0.91 osd.131 up 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 up 1 10 0.91 osd.10 up 1 11 0.91 osd.11 up 1 12 0.91 osd.12 up 1 13 0.91 osd.13 up 1 14 0.91 osd.14 up 1 15 0.91 osd.15 up 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 up 1 36 0.91 osd.36 up 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 up 1 40 0.91 osd.40 up 1 41 0.91 osd.41 up 1 42 0.91 osd.42 up 1 59 0.91 osd.59 up 1 60 0.91 osd.60 up 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 up 1 64 0.91 osd.64 up 1 65 0.91 osd.65 up 1 66 0.91 osd.66 up 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 up 1 88 0.91 osd.88 up 1 89 0.91 osd.89 up 1 90 0.91 osd.90 up 1 91 0.91 osd.91 up 1 92 0.91 osd.92 up 1 110 0.91 osd.110 up 1 111 0.91 osd.111 up 1 112 0.91 osd.112 up 1 113 0.91 osd.113 up 1 114 0.91 osd.114 up 1 115 0.91 osd.115 up 1 116 0.91 osd.116 up 1 117 0.91 osd.117 up 1 134 0.91 osd.134 up 1 135 0.91 osd.135 up 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 up 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 up 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 up 1 22 0.91 osd.22 up 1 23 0.91 osd.23 up 1 24 0.91 osd.24 up 1 25 0.91 osd.25 up 1 26 0.91 osd.26 up 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 up 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 up 1 71 0.91 osd.71 up 1 72 0.91 osd.72 up 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 up 1 94 0.91 osd.94 up 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 up 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 up 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 up 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd set pool rbd pg_num 1024 Invalid command: pool not in pause|noup|nodown|noout|noin|nobackfill|norecover|noscrub|nodeep-scrub|notieragent osd set pause|noup|nodown|noout|noin|nobackfill|norecover|noscrub|nodeep-scrub|notieragent : set Error EINVAL: invalid command [root@jktcb2cpstg01p ~]# ceph osd -h General usage: ============== usage: ceph [-h] [-c CEPHCONF] [-i INPUT_FILE] [-o OUTPUT_FILE] [--id CLIENT_ID] [--name CLIENT_NAME] [--cluster CLUSTER] [--admin-daemon ADMIN_SOCKET] [--admin-socket ADMIN_SOCKET_NOPE] [-s] [-w] [--watch-debug] [--watch-info] [--watch-sec] [--watch-warn] [--watch-error] [--version] [--verbose] [--concise] [-f {json,json-pretty,xml,xml-pretty,plain}] [--connect-timeout CLUSTER_TIMEOUT] Ceph administration tool optional arguments: -h, --help request mon help -c CEPHCONF, --conf CEPHCONF ceph configuration file -i INPUT_FILE, --in-file INPUT_FILE input file -o OUTPUT_FILE, --out-file OUTPUT_FILE output file --id CLIENT_ID, --user CLIENT_ID client id for authentication --name CLIENT_NAME, -n CLIENT_NAME client name for authentication --cluster CLUSTER cluster name --admin-daemon ADMIN_SOCKET submit admin-socket commands ("help" for help --admin-socket ADMIN_SOCKET_NOPE you probably mean --admin-daemon -s, --status show cluster status -w, --watch watch live cluster changes --watch-debug watch debug events --watch-info watch info events --watch-sec watch security events --watch-warn watch warn events --watch-error watch error events --version, -v display version --verbose make verbose --concise make less verbose -f {json,json-pretty,xml,xml-pretty,plain}, --format {json,json-pretty,xml,xml-pretty,plain} --connect-timeout CLUSTER_TIMEOUT set a timeout for connecting to the cluster Monitor commands: ================= [Contacting monitor, timeout after 5 seconds] osd blacklist add|rm add (optionally until seconds {} from now) or remove from blacklist osd blacklist ls show blacklisted clients osd create {} create new osd (with optional UUID) osd crush add add or update crushmap position and [...] weight for with and location osd crush add-bucket add no-parent (probably root) crush bucket of type osd crush create-or-move [.. for at/to location .] osd crush dump dump crush map osd crush link [...] link existing entry for under location osd crush move [...] move existing entry for to location osd crush remove {} remove from crush map ( everywhere, or just at ) osd crush reweight change 's weight to in crush map osd crush rm {} remove from crush map ( everywhere, or just at ) osd crush rule create-erasure create crush rule for erasure {} coded pool created with ( default default) osd crush rule create-simple create crush rule to start from {firstn|indep} , replicate across buckets of type , using a choose mode of (default firstn; indep best for erasure pools) osd crush rule dump {} dump crush rule (default all) osd crush rule list list crush rules osd crush rule ls list crush rules osd crush rule rm remove crush rule osd crush set set crush map from input file osd crush set update crushmap position and weight [...] for to with location osd crush show-tunables show current crush tunables osd crush tunables legacy|argonaut| set crush tunables values to bobtail|firefly|optimal|default osd crush unlink {} unlink from crush map ( everywhere, or just at ) osd deep-scrub initiate deep scrub on osd osd down [...] set osd(s) [...] down osd dump {} print summary of OSD map osd erasure-code-profile get get erasure code profile osd erasure-code-profile ls list all erasure code profiles osd erasure-code-profile rm remove erasure code profile osd erasure-code-profile set create erasure code profile { [...]} with [ ...] pairs. Add a --force at the end to override an existing profile (VERY DANGEROUS) osd find find osd in the CRUSH map and show its location osd getcrushmap {} get CRUSH map osd getmap {} get OSD map osd getmaxosd show largest OSD id osd in [...] set osd(s) [...] in osd lost {--yes-i-really-mean- mark osd as permanently lost. THIS it} DESTROYS DATA IF NO MORE REPLICAS EXIST, BE CAREFUL osd ls {} show all OSD ids osd lspools {} list pools osd map find pg for in osd metadata fetch metadata for osd osd out [...] set osd(s) [...] out osd pause pause osd osd perf print dump of OSD perf summary stats osd pg-temp { [...]} set pg_temp mapping pgid:[ [... ]] (developers only) osd pool create create pool {} {replicated|erasure} {} {} osd pool delete {} delete pool {--yes-i-really-really-mean-it} osd pool get size|min_size| get pool parameter crash_replay_interval|pg_num|pgp_num| crush_ruleset|hit_set_type|hit_set_ period|hit_set_count|hit_set_fpp|auid osd pool mksnap make snapshot in osd pool rename rename to osd pool rmsnap remove snapshot from osd pool set size|min_size| set pool parameter to crash_replay_interval|pg_num|pgp_num| crush_ruleset|hashpspool|hit_set_type| hit_set_period|hit_set_count|hit_set_ fpp|debug_fake_ec_pool|target_max_ bytes|target_max_objects|cache_target_ dirty_ratio|cache_target_full_ratio| cache_min_flush_age|cache_min_evict_ age|auid {--yes-i-really-mean-it} osd pool set-quota max_ set object or byte limit on pool objects|max_bytes osd pool stats {} obtain stats from all pools, or from specified pool osd primary-affinity <= 1.0 osd primary-temp set primary_temp mapping pgid:|-1 ( developers only) osd repair initiate repair on osd osd reweight reweight osd to 0.0 < < 1.0 osd reweight-by-utilization {} percentage-for-consideration, default 120] osd rm [...] remove osd(s) [...] in osd scrub initiate scrub on osd osd set pause|noup|nodown|noout|noin| set nobackfill|norecover|noscrub|nodeep- scrub|notieragent osd setcrushmap set crush map from input file osd setmaxosd set new maximum osd value osd stat print summary of OSD map osd thrash thrash OSDs for osd tier add {-- add the tier (the second force-nonempty} one) to base pool (the first one) osd tier add-cache add a cache (the second one) of size to existing pool (the first one) osd tier cache-mode none| specify the caching mode for cache writeback|forward|readonly tier osd tier remove remove the tier (the second one) from base pool (the first one) osd tier remove-overlay remove the overlay pool for base pool osd tier set-overlay set the overlay pool for base pool to be osd tree {} print OSD tree osd unpause unpause osd osd unset pause|noup|nodown|noout|noin| unset nobackfill|norecover|noscrub|nodeep- scrub|notieragent [root@jktcb2cpstg01p ~]# ceph osd pool set rbd pg_num 1024 set pool 2 pg_num to 1024 [root@jktcb2cpstg01p ~]# ceph osd pool set rbd pgp_num 1024 Error EBUSY: currently creating pgs, wait [root@jktcb2cpstg01p ~]# ceph osd pool get rbd pgp_num 1024 Invalid command: unused arguments: ['1024'] osd pool get size|min_size|crash_replay_interval|pg_num|pgp_num|crush_ruleset|hit_set_type|hit_set_period|hit_set_count|hit_set_fpp|auid : get pool parameter Error EINVAL: invalid command [root@jktcb2cpstg01p ~]# ceph osd pool get rbd pgp_num pgp_num: 64 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 up 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 up 1 30 0.91 osd.30 up 1 31 0.91 osd.31 up 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 up 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 up 1 55 0.91 osd.55 up 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 up 1 75 0.91 osd.75 up 1 76 0.91 osd.76 up 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 up 1 102 0.91 osd.102 up 1 103 0.91 osd.103 up 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 up 1 107 0.91 osd.107 up 1 108 0.91 osd.108 up 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 up 1 128 0.91 osd.128 up 1 129 0.91 osd.129 up 1 130 0.91 osd.130 up 1 131 0.91 osd.131 up 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 up 1 10 0.91 osd.10 up 1 11 0.91 osd.11 up 1 12 0.91 osd.12 up 1 13 0.91 osd.13 up 1 14 0.91 osd.14 up 1 15 0.91 osd.15 up 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 up 1 36 0.91 osd.36 up 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 up 1 40 0.91 osd.40 up 1 41 0.91 osd.41 up 1 42 0.91 osd.42 up 1 59 0.91 osd.59 up 1 60 0.91 osd.60 up 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 up 1 64 0.91 osd.64 up 1 65 0.91 osd.65 up 1 66 0.91 osd.66 up 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 up 1 88 0.91 osd.88 up 1 89 0.91 osd.89 up 1 90 0.91 osd.90 up 1 91 0.91 osd.91 up 1 92 0.91 osd.92 up 1 110 0.91 osd.110 up 1 111 0.91 osd.111 up 1 112 0.91 osd.112 up 1 113 0.91 osd.113 up 1 114 0.91 osd.114 up 1 115 0.91 osd.115 up 1 116 0.91 osd.116 up 1 117 0.91 osd.117 up 1 134 0.91 osd.134 up 1 135 0.91 osd.135 up 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 up 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 up 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 up 1 22 0.91 osd.22 up 1 23 0.91 osd.23 up 1 24 0.91 osd.24 up 1 25 0.91 osd.25 up 1 26 0.91 osd.26 up 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 up 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 up 1 71 0.91 osd.71 up 1 72 0.91 osd.72 up 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 up 1 94 0.91 osd.94 up 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 up 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 up 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 up 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph health HEALTH_WARN too few pgs per osd (7 < min 20); pool rbd pg_num 1024 > pgp_num 64 [root@jktcb2cpstg01p ~]# ceph osd pool set rbd pgp_num 1024 set pool 2 pgp_num to 1024 [root@jktcb2cpstg01p ~]# ceph health HEALTH_WARN 2 pgs peering; 2 pgs stuck inactive; 2 pgs stuck unclean; too few pgs per osd (7 < min 20) [root@jktcb2cpstg01p ~]# [root@jktcb2cpstg01p ~]# ceph health HEALTH_WARN 2 pgs peering; 2 pgs stuck inactive; 2 pgs stuck unclean; too few pgs per osd (7 < min 20) [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 up 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 up 1 30 0.91 osd.30 up 1 31 0.91 osd.31 up 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 up 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 up 1 55 0.91 osd.55 up 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 up 1 75 0.91 osd.75 up 1 76 0.91 osd.76 up 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 up 1 102 0.91 osd.102 up 1 103 0.91 osd.103 up 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 up 1 107 0.91 osd.107 up 1 108 0.91 osd.108 up 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 up 1 128 0.91 osd.128 up 1 129 0.91 osd.129 up 1 130 0.91 osd.130 up 1 131 0.91 osd.131 up 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 up 1 10 0.91 osd.10 up 1 11 0.91 osd.11 up 1 12 0.91 osd.12 up 1 13 0.91 osd.13 up 1 14 0.91 osd.14 up 1 15 0.91 osd.15 up 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 up 1 36 0.91 osd.36 up 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 up 1 40 0.91 osd.40 up 1 41 0.91 osd.41 up 1 42 0.91 osd.42 up 1 59 0.91 osd.59 up 1 60 0.91 osd.60 up 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 up 1 64 0.91 osd.64 up 1 65 0.91 osd.65 up 1 66 0.91 osd.66 up 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 up 1 88 0.91 osd.88 up 1 89 0.91 osd.89 up 1 90 0.91 osd.90 up 1 91 0.91 osd.91 up 1 92 0.91 osd.92 up 1 110 0.91 osd.110 up 1 111 0.91 osd.111 up 1 112 0.91 osd.112 up 1 113 0.91 osd.113 up 1 114 0.91 osd.114 up 1 115 0.91 osd.115 up 1 116 0.91 osd.116 up 1 117 0.91 osd.117 up 1 134 0.91 osd.134 up 1 135 0.91 osd.135 up 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 up 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 up 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 up 1 22 0.91 osd.22 up 1 23 0.91 osd.23 up 1 24 0.91 osd.24 up 1 25 0.91 osd.25 up 1 26 0.91 osd.26 up 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 up 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 up 1 71 0.91 osd.71 up 1 72 0.91 osd.72 up 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 up 1 94 0.91 osd.94 up 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 up 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 up 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 up 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph health detail HEALTH_WARN too few pgs per osd (7 < min 20) too few pgs per osd (7 < min 20) [root@jktcb2cpstg01p ~]# ceph health detail HEALTH_WARN too few pgs per osd (7 < min 20) too few pgs per osd (7 < min 20) [root@jktcb2cpstg01p ~]# ceph health HEALTH_WARN too few pgs per osd (7 < min 20) [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN too few pgs per osd (7 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e758: 150 osds: 150 up, 150 in pgmap v2276: 1152 pgs, 3 pools, 0 bytes data, 0 objects 12194 MB used, 136 TB / 136 TB avail 1152 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN too few pgs per osd (7 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e758: 150 osds: 150 up, 150 in pgmap v2276: 1152 pgs, 3 pools, 0 bytes data, 0 objects 12194 MB used, 136 TB / 136 TB avail 1152 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN too few pgs per osd (7 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e758: 150 osds: 150 up, 150 in pgmap v2276: 1152 pgs, 3 pools, 0 bytes data, 0 objects 12194 MB used, 136 TB / 136 TB avail 1152 active+clean [root@jktcb2cpstg01p ~]# ceph osd pool set rbd pg_num 2048 set pool 2 pg_num to 2048 [root@jktcb2cpstg01p ~]# ceph osd pool set rbd pgp_num 2048 Error EBUSY: currently creating pgs, wait [root@jktcb2cpstg01p ~]# ceph osd pool set rbd pgp_num 2048 set pool 2 pgp_num to 2048 [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2288: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12275 MB used, 136 TB / 136 TB avail 2176 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 11 pgs peering; 10 pgs stuck inactive; 10 pgs stuck unclean; too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2289: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12276 MB used, 136 TB / 136 TB avail 11 peering 2165 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 120 pgs peering; 115 pgs stuck inactive; 115 pgs stuck unclean; too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2290: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12285 MB used, 136 TB / 136 TB avail 120 peering 2056 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 120 pgs peering; 115 pgs stuck inactive; 115 pgs stuck unclean; too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2290: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12285 MB used, 136 TB / 136 TB avail 120 peering 2056 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 120 pgs peering; 115 pgs stuck inactive; 115 pgs stuck unclean; too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2290: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12285 MB used, 136 TB / 136 TB avail 120 peering 2056 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 120 pgs peering; 115 pgs stuck inactive; 115 pgs stuck unclean; too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2290: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12285 MB used, 136 TB / 136 TB avail 120 peering 2056 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 120 pgs peering; 115 pgs stuck inactive; 115 pgs stuck unclean; too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2290: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12285 MB used, 136 TB / 136 TB avail 120 peering 2056 active+clean [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 120 pgs peering; 115 pgs stuck inactive; 115 pgs stuck unclean; too few pgs per osd (14 < min 20) monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e762: 150 osds: 150 up, 150 in pgmap v2290: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12285 MB used, 136 TB / 136 TB avail 120 peering 2056 active+clean [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 up 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 up 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 up 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 up 1 55 0.91 osd.55 up 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 up 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 up 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 up 1 107 0.91 osd.107 up 1 108 0.91 osd.108 up 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 up 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 up 1 10 0.91 osd.10 up 1 11 0.91 osd.11 up 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 up 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 up 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 up 1 60 0.91 osd.60 up 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 up 1 111 0.91 osd.111 up 1 112 0.91 osd.112 down 1 113 0.91 osd.113 up 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 up 1 134 0.91 osd.134 up 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 up 1 22 0.91 osd.22 up 1 23 0.91 osd.23 up 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 up 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 up 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 up 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 up 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 up 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 up 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree # id weight type name up/down reweight -1 136.5 root default -2 45.5 host jktcb2ndstg01p 0 0.91 osd.0 up 1 1 0.91 osd.1 up 1 2 0.91 osd.2 up 1 3 0.91 osd.3 down 1 4 0.91 osd.4 up 1 5 0.91 osd.5 up 1 6 0.91 osd.6 up 1 7 0.91 osd.7 up 1 8 0.91 osd.8 up 1 27 0.91 osd.27 up 1 28 0.91 osd.28 up 1 29 0.91 osd.29 down 1 30 0.91 osd.30 up 1 31 0.91 osd.31 down 1 32 0.91 osd.32 up 1 33 0.91 osd.33 up 1 34 0.91 osd.34 down 1 51 0.91 osd.51 up 1 52 0.91 osd.52 up 1 53 0.91 osd.53 up 1 54 0.91 osd.54 down 1 55 0.91 osd.55 down 1 56 0.91 osd.56 up 1 57 0.91 osd.57 up 1 58 0.91 osd.58 down 1 75 0.91 osd.75 up 1 76 0.91 osd.76 down 1 77 0.91 osd.77 up 1 78 0.91 osd.78 up 1 79 0.91 osd.79 up 1 80 0.91 osd.80 up 1 81 0.91 osd.81 up 1 82 0.91 osd.82 up 1 83 0.91 osd.83 down 1 102 0.91 osd.102 down 1 103 0.91 osd.103 down 1 104 0.91 osd.104 up 1 105 0.91 osd.105 up 1 106 0.91 osd.106 down 1 107 0.91 osd.107 up 1 108 0.91 osd.108 down 1 109 0.91 osd.109 up 1 126 0.91 osd.126 up 1 127 0.91 osd.127 down 1 128 0.91 osd.128 down 1 129 0.91 osd.129 down 1 130 0.91 osd.130 up 1 131 0.91 osd.131 down 1 132 0.91 osd.132 up 1 133 0.91 osd.133 up 1 -3 45.5 host jktcb2ndstg02p 9 0.91 osd.9 down 1 10 0.91 osd.10 up 1 11 0.91 osd.11 down 1 12 0.91 osd.12 up 1 13 0.91 osd.13 down 1 14 0.91 osd.14 down 1 15 0.91 osd.15 down 1 16 0.91 osd.16 up 1 17 0.91 osd.17 up 1 35 0.91 osd.35 down 1 36 0.91 osd.36 down 1 37 0.91 osd.37 up 1 38 0.91 osd.38 up 1 39 0.91 osd.39 down 1 40 0.91 osd.40 up 1 41 0.91 osd.41 down 1 42 0.91 osd.42 down 1 59 0.91 osd.59 down 1 60 0.91 osd.60 down 1 61 0.91 osd.61 up 1 62 0.91 osd.62 up 1 63 0.91 osd.63 down 1 64 0.91 osd.64 down 1 65 0.91 osd.65 up 1 66 0.91 osd.66 down 1 84 0.91 osd.84 up 1 85 0.91 osd.85 up 1 86 0.91 osd.86 up 1 87 0.91 osd.87 down 1 88 0.91 osd.88 up 1 89 0.91 osd.89 down 1 90 0.91 osd.90 up 1 91 0.91 osd.91 down 1 92 0.91 osd.92 up 1 110 0.91 osd.110 down 1 111 0.91 osd.111 down 1 112 0.91 osd.112 down 1 113 0.91 osd.113 down 1 114 0.91 osd.114 down 1 115 0.91 osd.115 down 1 116 0.91 osd.116 down 1 117 0.91 osd.117 down 1 134 0.91 osd.134 down 1 135 0.91 osd.135 down 1 136 0.91 osd.136 up 1 137 0.91 osd.137 up 1 138 0.91 osd.138 down 1 139 0.91 osd.139 up 1 140 0.91 osd.140 up 1 141 0.91 osd.141 down 1 -4 45.5 host jktcb2ndstg03p 18 0.91 osd.18 up 1 19 0.91 osd.19 up 1 20 0.91 osd.20 up 1 21 0.91 osd.21 down 1 22 0.91 osd.22 up 1 23 0.91 osd.23 down 1 24 0.91 osd.24 down 1 25 0.91 osd.25 up 1 26 0.91 osd.26 down 1 43 0.91 osd.43 up 1 44 0.91 osd.44 up 1 45 0.91 osd.45 up 1 46 0.91 osd.46 up 1 47 0.91 osd.47 down 1 48 0.91 osd.48 up 1 49 0.91 osd.49 up 1 50 0.91 osd.50 up 1 67 0.91 osd.67 up 1 68 0.91 osd.68 up 1 69 0.91 osd.69 up 1 70 0.91 osd.70 down 1 71 0.91 osd.71 up 1 72 0.91 osd.72 down 1 73 0.91 osd.73 up 1 74 0.91 osd.74 up 1 93 0.91 osd.93 down 1 94 0.91 osd.94 down 1 95 0.91 osd.95 up 1 96 0.91 osd.96 up 1 97 0.91 osd.97 up 1 98 0.91 osd.98 up 1 99 0.91 osd.99 up 1 100 0.91 osd.100 up 1 101 0.91 osd.101 down 1 118 0.91 osd.118 up 1 119 0.91 osd.119 up 1 120 0.91 osd.120 up 1 121 0.91 osd.121 up 1 122 0.91 osd.122 up 1 123 0.91 osd.123 up 1 124 0.91 osd.124 down 1 125 0.91 osd.125 up 1 142 0.91 osd.142 up 1 143 0.91 osd.143 up 1 144 0.91 osd.144 up 1 145 0.91 osd.145 up 1 146 0.91 osd.146 down 1 147 0.91 osd.147 up 1 148 0.91 osd.148 up 1 149 0.91 osd.149 up 1 [root@jktcb2cpstg01p ~]# ceph osd tree ^[[A ^[[A ^CError EINTR: [root@jktcb2cpstg01p ~]# ceph osd tree ^CError connecting to cluster: InterruptedOrTimeoutError [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 132 pgs degraded; 4 pgs down; 217 pgs peering; 702 pgs stale; 165 pgs stuck inactive; 181 pgs stuck unclean; too few pgs per osd (14 < min 20); 62/150 in osds are down monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e769: 150 osds: 88 up, 150 in pgmap v2299: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12305 MB used, 136 TB / 136 TB avail 39 inactive 702 stale+active+clean 131 active+degraded 213 peering 2 active+remapped 1 active+degraded+remapped 1084 active+clean 4 down+peering [root@jktcb2cpstg01p ~]# ceph -s cluster 0d522f68-be26-424b-bf6f-ab14dcd30618 health HEALTH_WARN 190 pgs degraded; 51 pgs down; 371 pgs peering; 659 pgs stale; 235 pgs stuck inactive; 261 pgs stuck unclean; too few pgs per osd (14 < min 20); 132/150 in osds are down monmap e2: 3 mons at {jktcb2ndstg01p=172.17.2.101:6789/0,jktcb2ndstg02p=172.17.2.102:6789/0,jktcb2ndstg03p=172.17.2.103:6789/0}, election epoch 6, quorum 0,1,2 jktcb2ndstg01p,jktcb2ndstg02p,jktcb2ndstg03p osdmap e773: 150 osds: 18 up, 150 in pgmap v2303: 2176 pgs, 3 pools, 0 bytes data, 0 objects 12316 MB used, 136 TB / 136 TB avail 7 inactive 659 stale+active+clean 188 active+degraded 309 peering 3 active+remapped 2 active+degraded+remapped 946 active+clean 11 remapped+peering 51 down+peering [root@jktcb2cpstg01p ~]# ceph health detail HEALTH_WARN 501 pgs degraded; 166 pgs down; 166 pgs peering; 1383 pgs stale; 165 pgs stuck inactive; 303 pgs stuck unclean; too few pgs per osd (14 < min 20); 132/150 in osds are down pg 2.412 is stuck inactive since forever, current state down+peering, last acting [67] pg 2.59f is stuck inactive since forever, current state down+peering, last acting [105] pg 2.7f3 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.725 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.4d3 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.65d is stuck inactive since forever, current state down+peering, last acting [50] pg 2.597 is stuck inactive since forever, current state down+peering, last acting [40] pg 2.7e8 is stuck inactive since forever, current state down+peering, last acting [142] pg 2.7eb is stuck inactive since forever, current state down+peering, last acting [22] pg 2.4ce is stuck inactive since forever, current state down+peering, last acting [22] pg 2.4c8 is stuck inactive since forever, current state down+peering, last acting [67] pg 2.400 is stuck inactive since forever, current state down+peering, last acting [43] pg 2.592 is stuck inactive since forever, current state down+peering, last acting [8] pg 2.71e is stuck inactive since forever, current state down+peering, last acting [8] pg 2.4c4 is stuck inactive since forever, current state down+peering, last acting [98] pg 2.719 is stuck inactive since forever, current state down+peering, last acting [88] pg 2.718 is stuck inactive since forever, current state down+peering, last acting [22] pg 2.7e3 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.653 is stuck inactive since forever, current state down+peering, last acting [88] pg 2.584 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.64f is stuck inactive since forever, current state down+peering, last acting [104] pg 2.64e is stuck inactive since forever, current state down+peering, last acting [104] pg 2.4bf is stuck inactive since forever, current state down+peering, last acting [46,105] pg 2.4b9 is stuck inactive since forever, current state down+peering, last acting [8,22] pg 2.645 is stuck inactive since forever, current state down+peering, last acting [67] pg 2.7d6 is stuck inactive since forever, current state down+peering, last acting [104] pg 2.57f is stuck inactive since forever, current state down+peering, last acting [22] pg 2.7d0 is stuck inactive since forever, current state down+peering, last acting [46,40] pg 2.643 is stuck inactive since forever, current state down+peering, last acting [88] pg 2.57b is stuck inactive since forever, current state down+peering, last acting [67] pg 2.63d is stuck inactive since forever, current state down+peering, last acting [142] pg 2.704 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.575 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.6fd is stuck inactive since forever, current state down+peering, last acting [51] pg 2.6fc is stuck inactive since forever, current state down+peering, last acting [51] pg 2.7c1 is stuck inactive since forever, current state down+peering, last acting [40,51] pg 2.56f is stuck inactive since forever, current state down+peering, last acting [43,51] pg 2.631 is stuck inactive since forever, current state down+peering, last acting [142] pg 2.7c3 is stuck inactive since forever, current state down+peering, last acting [51] pg 2.4a6 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.4a3 is stuck inactive since forever, current state down+peering, last acting [104] pg 2.7bf is stuck inactive since forever, current state down+peering, last acting [48] pg 2.62c is stuck inactive since forever, current state down+peering, last acting [8] pg 2.564 is stuck inactive since forever, current state down+peering, last acting [51] pg 2.49c is stuck inactive since forever, current state down+peering, last acting [68] pg 2.62e is stuck inactive since forever, current state down+peering, last acting [68] pg 2.629 is stuck inactive since forever, current state down+peering, last acting [67,105] pg 2.6f0 is stuck inactive since forever, current state down+peering, last acting [98] pg 2.49e is stuck inactive since forever, current state down+peering, last acting [8] pg 2.563 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.62a is stuck inactive since forever, current state down+peering, last acting [88,68] pg 2.6ec is stuck inactive since forever, current state down+peering, last acting [43] pg 2.7b7 is stuck inactive since forever, current state down+peering, last acting [48] pg 2.624 is stuck inactive since forever, current state down+peering, last acting [104] pg 2.7b6 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.6e9 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.497 is stuck inactive since forever, current state down+peering, last acting [43] pg 2.621 is stuck inactive since forever, current state down+peering, last acting [50] pg 2.620 is stuck inactive since forever, current state down+peering, last acting [67] pg 2.6ea is stuck inactive since forever, current state down+peering, last acting [8] pg 2.61d is stuck inactive since forever, current state down+peering, last acting [104] pg 2.6e6 is stuck inactive since forever, current state down+peering, last acting [22] pg 2.48c is stuck inactive since forever, current state down+peering, last acting [67] pg 2.557 is stuck inactive since forever, current state down+peering, last acting [8] pg 2.7ab is stuck inactive since forever, current state down+peering, last acting [50] pg 2.551 is stuck inactive since forever, current state down+peering, last acting [22] pg 2.489 is stuck inactive since forever, current state down+peering, last acting [142] pg 2.61a is stuck inactive since forever, current state down+peering, last acting [50] pg 2.48b is stuck inactive since forever, current state down+peering, last acting [104] pg 2.48a is stuck inactive since forever, current state down+peering, last acting [97] pg 2.54d is stuck inactive since forever, current state down+peering, last acting [43] pg 2.7a0 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.611 is stuck inactive since forever, current state down+peering, last acting [25,40] pg 2.7a2 is stuck inactive since forever, current state down+peering, last acting [98] pg 2.6da is stuck inactive since forever, current state down+peering, last acting [98] pg 2.483 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.545 is stuck inactive since forever, current state down+peering, last acting [50] pg 2.6d7 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.47c is stuck inactive since forever, current state down+peering, last acting [50] pg 2.47e is stuck inactive since forever, current state down+peering, last acting [98] pg 2.541 is stuck inactive since forever, current state down+peering, last acting [104,43] pg 2.6d2 is stuck inactive since forever, current state down+peering, last acting [67] pg 2.47b is stuck inactive since forever, current state down+peering, last acting [97] pg 2.605 is stuck inactive since forever, current state down+peering, last acting [88] pg 2.793 is stuck inactive since forever, current state down+peering, last acting [142] pg 2.476 is stuck inactive since forever, current state down+peering, last acting [88,50] pg 2.539 is stuck inactive since forever, current state down+peering, last acting [98] pg 2.538 is stuck inactive since forever, current state down+peering, last acting [8] pg 2.5f8 is stuck inactive since forever, current state down+peering, last acting [105] pg 2.6c3 is stuck inactive since forever, current state down+peering, last acting [48] pg 2.784 is stuck inactive since forever, current state down+peering, last acting [98] pg 2.532 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.5f5 is stuck inactive since forever, current state down+peering, last acting [46,104] pg 2.6bc is stuck inactive since forever, current state down+peering, last acting [50] pg 2.5f4 is stuck inactive since forever, current state down+peering, last acting [48] pg 2.465 is stuck inactive since forever, current state down+peering, last acting [68,51] pg 2.464 is stuck inactive since forever, current state down+peering, last acting [46] pg 2.529 is stuck inactive since forever, current state down+peering, last acting [105] pg 2.77d is stuck inactive since forever, current state down+peering, last acting [46] pg 2.5ed is stuck inactive since forever, current state down+peering, last acting [22] pg 2.462 is stuck inactive since forever, current state down+peering, last acting [104] pg 2.6b7 is stuck inactive since forever, current state down+peering, last acting [67] pg 2.6b1 is stuck inactive since forever, current state down+peering, last acting [22] pg 2.526 is stuck inactive since forever, current state down+peering, last acting [48] pg 2.5e9 is stuck inactive since forever, current state down+peering, last acting [22] pg 2.776 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.455 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.5e6 is stuck inactive since forever, current state down+peering, last acting [40] pg 2.772 is stuck inactive since forever, current state down+peering, last acting [48] pg 2.6aa is stuck inactive since forever, current state down+peering, last acting [43] pg 2.51a is stuck inactive since forever, current state down+peering, last acting [88] pg 2.769 is stuck inactive since forever, current state down+peering, last acting [68] pg 2.449 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.69d is stuck inactive since forever, current state down+peering, last acting [67] pg 2.44b is stuck inactive since forever, current state down+peering, last acting [43,81] pg 2.5d5 is stuck inactive since forever, current state down+peering, last acting [88] pg 2.762 is stuck inactive since forever, current state down+peering, last acting [88] pg 2.695 is stuck inactive since forever, current state down+peering, last acting [40,46] pg 2.50a is stuck inactive since forever, current state down+peering, last acting [8] pg 2.442 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.504 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.43f is stuck inactive since forever, current state down+peering, last acting [81,22] pg 2.75b is stuck inactive since forever, current state down+peering, last acting [48] pg 2.43e is stuck inactive since forever, current state down+peering, last acting [25,104] pg 2.501 is stuck inactive since forever, current state down+peering, last acting [8] pg 2.500 is stuck inactive since forever, current state down+peering, last acting [46] pg 2.503 is stuck inactive since forever, current state down+peering, last acting [104] pg 2.68d is stuck inactive since forever, current state down+peering, last acting [51] pg 2.757 is stuck inactive since forever, current state down+peering, last acting [104] pg 2.435 is stuck inactive since forever, current state down+peering, last acting [48] pg 2.4ff is stuck inactive since forever, current state down+peering, last acting [68] pg 2.5c6 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.689 is stuck inactive since forever, current state down+peering, last acting [50] pg 2.688 is stuck inactive since forever, current state down+peering, last acting [105] pg 2.5c0 is stuck inactive since forever, current state down+peering, last acting [8,25] pg 2.68b is stuck inactive since forever, current state down+peering, last acting [48] pg 2.752 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.5bf is stuck inactive since forever, current state down+peering, last acting [8] pg 2.686 is stuck inactive since forever, current state down+peering, last acting [104,25] pg 2.681 is stuck inactive since forever, current state down+peering, last acting [22] pg 2.5ba is stuck inactive since forever, current state down+peering, last acting [22] pg 2.4f2 is stuck inactive since forever, current state down+peering, last acting [46] pg 2.42a is stuck inactive since forever, current state down+peering, last acting [40,97] pg 2.679 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.4ee is stuck inactive since forever, current state down+peering, last acting [98] pg 2.426 is stuck inactive since forever, current state down+peering, last acting [81] pg 2.5b0 is stuck inactive since forever, current state down+peering, last acting [105,40] pg 2.67b is stuck inactive since forever, current state down+peering, last acting [40,104] pg 2.4e8 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.5b2 is stuck inactive since forever, current state down+peering, last acting [43] pg 2.674 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.4e6 is stuck inactive since forever, current state down+peering, last acting [98] pg 2.7fd is stuck inactive since forever, current state down+peering, last acting [51] pg 2.41b is stuck inactive since forever, current state down+peering, last acting [97] pg 2.5a5 is stuck inactive since forever, current state down+peering, last acting [25] pg 2.7fe is stuck inactive since forever, current state down+peering, last acting [46] pg 2.66f is stuck inactive since forever, current state down+peering, last acting [68] pg 2.415 is stuck inactive since forever, current state down+peering, last acting [50] pg 2.4dc is stuck inactive since forever, current state down+peering, last acting [25] pg 2.66e is stuck inactive since forever, current state down+peering, last acting [97] pg 2.731 is stuck inactive since forever, current state down+peering, last acting [97] pg 2.7f8 is stuck inactive since forever, current state down+peering, last acting [105] pg 2.7f5 is stuck inactive since forever, current state down+peering, last acting [88] pg 2.4d8 is stuck inactive since forever, current state down+peering, last acting [105] pg 2.4da is stuck inactive since forever, current state down+peering, last acting [98] pg 2.5a3 is stuck unclean since forever, current state active+degraded, last acting [46] pg 2.5a2 is stuck unclean since forever, current state active+degraded+remapped, last acting [48,40] pg 2.407 is stuck unclean since forever, current state active+degraded+remapped, last acting [50,40] pg 2.59f is stuck unclean since forever, current state down+peering, last acting [105] pg 2.400 is stuck unclean since forever, current state down+peering, last acting [43] pg 2.736 is stuck unclean since forever, current state active+remapped, last acting [22,40,97] pg 2.731 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.733 is stuck unclean since forever, current state active+degraded+remapped, last acting [104,50] pg 2.597 is stuck unclean since forever, current state down+peering, last acting [40] pg 2.593 is stuck unclean since forever, current state active+degraded+remapped, last acting [46,142] pg 2.728 is stuck unclean since forever, current state active+degraded+remapped, last acting [46,43] pg 2.592 is stuck unclean since forever, current state down+peering, last acting [8] pg 2.725 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.588 is stuck unclean since forever, current state active+degraded+remapped, last acting [105,98] pg 2.721 is stuck unclean since forever, current state active+degraded, last acting [25] pg 2.723 is stuck unclean since forever, current state active+degraded+remapped, last acting [88,104] pg 2.722 is stuck unclean since forever, current state active+remapped, last acting [48,104,50] pg 2.584 is stuck unclean since forever, current state down+peering, last acting [68] pg 2.71e is stuck unclean since forever, current state down+peering, last acting [8] pg 2.719 is stuck unclean since forever, current state down+peering, last acting [88] pg 2.583 is stuck unclean since forever, current state active+degraded+remapped, last acting [81,48] pg 2.718 is stuck unclean since forever, current state down+peering, last acting [22] pg 2.71b is stuck unclean since forever, current state active+degraded+remapped, last acting [22,142] pg 2.71a is stuck unclean since forever, current state active+degraded+remapped, last acting [46,88] pg 2.57f is stuck unclean since forever, current state down+peering, last acting [22] pg 2.57b is stuck unclean since forever, current state down+peering, last acting [67] pg 2.575 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.577 is stuck unclean since forever, current state active+degraded+remapped, last acting [22,97] pg 2.708 is stuck unclean since forever, current state active+degraded+remapped, last acting [81,25] pg 2.56f is stuck unclean since forever, current state down+peering, last acting [43,51] pg 2.704 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.700 is stuck unclean since forever, current state active+degraded+remapped, last acting [48,51] pg 2.564 is stuck unclean since forever, current state down+peering, last acting [51] pg 2.6fd is stuck unclean since forever, current state down+peering, last acting [51] pg 2.6fc is stuck unclean since forever, current state down+peering, last acting [51] pg 2.563 is stuck unclean since forever, current state down+peering, last acting [68] pg 2.55c is stuck unclean since forever, current state active+degraded+remapped, last acting [25,68] pg 2.55f is stuck unclean since forever, current state active+degraded+remapped, last acting [68,8] pg 2.6f7 is stuck unclean since forever, current state active+degraded, last acting [142] pg 2.55b is stuck unclean since forever, current state active+degraded, last acting [142] pg 2.6f0 is stuck unclean since forever, current state down+peering, last acting [98] pg 2.55a is stuck unclean since forever, current state active+remapped, last acting [68,81,25] pg 2.6ed is stuck unclean since forever, current state active+degraded+remapped, last acting [98,105] pg 2.557 is stuck unclean since forever, current state down+peering, last acting [8] pg 2.6ec is stuck unclean since forever, current state down+peering, last acting [43] pg 2.551 is stuck unclean since forever, current state down+peering, last acting [22] pg 2.6e9 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.54d is stuck unclean since forever, current state down+peering, last acting [43] pg 2.6ea is stuck unclean since forever, current state down+peering, last acting [8] pg 2.54f is stuck unclean since forever, current state active+degraded+remapped, last acting [68,8] pg 2.54e is stuck unclean since forever, current state active+degraded+remapped, last acting [88,104] pg 2.6e6 is stuck unclean since forever, current state down+peering, last acting [22] pg 2.54a is stuck unclean since forever, current state active+remapped, last acting [8,48,51] pg 2.545 is stuck unclean since forever, current state down+peering, last acting [50] pg 2.6dd is stuck unclean since forever, current state active+degraded+remapped, last acting [22,8] pg 2.541 is stuck unclean since forever, current state down+peering, last acting [104,43] pg 2.542 is stuck unclean since forever, current state active+degraded+remapped, last acting [98,81] pg 2.6db is stuck unclean since forever, current state active+degraded, last acting [67] pg 2.6da is stuck unclean since forever, current state down+peering, last acting [98] pg 2.6d7 is stuck unclean since forever, current state down+peering, last acting [68] pg 2.539 is stuck unclean since forever, current state down+peering, last acting [98] pg 2.538 is stuck unclean since forever, current state down+peering, last acting [8] pg 2.6d1 is stuck unclean since forever, current state active+degraded, last acting [97] pg 2.6d3 is stuck unclean since forever, current state active+degraded+remapped, last acting [8,67] pg 2.535 is stuck unclean since forever, current state active+remapped, last acting [68,104,81] pg 2.6d2 is stuck unclean since forever, current state down+peering, last acting [67] pg 2.534 is stuck unclean since forever, current state active+degraded+remapped, last acting [25,67] pg 2.6cc is stuck unclean since forever, current state active+remapped, last acting [50,8,48] pg 2.532 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.529 is stuck unclean since forever, current state down+peering, last acting [105] pg 2.6c0 is stuck unclean since forever, current state active+degraded, last acting [68] pg 2.6c3 is stuck unclean since forever, current state down+peering, last acting [48] pg 2.524 is stuck unclean since forever, current state active+degraded+remapped, last acting [46,50] pg 2.6bc is stuck unclean since forever, current state down+peering, last acting [50] pg 2.526 is stuck unclean since forever, current state down+peering, last acting [48] pg 2.521 is stuck unclean since forever, current state active+degraded, last acting [81] pg 2.51c is stuck unclean since forever, current state active+degraded+remapped, last acting [46,81] pg 2.6b7 is stuck unclean since forever, current state down+peering, last acting [67] pg 2.6b1 is stuck unclean since forever, current state down+peering, last acting [22] pg 2.51a is stuck unclean since forever, current state down+peering, last acting [88] pg 2.517 is stuck unclean since forever, current state active+degraded+remapped, last acting [142,104] pg 2.511 is stuck unclean since forever, current state active+degraded+remapped, last acting [97,68] pg 2.6ab is stuck unclean since forever, current state active+degraded+remapped, last acting [43,8] pg 2.6aa is stuck unclean since forever, current state down+peering, last acting [43] pg 2.6a5 is stuck unclean since forever, current state active+remapped, last acting [105,50,88] pg 0.3e is stuck unclean since forever, current state active+degraded, last acting [40] pg 2.50a is stuck unclean since forever, current state down+peering, last acting [8] pg 0.3c is stuck unclean since forever, current state active+degraded, last acting [97] pg 2.504 is stuck unclean since forever, current state down+peering, last acting [97] pg 1.3a is stuck unclean for 898.244212, current state active+degraded, last acting [68] pg 2.69d is stuck unclean since forever, current state down+peering, last acting [67] pg 0.3a is stuck unclean for 2483.712207, current state active+degraded, last acting [43] pg 2.501 is stuck unclean since forever, current state down+peering, last acting [8] pg 1.39 is stuck unclean for 954.755076, current state active+degraded, last acting [142] pg 2.500 is stuck unclean since forever, current state down+peering, last acting [46] pg 2.503 is stuck unclean since forever, current state down+peering, last acting [104] pg 1.37 is stuck unclean for 2029.207045, current state active+degraded, last acting [22] pg 0.35 is stuck unclean for 951.964370, current state active+degraded, last acting [142] pg 1.35 is stuck unclean since forever, current state active+degraded, last acting [8] pg 2.695 is stuck unclean since forever, current state down+peering, last acting [40,46] pg 2.4ff is stuck unclean since forever, current state down+peering, last acting [68] pg 1.33 is stuck unclean for 1443.336116, current state active+degraded, last acting [68] pg 0.32 is stuck unclean for 2292.372766, current state active+degraded, last acting [98] pg 2.696 is stuck unclean since forever, current state active+degraded, last acting [22,105] pg 0.2e is stuck unclean for 1763.829274, current state active+degraded, last acting [68] pg 2.690 is stuck unclean since forever, current state active+degraded+remapped, last acting [98,48] pg 2.68d is stuck unclean since forever, current state down+peering, last acting [51] pg 2.4f7 is stuck unclean since forever, current state active+degraded+remapped, last acting [25,50] pg 2.4f6 is stuck unclean since forever, current state active+degraded, last acting [142] pg 1.28 is stuck unclean for 1077.602130, current state active+degraded, last acting [68] pg 2.689 is stuck unclean since forever, current state down+peering, last acting [50] pg 1.26 is stuck unclean for 3306.234036, current state active+degraded, last acting [50] pg 2.688 is stuck unclean since forever, current state down+peering, last acting [105] pg 1.27 is stuck unclean for 3417.645210, current state active+degraded, last acting [43] pg 2.4f2 is stuck unclean since forever, current state down+peering, last acting [46] pg 2.68b is stuck unclean since forever, current state down+peering, last acting [48] pg 1.22 is stuck unclean for 1899.114635, current state active+degraded, last acting [50] pg 2.4ee is stuck unclean since forever, current state down+peering, last acting [98] pg 2.687 is stuck unclean since forever, current state active+degraded+remapped, last acting [104,88] pg 1.20 is stuck unclean for 1187.626815, current state active+degraded, last acting [46] pg 2.686 is stuck unclean since forever, current state down+peering, last acting [104,25] pg 2.4e8 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.681 is stuck unclean since forever, current state down+peering, last acting [22] pg 2.4ea is stuck unclean since forever, current state active+degraded+remapped, last acting [88,22] pg 2.4e5 is stuck unclean since forever, current state active+degraded, last acting [67] pg 0.1c is stuck unclean for 1577.466378, current state active+degraded, last acting [105] pg 1.1d is stuck unclean since forever, current state active+degraded, last acting [88] pg 0.1b is stuck unclean for 2203.597460, current state active+degraded, last acting [25] pg 1.1a is stuck unclean since forever, current state active+degraded, last acting [67] pg 2.4e7 is stuck unclean since forever, current state active+degraded+remapped, last acting [43,48] pg 2.4e6 is stuck unclean since forever, current state down+peering, last acting [98] pg 0.19 is stuck unclean for 1741.977482, current state active+degraded, last acting [88] pg 2.67e is stuck unclean since forever, current state active+remapped, last acting [97,88,8] pg 0.18 is stuck unclean since forever, current state active+degraded, last acting [88] pg 1.19 is stuck unclean for 2055.349706, current state active+degraded, last acting [48] pg 2.679 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.678 is stuck unclean since forever, current state active+remapped, last acting [88,50,104] pg 2.67b is stuck unclean since forever, current state down+peering, last acting [40,104] pg 1.15 is stuck unclean since forever, current state active+degraded, last acting [40] pg 2.4dc is stuck unclean since forever, current state down+peering, last acting [25] pg 0.13 is stuck unclean since forever, current state active+degraded, last acting [67] pg 2.674 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.4d8 is stuck unclean since forever, current state down+peering, last acting [105] pg 1.e is stuck unclean for 2484.756021, current state active+degraded, last acting [43] pg 0.e is stuck unclean since forever, current state active+degraded, last acting [98] pg 2.4da is stuck unclean since forever, current state down+peering, last acting [98] pg 2.66d is stuck unclean since forever, current state active+degraded+remapped, last acting [81,67] pg 0.b is stuck unclean for 1981.063528, current state active+degraded, last acting [50] pg 2.66f is stuck unclean since forever, current state down+peering, last acting [68] pg 2.66e is stuck unclean since forever, current state down+peering, last acting [97] pg 0.8 is stuck unclean for 3196.929769, current state active+degraded, last acting [50] pg 2.4d3 is stuck unclean since forever, current state down+peering, last acting [68] pg 1.7 is stuck unclean since forever, current state active+degraded, last acting [48] pg 1.5 is stuck unclean for 863.634964, current state active+degraded, last acting [8] pg 0.4 is stuck unclean since forever, current state active+degraded, last acting [48] pg 2.4cc is stuck unclean since forever, current state active+remapped, last acting [81,40,98] pg 2.7fd is stuck unclean since forever, current state down+peering, last acting [51] pg 2.4ce is stuck unclean since forever, current state down+peering, last acting [22] pg 0.1 is stuck unclean for 2120.147114, current state active+degraded, last acting [105] pg 2.4c8 is stuck unclean since forever, current state down+peering, last acting [67] pg 2.7fe is stuck unclean since forever, current state down+peering, last acting [46] pg 2.7f8 is stuck unclean since forever, current state down+peering, last acting [105] pg 2.662 is stuck unclean since forever, current state active+remapped, last acting [67,43,81] pg 2.4c4 is stuck unclean since forever, current state down+peering, last acting [98] pg 2.65d is stuck unclean since forever, current state down+peering, last acting [50] pg 2.7f5 is stuck unclean since forever, current state down+peering, last acting [88] pg 2.7f7 is stuck unclean since forever, current state active+degraded+remapped, last acting [68,105] pg 2.4c0 is stuck unclean since forever, current state active+degraded+remapped, last acting [25,67] pg 2.659 is stuck unclean since forever, current state active+remapped, last acting [51,50,48] pg 2.7f3 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.4bf is stuck unclean since forever, current state down+peering, last acting [46,105] pg 2.4b9 is stuck unclean since forever, current state down+peering, last acting [8,22] pg 2.651 is stuck unclean since forever, current state active+degraded+remapped, last acting [88,50] pg 2.653 is stuck unclean since forever, current state down+peering, last acting [88] pg 2.7e8 is stuck unclean since forever, current state down+peering, last acting [142] pg 2.7eb is stuck unclean since forever, current state down+peering, last acting [22] pg 2.64f is stuck unclean since forever, current state down+peering, last acting [104] pg 2.64e is stuck unclean since forever, current state down+peering, last acting [104] pg 2.4ad is stuck unclean since forever, current state active+degraded+remapped, last acting [81,51] pg 2.7e3 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.4ac is stuck unclean since forever, current state active+degraded+remapped, last acting [50,142] pg 2.645 is stuck unclean since forever, current state down+peering, last acting [67] pg 2.4a9 is stuck unclean since forever, current state active+degraded+remapped, last acting [81,67] pg 2.7d9 is stuck unclean since forever, current state active+degraded, last acting [25] pg 2.643 is stuck unclean since forever, current state down+peering, last acting [88] pg 2.63d is stuck unclean since forever, current state down+peering, last acting [142] pg 2.4a6 is stuck unclean since forever, current state down+peering, last acting [68] pg 2.7d6 is stuck unclean since forever, current state down+peering, last acting [104] pg 2.4a3 is stuck unclean since forever, current state down+peering, last acting [104] pg 2.7d0 is stuck unclean since forever, current state down+peering, last acting [46,40] pg 2.49c is stuck unclean since forever, current state down+peering, last acting [68] pg 2.7d2 is stuck unclean since forever, current state active+degraded+remapped, last acting [40,104] pg 2.49e is stuck unclean since forever, current state down+peering, last acting [8] pg 2.631 is stuck unclean since forever, current state down+peering, last acting [142] pg 2.49b is stuck unclean since forever, current state active+degraded+remapped, last acting [46,88] pg 2.495 is stuck unclean since forever, current state active+degraded+remapped, last acting [68,88] pg 2.497 is stuck unclean since forever, current state down+peering, last acting [43] pg 2.62c is stuck unclean since forever, current state down+peering, last acting [8] pg 2.496 is stuck unclean since forever, current state active+degraded+remapped, last acting [50,46] pg 2.62e is stuck unclean since forever, current state down+peering, last acting [68] pg 2.629 is stuck unclean since forever, current state down+peering, last acting [67,105] pg 2.7c1 is stuck unclean since forever, current state down+peering, last acting [40,51] pg 2.62a is stuck unclean since forever, current state down+peering, last acting [88,68] pg 2.7c3 is stuck unclean since forever, current state down+peering, last acting [51] pg 2.48c is stuck unclean since forever, current state down+peering, last acting [67] pg 2.48f is stuck unclean since forever, current state active+degraded+remapped, last acting [51,67] pg 2.624 is stuck unclean since forever, current state down+peering, last acting [104] pg 2.489 is stuck unclean since forever, current state down+peering, last acting [142] pg 2.7bf is stuck unclean since forever, current state down+peering, last acting [48] pg 2.621 is stuck unclean since forever, current state down+peering, last acting [50] pg 2.48b is stuck unclean since forever, current state down+peering, last acting [104] pg 2.620 is stuck unclean since forever, current state down+peering, last acting [67] pg 2.48a is stuck unclean since forever, current state down+peering, last acting [97] pg 2.623 is stuck unclean since forever, current state active+degraded+remapped, last acting [50,142] pg 2.61d is stuck unclean since forever, current state down+peering, last acting [104] pg 2.7b7 is stuck unclean since forever, current state down+peering, last acting [48] pg 2.619 is stuck unclean since forever, current state active+degraded+remapped, last acting [46,97] pg 2.7b6 is stuck unclean since forever, current state down+peering, last acting [68] pg 2.483 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.61a is stuck unclean since forever, current state down+peering, last acting [50] pg 2.47c is stuck unclean since forever, current state down+peering, last acting [50] pg 2.47e is stuck unclean since forever, current state down+peering, last acting [98] pg 2.616 is stuck unclean since forever, current state active+degraded+remapped, last acting [142,48] pg 2.611 is stuck unclean since forever, current state down+peering, last acting [25,40] pg 2.47b is stuck unclean since forever, current state down+peering, last acting [97] pg 2.7a9 is stuck unclean since forever, current state active+degraded+remapped, last acting [105,98] pg 2.7ab is stuck unclean since forever, current state down+peering, last acting [50] pg 2.476 is stuck unclean since forever, current state down+peering, last acting [88,50] pg 2.7a1 is stuck unclean since forever, current state active+degraded, last acting [22] pg 2.7a0 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.7a3 is stuck unclean since forever, current state active+degraded+remapped, last acting [43,142] pg 2.605 is stuck unclean since forever, current state down+peering, last acting [88] pg 2.7a2 is stuck unclean since forever, current state down+peering, last acting [98] pg 2.601 is stuck unclean since forever, current state active+degraded+remapped, last acting [50,81] pg 2.465 is stuck unclean since forever, current state down+peering, last acting [68,51] pg 2.79b is stuck unclean since forever, current state active+remapped, last acting [142,81,98] pg 2.464 is stuck unclean since forever, current state down+peering, last acting [46] pg 2.5fd is stuck unclean since forever, current state active+degraded+remapped, last acting [22,105] pg 2.5fc is stuck unclean since forever, current state active+degraded+remapped, last acting [68,40] pg 2.5f8 is stuck unclean since forever, current state down+peering, last acting [105] pg 2.462 is stuck unclean since forever, current state down+peering, last acting [104] pg 2.793 is stuck unclean since forever, current state down+peering, last acting [142] pg 2.5f5 is stuck unclean since forever, current state down+peering, last acting [46,104] pg 2.792 is stuck unclean since forever, current state active+degraded+remapped, last acting [50,88] pg 2.45f is stuck unclean since forever, current state active+degraded+remapped, last acting [51,67] pg 2.5f4 is stuck unclean since forever, current state down+peering, last acting [48] pg 2.78d is stuck unclean since forever, current state active+degraded+remapped, last acting [88,142] pg 2.45e is stuck unclean since forever, current state active+degraded+remapped, last acting [51,98] pg 2.78c is stuck unclean since forever, current state active+degraded+remapped, last acting [98,22] pg 2.5f6 is stuck unclean since forever, current state active+degraded+remapped, last acting [48,68] pg 2.458 is stuck unclean since forever, current state active+degraded+remapped, last acting [22,46] pg 2.455 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.5ed is stuck unclean since forever, current state down+peering, last acting [22] pg 2.5ef is stuck unclean since forever, current state active+degraded+remapped, last acting [67,104] pg 2.784 is stuck unclean since forever, current state down+peering, last acting [98] pg 2.5ee is stuck unclean since forever, current state active+degraded, last acting [48] pg 2.5e9 is stuck unclean since forever, current state down+peering, last acting [22] pg 2.5ea is stuck unclean since forever, current state active+degraded, last acting [97] pg 2.5e4 is stuck unclean since forever, current state active+degraded+remapped, last acting [105,50] pg 2.77d is stuck unclean since forever, current state down+peering, last acting [46] pg 2.449 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.5e6 is stuck unclean since forever, current state down+peering, last acting [40] pg 2.44b is stuck unclean since forever, current state down+peering, last acting [43,81] pg 2.445 is stuck unclean since forever, current state active+remapped, last acting [46,88,67] pg 2.776 is stuck unclean since forever, current state down+peering, last acting [68] pg 2.442 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.5da is stuck unclean since forever, current state active+degraded+remapped, last acting [48,22] pg 2.5d5 is stuck unclean since forever, current state down+peering, last acting [88] pg 2.772 is stuck unclean since forever, current state down+peering, last acting [48] pg 2.43f is stuck unclean since forever, current state down+peering, last acting [81,22] pg 2.43e is stuck unclean since forever, current state down+peering, last acting [25,104] pg 2.5d6 is stuck unclean since forever, current state active+degraded+remapped, last acting [142,98] pg 2.5d1 is stuck unclean since forever, current state active+degraded+remapped, last acting [142,46] pg 2.769 is stuck unclean since forever, current state down+peering, last acting [68] pg 2.435 is stuck unclean since forever, current state down+peering, last acting [48] pg 2.436 is stuck unclean since forever, current state active+degraded+remapped, last acting [97,81] pg 2.5cf is stuck unclean since forever, current state active+degraded+remapped, last acting [25,105] pg 2.5c8 is stuck unclean since forever, current state active+degraded, last acting [97] pg 2.760 is stuck unclean since forever, current state active+degraded+remapped, last acting [142,8] pg 2.42d is stuck unclean since forever, current state active+degraded+remapped, last acting [25,8] pg 2.42c is stuck unclean since forever, current state active+degraded+remapped, last acting [8,104] pg 2.762 is stuck unclean since forever, current state down+peering, last acting [88] pg 2.5c6 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.75f is stuck unclean since forever, current state active+remapped, last acting [48,67,105] pg 2.5c0 is stuck unclean since forever, current state down+peering, last acting [8,25] pg 2.42a is stuck unclean since forever, current state down+peering, last acting [40,97] pg 2.75b is stuck unclean since forever, current state down+peering, last acting [48] pg 2.426 is stuck unclean since forever, current state down+peering, last acting [81] pg 2.5bf is stuck unclean since forever, current state down+peering, last acting [8] pg 2.757 is stuck unclean since forever, current state down+peering, last acting [104] pg 2.750 is stuck unclean since forever, current state active+degraded+remapped, last acting [25,8] pg 2.5ba is stuck unclean since forever, current state down+peering, last acting [22] pg 2.752 is stuck unclean since forever, current state down+peering, last acting [97] pg 2.41f is stuck unclean since forever, current state active+degraded+remapped, last acting [46,43] pg 2.418 is stuck unclean since forever, current state active+remapped, last acting [43,51,50] pg 2.41b is stuck unclean since forever, current state down+peering, last acting [97] pg 2.5b0 is stuck unclean since forever, current state down+peering, last acting [105,40] pg 2.415 is stuck unclean since forever, current state down+peering, last acting [50] pg 2.5b2 is stuck unclean since forever, current state down+peering, last acting [43] pg 2.414 is stuck unclean since forever, current state active+degraded+remapped, last acting [43,104] pg 2.412 is stuck unclean since forever, current state down+peering, last acting [67] pg 2.5a5 is stuck unclean since forever, current state down+peering, last acting [25] pg 2.5a4 is stuck unclean since forever, current state active+degraded+remapped, last acting [46,43] pg 2.1af is stale+active+clean, acting [146,103,38] pg 2.1ae is active+degraded, acting [142] pg 2.1a9 is stale+active+clean, acting [130,19,111] pg 2.1a8 is stale+active+clean, acting [77,120,66] pg 2.1ab is stale+active+clean, acting [91,120,2] pg 2.1aa is stale+active+clean, acting [83,64,71] pg 2.1a5 is stale+active+clean, acting [19,128,9] pg 2.1a4 is active+degraded, acting [43] pg 2.1a7 is stale+active+clean, acting [16,3,49] pg 2.1a6 is stale+active+clean, acting [117,76,123] pg 2.1a1 is stale+active+clean, acting [20,82,140] pg 2.1a0 is stale+active+clean, acting [7,16,147] pg 2.1a3 is active+degraded, acting [46] pg 2.1a2 is active+degraded, acting [40] pg 2.19d is active+degraded, acting [40] pg 2.19c is stale+active+clean, acting [37,75,96] pg 2.19f is stale+active+clean, acting [85,32,23] pg 2.19e is active+degraded, acting [68] pg 2.199 is stale+active+clean, acting [23,107,65] pg 2.198 is active+degraded, acting [105] pg 2.19b is active+degraded, acting [51] pg 2.19a is active+degraded, acting [142] pg 2.195 is active+degraded, acting [105] pg 2.194 is stale+active+clean, acting [126,26,61] pg 2.197 is stale+active+clean, acting [7,59,73] pg 2.196 is stale+active+clean, acting [136,124,133] pg 2.191 is active+degraded, acting [46,81] pg 2.190 is active+degraded, acting [81,22] pg 2.193 is active+degraded, acting [142] pg 2.192 is stale+active+clean, acting [76,64,121] pg 2.18d is stale+active+clean, acting [71,78,38] pg 2.18c is stale+active+clean, acting [73,86,106] pg 2.18f is active+degraded, acting [142] pg 2.18e is stale+active+clean, acting [116,133,24] pg 2.189 is stale+active+clean, acting [111,5,101] pg 2.188 is active+degraded, acting [98] pg 2.18b is stale+active+clean, acting [131,143,113] pg 2.18a is stale+active+clean, acting [5,110,123] pg 2.185 is stale+active+clean, acting [65,129,73] pg 2.184 is stale+active+clean, acting [55,19,41] pg 2.187 is stale+active+clean, acting [61,76,143] pg 2.186 is active+degraded, acting [98,51] pg 2.181 is active+degraded, acting [40] pg 2.180 is stale+active+clean, acting [16,149,130] pg 2.183 is active+degraded, acting [48] pg 2.182 is active+degraded, acting [104] pg 2.17d is stale+active+clean, acting [135,123,29] pg 2.17c is stale+active+clean, acting [96,107,64] pg 2.17f is stale+active+clean, acting [77,38,23] pg 2.17e is active+degraded, acting [22] pg 2.179 is stale+active+clean, acting [41,45,78] pg 2.178 is stale+active+clean, acting [146,140,34] pg 2.17b is stale+active+clean, acting [61,143,78] pg 2.17a is stale+active+clean, acting [102,39,23] pg 2.175 is stale+active+clean, acting [49,84,32] pg 2.174 is stale+active+clean, acting [90,21,131] pg 2.177 is active+degraded, acting [97] pg 2.171 is active+degraded, acting [46] pg 2.170 is active+degraded, acting [8] pg 2.173 is stale+active+clean, acting [149,75,10] pg 2.172 is stale+active+clean, acting [60,125,108] pg 2.16d is active+degraded, acting [8] pg 2.16c is active+degraded, acting [97] pg 2.16f is stale+active+clean, acting [149,33,10] pg 2.16e is stale+active+clean, acting [131,141,149] pg 2.169 is stale+active+clean, acting [1,17,70] pg 2.168 is stale+active+clean, acting [29,138,118] pg 2.16b is stale+active+clean, acting [45,130,36] pg 2.16a is stale+active+clean, acting [79,73,91] pg 2.165 is stale+active+clean, acting [85,93,78] pg 2.164 is stale+active+clean, acting [141,20,83] pg 2.167 is stale+active+clean, acting [12,101,76] pg 2.166 is stale+active+clean, acting [134,149,1] pg 2.161 is active+degraded, acting [67] pg 2.160 is stale+active+clean, acting [61,58,119] pg 2.163 is stale+active+clean, acting [92,126,96] pg 2.162 is stale+active+clean, acting [138,76,20] pg 2.15d is stale+active+clean, acting [134,52,95] pg 2.15c is active+degraded, acting [68] pg 2.15f is active+degraded, acting [8] pg 2.15e is active+degraded, acting [43] pg 2.159 is active+degraded, acting [25] pg 2.158 is active+degraded, acting [48] pg 2.15b is active+degraded, acting [25] pg 2.15a is active+degraded, acting [25] pg 2.155 is stale+active+clean, acting [128,47,137] pg 2.154 is stale+active+clean, acting [26,85,75] pg 2.157 is stale+active+clean, acting [103,63,101] pg 2.156 is active+degraded, acting [81] pg 2.151 is stale+active+clean, acting [49,59,4] pg 2.150 is active+degraded, acting [48] pg 2.153 is stale+active+clean, acting [79,9,143] pg 2.152 is stale+active+clean, acting [136,107,19] pg 2.14d is stale+active+clean, acting [60,133,73] pg 2.14c is stale+active+clean, acting [145,65,133] pg 2.14f is active+degraded, acting [8] pg 2.14e is active+degraded, acting [104] pg 2.149 is stale+active+clean, acting [146,1,92] pg 2.148 is stale+active+clean, acting [102,10,70] pg 2.14b is stale+active+clean, acting [45,17,128] pg 2.14a is active+degraded, acting [51] pg 2.145 is stale+active+clean, acting [131,147,137] pg 2.144 is stale+active+clean, acting [79,145,10] pg 2.147 is stale+active+clean, acting [18,86,5] pg 2.146 is active+degraded, acting [104] pg 2.141 is stale+active+clean, acting [144,114,58] pg 2.140 is stale+active+clean, acting [146,4,36] pg 2.143 is active+degraded, acting [48] pg 2.142 is active+degraded, acting [98,81] pg 2.13d is stale+active+clean, acting [103,84,120] pg 2.13c is active+degraded, acting [97] pg 2.13f is stale+active+clean, acting [89,93,103] pg 2.13e is active+degraded, acting [105] pg 2.139 is stale+active+clean, acting [136,103,118] pg 2.138 is stale+active+clean, acting [143,89,131] pg 2.13b is stale+active+clean, acting [108,113,96] pg 2.13a is stale+active+clean, acting [95,62,5] pg 2.135 is active+degraded, acting [81] pg 2.134 is active+degraded, acting [67] pg 2.137 is stale+active+clean, acting [114,122,130] pg 2.136 is stale+active+clean, acting [119,113,52] pg 2.131 is stale+active+clean, acting [118,58,84] pg 2.130 is stale+active+clean, acting [103,144,61] pg 2.133 is active+degraded, acting [46] pg 2.132 is stale+active+clean, acting [119,63,30] pg 2.12d is stale+active+clean, acting [87,146,28] pg 2.12c is stale+active+clean, acting [143,37,30] pg 2.12f is stale+active+clean, acting [129,121,112] pg 2.12e is stale+active+clean, acting [125,15,54] pg 2.129 is stale+active+clean, acting [149,3,141] pg 2.128 is stale+active+clean, acting [34,49,137] pg 2.12b is stale+active+clean, acting [132,122,91] pg 2.12a is stale+active+clean, acting [125,65,126] pg 2.125 is stale+active+clean, acting [123,31,39] pg 2.124 is active+degraded, acting [50] pg 2.127 is stale+active+clean, acting [85,47,109] pg 2.126 is stale+active+clean, acting [129,85,19] pg 2.121 is active+degraded, acting [81] pg 2.120 is stale+active+clean, acting [33,72,42] pg 2.123 is active+degraded, acting [46] pg 2.122 is active+degraded, acting [48] pg 2.11d is stale+active+clean, acting [133,118,37] pg 2.11c is active+degraded, acting [81] pg 2.11f is stale+active+clean, acting [10,30,122] pg 2.11e is stale+active+clean, acting [146,2,110] pg 2.119 is stale+active+clean, acting [57,112,24] pg 2.118 is stale+active+clean, acting [102,101,38] pg 2.11b is active+degraded, acting [8] pg 2.11a is stale+active+clean, acting [62,79,26] pg 2.115 is stale+active+clean, acting [20,3,41] pg 2.114 is active+degraded, acting [104,68] pg 2.117 is active+degraded, acting [104] pg 2.116 is stale+active+clean, acting [18,7,66] pg 2.111 is active+degraded, acting [68] pg 2.110 is stale+active+clean, acting [44,78,91] pg 2.113 is active+degraded, acting [81] pg 2.112 is stale+active+clean, acting [3,100,14] pg 2.10d is active+degraded, acting [46] pg 2.10c is stale+active+clean, acting [140,127,26] pg 2.10f is active+degraded, acting [98] pg 2.10e is stale+active+clean, acting [84,102,96] pg 2.109 is active+degraded, acting [48] pg 2.108 is stale+active+clean, acting [132,123,38] pg 2.10b is active+degraded, acting [68,88] pg 2.10a is stale+active+clean, acting [16,54,120] pg 2.105 is active+degraded, acting [22] pg 2.104 is stale+active+clean, acting [136,1,74] pg 2.107 is stale+active+clean, acting [106,61,144] pg 2.106 is stale+active+clean, acting [102,134,96] pg 2.101 is stale+active+clean, acting [64,125,80] pg 2.100 is stale+active+clean, acting [38,5,148] pg 2.103 is stale+active+clean, acting [130,9,122] pg 2.102 is active+degraded, acting [88,81] pg 2.fd is stale+active+clean, acting [55,114,144] pg 2.fc is active+degraded, acting [98,105] pg 2.ff is stale+active+clean, acting [10,33,49] pg 2.fe is stale+active+clean, acting [66,73,75] pg 2.f9 is stale+active+clean, acting [61,149,54] pg 2.f8 is stale+active+clean, acting [21,114,82] pg 2.fb is stale+active+clean, acting [39,32,69] pg 2.fa is stale+active+clean, acting [16,102,147] pg 2.f5 is stale+active+clean, acting [99,58,60] pg 2.f4 is active+degraded, acting [51] pg 2.f7 is active+degraded, acting [50] pg 2.f6 is active+degraded, acting [142] pg 2.f1 is stale+active+clean, acting [2,139,143] pg 2.f0 is stale+active+clean, acting [58,11,120] pg 2.f3 is stale+active+clean, acting [113,95,109] pg 2.f2 is stale+active+clean, acting [57,44,13] pg 2.ed is stale+active+clean, acting [34,73,117] pg 2.ec is stale+active+clean, acting [72,82,86] pg 2.ef is stale+active+clean, acting [75,47,16] pg 2.ee is stale+active+clean, acting [86,1,74] pg 2.e9 is stale+active+clean, acting [123,103,35] pg 2.e8 is stale+active+clean, acting [119,29,140] pg 2.eb is active+degraded, acting [25] pg 2.ea is active+degraded, acting [22] pg 2.e5 is active+degraded, acting [40] pg 2.e4 is active+degraded, acting [43] pg 2.e7 is active+degraded, acting [48] pg 2.e6 is stale+active+clean, acting [133,145,110] pg 2.e1 is active+degraded, acting [25] pg 2.e0 is stale+active+clean, acting [70,130,139] pg 2.e3 is stale+active+clean, acting [6,118,111] pg 2.e2 is stale+active+clean, acting [66,58,100] pg 2.dd is stale+active+clean, acting [115,58,118] pg 2.dc is stale+active+clean, acting [6,16,44] pg 2.df is stale+active+clean, acting [33,63,74] pg 2.de is stale+active+clean, acting [87,144,29] pg 2.d9 is active+degraded, acting [25] pg 2.d8 is stale+active+clean, acting [73,80,16] pg 2.db is stale+active+clean, acting [110,7,124] pg 2.da is stale+active+clean, acting [14,106,24] pg 2.d5 is stale+active+clean, acting [27,72,65] pg 2.d4 is stale+active+clean, acting [34,139,20] pg 2.d7 is active+degraded, acting [50] pg 2.d6 is stale+active+clean, acting [55,122,117] pg 2.d1 is stale+active+clean, acting [19,114,133] pg 2.d0 is stale+active+clean, acting [100,57,137] pg 2.d3 is stale+active+clean, acting [102,18,62] pg 2.d2 is stale+active+clean, acting [21,136,107] pg 2.cd is stale+active+clean, acting [110,74,32] pg 2.cc is active+degraded, acting [40,98] pg 2.cf is active+degraded, acting [88] pg 2.ce is stale+active+clean, acting [19,42,53] pg 2.c9 is active+degraded, acting [46] pg 2.c8 is stale+active+clean, acting [9,56,146] pg 2.cb is stale+active+clean, acting [17,124,131] pg 2.ca is active+degraded, acting [105] pg 2.c5 is active+degraded, acting [104] pg 2.c4 is stale+active+clean, acting [93,57,92] pg 2.c7 is active+degraded, acting [104] pg 2.c6 is stale+active+clean, acting [56,99,17] pg 2.c1 is stale+active+clean, acting [112,127,26] pg 2.c0 is active+degraded, acting [67] pg 2.c3 is stale+active+clean, acting [5,12,94] pg 2.c2 is stale+active+clean, acting [109,93,60] pg 2.bd is active+degraded, acting [48] pg 2.bc is stale+active+clean, acting [135,72,28] pg 2.bf is stale+active+clean, acting [76,15,49] pg 2.be is stale+active+clean, acting [12,73,127] pg 2.b9 is stale+active+clean, acting [138,99,6] pg 2.b8 is stale+active+clean, acting [121,87,80] pg 2.bb is stale+active+clean, acting [84,147,75] pg 2.ba is stale+active+clean, acting [56,144,10] pg 2.b5 is stale+active+clean, acting [145,27,64] pg 2.b4 is stale+active+clean, acting [140,95,80] pg 2.b7 is active+degraded, acting [25] pg 2.b6 is stale+active+clean, acting [128,149,13] pg 2.b1 is stale+active+clean, acting [41,131,146] pg 2.b0 is stale+active+clean, acting [24,79,12] pg 2.b3 is stale+active+clean, acting [53,64,24] pg 2.b2 is stale+active+clean, acting [82,60,99] pg 2.ad is active+degraded, acting [51] pg 2.ac is active+degraded, acting [142] pg 2.af is stale+active+clean, acting [28,91,122] pg 2.ae is active+degraded, acting [51] pg 2.a9 is active+degraded, acting [67] pg 2.a8 is active+degraded, acting [46] pg 2.ab is active+degraded, acting [50] pg 2.aa is stale+active+clean, acting [128,123,64] pg 2.a5 is stale+active+clean, acting [17,93,108] pg 2.a4 is active+degraded, acting [8] pg 2.a7 is stale+active+clean, acting [35,101,5] pg 2.a6 is stale+active+clean, acting [146,80,114] pg 2.a1 is active+degraded, acting [105] pg 2.a0 is active+degraded, acting [22] pg 2.a3 is stale+active+clean, acting [49,84,80] pg 2.a2 is stale+active+clean, acting [9,69,55] pg 2.9d is active+degraded, acting [88] pg 2.9c is stale+active+clean, acting [129,119,137] pg 2.9f is stale+active+clean, acting [117,123,52] pg 2.9e is stale+active+clean, acting [84,7,146] pg 2.99 is stale+active+clean, acting [144,140,2] pg 2.98 is active+degraded, acting [25] pg 2.9b is active+degraded, acting [88] pg 2.9a is stale+active+clean, acting [35,30,101] pg 2.95 is active+degraded, acting [88] pg 2.94 is stale+active+clean, acting [126,35,100] pg 2.97 is stale+active+clean, acting [39,30,121] pg 2.96 is active+degraded, acting [46] pg 2.91 is stale+active+clean, acting [77,99,41] pg 2.90 is stale+active+clean, acting [24,28,92] pg 2.93 is stale+active+clean, acting [139,0,95] pg 2.92 is stale+active+clean, acting [64,123,27] pg 2.8d is stale+active+clean, acting [6,99,14] pg 2.8c is stale+active+clean, acting [83,62,101] pg 2.8f is active+degraded, acting [67] pg 2.8e is stale+active+clean, acting [148,79,16] pg 2.89 is stale+active+clean, acting [45,108,39] pg 2.88 is active+degraded, acting [97] pg 2.8b is stale+active+clean, acting [59,71,76] pg 2.8a is stale+active+clean, acting [13,82,45] pg 2.85 is stale+active+clean, acting [1,72,13] pg 2.84 is stale+active+clean, acting [13,147,78] pg 2.87 is stale+active+clean, acting [110,49,133] pg 2.86 is stale+active+clean, acting [52,134,20] pg 2.81 is stale+active+clean, acting [108,123,134] pg 2.80 is active+degraded, acting [68] pg 2.83 is stale+active+clean, acting [24,31,115] pg 2.82 is stale+active+clean, acting [26,31,112] pg 2.7d is stale+active+clean, acting [33,17,120] pg 2.7c is stale+active+clean, acting [32,39,47] pg 2.7f is stale+active+clean, acting [107,100,87] pg 2.7e is stale+active+clean, acting [89,108,20] pg 2.79 is stale+active+clean, acting [61,143,53] pg 2.78 is stale+active+clean, acting [114,0,123] pg 2.7b is stale+active+clean, acting [71,5,136] pg 2.7a is active+degraded, acting [81,98] pg 2.75 is stale+active+clean, acting [38,122,129] pg 2.74 is stale+active+clean, acting [94,111,108] pg 2.77 is stale+active+clean, acting [35,124,109] pg 2.76 is stale+active+clean, acting [73,59,53] pg 2.71 is active+degraded, acting [50] pg 2.70 is stale+active+clean, acting [52,12,73] pg 2.73 is stale+active+clean, acting [76,125,62] pg 2.72 is active+degraded, acting [68] pg 2.6d is active+degraded, acting [67] pg 2.6c is stale+active+clean, acting [139,31,19] pg 2.6f is stale+active+clean, acting [34,26,61] pg 2.6e is stale+active+clean, acting [21,107,16] pg 2.69 is active+degraded, acting [97] pg 2.68 is active+degraded, acting [43] pg 2.6b is active+degraded, acting [25] pg 2.6a is active+degraded, acting [104] pg 2.65 is stale+active+clean, acting [53,136,94] pg 2.64 is stale+active+clean, acting [71,133,66] pg 2.67 is active+degraded, acting [68] pg 2.66 is stale+active+clean, acting [3,138,49] pg 2.61 is stale+active+clean, acting [76,118,13] pg 2.60 is stale+active+clean, acting [74,103,41] pg 2.63 is stale+active+clean, acting [140,146,3] pg 2.62 is stale+active+clean, acting [86,144,54] pg 2.5d is active+degraded, acting [67] pg 2.5c is stale+active+clean, acting [14,44,128] pg 2.5f is active+degraded, acting [67] pg 2.5e is active+degraded, acting [98] pg 2.59 is active+degraded, acting [98] pg 2.58 is active+degraded, acting [46] pg 2.5b is stale+active+clean, acting [115,121,32] pg 2.5a is stale+active+clean, acting [18,13,55] pg 2.55 is stale+active+clean, acting [84,101,7] pg 2.54 is stale+active+clean, acting [55,20,17] pg 2.57 is stale+active+clean, acting [18,53,91] pg 2.56 is stale+active+clean, acting [145,15,28] pg 2.51 is active+degraded, acting [51] pg 2.50 is active+degraded, acting [51] pg 2.53 is active+degraded, acting [67] pg 2.52 is stale+active+clean, acting [17,100,34] pg 2.4d is active+degraded, acting [50] pg 2.4c is stale+active+clean, acting [31,119,59] pg 2.4f is stale+active+clean, acting [61,145,28] pg 2.4e is stale+active+clean, acting [121,52,62] pg 2.49 is stale+active+clean, acting [32,21,38] pg 2.48 is active+degraded, acting [98] pg 2.4b is stale+active+clean, acting [35,99,80] pg 2.4a is active+degraded, acting [67] pg 2.45 is active+degraded, acting [67] pg 2.44 is active+degraded, acting [22] pg 2.47 is active+degraded, acting [104] pg 2.46 is active+degraded, acting [142] pg 2.41 is stale+active+clean, acting [65,57,119] pg 2.40 is stale+active+clean, acting [58,101,37] pg 2.43 is active+degraded, acting [142] pg 2.42 is stale+active+clean, acting [118,11,0] pg 2.3d is active+degraded, acting [88,68] pg 1.3e is stale+active+clean, acting [35,6,47] pg 0.3f is stale+active+clean, acting [54,71,42] pg 2.3c is active+degraded, acting [142] pg 1.3f is active+degraded, acting [50] pg 0.3e is active+degraded, acting [40] pg 2.3f is stale+active+clean, acting [1,93,113] pg 1.3c is stale+active+clean, acting [112,124,78] pg 0.3d is stale+active+clean, acting [107,95,134] pg 2.3e is stale+active+clean, acting [100,42,75] pg 1.3d is stale+active+clean, acting [89,47,128] pg 0.3c is active+degraded, acting [97] pg 2.39 is stale+active+clean, acting [21,1,61] pg 1.3a is active+degraded, acting [68] pg 0.3b is stale+active+clean, acting [28,70,117] pg 2.38 is active+degraded, acting [43] pg 1.3b is stale+active+clean, acting [87,130,95] pg 0.3a is active+degraded, acting [43] pg 2.3b is active+degraded, acting [43] pg 1.38 is stale+active+clean, acting [99,117,27] pg 0.39 is stale+active+clean, acting [9,82,118] pg 2.3a is stale+active+clean, acting [52,42,95] pg 1.39 is active+degraded, acting [142] pg 0.38 is stale+active+clean, acting [36,126,19] pg 2.35 is stale+active+clean, acting [42,100,79] pg 1.36 is stale+active+clean, acting [123,127,110] pg 0.37 is stale+active+clean, acting [84,75,72] pg 2.34 is stale+active+clean, acting [101,15,77] pg 1.37 is active+degraded, acting [22] pg 0.36 is stale+active+clean, acting [17,120,80] pg 2.37 is stale+active+clean, acting [33,147,136] pg 1.34 is stale+active+clean, acting [44,15,32] pg 0.35 is active+degraded, acting [142] pg 2.36 is active+degraded, acting [81] pg 1.35 is active+degraded, acting [8] pg 0.34 is stale+active+clean, acting [115,146,0] pg 2.31 is stale+active+clean, acting [124,56,111] pg 1.32 is stale+active+clean, acting [106,146,136] pg 0.33 is stale+active+clean, acting [116,101,130] pg 2.30 is stale+active+clean, acting [112,19,0] pg 1.33 is active+degraded, acting [68] pg 0.32 is active+degraded, acting [98] pg 2.33 is active+degraded, acting [51] pg 1.30 is stale+active+clean, acting [116,95,130] pg 0.31 is stale+active+clean, acting [32,93,38] pg 2.32 is active+degraded, acting [67] pg 1.31 is stale+active+clean, acting [103,18,137] pg 0.30 is active+degraded, acting [22] pg 2.2d is active+degraded, acting [8] pg 1.2e is stale+active+clean, acting [122,127,65] pg 0.2f is stale+active+clean, acting [148,63,102] pg 2.2c is active+degraded, acting [104] pg 1.2f is stale+active+clean, acting [56,39,24] pg 0.2e is active+degraded, acting [68] pg 2.2f is stale+active+clean, acting [127,117,118] pg 0.2d is stale+active+clean, acting [92,148,83] pg 1.2c is active+degraded, acting [68] pg 2.2e is active+degraded, acting [25] pg 0.2c is stale+active+clean, acting [93,0,84] pg 1.2d is stale+active+clean, acting [107,63,122] pg 2.29 is active+degraded, acting [97] pg 0.2b is stale+active+clean, acting [42,101,131] pg 1.2a is stale+active+clean, acting [116,76,146] pg 2.28 is active+degraded, acting [46] pg 0.2a is stale+active+clean, acting [20,64,32] pg 1.2b is active+degraded, acting [46] pg 2.2b is active+degraded, acting [40,68] pg 0.29 is stale+active+clean, acting [74,6,89] pg 1.28 is active+degraded, acting [68] pg 2.2a is stale+active+clean, acting [54,143,12] pg 0.28 is stale+active+clean, acting [126,89,71] pg 1.29 is stale+active+clean, acting [119,5,17] pg 2.25 is stale+active+clean, acting [110,109,18] pg 0.27 is stale+active+clean, acting [4,66,69] pg 1.26 is active+degraded, acting [50] pg 2.24 is stale+active+clean, acting [6,69,115] pg 0.26 is stale+active+clean, acting [126,134,20] pg 1.27 is active+degraded, acting [43] pg 2.27 is stale+active+clean, acting [56,64,21] pg 0.25 is stale+active+clean, acting [114,132,143] pg 1.24 is stale+active+clean, acting [3,139,120] pg 2.26 is stale+active+clean, acting [73,27,14] pg 0.24 is stale+active+clean, acting [123,132,59] pg 1.25 is stale+active+clean, acting [139,93,56] pg 2.21 is stale+active+clean, acting [139,94,109] pg 0.23 is stale+active+clean, acting [115,100,129] pg 1.22 is active+degraded, acting [50] pg 2.20 is stale+active+clean, acting [70,112,27] pg 0.22 is stale+active+clean, acting [118,116,0] pg 1.23 is stale+active+clean, acting [32,9,148] pg 2.23 is stale+active+clean, acting [36,19,82] pg 0.21 is active+degraded, acting [88] pg 1.20 is active+degraded, acting [46] pg 2.22 is active+degraded, acting [68] pg 0.20 is stale+active+clean, acting [65,2,99] pg 1.21 is stale+active+clean, acting [148,11,130] pg 2.1d is active+degraded, acting [67] pg 0.1f is stale+active+clean, acting [148,32,65] pg 1.1e is stale+active+clean, acting [114,73,56] pg 2.1c is stale+active+clean, acting [34,146,10] pg 0.1e is stale+active+clean, acting [110,1,145] pg 1.1f is stale+active+clean, acting [118,36,79] pg 2.1f is active+degraded, acting [43] pg 0.1d is stale+active+clean, acting [13,57,122] pg 1.1c is stale+active+clean, acting [18,137,58] pg 2.1e is active+degraded, acting [46] pg 0.1c is active+degraded, acting [105] pg 1.1d is active+degraded, acting [88] pg 2.19 is active+degraded, acting [40] pg 0.1b is active+degraded, acting [25] pg 1.1a is active+degraded, acting [67] pg 2.18 is active+degraded, acting [50,51] pg 0.1a is stale+active+clean, acting [87,4,93] pg 1.1b is active+degraded, acting [68] pg 2.1b is stale+active+clean, acting [69,141,7] pg 0.19 is active+degraded, acting [88] pg 1.18 is active+degraded, acting [97] pg 2.1a is stale+active+clean, acting [82,124,139] pg 0.18 is active+degraded, acting [88] pg 1.19 is active+degraded, acting [48] pg 2.15 is stale+active+clean, acting [1,118,90] pg 0.17 is stale+active+clean, acting [32,91,144] pg 1.16 is stale+active+clean, acting [91,33,122] pg 2.14 is active+degraded, acting [104] pg 0.16 is stale+active+clean, acting [122,115,103] pg 1.17 is active+degraded, acting [97] pg 2.17 is active+degraded, acting [81] pg 0.15 is stale+active+clean, acting [29,44,87] pg 1.14 is stale+active+clean, acting [64,99,4] pg 2.16 is stale+active+clean, acting [15,6,93] pg 0.14 is stale+active+clean, acting [1,74,13] pg 1.15 is active+degraded, acting [40] pg 2.11 is stale+active+clean, acting [55,42,149] pg 0.13 is active+degraded, acting [67] pg 1.12 is stale+active+clean, acting [108,136,49] pg 2.10 is stale+active+clean, acting [149,84,2] pg 0.12 is stale+active+clean, acting [141,101,6] pg 1.13 is stale+active+clean, acting [86,119,52] pg 2.13 is active+degraded, acting [88] pg 0.11 is stale+active+clean, acting [92,71,126] pg 1.10 is stale+active+clean, acting [35,108,149] pg 2.12 is stale+active+clean, acting [3,141,120] pg 0.10 is stale+active+clean, acting [130,123,141] pg 1.11 is stale+active+clean, acting [86,19,30] pg 2.d is stale+active+clean, acting [95,10,34] pg 1.e is active+degraded, acting [43] pg 0.f is stale+active+clean, acting [2,118,114] pg 2.c is stale+active+clean, acting [138,19,75] pg 1.f is stale+active+clean, acting [148,140,30] pg 0.e is active+degraded, acting [98] pg 2.f is active+degraded, acting [8,22] pg 1.c is stale+active+clean, acting [44,114,106] pg 0.d is active+degraded, acting [43] pg 2.e is active+degraded, acting [142] pg 1.d is stale+active+clean, acting [99,89,58] pg 0.c is stale+active+clean, acting [89,69,52] pg 2.9 is active+degraded, acting [97] pg 1.a is stale+active+clean, acting [33,9,95] pg 0.b is active+degraded, acting [50] pg 2.8 is stale+active+clean, acting [132,60,47] pg 1.b is stale+active+clean, acting [130,14,149] pg 0.a is stale+active+clean, acting [23,116,30] pg 2.b is stale+active+clean, acting [26,109,116] pg 1.8 is stale+active+clean, acting [99,58,12] pg 0.9 is stale+active+clean, acting [109,35,71] pg 2.a is stale+active+clean, acting [44,139,102] pg 1.9 is stale+active+clean, acting [24,110,132] pg 0.8 is active+degraded, acting [50] pg 2.5 is active+degraded, acting [8] pg 1.6 is stale+active+clean, acting [95,113,102] pg 0.7 is stale+active+clean, acting [7,124,41] pg 2.4 is stale+active+clean, acting [11,34,118] pg 1.7 is active+degraded, acting [48] pg 0.6 is stale+active+clean, acting [106,101,59] pg 2.7 is active+degraded, acting [40] pg 1.4 is stale+active+clean, acting [52,118,140] pg 0.5 is stale+active+clean, acting [18,79,112] pg 2.6 is stale+active+clean, acting [149,116,128] pg 1.5 is active+degraded, acting [8] pg 0.4 is active+degraded, acting [48] pg 2.1 is stale+active+clean, acting [102,92,74] pg 0.3 is stale+active+clean, acting [115,107,49] pg 1.2 is stale+active+clean, acting [92,71,102] pg 2.0 is stale+active+clean, acting [3,24,138] pg 1.3 is stale+active+clean, acting [63,149,27] pg 0.2 is stale+active+clean, acting [65,53,47] pg 2.3 is stale+active+clean, acting [47,131,84] pg 0.1 is active+degraded, acting [105] pg 1.0 is stale+active+clean, acting [38,34,148] pg 2.2 is stale+active+clean, acting [28,35,94] pg 0.0 is stale+active+clean, acting [52,39,24] pg 1.1 is stale+active+clean, acting [94,59,109] pg 2.7fd is down+peering, acting [51] pg 2.7fc is stale+active+clean, acting [106,36,125] pg 2.7ff is stale+active+clean, acting [112,75,100] pg 2.7fe is down+peering, acting [46] pg 2.7f9 is stale+active+clean, acting [121,132,136] pg 2.7f8 is down+peering, acting [105] pg 2.7fb is stale+active+clean, acting [100,136,8] pg 2.7fa is stale+active+clean, acting [41,103,47] pg 2.7f5 is down+peering, acting [88] pg 2.7f4 is stale+active+clean, acting [24,131,112] pg 2.7f7 is active+degraded+remapped, acting [68,105] pg 2.7f1 is stale+active+clean, acting [135,55,22] pg 2.7f0 is stale+active+clean, acting [1,63,144] pg 2.7f3 is down+peering, acting [97] pg 2.7f2 is stale+active+clean, acting [62,57,72] pg 2.7ed is stale+active+clean, acting [70,75,115] pg 2.7ec is stale+active+clean, acting [76,70,91] pg 2.7ef is stale+active+clean, acting [32,68,135] pg 2.7ee is stale+active+clean, acting [0,25,136] pg 2.7e9 is stale+active+clean, acting [45,30,41] pg 2.7e8 is down+peering, acting [142] pg 2.7eb is down+peering, acting [22] pg 2.7ea is stale+active+clean, acting [69,51,59] pg 2.7e5 is stale+active+clean, acting [5,73,40] pg 2.7e4 is stale+active+clean, acting [116,7,26] pg 2.7e7 is stale+active+clean, acting [29,148,110] pg 2.7e6 is stale+active+clean, acting [125,59,29] pg 2.7e1 is stale+active+clean, acting [56,69,113] pg 2.7e0 is stale+active+clean, acting [74,36,79] pg 2.7e3 is down+peering, acting [97] pg 2.7e2 is stale+active+clean, acting [20,77,41] pg 2.7dd is stale+active+clean, acting [70,33,17] pg 2.7dc is stale+active+clean, acting [144,114,8] pg 2.7df is stale+active+clean, acting [73,91,130] pg 2.7de is stale+active+clean, acting [61,72,54] pg 2.7d9 is active+degraded, acting [25] pg 2.7d8 is stale+active+clean, acting [125,127,134] pg 2.7db is stale+active+clean, acting [42,82,22] pg 2.7da is stale+active+clean, acting [10,100,82] pg 2.7d5 is stale+active+clean, acting [38,57,47] pg 2.7d4 is stale+active+clean, acting [84,106,47] pg 2.7d7 is stale+active+clean, acting [92,75,146] pg 2.7d6 is down+peering, acting [104] pg 2.7d0 is down+peering, acting [46,40] pg 2.7d3 is stale+active+clean, acting [140,22,55] pg 2.7d2 is active+degraded+remapped, acting [40,104] pg 2.7cd is stale+active+clean, acting [93,86,6] pg 2.7cc is stale+active+clean, acting [136,8,120] pg 2.7cf is stale+active+clean, acting [110,31,70] pg 2.7ce is stale+active+clean, acting [33,97,9] pg 2.7c9 is stale+active+clean, acting [6,19,88] pg 2.7c8 is stale+active+clean, acting [16,29,125] pg 2.7cb is stale+active+clean, acting [91,46,29] pg 2.7c5 is stale+active+clean, acting [87,0,148] pg 2.7c4 is stale+active+clean, acting [41,76,123] pg 2.7c7 is stale+active+clean, acting [118,104,62] pg 2.7c6 is stale+active+clean, acting [136,47,106] pg 2.7c1 is down+peering, acting [40,51] pg 2.7c0 is stale+active+clean, acting [30,49,113] pg 2.7c3 is down+peering, acting [51] pg 2.7bd is stale+active+clean, acting [66,100,108] pg 2.7bc is stale+active+clean, acting [101,140,105] pg 2.7bf is down+peering, acting [48] pg 2.7be is stale+active+clean, acting [134,109,118] pg 2.7b9 is stale+active+clean, acting [78,94,89] pg 2.7b8 is stale+active+clean, acting [149,32,16] pg 2.7bb is stale+active+clean, acting [135,20,29] pg 2.7ba is stale+active+clean, acting [6,147,37] pg 2.7b5 is stale+active+clean, acting [137,95,0] pg 2.7b4 is stale+active+clean, acting [72,77,112] pg 2.7b7 is down+peering, acting [48] pg 2.7b6 is down+peering, acting [68] pg 2.7b1 is stale+active+clean, acting [76,140,71] pg 2.7b0 is stale+active+clean, acting [28,149,112] pg 2.7b3 is stale+active+clean, acting [60,46,30] pg 2.7ad is stale+active+clean, acting [66,30,73] pg 2.7af is stale+active+clean, acting [30,92,146] pg 2.7ae is stale+active+clean, acting [147,103,88] pg 2.7a9 is active+degraded+remapped, acting [105,98] pg 2.7a8 is stale+active+clean, acting [92,126,144] pg 2.7ab is down+peering, acting [50] pg 2.7aa is stale+active+clean, acting [60,83,73] pg 2.7a5 is stale+active+clean, acting [45,7,116] pg 2.7a7 is stale+active+clean, acting [117,2,123] pg 2.7a6 is stale+active+clean, acting [49,75,11] pg 2.7a1 is active+degraded, acting [22] pg 2.7a0 is down+peering, acting [25] pg 2.7a3 is active+degraded+remapped, acting [43,142] pg 2.7a2 is down+peering, acting [98] pg 2.79d is stale+active+clean, acting [129,61,145] pg 2.79c is stale+active+clean, acting [122,1,15] pg 2.79f is stale+active+clean, acting [122,27,85] pg 2.799 is stale+active+clean, acting [138,23,4] pg 2.79a is stale+active+clean, acting [54,48,12] pg 2.797 is stale+active+clean, acting [34,19,38] pg 2.796 is stale+active+clean, acting [139,5,49] pg 2.791 is stale+active+clean, acting [144,9,58] pg 2.790 is stale+active+clean, acting [130,118,135] pg 2.793 is down+peering, acting [142] pg 2.792 is active+degraded+remapped, acting [50,88] pg 2.78d is active+degraded+remapped, acting [88,142] pg 2.78c is active+degraded+remapped, acting [98,22] pg 2.78f is stale+active+clean, acting [2,13,125] pg 2.78e is stale+active+clean, acting [118,4,14] pg 2.789 is stale+active+clean, acting [14,146,107] pg 2.78a is stale+active+clean, acting [108,50,17] pg 2.785 is stale+active+clean, acting [107,86,122] pg 2.784 is down+peering, acting [98] pg 2.787 is stale+active+clean, acting [86,93,132] pg 2.786 is stale+active+clean, acting [149,5,111] pg 2.781 is stale+active+clean, acting [119,129,140] pg 2.782 is stale+active+clean, acting [76,85,69] pg 2.77d is down+peering, acting [46] pg 2.77c is stale+active+clean, acting [10,78,100] pg 2.77f is stale+active+clean, acting [120,127,110] pg 2.779 is stale+active+clean, acting [73,87,54] pg 2.77b is stale+active+clean, acting [5,41,143] pg 2.77a is stale+active+clean, acting [130,112,73] pg 2.775 is stale+active+clean, acting [76,45,135] pg 2.774 is stale+active+clean, acting [29,116,96] pg 2.777 is stale+active+clean, acting [108,137,20] pg 2.776 is down+peering, acting [68] pg 2.770 is stale+active+clean, acting [100,64,0] pg 2.773 is stale+active+clean, acting [1,141,149] pg 2.772 is down+peering, acting [48] pg 2.76c is stale+active+clean, acting [123,56,63] pg 2.76e is stale+active+clean, acting [112,31,25] pg 2.769 is down+peering, acting [68] pg 2.768 is stale+active+clean, acting [121,12,6] pg 2.76b is stale+active+clean, acting [60,22,104] pg 2.76a is stale+active+clean, acting [138,144,5] pg 2.765 is stale+active+clean, acting [14,0,26] pg 2.764 is active+degraded, acting [88] pg 2.767 is stale+active+clean, acting [30,24,13] pg 2.761 is stale+active+clean, acting [64,43,133] pg 2.760 is active+degraded+remapped, acting [142,8] pg 2.763 is stale+active+clean, acting [62,109,142] pg 2.762 is down+peering, acting [88] pg 2.75d is stale+active+clean, acting [32,25,137] pg 2.75c is stale+active+clean, acting [144,136,28] pg 2.75e is active+degraded, acting [46] pg 2.759 is stale+active+clean, acting [100,102,63] pg 2.758 is stale+active+clean, acting [60,32,18] pg 2.75b is down+peering, acting [48] pg 2.75a is stale+active+clean, acting [60,49,133] pg 2.755 is stale+active+clean, acting [116,123,52] pg 2.754 is stale+active+clean, acting [116,147,128] pg 2.757 is down+peering, acting [104] pg 2.756 is stale+active+clean, acting [101,3,84] pg 2.751 is stale+active+clean, acting [119,65,51] pg 2.750 is active+degraded+remapped, acting [25,8] pg 2.753 is stale+active+clean, acting [45,57,135] pg 2.752 is down+peering, acting [97] pg 2.74d is stale+active+clean, acting [12,69,76] pg 2.74c is stale+active+clean, acting [128,65,23] pg 2.74f is stale+active+clean, acting [3,88,149] pg 2.74e is stale+active+clean, acting [114,69,81] pg 2.748 is stale+active+clean, acting [12,94,0] pg 2.74b is stale+active+clean, acting [31,125,136] pg 2.74a is stale+active+clean, acting [2,116,118] pg 2.745 is stale+active+clean, acting [100,57,66] pg 2.744 is stale+active+clean, acting [79,86,98] pg 2.747 is stale+active+clean, acting [1,59,26] pg 2.746 is stale+active+clean, acting [122,112,30] pg 2.741 is stale+active+clean, acting [65,48,128] pg 2.740 is stale+active+clean, acting [17,48,55] pg 2.743 is stale+active+clean, acting [70,83,138] pg 2.742 is stale+active+clean, acting [26,136,107] pg 2.73d is stale+active+clean, acting [71,130,62] pg 2.73c is stale+active+clean, acting [45,134,77] pg 2.73f is stale+active+clean, acting [114,130,22] pg 2.73e is stale+active+clean, acting [100,113,53] pg 2.739 is stale+active+clean, acting [82,63,122] pg 2.738 is stale+active+clean, acting [18,53,114] pg 2.73b is stale+active+clean, acting [108,140,122] pg 2.73a is stale+active+clean, acting [109,60,143] pg 2.735 is stale+active+clean, acting [139,109,74] pg 2.734 is stale+active+clean, acting [107,139,118] pg 2.737 is stale+active+clean, acting [11,119,33] pg 2.731 is down+peering, acting [97] pg 2.730 is stale+active+clean, acting [83,64,125] pg 2.733 is active+degraded+remapped, acting [104,50] pg 2.72d is stale+active+clean, acting [66,103,99] pg 2.72c is stale+active+clean, acting [63,58,125] pg 2.72f is stale+active+clean, acting [15,131,68] pg 2.72e is stale+active+clean, acting [114,23,78] pg 2.729 is stale+active+clean, acting [52,70,66] pg 2.728 is active+degraded+remapped, acting [46,43] pg 2.72b is stale+active+clean, acting [111,71,32] pg 2.72a is stale+active+clean, acting [17,122,81] pg 2.725 is down+peering, acting [25] pg 2.724 is stale+active+clean, acting [95,42,76] pg 2.727 is stale+active+clean, acting [70,102,137] pg 2.726 is stale+active+clean, acting [87,132,72] pg 2.721 is active+degraded, acting [25] pg 2.720 is stale+active+clean, acting [116,75,20] pg 2.723 is active+degraded+remapped, acting [88,104] pg 2.71d is stale+active+clean, acting [123,102,88] pg 2.71c is stale+active+clean, acting [62,68,78] pg 2.71f is stale+active+clean, acting [96,16,127] pg 2.71e is down+peering, acting [8] pg 2.719 is down+peering, acting [88] pg 2.718 is down+peering, acting [22] pg 2.71b is active+degraded+remapped, acting [22,142] pg 2.71a is active+degraded+remapped, acting [46,88] pg 2.715 is stale+active+clean, acting [58,47,138] pg 2.714 is stale+active+clean, acting [7,37,22] pg 2.717 is stale+active+clean, acting [0,62,122] pg 2.716 is stale+active+clean, acting [118,112,54] pg 2.711 is stale+active+clean, acting [117,130,49] pg 2.710 is stale+active+clean, acting [114,54,119] pg 2.713 is stale+active+clean, acting [86,68,106] pg 2.712 is stale+active+clean, acting [66,100,129] pg 2.70d is stale+active+clean, acting [83,39,121] pg 2.70c is stale+active+clean, acting [47,63,105] pg 2.70f is stale+active+clean, acting [36,67,30] pg 2.70e is stale+active+clean, acting [21,3,41] pg 2.709 is stale+active+clean, acting [121,38,53] pg 2.708 is active+degraded+remapped, acting [81,25] pg 2.70b is stale+active+clean, acting [53,66,98] pg 2.705 is stale+active+clean, acting [92,130,124] pg 2.704 is down+peering, acting [97] pg 2.707 is stale+active+clean, acting [109,117,95] pg 2.706 is stale+active+clean, acting [47,27,38] pg 2.700 is active+degraded+remapped, acting [48,51] pg 2.703 is stale+active+clean, acting [29,93,15] pg 2.702 is stale+active+clean, acting [145,15,52] pg 2.6fd is down+peering, acting [51] pg 2.6fc is down+peering, acting [51] pg 2.6ff is stale+active+clean, acting [31,124,137] pg 2.6fe is stale+active+clean, acting [49,104,59] pg 2.6f9 is stale+active+clean, acting [58,24,114] pg 2.6f8 is stale+active+clean, acting [17,132,23] pg 2.6fb is stale+active+clean, acting [44,91,4] pg 2.6fa is stale+active+clean, acting [71,2,116] pg 2.6f4 is stale+active+clean, acting [57,67,66] pg 2.6f7 is active+degraded, acting [142] pg 2.6f6 is stale+active+clean, acting [118,85,27] pg 2.6f1 is stale+active+clean, acting [19,30,41] pg 2.6f0 is down+peering, acting [98] pg 2.6f3 is stale+active+clean, acting [70,87,76] pg 2.6f2 is stale+active+clean, acting [76,147,138] pg 2.6ed is active+degraded+remapped, acting [98,105] pg 2.6ec is down+peering, acting [43] pg 2.6e9 is down+peering, acting [97] pg 2.6e8 is stale+active+clean, acting [58,73,85] pg 2.6eb is stale+active+clean, acting [101,57,13] pg 2.6ea is down+peering, acting [8] pg 2.6e5 is active+degraded, acting [51,98] pg 2.6e4 is stale+active+clean, acting [139,19,31] pg 2.6e7 is stale+active+clean, acting [0,97,41] pg 2.6e6 is down+peering, acting [22] pg 2.6e0 is stale+active+clean, acting [15,142,6] pg 2.6e3 is stale+active+clean, acting [55,91,48] pg 2.6dd is active+degraded+remapped, acting [22,8] pg 2.6dc is stale+active+clean, acting [116,79,49] pg 2.6df is stale+active+clean, acting [64,130,71] pg 2.6de is stale+active+clean, acting [136,72,28] pg 2.6d9 is stale+active+clean, acting [33,138,149] pg 2.6d8 is stale+active+clean, acting [66,132,49] pg 2.6db is active+degraded, acting [67] pg 2.6da is down+peering, acting [98] pg 2.6d5 is stale+active+clean, acting [140,4,72] pg 2.6d7 is down+peering, acting [68] pg 2.6d6 is stale+active+clean, acting [108,44,35] pg 2.6d1 is active+degraded, acting [97] pg 2.6d0 is stale+active+clean, acting [117,21,53] pg 2.6d3 is active+degraded+remapped, acting [8,67] pg 2.6d2 is down+peering, acting [67] pg 2.6cd is stale+active+clean, acting [62,19,102] pg 2.6cf is stale+active+clean, acting [123,34,136] pg 2.6ce is active+degraded, acting [43] pg 2.6c8 is stale+active+clean, acting [110,49,53] pg 2.6cb is stale+active+clean, acting [76,113,98] pg 2.6ca is stale+active+clean, acting [64,5,21] pg 2.6c5 is stale+active+clean, acting [74,85,55] pg 2.6c7 is stale+active+clean, acting [148,31,12] pg 2.6c6 is stale+active+clean, acting [24,83,15] pg 2.6c1 is stale+active+clean, acting [102,44,11] pg 2.6c0 is active+degraded, acting [68] pg 2.6c3 is down+peering, acting [48] pg 2.6c2 is stale+active+clean, acting [94,136,102] pg 2.6bd is stale+active+clean, acting [61,7,144] pg 2.6bc is down+peering, acting [50] pg 2.6bf is stale+active+clean, acting [65,7,120] pg 2.6be is stale+active+clean, acting [59,124,131] pg 2.6b9 is stale+active+clean, acting [79,121,115] pg 2.6b8 is stale+active+clean, acting [65,99,102] pg 2.6ba is stale+active+clean, acting [86,79,20] pg 2.6b5 is stale+active+clean, acting [147,78,39] pg 2.6b4 is stale+active+clean, acting [87,107,123] pg 2.6b7 is down+peering, acting [67] pg 2.6b6 is stale+active+clean, acting [10,20,128] pg 2.6b1 is down+peering, acting [22] pg 2.6b0 is stale+active+clean, acting [12,82,96] pg 2.6b3 is stale+active+clean, acting [76,140,149] pg 2.6ac is stale+active+clean, acting [103,97,115] pg 2.6af is stale+active+clean, acting [23,17,55] pg 2.6ae is stale+active+clean, acting [54,141,26] pg 2.6ab is active+degraded+remapped, acting [43,8] pg 2.6aa is down+peering, acting [43] pg 2.6a4 is stale+active+clean, acting [83,19,112] pg 2.6a7 is stale+active+clean, acting [13,49,4] pg 2.6a6 is stale+active+clean, acting [140,22,30] pg 2.6a1 is stale+active+clean, acting [72,140,51] pg 2.6a0 is stale+active+clean, acting [31,119,37] pg 2.6a3 is stale+active+clean, acting [116,72,78] pg 2.6a2 is stale+active+clean, acting [95,0,13] pg 2.69d is down+peering, acting [67] pg 2.69c is stale+active+clean, acting [121,32,92] pg 2.69e is stale+active+clean, acting [33,61,70] pg 2.699 is active+degraded, acting [81] pg 2.698 is stale+active+clean, acting [130,149,41] pg 2.69b is stale+active+clean, acting [123,5,89] pg 2.69a is stale+active+clean, acting [29,67,137] pg 2.695 is down+peering, acting [40,46] pg 2.694 is stale+active+clean, acting [112,95,56] pg 2.697 is stale+active+clean, acting [129,84,70] pg 2.696 is active+degraded, acting [22,105] pg 2.691 is stale+active+clean, acting [130,12,123] pg 2.690 is active+degraded+remapped, acting [98,48] pg 2.693 is stale+active+clean, acting [122,138,78] pg 2.692 is stale+active+clean, acting [139,31,74] pg 2.68d is down+peering, acting [51] pg 2.68c is stale+active+clean, acting [90,57,68] pg 2.68e is stale+active+clean, acting [83,121,38] pg 2.689 is down+peering, acting [50] pg 2.688 is down+peering, acting [105] pg 2.68b is down+peering, acting [48] pg 2.68a is stale+active+clean, acting [69,77,60] pg 2.685 is stale+active+clean, acting [17,30,118] pg 2.684 is stale+active+clean, acting [29,40,123] pg 2.687 is active+degraded+remapped, acting [104,88] pg 2.686 is down+peering, acting [104,25] pg 2.681 is down+peering, acting [22] pg 2.683 is stale+active+clean, acting [11,142,79] pg 2.682 is stale+active+clean, acting [138,126,68] pg 2.67d is stale+active+clean, acting [28,42,74] pg 2.67c is stale+active+clean, acting [127,84,50] pg 2.67f is stale+active+clean, acting [20,42,32] pg 2.679 is down+peering, acting [25] pg 2.67b is down+peering, acting [40,104] pg 2.67a is stale+active+clean, acting [61,96,126] pg 2.675 is stale+active+clean, acting [135,31,124] pg 2.674 is down+peering, acting [25] pg 2.677 is stale+active+clean, acting [59,75,46] pg 2.676 is stale+active+clean, acting [140,44,29] pg 2.670 is stale+active+clean, acting [133,49,11] pg 2.673 is stale+active+clean, acting [56,137,71] pg 2.672 is stale+active+clean, acting [110,108,144] pg 2.66d is active+degraded+remapped, acting [81,67] pg 2.66c is stale+active+clean, acting [133,100,35] pg 2.66f is down+peering, acting [68] pg 2.66e is down+peering, acting [97] pg 2.669 is stale+active+clean, acting [11,50,133] pg 2.668 is stale+active+clean, acting [21,128,66] pg 2.66b is stale+active+clean, acting [103,143,117] pg 2.66a is stale+active+clean, acting [107,90,124] pg 2.665 is stale+active+clean, acting [120,61,78] pg 2.664 is stale+active+clean, acting [128,99,15] pg 2.667 is stale+active+clean, acting [21,31,61] pg 2.666 is stale+active+clean, acting [139,100,51] pg 2.661 is stale+active+clean, acting [33,85,124] pg 2.663 is active+degraded, acting [51] pg 2.65d is down+peering, acting [50] pg 2.65c is stale+active+clean, acting [45,32,64] pg 2.65f is stale+active+clean, acting [2,117,21] pg 2.658 is stale+active+clean, acting [108,99,11] pg 2.65b is stale+active+clean, acting [15,71,128] pg 2.65a is stale+active+clean, acting [39,148,54] pg 2.655 is stale+active+clean, acting [95,0,90] pg 2.654 is stale+active+clean, acting [123,102,92] pg 2.657 is stale+active+clean, acting [16,2,72] pg 2.656 is stale+active+clean, acting [6,101,117] pg 2.651 is active+degraded+remapped, acting [88,50] pg 2.650 is stale+active+clean, acting [6,136,74] pg 2.653 is down+peering, acting [88] pg 2.652 is stale+active+clean, acting [131,84,69] pg 2.64c is stale+active+clean, acting [47,30,137] pg 2.64f is down+peering, acting [104] pg 2.64e is down+peering, acting [104] pg 2.649 is stale+active+clean, acting [100,108,16] pg 2.64b is stale+active+clean, acting [110,1,21] pg 2.64a is stale+active+clean, acting [63,145,0] pg 2.645 is down+peering, acting [67] pg 2.644 is stale+active+clean, acting [26,16,28] pg 2.647 is stale+active+clean, acting [85,103,121] pg 2.646 is stale+active+clean, acting [39,105,148] pg 2.640 is stale+active+clean, acting [55,63,118] pg 2.643 is down+peering, acting [88] pg 2.642 is stale+active+clean, acting [69,32,112] pg 2.63d is down+peering, acting [142] pg 2.63c is stale+active+clean, acting [17,30,49] pg 2.63f is stale+active+clean, acting [149,11,126] pg 2.63e is stale+active+clean, acting [117,72,2] pg 2.639 is stale+active+clean, acting [89,58,100] pg 2.638 is stale+active+clean, acting [18,61,132] pg 2.63b is stale+active+clean, acting [53,87,122] pg 2.63a is stale+active+clean, acting [123,82,14] pg 2.635 is stale+active+clean, acting [79,98,86] pg 2.634 is stale+active+clean, acting [32,12,73] pg 2.637 is stale+active+clean, acting [21,59,54] pg 2.636 is stale+active+clean, acting [4,89,124] pg 2.631 is down+peering, acting [142] pg 2.630 is stale+active+clean, acting [35,149,77] pg 2.632 is stale+active+clean, acting [132,67,35] pg 2.62d is stale+active+clean, acting [108,97,42] pg 2.62c is down+peering, acting [8] pg 2.62f is stale+active+clean, acting [131,115,69] pg 2.62e is down+peering, acting [68] pg 2.629 is down+peering, acting [67,105] pg 2.628 is stale+active+clean, acting [112,120,29] pg 2.62b is stale+active+clean, acting [74,79,64] pg 2.62a is down+peering, acting [88,68] pg 2.625 is stale+active+clean, acting [15,25,31] pg 2.624 is down+peering, acting [104] pg 2.627 is stale+active+clean, acting [102,15,147] pg 2.621 is down+peering, acting [50] pg 2.620 is down+peering, acting [67] pg 2.623 is active+degraded+remapped, acting [50,142] pg 2.61d is down+peering, acting [104] pg 2.61f is stale+active+clean, acting [132,12,145] pg 2.61e is stale+active+clean, acting [59,118,52] pg 2.619 is active+degraded+remapped, acting [46,97] pg 2.618 is stale+active+clean, acting [58,66,124] pg 2.61b is stale+active+clean, acting [21,9,104] pg 2.61a is down+peering, acting [50] pg 2.615 is stale+active+clean, acting [116,125,131] pg 2.614 is stale+active+clean, acting [149,106,64] pg 2.617 is stale+active+clean, acting [59,50,127] pg 2.616 is active+degraded+remapped, acting [142,48] pg 2.611 is down+peering, acting [25,40] pg 2.610 is stale+active+clean, acting [111,119,8] pg 2.613 is stale+active+clean, acting [129,63,148] pg 2.612 is stale+active+clean, acting [121,138,102] pg 2.60d is stale+active+clean, acting [55,46,87] pg 2.60c is stale+active+clean, acting [84,8,96] pg 2.60f is stale+active+clean, acting [144,84,30] pg 2.60e is stale+active+clean, acting [130,22,141] pg 2.608 is stale+active+clean, acting [107,119,17] pg 2.60b is stale+active+clean, acting [6,124,139] pg 2.60a is stale+active+clean, acting [129,63,93] pg 2.605 is down+peering, acting [88] pg 2.604 is stale+active+clean, acting [140,20,0] pg 2.607 is stale+active+clean, acting [12,106,148] pg 2.606 is stale+active+clean, acting [117,33,96] pg 2.601 is active+degraded+remapped, acting [50,81] pg 2.600 is stale+active+clean, acting [103,100,111] pg 2.603 is stale+active+clean, acting [119,79,138] pg 2.602 is stale+active+clean, acting [32,120,38] pg 2.5fd is active+degraded+remapped, acting [22,105] pg 2.5fc is active+degraded+remapped, acting [68,40] pg 2.5ff is stale+active+clean, acting [64,142,102] pg 2.5fe is stale+active+clean, acting [116,51,148] pg 2.5f9 is stale+active+clean, acting [84,127,18] pg 2.5f8 is down+peering, acting [105] pg 2.5fa is stale+active+clean, acting [74,66,77] pg 2.5f5 is down+peering, acting [46,104] pg 2.5f4 is down+peering, acting [48] pg 2.5f6 is active+degraded+remapped, acting [48,68] pg 2.5f1 is stale+active+clean, acting [100,10,131] pg 2.5f0 is stale+active+clean, acting [143,37,130] pg 2.5f3 is stale+active+clean, acting [29,19,9] pg 2.5f2 is stale+active+clean, acting [32,144,35] pg 2.5ed is down+peering, acting [22] pg 2.5ec is stale+active+clean, acting [5,92,22] pg 2.5ef is active+degraded+remapped, acting [67,104] pg 2.5ee is active+degraded, acting [48] pg 2.5e9 is down+peering, acting [22] pg 2.5e8 is stale+active+clean, acting [141,124,109] pg 2.5eb is stale+active+clean, acting [61,109,119] pg 2.5ea is active+degraded, acting [97] pg 2.5e5 is stale+active+clean, acting [0,95,66] pg 2.5e4 is active+degraded+remapped, acting [105,50] pg 2.5e7 is stale+active+clean, acting [114,123,3] pg 2.5e6 is down+peering, acting [40] pg 2.5e1 is stale+active+clean, acting [91,121,108] pg 2.5e0 is stale+active+clean, acting [9,26,53] pg 2.5e3 is stale+active+clean, acting [109,10,73] pg 2.5e2 is stale+active+clean, acting [89,94,131] pg 2.5dd is stale+active+clean, acting [90,131,50] pg 2.5df is stale+active+clean, acting [113,22,81] pg 2.5de is stale+active+clean, acting [70,13,82] pg 2.5d8 is stale+active+clean, acting [108,65,45] pg 2.5db is stale+active+clean, acting [54,115,74] pg 2.5da is active+degraded+remapped, acting [48,22] pg 2.5d5 is down+peering, acting [88] pg 2.5d7 is stale+active+clean, acting [26,7,14] pg 2.5d6 is active+degraded+remapped, acting [142,98] pg 2.5d1 is active+degraded+remapped, acting [142,46] pg 2.5d0 is stale+active+clean, acting [36,32,120] pg 2.5d3 is stale+active+clean, acting [116,76,101] pg 2.5d2 is active+degraded, acting [22,88] pg 2.5cd is stale+active+clean, acting [112,54,142] pg 2.5cc is stale+active+clean, acting [138,95,129] pg 2.5cf is active+degraded+remapped, acting [25,105] pg 2.5c9 is stale+active+clean, acting [5,49,138] pg 2.5c8 is active+degraded, acting [97] pg 2.5cb is stale+active+clean, acting [56,41,143] pg 2.5ca is stale+active+clean, acting [95,3,36] pg 2.5c4 is stale+active+clean, acting [114,95,127] pg 2.5c7 is stale+active+clean, acting [132,24,36] pg 2.5c6 is down+peering, acting [25] pg 2.5c1 is stale+active+clean, acting [132,41,142] pg 2.5c0 is down+peering, acting [8,25] pg 2.5c3 is stale+active+clean, acting [6,90,100] pg 2.5c2 is stale+active+clean, acting [55,87,118] pg 2.5bd is stale+active+clean, acting [10,33,18] pg 2.5bf is down+peering, acting [8] pg 2.5be is stale+active+clean, acting [11,73,28] pg 2.5b9 is stale+active+clean, acting [21,57,63] pg 2.5bb is stale+active+clean, acting [34,19,92] pg 2.5ba is down+peering, acting [22] pg 2.5b5 is stale+active+clean, acting [107,23,40] pg 2.5b4 is stale+active+clean, acting [18,84,51] pg 2.5b1 is stale+active+clean, acting [11,44,107] pg 2.5b0 is down+peering, acting [105,40] pg 2.5b3 is stale+active+clean, acting [117,103,24] pg 2.5b2 is down+peering, acting [43] pg 2.5ad is stale+active+clean, acting [61,98,83] pg 2.5ac is stale+active+clean, acting [131,64,124] pg 2.5af is stale+active+clean, acting [146,103,38] pg 2.5ae is active+degraded, acting [67,81] pg 2.5a9 is stale+active+clean, acting [130,19,111] pg 2.5a8 is stale+active+clean, acting [77,120,66] pg 2.5ab is stale+active+clean, acting [91,120,2] pg 2.5aa is stale+active+clean, acting [83,64,71] pg 2.5a5 is down+peering, acting [25] pg 2.5a4 is active+degraded+remapped, acting [46,43] pg 2.5a7 is stale+active+clean, acting [16,3,49] pg 2.5a6 is stale+active+clean, acting [117,76,123] pg 2.5a1 is stale+active+clean, acting [20,82,140] pg 2.5a0 is stale+active+clean, acting [7,16,147] pg 2.5a3 is active+degraded, acting [46] pg 2.5a2 is active+degraded+remapped, acting [48,40] pg 2.59d is stale+active+clean, acting [131,40,125] pg 2.59c is stale+active+clean, acting [37,75,96] pg 2.59f is down+peering, acting [105] pg 2.59e is stale+active+clean, acting [113,1,68] pg 2.599 is stale+active+clean, acting [23,107,65] pg 2.598 is stale+active+clean, acting [12,99,105] pg 2.59b is stale+active+clean, acting [145,63,51] pg 2.59a is active+degraded, acting [142] pg 2.595 is stale+active+clean, acting [17,69,105] pg 2.594 is stale+active+clean, acting [126,26,61] pg 2.597 is down+peering, acting [40] pg 2.596 is stale+active+clean, acting [136,124,133] pg 2.590 is active+degraded+remapped, acting [22,81] pg 2.593 is active+degraded+remapped, acting [46,142] pg 2.592 is down+peering, acting [8] pg 2.58d is stale+active+clean, acting [71,78,38] pg 2.58c is stale+active+clean, acting [73,86,106] pg 2.58f is stale+active+clean, acting [139,128,142] pg 2.58e is stale+active+clean, acting [116,133,24] pg 2.589 is stale+active+clean, acting [111,5,101] pg 2.588 is active+degraded+remapped, acting [105,98] pg 2.58b is stale+active+clean, acting [131,143,113] pg 2.58a is stale+active+clean, acting [5,110,123] pg 2.585 is stale+active+clean, acting [65,129,73] pg 2.584 is down+peering, acting [68] pg 2.587 is stale+active+clean, acting [61,76,143] pg 2.580 is stale+active+clean, acting [16,149,130] pg 2.583 is active+degraded+remapped, acting [81,48] pg 2.57d is stale+active+clean, acting [135,123,29] pg 2.57c is stale+active+clean, acting [96,107,64] pg 2.57f is down+peering, acting [22] pg 2.57e is stale+active+clean, acting [113,6,22] pg 2.579 is stale+active+clean, acting [41,45,78] pg 2.578 is stale+active+clean, acting [146,140,34] pg 2.57b is down+peering, acting [67] pg 2.57a is stale+active+clean, acting [102,39,23] pg 2.575 is down+peering, acting [97] pg 2.574 is stale+active+clean, acting [90,21,131] pg 2.577 is active+degraded+remapped, acting [22,97] pg 2.573 is stale+active+clean, acting [149,75,10] pg 2.572 is stale+active+clean, acting [60,125,108] pg 2.56d is stale+active+clean, acting [45,61,8] pg 2.56c is stale+active+clean, acting [86,97,32] pg 2.56f is down+peering, acting [43,51] pg 2.56e is stale+active+clean, acting [131,141,149] pg 2.569 is stale+active+clean, acting [1,17,70] pg 2.568 is stale+active+clean, acting [29,138,118] pg 2.56b is stale+active+clean, acting [45,130,36] pg 2.56a is stale+active+clean, acting [79,73,91] pg 2.565 is stale+active+clean, acting [85,93,78] pg 2.564 is down+peering, acting [51] pg 2.567 is stale+active+clean, acting [12,101,76] pg 2.566 is active+degraded, acting [8,68] pg 2.560 is stale+active+clean, acting [61,58,119] pg 2.563 is down+peering, acting [68] pg 2.562 is stale+active+clean, acting [138,76,20] pg 2.55d is stale+active+clean, acting [134,52,95] pg 2.55c is active+degraded+remapped, acting [25,68] pg 2.55f is active+degraded+remapped, acting [68,8] pg 2.55e is active+degraded, acting [43] pg 2.559 is stale+active+clean, acting [4,25,63] pg 2.55b is active+degraded, acting [142] pg 2.555 is stale+active+clean, acting [128,47,137] pg 2.554 is stale+active+clean, acting [26,85,75] pg 2.557 is down+peering, acting [8] pg 2.551 is down+peering, acting [22] pg 2.553 is stale+active+clean, acting [79,9,143] pg 2.552 is stale+active+clean, acting [136,107,19] pg 2.54d is down+peering, acting [43] pg 2.54c is stale+active+clean, acting [145,65,133] pg 2.54f is active+degraded+remapped, acting [68,8] pg 2.54e is active+degraded+remapped, acting [88,104] pg 2.549 is stale+active+clean, acting [146,1,92] pg 2.548 is stale+active+clean, acting [102,10,70] pg 2.54b is stale+active+clean, acting [45,17,128] pg 2.545 is down+peering, acting [50] pg 2.544 is stale+active+clean, acting [79,145,10] pg 2.547 is stale+active+clean, acting [18,86,5] pg 2.546 is stale+active+clean, acting [148,87,104] pg 2.541 is down+peering, acting [104,43] pg 2.540 is stale+active+clean, acting [146,4,36] pg 2.542 is active+degraded+remapped, acting [98,81] pg 2.53d is stale+active+clean, acting [103,84,120] pg 2.53c is stale+active+clean, acting [28,86,97] pg 2.53f is stale+active+clean, acting [89,93,103] pg 2.53e is stale+active+clean, acting [135,149,105] pg 2.539 is down+peering, acting [98] pg 2.538 is down+peering, acting [8] pg 2.53b is stale+active+clean, acting [108,113,96] pg 2.53a is stale+active+clean, acting [95,62,5] pg 2.534 is active+degraded+remapped, acting [25,67] pg 2.537 is stale+active+clean, acting [114,122,130] pg 2.536 is stale+active+clean, acting [119,113,52] pg 2.531 is stale+active+clean, acting [118,58,84] pg 2.530 is stale+active+clean, acting [103,144,61] pg 2.532 is down+peering, acting [97] pg 2.52d is stale+active+clean, acting [87,146,28] pg 2.52c is stale+active+clean, acting [143,37,30] pg 2.52f is stale+active+clean, acting [129,121,112] pg 2.52e is stale+active+clean, acting [125,15,54] pg 2.529 is down+peering, acting [105] pg 2.528 is stale+active+clean, acting [34,49,137] pg 2.52b is stale+active+clean, acting [132,122,91] pg 2.52a is stale+active+clean, acting [125,65,126] pg 2.525 is stale+active+clean, acting [123,31,39] pg 2.524 is active+degraded+remapped, acting [46,50] pg 2.527 is stale+active+clean, acting [85,47,109] pg 2.526 is down+peering, acting [48] pg 2.521 is active+degraded, acting [81] pg 2.520 is stale+active+clean, acting [33,72,42] pg 2.51d is stale+active+clean, acting [133,118,37] pg 2.51c is active+degraded+remapped, acting [46,81] pg 2.51f is stale+active+clean, acting [10,30,122] pg 2.51e is stale+active+clean, acting [146,2,110] pg 2.519 is stale+active+clean, acting [57,112,24] pg 2.518 is stale+active+clean, acting [102,101,38] pg 2.51b is stale+active+clean, acting [11,101,8] pg 2.51a is down+peering, acting [88] pg 2.515 is stale+active+clean, acting [20,3,41] pg 2.517 is active+degraded+remapped, acting [142,104] pg 2.516 is stale+active+clean, acting [18,7,66] pg 2.511 is active+degraded+remapped, acting [97,68] pg 2.510 is stale+active+clean, acting [44,78,91] pg 2.512 is stale+active+clean, acting [3,100,14] pg 2.50d is stale+active+clean, acting [66,34,46] pg 2.50c is stale+active+clean, acting [140,127,26] pg 2.50e is stale+active+clean, acting [84,102,96] pg 2.508 is stale+active+clean, acting [132,123,38] pg 2.50b is stale+active+clean, acting [129,68,88] pg 2.50a is down+peering, acting [8] pg 2.504 is down+peering, acting [97] pg 2.507 is stale+active+clean, acting [106,61,144] pg 2.506 is stale+active+clean, acting [102,134,96] pg 2.501 is down+peering, acting [8] pg 2.500 is down+peering, acting [46] pg 2.503 is down+peering, acting [104] pg 2.502 is stale+active+clean, acting [120,88,81] pg 2.4fd is stale+active+clean, acting [55,114,144] pg 2.4ff is down+peering, acting [68] pg 2.4fe is stale+active+clean, acting [66,73,75] pg 2.4f9 is stale+active+clean, acting [61,149,54] pg 2.4f8 is stale+active+clean, acting [21,114,82] pg 2.4fb is stale+active+clean, acting [39,32,69] pg 2.4fa is stale+active+clean, acting [16,102,147] pg 2.4f5 is stale+active+clean, acting [99,58,60] pg 2.4f7 is active+degraded+remapped, acting [25,50] pg 2.4f6 is active+degraded, acting [142] pg 2.4f1 is stale+active+clean, acting [2,139,143] pg 2.4f0 is stale+active+clean, acting [58,11,120] pg 2.4f3 is stale+active+clean, acting [113,95,109] pg 2.4f2 is down+peering, acting [46] pg 2.4ed is stale+active+clean, acting [34,73,117] pg 2.4ec is stale+active+clean, acting [72,82,86] pg 2.4ef is stale+active+clean, acting [75,47,16] pg 2.4ee is down+peering, acting [98] pg 2.4e9 is stale+active+clean, acting [123,103,35] pg 2.4e8 is down+peering, acting [25] pg 2.4ea is active+degraded+remapped, acting [88,22] pg 2.4e5 is active+degraded, acting [67] pg 2.4e4 is stale+active+clean, acting [84,27,43] pg 2.4e7 is active+degraded+remapped, acting [43,48] pg 2.4e6 is down+peering, acting [98] pg 2.4e1 is stale+active+clean, acting [87,25,54] pg 2.4e0 is stale+active+clean, acting [70,130,139] pg 2.4e3 is stale+active+clean, acting [6,118,111] pg 2.4e2 is stale+active+clean, acting [66,58,100] pg 2.4dd is stale+active+clean, acting [115,58,118] pg 2.4dc is down+peering, acting [25] pg 2.4df is stale+active+clean, acting [33,63,74] pg 2.4de is stale+active+clean, acting [87,144,29] pg 2.4d8 is down+peering, acting [105] pg 2.4db is stale+active+clean, acting [110,7,124] pg 2.4da is down+peering, acting [98] pg 2.4d5 is stale+active+clean, acting [27,72,65] pg 2.4d4 is stale+active+clean, acting [34,139,20] pg 2.4d7 is stale+active+clean, acting [4,50,136] pg 2.4d6 is stale+active+clean, acting [55,122,117] pg 2.4d1 is stale+active+clean, acting [19,114,133] pg 2.4d0 is stale+active+clean, acting [100,57,137] pg 2.4d3 is down+peering, acting [68] pg 2.4d2 is stale+active+clean, acting [21,136,107] pg 2.4cd is stale+active+clean, acting [110,74,32] pg 2.4ce is down+peering, acting [22] pg 2.4c9 is stale+active+clean, acting [52,46,17] pg 2.4c8 is down+peering, acting [67] pg 2.4cb is stale+active+clean, acting [17,124,131] pg 2.4c4 is down+peering, acting [98] pg 2.4c7 is stale+active+clean, acting [72,104,63] pg 2.4c6 is stale+active+clean, acting [56,99,17] pg 2.4c1 is stale+active+clean, acting [112,127,26] pg 2.4c0 is active+degraded+remapped, acting [25,67] pg 2.4c3 is stale+active+clean, acting [5,12,94] pg 2.4c2 is stale+active+clean, acting [109,93,60] pg 2.4bd is stale+active+clean, acting [58,48,91] pg 2.4bc is stale+active+clean, acting [135,72,28] pg 2.4bf is down+peering, acting [46,105] pg 2.4be is stale+active+clean, acting [12,73,127] pg 2.4b9 is down+peering, acting [8,22] pg 2.4b8 is stale+active+clean, acting [121,87,80] pg 2.4bb is stale+active+clean, acting [84,147,75] pg 2.4ba is stale+active+clean, acting [56,144,10] pg 2.4b5 is stale+active+clean, acting [145,27,64] pg 2.4b4 is stale+active+clean, acting [140,95,80] pg 2.4b6 is stale+active+clean, acting [128,149,13] pg 2.4b1 is stale+active+clean, acting [41,131,146] pg 2.4b0 is stale+active+clean, acting [24,79,12] pg 2.4b3 is stale+active+clean, acting [53,64,24] pg 2.4b2 is stale+active+clean, acting [82,60,99] pg 2.4ad is active+degraded+remapped, acting [81,51] pg 2.4ac is active+degraded+remapped, acting [50,142] pg 2.4af is stale+active+clean, acting [28,91,122] pg 2.4ae is active+degraded, acting [43,8] pg 2.4a9 is active+degraded+remapped, acting [81,67] pg 2.4ab is stale+active+clean, acting [138,50,83] pg 2.4aa is stale+active+clean, acting [128,123,64] pg 2.4a5 is stale+active+clean, acting [17,93,108] pg 2.4a4 is stale+active+clean, acting [114,20,8] pg 2.4a7 is stale+active+clean, acting [35,101,5] pg 2.4a6 is down+peering, acting [68] pg 2.4a3 is down+peering, acting [104] pg 2.4a2 is stale+active+clean, acting [9,69,55] pg 2.49d is stale+active+clean, acting [72,32,88] pg 2.49c is down+peering, acting [68] pg 2.49f is stale+active+clean, acting [117,123,52] pg 2.49e is down+peering, acting [8] pg 2.499 is stale+active+clean, acting [144,140,2] pg 2.498 is stale+active+clean, acting [9,56,25] pg 2.49b is active+degraded+remapped, acting [46,88] pg 2.49a is stale+active+clean, acting [35,30,101] pg 2.495 is active+degraded+remapped, acting [68,88] pg 2.494 is stale+active+clean, acting [126,35,100] pg 2.497 is down+peering, acting [43] pg 2.496 is active+degraded+remapped, acting [50,46] pg 2.491 is stale+active+clean, acting [77,99,41] pg 2.490 is stale+active+clean, acting [24,28,92] pg 2.493 is stale+active+clean, acting [139,0,95] pg 2.492 is stale+active+clean, acting [64,123,27] pg 2.48d is stale+active+clean, acting [6,99,14] pg 2.48c is down+peering, acting [67] pg 2.48f is active+degraded+remapped, acting [51,67] pg 2.48e is stale+active+clean, acting [148,79,16] pg 2.489 is down+peering, acting [142] pg 2.488 is stale+active+clean, acting [85,97,78] pg 2.48b is down+peering, acting [104] pg 2.48a is down+peering, acting [97] pg 2.485 is stale+active+clean, acting [1,72,13] pg 2.484 is stale+active+clean, acting [13,147,78] pg 2.487 is stale+active+clean, acting [110,49,133] pg 2.486 is stale+active+clean, acting [52,134,20] pg 2.481 is stale+active+clean, acting [108,123,134] pg 2.483 is down+peering, acting [97] pg 2.482 is stale+active+clean, acting [26,31,112] pg 2.47d is stale+active+clean, acting [33,17,120] pg 2.47c is down+peering, acting [50] pg 2.47f is stale+active+clean, acting [107,100,87] pg 2.47e is down+peering, acting [98] pg 2.479 is stale+active+clean, acting [61,143,53] pg 2.478 is stale+active+clean, acting [114,0,123] pg 2.47b is down+peering, acting [97] pg 2.475 is stale+active+clean, acting [38,122,129] pg 2.474 is stale+active+clean, acting [94,111,108] pg 2.477 is stale+active+clean, acting [35,124,109] pg 2.476 is down+peering, acting [88,50] pg 2.471 is stale+active+clean, acting [109,50,84] pg 2.470 is stale+active+clean, acting [52,12,73] pg 2.473 is stale+active+clean, acting [76,125,62] pg 2.46d is stale+active+clean, acting [136,67,103] pg 2.46c is stale+active+clean, acting [139,31,19] pg 2.46f is stale+active+clean, acting [34,26,61] pg 2.46e is stale+active+clean, acting [21,107,16] pg 2.469 is stale+active+clean, acting [30,59,97] pg 2.468 is stale+active+clean, acting [80,43,65] pg 2.46b is stale+active+clean, acting [3,140,25] pg 2.465 is down+peering, acting [68,51] pg 2.464 is down+peering, acting [46] pg 2.467 is stale+active+clean, acting [14,68,82] pg 2.466 is stale+active+clean, acting [3,138,49] pg 2.461 is stale+active+clean, acting [76,118,13] pg 2.460 is stale+active+clean, acting [74,103,41] pg 2.463 is stale+active+clean, acting [140,146,3] pg 2.462 is down+peering, acting [104] pg 2.45d is stale+active+clean, acting [17,34,67] pg 2.45c is stale+active+clean, acting [14,44,128] pg 2.45f is active+degraded+remapped, acting [51,67] pg 2.45e is active+degraded+remapped, acting [51,98] pg 2.459 is stale+active+clean, acting [6,9,98] pg 2.458 is active+degraded+remapped, acting [22,46] pg 2.45b is stale+active+clean, acting [115,121,32] pg 2.45a is stale+active+clean, acting [18,13,55] pg 2.455 is down+peering, acting [97] pg 2.454 is stale+active+clean, acting [55,20,17] pg 2.457 is stale+active+clean, acting [18,53,91] pg 2.456 is stale+active+clean, acting [145,15,28] pg 2.450 is stale+active+clean, acting [137,93,51] pg 2.453 is stale+active+clean, acting [126,61,67] pg 2.452 is stale+active+clean, acting [17,100,34] pg 2.44d is stale+active+clean, acting [117,50,126] pg 2.44c is stale+active+clean, acting [31,119,59] pg 2.44f is stale+active+clean, acting [61,145,28] pg 2.44e is stale+active+clean, acting [121,52,62] pg 2.449 is down+peering, acting [25] pg 2.448 is active+degraded, acting [98] pg 2.44b is down+peering, acting [43,81] pg 2.44a is stale+active+clean, acting [7,67,135] pg 2.444 is stale+active+clean, acting [15,22,109] pg 2.446 is active+degraded, acting [46,8] pg 2.441 is stale+active+clean, acting [65,57,119] pg 2.440 is stale+active+clean, acting [58,101,37] pg 2.443 is stale+active+clean, acting [82,111,142] pg 2.442 is down+peering, acting [97] pg 2.43f is down+peering, acting [81,22] pg 2.43e is down+peering, acting [25,104] pg 2.439 is stale+active+clean, acting [21,1,61] pg 2.43b is stale+active+clean, acting [13,43,4] pg 2.43a is down+peering, acting [67] pg 2.435 is down+peering, acting [48] pg 2.434 is stale+active+clean, acting [101,15,77] pg 2.437 is active+degraded, acting [142] pg 2.436 is active+degraded+remapped, acting [97,81] pg 2.431 is stale+active+clean, acting [124,56,111] pg 2.430 is stale+active+clean, acting [112,19,0] pg 2.42d is active+degraded+remapped, acting [25,8] pg 2.42c is active+degraded+remapped, acting [8,104] pg 2.42f is stale+active+clean, acting [127,117,118] pg 2.42e is stale+active+clean, acting [83,12,25] pg 2.429 is stale+active+clean, acting [108,10,97] pg 2.428 is stale+active+clean, acting [139,29,46] pg 2.42a is down+peering, acting [40,97] pg 2.425 is stale+active+clean, acting [110,109,18] pg 2.424 is stale+active+clean, acting [6,69,115] pg 2.427 is stale+active+clean, acting [56,64,21] pg 2.426 is down+peering, acting [81] pg 2.421 is stale+active+clean, acting [139,94,109] pg 2.420 is stale+active+clean, acting [70,112,27] pg 2.423 is active+degraded, acting [43] pg 2.422 is stale+active+clean, acting [75,59,68] pg 2.41c is stale+active+clean, acting [34,146,10] pg 2.41f is active+degraded+remapped, acting [46,43] pg 2.41e is stale+active+clean, acting [84,46,82] pg 2.419 is stale+active+clean, acting [26,40,126] pg 2.41b is down+peering, acting [97] pg 2.41a is stale+active+clean, acting [82,124,139] pg 2.415 is down+peering, acting [50] pg 2.414 is active+degraded+remapped, acting [43,104] pg 2.417 is stale+active+clean, acting [146,86,81] pg 2.416 is stale+active+clean, acting [15,6,93] pg 2.410 is stale+active+clean, acting [149,84,2] pg 2.413 is stale+active+clean, acting [122,88,129] pg 2.412 is down+peering, acting [67] pg 2.40d is active+degraded, acting [142,104] pg 2.40c is stale+active+clean, acting [138,19,75] pg 2.40e is stale+active+clean, acting [111,142,58] pg 2.409 is active+degraded, acting [97,8] pg 2.408 is stale+active+clean, acting [132,60,47] pg 2.40b is stale+active+clean, acting [26,109,116] pg 2.40a is stale+active+clean, acting [44,139,102] pg 2.405 is stale+active+clean, acting [143,135,8] pg 2.404 is stale+active+clean, acting [11,34,118] pg 2.407 is active+degraded+remapped, acting [50,40] pg 2.406 is stale+active+clean, acting [149,116,128] pg 2.401 is stale+active+clean, acting [102,92,74] pg 2.400 is down+peering, acting [43] pg 2.403 is stale+active+clean, acting [47,131,84] pg 2.402 is stale+active+clean, acting [28,35,94] pg 2.3fd is stale+active+clean, acting [120,103,138] pg 2.3fc is stale+active+clean, acting [106,36,125] pg 2.3ff is stale+active+clean, acting [112,75,100] pg 2.3fe is stale+active+clean, acting [74,31,141] pg 2.3f9 is stale+active+clean, acting [121,132,136] pg 2.3f8 is stale+active+clean, acting [149,127,61] pg 2.3fb is active+degraded, acting [8] pg 2.3fa is stale+active+clean, acting [41,103,47] pg 2.3f5 is stale+active+clean, acting [9,144,34] pg 2.3f4 is stale+active+clean, acting [24,131,112] pg 2.3f7 is active+degraded, acting [105] pg 2.3f6 is active+degraded, acting [50] pg 2.3f1 is active+degraded, acting [22] pg 2.3f0 is stale+active+clean, acting [1,63,144] pg 2.3f3 is stale+active+clean, acting [119,112,34] pg 2.3f2 is stale+active+clean, acting [62,57,72] pg 2.3ed is stale+active+clean, acting [70,75,115] pg 2.3ec is stale+active+clean, acting [76,70,91] pg 2.3ef is active+degraded, acting [68] pg 2.3ee is active+degraded, acting [25] pg 2.3e9 is stale+active+clean, acting [45,30,41] pg 2.3e8 is stale+active+clean, acting [112,96,28] pg 2.3eb is stale+active+clean, acting [130,145,139] pg 2.3ea is active+degraded, acting [51] pg 2.3e5 is active+degraded, acting [40] pg 2.3e4 is stale+active+clean, acting [116,7,26] pg 2.3e7 is stale+active+clean, acting [29,148,110] pg 2.3e6 is stale+active+clean, acting [125,59,29] pg 2.3e1 is stale+active+clean, acting [56,69,113] pg 2.3e0 is stale+active+clean, acting [74,36,79] pg 2.3e3 is stale+active+clean, acting [133,147,116] pg 2.3e2 is stale+active+clean, acting [20,77,41] pg 2.3dd is stale+active+clean, acting [70,33,17] pg 2.3dc is active+degraded, acting [8] pg 2.3df is stale+active+clean, acting [73,91,130] pg 2.3de is stale+active+clean, acting [61,72,54] pg 2.3d9 is stale+active+clean, acting [4,134,72] pg 2.3d8 is stale+active+clean, acting [125,127,134] pg 2.3db is active+degraded, acting [22] pg 2.3da is stale+active+clean, acting [10,100,82] pg 2.3d5 is stale+active+clean, acting [38,57,47] pg 2.3d4 is stale+active+clean, acting [84,106,47] pg 2.3d7 is stale+active+clean, acting [92,75,146] pg 2.3d6 is stale+active+clean, acting [15,143,102] pg 2.3d1 is active+degraded, acting [88] pg 2.3d0 is stale+active+clean, acting [31,65,101] pg 2.3d3 is active+degraded, acting [22] pg 2.3d2 is active+degraded, acting [104] pg 2.3cd is stale+active+clean, acting [93,86,6] pg 2.3cc is active+degraded, acting [8] pg 2.3cf is stale+active+clean, acting [110,31,70] pg 2.3ce is active+degraded, acting [97] pg 2.3c9 is active+degraded, acting [88] pg 2.3c8 is stale+active+clean, acting [16,29,125] pg 2.3cb is active+degraded, acting [46] pg 2.3ca is active+degraded, acting [40,48] pg 2.3c5 is stale+active+clean, acting [87,0,148] pg 2.3c4 is stale+active+clean, acting [41,76,123] pg 2.3c7 is active+degraded, acting [104] pg 2.3c6 is stale+active+clean, acting [136,47,106] pg 2.3c1 is stale+active+clean, acting [76,85,72] pg 2.3c0 is stale+active+clean, acting [30,49,113] pg 2.3c3 is stale+active+clean, acting [66,148,75] pg 2.3c2 is active+degraded, acting [25,88] pg 2.3bd is stale+active+clean, acting [66,100,108] pg 2.3bc is active+degraded, acting [105] pg 2.3bf is stale+active+clean, acting [42,128,23] pg 2.3be is stale+active+clean, acting [134,109,118] pg 2.3b9 is stale+active+clean, acting [78,94,89] pg 2.3b8 is stale+active+clean, acting [149,32,16] pg 2.3bb is stale+active+clean, acting [135,20,29] pg 2.3ba is stale+active+clean, acting [6,147,37] pg 2.3b5 is stale+active+clean, acting [137,95,0] pg 2.3b4 is stale+active+clean, acting [72,77,112] pg 2.3b7 is stale+active+clean, acting [110,109,149] pg 2.3b6 is stale+active+clean, acting [80,42,95] pg 2.3b1 is stale+active+clean, acting [76,140,71] pg 2.3b0 is stale+active+clean, acting [28,149,112] pg 2.3b3 is active+degraded, acting [46] pg 2.3b2 is active+degraded, acting [81,142] pg 2.3ad is stale+active+clean, acting [66,30,73] pg 2.3ac is active+degraded, acting [25] pg 2.3af is stale+active+clean, acting [30,92,146] pg 2.3ae is active+degraded, acting [88] pg 2.3a9 is active+degraded, acting [98] pg 2.3a8 is stale+active+clean, acting [92,126,144] pg 2.3ab is stale+active+clean, acting [62,34,123] pg 2.3aa is stale+active+clean, acting [60,83,73] pg 2.3a5 is stale+active+clean, acting [45,7,116] pg 2.3a4 is active+degraded, acting [46] pg 2.3a7 is stale+active+clean, acting [117,2,123] pg 2.3a6 is stale+active+clean, acting [49,75,11] pg 2.3a1 is stale+active+clean, acting [58,16,21] pg 2.3a0 is stale+active+clean, acting [93,109,114] pg 2.3a3 is active+degraded, acting [142] pg 2.3a2 is stale+active+clean, acting [148,61,56] pg 2.39d is stale+active+clean, acting [129,61,145] pg 2.39c is stale+active+clean, acting [122,1,15] pg 2.39f is stale+active+clean, acting [122,27,85] pg 2.39e is active+degraded, acting [8] pg 2.399 is stale+active+clean, acting [138,23,4] pg 2.398 is active+degraded, acting [25] pg 2.39b is active+degraded, acting [81,98] pg 2.39a is active+degraded, acting [48] pg 2.395 is active+degraded, acting [97,104] pg 2.394 is active+degraded, acting [51] pg 2.397 is stale+active+clean, acting [34,19,38] pg 2.396 is stale+active+clean, acting [139,5,49] pg 2.391 is stale+active+clean, acting [144,9,58] pg 2.390 is stale+active+clean, acting [130,118,135] pg 2.393 is stale+active+clean, acting [92,1,124] pg 2.392 is active+degraded, acting [88] pg 2.38d is active+degraded, acting [142] pg 2.38c is active+degraded, acting [22] pg 2.38f is stale+active+clean, acting [2,13,125] pg 2.38e is stale+active+clean, acting [118,4,14] pg 2.389 is stale+active+clean, acting [14,146,107] pg 2.388 is active+degraded, acting [43] pg 2.38b is active+degraded, acting [98] pg 2.38a is active+degraded, acting [50] pg 2.385 is stale+active+clean, acting [107,86,122] pg 2.384 is stale+active+clean, acting [13,96,106] pg 2.387 is stale+active+clean, acting [86,93,132] pg 2.386 is stale+active+clean, acting [149,5,111] pg 2.381 is stale+active+clean, acting [119,129,140] pg 2.380 is active+degraded, acting [105,43] pg 2.383 is active+degraded, acting [67] pg 2.382 is stale+active+clean, acting [76,85,69] pg 2.37d is stale+active+clean, acting [49,75,92] pg 2.37c is stale+active+clean, acting [10,78,100] pg 2.37f is stale+active+clean, acting [120,127,110] pg 2.37e is active+degraded, acting [81] pg 2.379 is stale+active+clean, acting [73,87,54] pg 2.378 is active+degraded, acting [22] pg 2.37b is stale+active+clean, acting [5,41,143] pg 2.37a is stale+active+clean, acting [130,112,73] pg 2.375 is stale+active+clean, acting [76,45,135] pg 2.374 is stale+active+clean, acting [29,116,96] pg 2.377 is stale+active+clean, acting [108,137,20] pg 2.376 is stale+active+clean, acting [28,90,147] pg 2.371 is active+degraded, acting [51] pg 2.370 is stale+active+clean, acting [100,64,0] pg 2.373 is stale+active+clean, acting [1,141,149] pg 2.372 is stale+active+clean, acting [1,146,90] pg 2.36d is active+degraded, acting [81] pg 2.36c is stale+active+clean, acting [123,56,63] pg 2.36f is active+degraded, acting [98] pg 2.36e is active+degraded, acting [25] pg 2.369 is stale+active+clean, acting [28,99,42] pg 2.368 is stale+active+clean, acting [121,12,6] pg 2.36b is active+degraded, acting [22,104] pg 2.36a is stale+active+clean, acting [138,144,5] pg 2.365 is stale+active+clean, acting [14,0,26] pg 2.364 is active+degraded, acting [88] pg 2.367 is stale+active+clean, acting [30,24,13] pg 2.366 is active+degraded, acting [8,67] pg 2.361 is active+degraded, acting [43] pg 2.360 is active+degraded, acting [8] pg 2.363 is active+degraded, acting [142] pg 2.362 is stale+active+clean, acting [72,141,34] pg 2.35d is active+degraded, acting [25] pg 2.35c is stale+active+clean, acting [144,136,28] pg 2.35f is active+degraded, acting [105,67] pg 2.35e is stale+active+clean, acting [138,143,2] pg 2.359 is stale+active+clean, acting [100,102,63] pg 2.358 is stale+active+clean, acting [60,32,18] pg 2.35b is stale+active+clean, acting [92,131,21] pg 2.35a is stale+active+clean, acting [60,49,133] pg 2.355 is stale+active+clean, acting [116,123,52] pg 2.354 is stale+active+clean, acting [116,147,128] pg 2.357 is stale+active+clean, acting [126,136,146] pg 2.356 is stale+active+clean, acting [101,3,84] pg 2.351 is active+degraded, acting [51] pg 2.350 is active+degraded, acting [8] pg 2.353 is stale+active+clean, acting [45,57,135] pg 2.352 is stale+active+clean, acting [61,58,69] pg 2.34d is stale+active+clean, acting [12,69,76] pg 2.34c is stale+active+clean, acting [128,65,23] pg 2.34f is active+degraded, acting [88] pg 2.34e is active+degraded, acting [81] pg 2.349 is active+degraded, acting [43,8] pg 2.348 is stale+active+clean, acting [12,94,0] pg 2.34b is stale+active+clean, acting [31,125,136] pg 2.34a is stale+active+clean, acting [2,116,118] pg 2.345 is stale+active+clean, acting [100,57,66] pg 2.344 is active+degraded, acting [98] pg 2.347 is stale+active+clean, acting [1,59,26] pg 2.346 is stale+active+clean, acting [122,112,30] pg 2.341 is active+degraded, acting [48] pg 2.340 is active+degraded, acting [48] pg 2.343 is stale+active+clean, acting [70,83,138] pg 2.342 is stale+active+clean, acting [26,136,107] pg 2.33d is stale+active+clean, acting [71,130,62] pg 2.33c is stale+active+clean, acting [45,134,77] pg 2.33f is active+degraded, acting [22] pg 2.33e is stale+active+clean, acting [100,113,53] pg 2.339 is stale+active+clean, acting [82,63,122] pg 2.338 is stale+active+clean, acting [18,53,114] pg 2.33b is stale+active+clean, acting [108,140,122] pg 2.33a is stale+active+clean, acting [109,60,143] pg 2.335 is stale+active+clean, acting [139,109,74] pg 2.334 is stale+active+clean, acting [107,139,118] pg 2.337 is stale+active+clean, acting [11,119,33] pg 2.336 is active+degraded, acting [97] pg 2.331 is stale+active+clean, acting [44,127,141] pg 2.330 is stale+active+clean, acting [83,64,125] pg 2.333 is active+degraded, acting [50] pg 2.332 is active+degraded, acting [25] pg 2.32d is stale+active+clean, acting [66,103,99] pg 2.32c is stale+active+clean, acting [63,58,125] pg 2.32f is active+degraded, acting [68] pg 2.32e is stale+active+clean, acting [114,23,78] pg 2.329 is stale+active+clean, acting [52,70,66] pg 2.328 is active+degraded, acting [43] pg 2.32b is stale+active+clean, acting [111,71,32] pg 2.32a is active+degraded, acting [81] pg 2.325 is stale+active+clean, acting [149,76,85] pg 2.324 is stale+active+clean, acting [95,42,76] pg 2.327 is stale+active+clean, acting [70,102,137] pg 2.326 is stale+active+clean, acting [87,132,72] pg 2.321 is active+degraded, acting [46] pg 2.320 is stale+active+clean, acting [116,75,20] pg 2.323 is active+degraded, acting [104] pg 2.322 is active+degraded, acting [50] pg 2.31d is active+degraded, acting [88] pg 2.31c is active+degraded, acting [68] pg 2.31f is stale+active+clean, acting [96,16,127] pg 2.31e is stale+active+clean, acting [45,76,140] pg 2.319 is stale+active+clean, acting [18,59,31] pg 2.318 is stale+active+clean, acting [21,91,2] pg 2.31b is active+degraded, acting [142] pg 2.31a is active+degraded, acting [88] pg 2.315 is stale+active+clean, acting [58,47,138] pg 2.314 is active+degraded, acting [22] pg 2.317 is stale+active+clean, acting [0,62,122] pg 2.316 is stale+active+clean, acting [118,112,54] pg 2.311 is stale+active+clean, acting [117,130,49] pg 2.310 is stale+active+clean, acting [114,54,119] pg 2.313 is active+degraded, acting [68] pg 2.312 is stale+active+clean, acting [66,100,129] pg 2.30d is stale+active+clean, acting [83,39,121] pg 2.30c is active+degraded, acting [105] pg 2.30f is active+degraded, acting [67] pg 2.30e is stale+active+clean, acting [21,3,41] pg 2.309 is stale+active+clean, acting [121,38,53] pg 2.308 is active+degraded, acting [25] pg 2.30b is active+degraded, acting [98] pg 2.30a is active+degraded, acting [68] pg 2.305 is stale+active+clean, acting [92,130,124] pg 2.304 is stale+active+clean, acting [12,74,31] pg 2.307 is stale+active+clean, acting [109,117,95] pg 2.306 is stale+active+clean, acting [47,27,38] pg 2.301 is active+degraded, acting [50] pg 2.300 is active+degraded, acting [51] pg 2.303 is stale+active+clean, acting [29,93,15] pg 2.302 is stale+active+clean, acting [145,15,52] pg 2.2fd is stale+active+clean, acting [72,133,139] pg 2.2fc is stale+active+clean, acting [78,69,91] pg 2.2ff is stale+active+clean, acting [31,124,137] pg 2.2fe is active+degraded, acting [104] pg 2.2f9 is stale+active+clean, acting [58,24,114] pg 2.2f8 is stale+active+clean, acting [17,132,23] pg 2.2fb is stale+active+clean, acting [44,91,4] pg 2.2fa is stale+active+clean, acting [71,2,116] pg 2.2f5 is active+degraded, acting [105,48] pg 2.2f4 is active+degraded, acting [67] pg 2.2f7 is stale+active+clean, acting [59,49,27] pg 2.2f6 is stale+active+clean, acting [118,85,27] pg 2.2f1 is stale+active+clean, acting [19,30,41] pg 2.2f0 is stale+active+clean, acting [96,13,1] pg 2.2f3 is stale+active+clean, acting [70,87,76] pg 2.2f2 is stale+active+clean, acting [76,147,138] pg 2.2ed is active+degraded, acting [105] pg 2.2ec is stale+active+clean, acting [94,86,55] pg 2.2ef is active+degraded, acting [50] pg 2.2ee is active+degraded, acting [105] pg 2.2e9 is stale+active+clean, acting [80,147,38] pg 2.2e8 is stale+active+clean, acting [58,73,85] pg 2.2eb is stale+active+clean, acting [101,57,13] pg 2.2ea is stale+active+clean, acting [61,122,132] pg 2.2e5 is stale+active+clean, acting [96,92,109] pg 2.2e4 is stale+active+clean, acting [139,19,31] pg 2.2e7 is active+degraded, acting [97] pg 2.2e6 is stale+active+clean, acting [28,10,145] pg 2.2e1 is active+degraded, acting [50] pg 2.2e0 is active+degraded, acting [142] pg 2.2e3 is active+degraded, acting [48] pg 2.2e2 is active+degraded, acting [51] pg 2.2dd is active+degraded, acting [8] pg 2.2dc is stale+active+clean, acting [116,79,49] pg 2.2df is stale+active+clean, acting [64,130,71] pg 2.2de is stale+active+clean, acting [136,72,28] pg 2.2d9 is stale+active+clean, acting [33,138,149] pg 2.2d8 is stale+active+clean, acting [66,132,49] pg 2.2db is active+degraded, acting [40] pg 2.2da is stale+active+clean, acting [112,93,106] pg 2.2d5 is stale+active+clean, acting [140,4,72] pg 2.2d4 is active+degraded, acting [105] pg 2.2d7 is stale+active+clean, acting [16,127,144] pg 2.2d6 is stale+active+clean, acting [108,44,35] pg 2.2d1 is stale+active+clean, acting [108,36,73] pg 2.2d0 is stale+active+clean, acting [117,21,53] pg 2.2d3 is active+degraded, acting [67] pg 2.2d2 is stale+active+clean, acting [136,80,143] pg 2.2cd is stale+active+clean, acting [62,19,102] pg 2.2cc is active+degraded, acting [8,48] pg 2.2cf is stale+active+clean, acting [123,34,136] pg 2.2ce is stale+active+clean, acting [18,141,131] pg 2.2c9 is active+degraded, acting [97,81] pg 2.2c8 is stale+active+clean, acting [110,49,53] pg 2.2cb is active+degraded, acting [98] pg 2.2ca is stale+active+clean, acting [64,5,21] pg 2.2c5 is stale+active+clean, acting [74,85,55] pg 2.2c4 is active+degraded, acting [8] pg 2.2c7 is stale+active+clean, acting [148,31,12] pg 2.2c6 is stale+active+clean, acting [24,83,15] pg 2.2c1 is stale+active+clean, acting [102,44,11] pg 2.2c0 is active+degraded, acting [68] pg 2.2c3 is stale+active+clean, acting [76,101,90] pg 2.2c2 is stale+active+clean, acting [94,136,102] pg 2.2bd is stale+active+clean, acting [61,7,144] pg 2.2bc is stale+active+clean, acting [111,107,118] pg 2.2bf is stale+active+clean, acting [65,7,120] pg 2.2be is stale+active+clean, acting [59,124,131] pg 2.2b9 is stale+active+clean, acting [79,121,115] pg 2.2b8 is stale+active+clean, acting [65,99,102] pg 2.2bb is active+degraded, acting [25] pg 2.2ba is stale+active+clean, acting [86,79,20] pg 2.2b5 is stale+active+clean, acting [147,78,39] pg 2.2b4 is stale+active+clean, acting [87,107,123] pg 2.2b7 is stale+active+clean, acting [124,117,127] pg 2.2b6 is stale+active+clean, acting [10,20,128] pg 2.2b1 is stale+active+clean, acting [57,87,70] pg 2.2b0 is stale+active+clean, acting [12,82,96] pg 2.2b3 is stale+active+clean, acting [76,140,149] pg 2.2b2 is active+degraded, acting [104,46] pg 2.2ad is active+degraded, acting [25] pg 2.2ac is active+degraded, acting [97] pg 2.2af is stale+active+clean, acting [23,17,55] pg 2.2ae is stale+active+clean, acting [54,141,26] pg 2.2a9 is active+degraded, acting [97] pg 2.2a8 is active+degraded, acting [104] pg 2.2ab is active+degraded, acting [8] pg 2.2aa is stale+active+clean, acting [44,140,0] pg 2.2a5 is active+degraded, acting [88] pg 2.2a4 is stale+active+clean, acting [83,19,112] pg 2.2a7 is stale+active+clean, acting [13,49,4] pg 2.2a6 is active+degraded, acting [22] pg 2.2a1 is active+degraded, acting [51] pg 2.2a0 is stale+active+clean, acting [31,119,37] pg 2.2a3 is stale+active+clean, acting [116,72,78] pg 2.2a2 is stale+active+clean, acting [95,0,13] pg 2.29d is stale+active+clean, acting [145,136,126] pg 2.29c is stale+active+clean, acting [121,32,92] pg 2.29f is active+degraded, acting [46] pg 2.29e is stale+active+clean, acting [33,61,70] pg 2.299 is active+degraded, acting [50,88] pg 2.298 is stale+active+clean, acting [130,149,41] pg 2.29b is stale+active+clean, acting [123,5,89] pg 2.29a is active+degraded, acting [67] pg 2.295 is stale+active+clean, acting [127,20,134] pg 2.294 is stale+active+clean, acting [112,95,56] pg 2.297 is stale+active+clean, acting [129,84,70] pg 2.296 is active+degraded, acting [105] pg 2.291 is stale+active+clean, acting [130,12,123] pg 2.290 is active+degraded, acting [48] pg 2.293 is stale+active+clean, acting [122,138,78] pg 2.292 is stale+active+clean, acting [139,31,74] pg 2.28d is stale+active+clean, acting [143,89,52] pg 2.28c is active+degraded, acting [68] pg 2.28f is active+degraded, acting [40,67] pg 2.28e is stale+active+clean, acting [83,121,38] pg 2.289 is stale+active+clean, acting [112,144,3] pg 2.288 is stale+active+clean, acting [122,131,39] pg 2.28b is stale+active+clean, acting [26,77,60] pg 2.28a is stale+active+clean, acting [69,77,60] pg 2.285 is stale+active+clean, acting [17,30,118] pg 2.284 is active+degraded, acting [40] pg 2.287 is active+degraded, acting [88] pg 2.286 is stale+active+clean, acting [122,11,55] pg 2.281 is stale+active+clean, acting [144,83,141] pg 2.280 is active+degraded, acting [105,25] pg 2.283 is active+degraded, acting [142] pg 2.282 is active+degraded, acting [68] pg 2.27d is stale+active+clean, acting [28,42,74] pg 2.27c is active+degraded, acting [50] pg 2.27f is stale+active+clean, acting [20,42,32] pg 2.27e is active+degraded, acting [8] pg 2.279 is stale+active+clean, acting [111,32,23] pg 2.278 is active+degraded, acting [50,104] pg 2.27b is stale+active+clean, acting [113,44,103] pg 2.27a is stale+active+clean, acting [61,96,126] pg 2.275 is stale+active+clean, acting [135,31,124] pg 2.274 is stale+active+clean, acting [19,117,82] pg 2.277 is active+degraded, acting [46] pg 2.276 is stale+active+clean, acting [140,44,29] pg 2.271 is active+degraded, acting [46] pg 2.270 is stale+active+clean, acting [133,49,11] pg 2.273 is stale+active+clean, acting [56,137,71] pg 2.272 is stale+active+clean, acting [110,108,144] pg 2.26d is active+degraded, acting [67] pg 2.26c is stale+active+clean, acting [133,100,35] pg 2.26f is stale+active+clean, acting [148,33,15] pg 2.26e is stale+active+clean, acting [121,126,86] pg 2.269 is active+degraded, acting [50] pg 2.268 is stale+active+clean, acting [21,128,66] pg 2.26b is stale+active+clean, acting [103,143,117] pg 2.26a is stale+active+clean, acting [107,90,124] pg 2.265 is stale+active+clean, acting [120,61,78] pg 2.264 is stale+active+clean, acting [128,99,15] pg 2.267 is stale+active+clean, acting [21,31,61] pg 2.266 is active+degraded, acting [51] pg 2.261 is stale+active+clean, acting [33,85,124] pg 2.260 is active+degraded, acting [22] pg 2.263 is active+degraded, acting [51] pg 2.262 is active+degraded, acting [43,81] pg 2.25d is stale+active+clean, acting [115,126,125] pg 2.25c is stale+active+clean, acting [45,32,64] pg 2.25f is stale+active+clean, acting [2,117,21] pg 2.25e is active+degraded, acting [105] pg 2.259 is active+degraded, acting [48] pg 2.258 is stale+active+clean, acting [108,99,11] pg 2.25b is stale+active+clean, acting [15,71,128] pg 2.25a is stale+active+clean, acting [39,148,54] pg 2.255 is stale+active+clean, acting [95,0,90] pg 2.254 is stale+active+clean, acting [123,102,92] pg 2.257 is stale+active+clean, acting [16,2,72] pg 2.256 is stale+active+clean, acting [6,101,117] pg 2.251 is active+degraded, acting [50] pg 2.250 is stale+active+clean, acting [6,136,74] pg 2.253 is stale+active+clean, acting [137,101,56] pg 2.252 is stale+active+clean, acting [131,84,69] pg 2.24d is active+degraded, acting [8,48] pg 2.24c is stale+active+clean, acting [47,30,137] pg 2.24f is stale+active+clean, acting [106,15,93] pg 2.24e is stale+active+clean, acting [75,42,125] pg 2.249 is stale+active+clean, acting [100,108,16] pg 2.248 is active+degraded, acting [97] pg 2.24b is stale+active+clean, acting [110,1,21] pg 2.24a is stale+active+clean, acting [63,145,0] pg 2.245 is stale+active+clean, acting [118,63,132] pg 2.244 is stale+active+clean, acting [26,16,28] pg 2.247 is stale+active+clean, acting [85,103,121] pg 2.246 is active+degraded, acting [105] pg 2.241 is active+degraded, acting [48] pg 2.240 is stale+active+clean, acting [55,63,118] pg 2.243 is stale+active+clean, acting [123,129,136] pg 2.242 is stale+active+clean, acting [69,32,112] pg 2.23d is stale+active+clean, acting [125,60,79] pg 2.23c is stale+active+clean, acting [17,30,49] pg 2.23f is stale+active+clean, acting [149,11,126] pg 2.23e is stale+active+clean, acting [117,72,2] pg 2.239 is stale+active+clean, acting [89,58,100] pg 2.238 is stale+active+clean, acting [18,61,132] pg 2.23b is stale+active+clean, acting [53,87,122] pg 2.23a is stale+active+clean, acting [123,82,14] pg 2.235 is active+degraded, acting [98] pg 2.234 is stale+active+clean, acting [32,12,73] pg 2.237 is stale+active+clean, acting [21,59,54] pg 2.236 is stale+active+clean, acting [4,89,124] pg 2.231 is stale+active+clean, acting [24,128,140] pg 2.230 is stale+active+clean, acting [35,149,77] pg 2.233 is active+degraded, acting [81] pg 2.232 is active+degraded, acting [67] pg 2.22d is active+degraded, acting [97] pg 2.22c is stale+active+clean, acting [149,92,0] pg 2.22f is stale+active+clean, acting [131,115,69] pg 2.22e is stale+active+clean, acting [83,61,95] pg 2.229 is stale+active+clean, acting [20,35,53] pg 2.228 is stale+active+clean, acting [112,120,29] pg 2.22b is stale+active+clean, acting [74,79,64] pg 2.22a is stale+active+clean, acting [38,53,19] pg 2.225 is active+degraded, acting [25] pg 2.224 is stale+active+clean, acting [14,123,77] pg 2.227 is stale+active+clean, acting [102,15,147] pg 2.226 is active+degraded, acting [25] pg 2.221 is stale+active+clean, acting [18,107,86] pg 2.220 is stale+active+clean, acting [103,143,36] pg 2.223 is active+degraded, acting [142] pg 2.222 is active+degraded, acting [48,105] pg 2.21d is stale+active+clean, acting [93,75,10] pg 2.21c is active+degraded, acting [98] pg 2.21f is stale+active+clean, acting [132,12,145] pg 2.21e is stale+active+clean, acting [59,118,52] pg 2.219 is active+degraded, acting [97] pg 2.218 is stale+active+clean, acting [58,66,124] pg 2.21b is active+degraded, acting [104] pg 2.21a is stale+active+clean, acting [45,42,52] pg 2.215 is stale+active+clean, acting [116,125,131] pg 2.214 is stale+active+clean, acting [149,106,64] pg 2.217 is active+degraded, acting [50] pg 2.216 is active+degraded, acting [48] pg 2.211 is stale+active+clean, acting [60,27,119] pg 2.210 is active+degraded, acting [8] pg 2.213 is stale+active+clean, acting [129,63,148] pg 2.212 is stale+active+clean, acting [121,138,102] pg 2.20d is active+degraded, acting [46] pg 2.20c is active+degraded, acting [8] pg 2.20f is stale+active+clean, acting [144,84,30] pg 2.20e is active+degraded, acting [22] pg 2.209 is active+degraded, acting [88,8] pg 2.208 is stale+active+clean, acting [107,119,17] pg 2.20b is stale+active+clean, acting [6,124,139] pg 2.20a is stale+active+clean, acting [129,63,93] pg 2.205 is stale+active+clean, acting [33,47,64] pg 2.204 is stale+active+clean, acting [140,20,0] pg 2.207 is stale+active+clean, acting [12,106,148] pg 2.206 is stale+active+clean, acting [117,33,96] pg 2.201 is active+degraded, acting [81] pg 2.200 is stale+active+clean, acting [103,100,111] pg 2.203 is stale+active+clean, acting [119,79,138] pg 2.202 is stale+active+clean, acting [32,120,38] pg 2.1fd is active+degraded, acting [105] pg 2.1fc is active+degraded, acting [40] pg 2.1ff is active+degraded, acting [142] pg 2.1fe is active+degraded, acting [51] pg 2.1f9 is stale+active+clean, acting [84,127,18] pg 2.1f8 is stale+active+clean, acting [19,2,114] pg 2.1fb is active+degraded, acting [68] pg 2.1fa is stale+active+clean, acting [74,66,77] pg 2.1f5 is stale+active+clean, acting [20,75,17] pg 2.1f4 is stale+active+clean, acting [145,59,34] pg 2.1f7 is active+degraded, acting [142] pg 2.1f6 is active+degraded, acting [68] pg 2.1f1 is stale+active+clean, acting [100,10,131] pg 2.1f0 is stale+active+clean, acting [143,37,130] pg 2.1f3 is stale+active+clean, acting [29,19,9] pg 2.1f2 is stale+active+clean, acting [32,144,35] pg 2.1ed is stale+active+clean, acting [34,65,125] pg 2.1ec is active+degraded, acting [22] pg 2.1ef is active+degraded, acting [104] pg 2.1ee is stale+active+clean, acting [20,106,134] pg 2.1e9 is stale+active+clean, acting [71,65,131] pg 2.1e8 is stale+active+clean, acting [141,124,109] pg 2.1eb is stale+active+clean, acting [61,109,119] pg 2.1ea is active+degraded, acting [22] pg 2.1e5 is stale+active+clean, acting [0,95,66] pg 2.1e4 is active+degraded, acting [50] pg 2.1e7 is stale+active+clean, acting [114,123,3] pg 2.1e6 is stale+active+clean, acting [72,35,53] pg 2.1e1 is stale+active+clean, acting [91,121,108] pg 2.1e0 is stale+active+clean, acting [9,26,53] pg 2.1e3 is stale+active+clean, acting [109,10,73] pg 2.1e2 is stale+active+clean, acting [89,94,131] pg 2.1dd is active+degraded, acting [50] pg 2.1dc is active+degraded, acting [88] pg 2.1df is active+degraded, acting [22,81] pg 2.1de is stale+active+clean, acting [70,13,82] pg 2.1d9 is active+degraded, acting [51,142] pg 2.1d8 is stale+active+clean, acting [108,65,45] pg 2.1db is stale+active+clean, acting [54,115,74] pg 2.1da is active+degraded, acting [22] pg 2.1d5 is stale+active+clean, acting [146,75,41] pg 2.1d4 is active+degraded, acting [88] pg 2.1d7 is stale+active+clean, acting [26,7,14] pg 2.1d6 is active+degraded, acting [98] pg 2.1d1 is active+degraded, acting [46] pg 2.1d0 is stale+active+clean, acting [36,32,120] pg 2.1d3 is stale+active+clean, acting [116,76,101] pg 2.1d2 is active+degraded, acting [22] pg 2.1cd is active+degraded, acting [142] pg 2.1cc is stale+active+clean, acting [138,95,129] pg 2.1cf is active+degraded, acting [105] pg 2.1ce is active+degraded, acting [43] pg 2.1c9 is stale+active+clean, acting [5,49,138] pg 2.1c8 is active+degraded, acting [43] pg 2.1cb is stale+active+clean, acting [56,41,143] pg 2.1ca is stale+active+clean, acting [95,3,36] pg 2.1c5 is active+degraded, acting [105,25] pg 2.1c4 is stale+active+clean, acting [114,95,127] pg 2.1c7 is stale+active+clean, acting [132,24,36] pg 2.1c6 is stale+active+clean, acting [129,9,146] pg 2.1c1 is active+degraded, acting [142] pg 2.1c0 is stale+active+clean, acting [0,91,100] pg 2.1c3 is stale+active+clean, acting [6,90,100] pg 2.1c2 is stale+active+clean, acting [55,87,118] pg 2.1bd is stale+active+clean, acting [10,33,18] pg 2.1bc is active+degraded, acting [98] pg 2.1bf is stale+active+clean, acting [114,7,144] pg 2.1be is stale+active+clean, acting [11,73,28] pg 2.1b9 is stale+active+clean, acting [21,57,63] pg 2.1b8 is active+degraded, acting [98] pg 2.1bb is stale+active+clean, acting [34,19,92] pg 2.1ba is stale+active+clean, acting [96,13,3] pg 2.1b5 is active+degraded, acting [40] pg 2.1b4 is active+degraded, acting [51] pg 2.1b7 is active+degraded, acting [46] pg 2.1b6 is active+degraded, acting [67] pg 2.1b1 is stale+active+clean, acting [11,44,107] pg 2.1b0 is stale+active+clean, acting [119,103,85] pg 2.1b3 is stale+active+clean, acting [117,103,24] pg 2.1b2 is stale+active+clean, acting [75,140,49] pg 2.1ad is active+degraded, acting [98] pg 2.1ac is stale+active+clean, acting [131,64,124] too few pgs per osd (14 < min 20) osd.0 is down since epoch 770, last address 172.17.2.101:6800/8565 osd.1 is down since epoch 770, last address 172.17.2.101:6803/10276 osd.2 is down since epoch 770, last address 172.17.2.101:6806/11964 osd.3 is down since epoch 766, last address 172.17.2.101:6809/14484 osd.4 is down since epoch 769, last address 172.17.2.101:6812/16914 osd.5 is down since epoch 770, last address 172.17.2.101:6815/19313 osd.6 is down since epoch 770, last address 172.17.2.101:6818/22949 osd.7 is down since epoch 770, last address 172.17.2.101:6821/26482 osd.9 is down since epoch 766, last address 172.17.2.102:6800/24363 osd.10 is down since epoch 772, last address 172.17.2.102:6803/25963 osd.11 is down since epoch 765, last address 172.17.2.102:6806/28298 osd.12 is down since epoch 770, last address 172.17.2.102:6809/30463 osd.13 is down since epoch 763, last address 172.17.2.102:6812/405 osd.14 is down since epoch 763, last address 172.17.2.102:6815/3478 osd.15 is down since epoch 766, last address 172.17.2.102:6818/5764 osd.16 is down since epoch 771, last address 172.17.2.102:6821/10098 osd.17 is down since epoch 770, last address 172.17.2.102:6824/14678 osd.18 is down since epoch 772, last address 172.17.2.103:6800/27242 osd.19 is down since epoch 772, last address 172.17.2.103:6803/29034 osd.20 is down since epoch 771, last address 172.17.2.103:6806/31125 osd.21 is down since epoch 766, last address 172.17.2.103:6809/807 osd.23 is down since epoch 766, last address 172.17.2.103:6815/6592 osd.24 is down since epoch 763, last address 172.17.2.103:6818/10086 osd.26 is down since epoch 763, last address 172.17.2.103:6824/18275 osd.27 is down since epoch 770, last address 172.17.2.101:6827/3855 osd.28 is down since epoch 770, last address 172.17.2.101:6830/10951 osd.29 is down since epoch 763, last address 172.17.2.101:6833/13172 osd.30 is down since epoch 770, last address 172.17.2.101:6836/22226 osd.31 is down since epoch 765, last address 172.17.2.101:6839/24592 osd.32 is down since epoch 770, last address 172.17.2.101:6842/30921 osd.33 is down since epoch 772, last address 172.17.2.101:6845/6678 osd.34 is down since epoch 766, last address 172.17.2.101:6848/14129 osd.35 is down since epoch 763, last address 172.17.2.102:6827/19902 osd.36 is down since epoch 763, last address 172.17.2.102:6830/27053 osd.37 is down since epoch 770, last address 172.17.2.102:6833/29737 osd.38 is down since epoch 772, last address 172.17.2.102:6836/4271 osd.39 is down since epoch 766, last address 172.17.2.102:6839/11985 osd.41 is down since epoch 763, last address 172.17.2.102:6845/23095 osd.42 is down since epoch 763, last address 172.17.2.102:6848/31079 osd.44 is down since epoch 770, last address 172.17.2.103:6830/28950 osd.45 is down since epoch 772, last address 172.17.2.103:6833/2894 osd.47 is down since epoch 766, last address 172.17.2.103:6839/12775 osd.49 is down since epoch 770, last address 172.17.2.103:6845/30469 osd.52 is down since epoch 770, last address 172.17.2.101:6854/6878 osd.53 is down since epoch 772, last address 172.17.2.101:6857/14586 osd.54 is down since epoch 766, last address 172.17.2.101:6860/21039 osd.55 is down since epoch 766, last address 172.17.2.101:6863/3241 osd.56 is down since epoch 770, last address 172.17.2.101:6866/12915 osd.57 is down since epoch 772, last address 172.17.2.101:6869/23809 osd.58 is down since epoch 766, last address 172.17.2.101:6872/11463 osd.59 is down since epoch 766, last address 172.17.2.102:6851/10212 osd.60 is down since epoch 766, last address 172.17.2.102:6854/20899 osd.61 is down since epoch 770, last address 172.17.2.102:6857/29600 osd.62 is down since epoch 772, last address 172.17.2.102:6860/7793 osd.63 is down since epoch 763, last address 172.17.2.102:6863/16444 osd.64 is down since epoch 763, last address 172.17.2.102:6866/31201 osd.65 is down since epoch 770, last address 172.17.2.102:6869/13669 osd.66 is down since epoch 763, last address 172.17.2.102:6872/27404 osd.69 is down since epoch 771, last address 172.17.2.103:6857/31051 osd.70 is down since epoch 766, last address 172.17.2.103:6860/13866 osd.71 is down since epoch 770, last address 172.17.2.103:6863/24628 osd.72 is down since epoch 763, last address 172.17.2.103:6866/5055 osd.73 is down since epoch 770, last address 172.17.2.103:6869/12940 osd.74 is down since epoch 770, last address 172.17.2.103:6872/25328 osd.75 is down since epoch 770, last address 172.17.2.101:6875/28195 osd.76 is down since epoch 763, last address 172.17.2.101:6878/2341 osd.77 is down since epoch 772, last address 172.17.2.101:6881/18365 osd.78 is down since epoch 772, last address 172.17.2.101:6884/2115 osd.79 is down since epoch 770, last address 172.17.2.101:6887/27650 osd.80 is down since epoch 772, last address 172.17.2.101:6890/16015 osd.82 is down since epoch 770, last address 172.17.2.101:6896/12719 osd.83 is down since epoch 763, last address 172.17.2.101:6899/2173 osd.84 is down since epoch 770, last address 172.17.2.102:6875/3442 osd.85 is down since epoch 772, last address 172.17.2.102:6878/18636 osd.86 is down since epoch 772, last address 172.17.2.102:6881/1734 osd.87 is down since epoch 763, last address 172.17.2.102:6884/18119 osd.89 is down since epoch 763, last address 172.17.2.102:6890/22246 osd.90 is down since epoch 772, last address 172.17.2.102:6893/14348 osd.91 is down since epoch 763, last address 172.17.2.102:6896/8185 osd.92 is down since epoch 772, last address 172.17.2.102:6899/1182 osd.93 is down since epoch 763, last address 172.17.2.103:6875/7270 osd.94 is down since epoch 766, last address 172.17.2.103:6878/22341 osd.95 is down since epoch 770, last address 172.17.2.103:6881/5553 osd.96 is down since epoch 769, last address 172.17.2.103:6884/1508 osd.99 is down since epoch 772, last address 172.17.2.103:6893/16899 osd.100 is down since epoch 770, last address 172.17.2.103:6896/32609 osd.101 is down since epoch 766, last address 172.17.2.103:6899/1309 osd.102 is down since epoch 766, last address 172.17.2.101:6902/27098 osd.103 is down since epoch 763, last address 172.17.2.101:6905/17691 osd.106 is down since epoch 765, last address 172.17.2.101:6914/5754 osd.107 is down since epoch 770, last address 172.17.2.101:6917/3769 osd.108 is down since epoch 765, last address 172.17.2.101:6920/28263 osd.109 is down since epoch 770, last address 172.17.2.101:6923/27285 osd.110 is down since epoch 765, last address 172.17.2.102:6902/8238 osd.111 is down since epoch 766, last address 172.17.2.102:6905/18197 osd.112 is down since epoch 763, last address 172.17.2.102:6908/12571 osd.113 is down since epoch 766, last address 172.17.2.102:6911/22956 osd.114 is down since epoch 763, last address 172.17.2.102:6914/29952 osd.115 is down since epoch 763, last address 172.17.2.102:6917/27143 osd.116 is down since epoch 763, last address 172.17.2.102:6920/2258 osd.117 is down since epoch 766, last address 172.17.2.102:6923/1261 osd.118 is down since epoch 772, last address 172.17.2.103:6902/20993 osd.119 is down since epoch 770, last address 172.17.2.103:6905/5570 osd.120 is down since epoch 769, last address 172.17.2.103:6908/14964 osd.121 is down since epoch 770, last address 172.17.2.103:6911/26957 osd.122 is down since epoch 770, last address 172.17.2.103:6914/7923 osd.123 is down since epoch 770, last address 172.17.2.103:6917/8511 osd.124 is down since epoch 766, last address 172.17.2.103:6920/20734 osd.125 is down since epoch 770, last address 172.17.2.103:6923/19824 osd.126 is down since epoch 770, last address 172.17.2.101:6926/4648 osd.127 is down since epoch 766, last address 172.17.2.101:6929/1540 osd.128 is down since epoch 763, last address 172.17.2.101:6932/5890 osd.129 is down since epoch 763, last address 172.17.2.101:6935/12632 osd.130 is down since epoch 772, last address 172.17.2.101:6938/31700 osd.131 is down since epoch 763, last address 172.17.2.101:6941/5784 osd.132 is down since epoch 770, last address 172.17.2.101:6944/4264 osd.133 is down since epoch 772, last address 172.17.2.101:6947/28624 osd.134 is down since epoch 766, last address 172.17.2.102:6926/2936 osd.135 is down since epoch 763, last address 172.17.2.102:6929/28462 osd.136 is down since epoch 772, last address 172.17.2.102:6932/24967 osd.137 is down since epoch 772, last address 172.17.2.102:6935/13338 osd.138 is down since epoch 763, last address 172.17.2.102:6938/20294 osd.139 is down since epoch 770, last address 172.17.2.102:6941/3753 osd.140 is down since epoch 772, last address 172.17.2.102:6944/12254 osd.141 is down since epoch 763, last address 172.17.2.102:6947/10995 osd.143 is down since epoch 772, last address 172.17.2.103:6929/9420 osd.144 is down since epoch 770, last address 172.17.2.103:6932/23701 osd.145 is down since epoch 772, last address 172.17.2.103:6935/27912 osd.146 is down since epoch 766, last address 172.17.2.103:6938/5612 osd.147 is down since epoch 770, last address 172.17.2.103:6941/16491 osd.148 is down since epoch 772, last address 172.17.2.103:6944/21417 osd.149 is down since epoch 770, last address 172.17.2.103:6947/31998 [root@jktcb2cpstg01p ~]# ceph osd dump epoch 776 fsid 0d522f68-be26-424b-bf6f-ab14dcd30618 created 2014-07-14 00:38:53.339896 modified 2014-07-14 02:16:03.965752 flags pool 0 'data' replicated size 3 min_size 1 crush_ruleset 0 object_hash rjenkins pg_num 64 pgp_num 64 last_change 1 flags hashpspool crash_replay_interval 45 stripe_width 0 pool 1 'metadata' replicated size 3 min_size 1 crush_ruleset 0 object_hash rjenkins pg_num 64 pgp_num 64 last_change 1 flags hashpspool stripe_width 0 pool 2 'rbd' replicated size 3 min_size 1 crush_ruleset 0 object_hash rjenkins pg_num 2048 pgp_num 2048 last_change 761 flags hashpspool stripe_width 0 max_osd 150 osd.0 down in weight 1 up_from 4 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6800/8565 192.168.10.1:6800/8565 192.168.10.1:6801/8565 172.17.2.101:6801/8565 exists f3b88ce3-c761-4066-a83e-925b984fc9f0 osd.1 down in weight 1 up_from 8 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6803/10276 192.168.10.1:6802/10276 192.168.10.1:6803/10276 172.17.2.101:6804/10276 exists b39294cd-1388-4a06-a623-0cf8824670f8 osd.2 down in weight 1 up_from 16 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6806/11964 192.168.10.1:6804/11964 192.168.10.1:6805/11964 172.17.2.101:6807/11964 exists e3883992-b675-4d18-a3c4-b10f910f8d9b osd.3 down in weight 1 up_from 21 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.101:6809/14484 192.168.10.1:6806/14484 192.168.10.1:6807/14484 172.17.2.101:6810/14484 exists 66964290-462d-4190-ad94-9a43a2711501 osd.4 down in weight 1 up_from 26 up_thru 761 down_at 769 last_clean_interval [0,0) 172.17.2.101:6812/16914 192.168.10.1:6808/16914 192.168.10.1:6809/16914 172.17.2.101:6813/16914 exists fd255341-4335-42f8-8429-66f9fa8867cd osd.5 down in weight 1 up_from 31 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6815/19313 192.168.10.1:6810/19313 192.168.10.1:6811/19313 172.17.2.101:6816/19313 exists 221303ff-889d-465f-989e-916a41b07d14 osd.6 down in weight 1 up_from 36 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6818/22949 192.168.10.1:6812/22949 192.168.10.1:6813/22949 172.17.2.101:6819/22949 exists 5344ed67-eb47-4281-9a56-5695b4faacd3 osd.7 down in weight 1 up_from 41 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6821/26482 192.168.10.1:6814/26482 192.168.10.1:6815/26482 172.17.2.101:6822/26482 exists f0092397-7066-482f-a036-c4cff5e6c535 osd.8 up in weight 1 up_from 46 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.101:6824/30060 192.168.10.1:6816/30060 192.168.10.1:6817/30060 172.17.2.101:6825/30060 exists,up c8521ce0-2d59-4af0-81a7-3de882e54007 osd.9 down in weight 1 up_from 51 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6800/24363 192.168.10.2:6800/24363 192.168.10.2:6801/24363 172.17.2.102:6801/24363 exists 3f3ee88d-84d5-4286-b792-13dfa2f4cf2d osd.10 down in weight 1 up_from 56 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6803/25963 192.168.10.2:6802/25963 192.168.10.2:6803/25963 172.17.2.102:6804/25963 exists aee917f1-6688-4c27-b8ba-78616fc7e2f2 osd.11 down in weight 1 up_from 61 up_thru 761 down_at 765 last_clean_interval [0,0) 172.17.2.102:6806/28298 192.168.10.2:6804/28298 192.168.10.2:6805/28298 172.17.2.102:6807/28298 exists 3ccc1ac9-8032-4c12-af2f-18fcdf6303d2 osd.12 down in weight 1 up_from 66 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.102:6809/30463 192.168.10.2:6806/30463 192.168.10.2:6807/30463 172.17.2.102:6810/30463 exists d9e47bff-4b03-4d0b-bf09-c848c893771f osd.13 down in weight 1 up_from 71 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6812/405 192.168.10.2:6808/405 192.168.10.2:6809/405 172.17.2.102:6813/405 exists 02dafd19-2afb-4229-a3dd-d751f5b933c6 osd.14 down in weight 1 up_from 76 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6815/3478 192.168.10.2:6810/3478 192.168.10.2:6811/3478 172.17.2.102:6816/3478 exists 03e61e6d-479d-407e-9e1a-cede2f485889 osd.15 down in weight 1 up_from 81 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6818/5764 192.168.10.2:6812/5764 192.168.10.2:6813/5764 172.17.2.102:6819/5764 exists dab80154-a1d5-4854-b953-0b54760ed3b4 osd.16 down in weight 1 up_from 86 up_thru 761 down_at 771 last_clean_interval [0,0) 172.17.2.102:6821/10098 192.168.10.2:6814/10098 192.168.10.2:6815/10098 172.17.2.102:6822/10098 exists da0dfd81-b161-49ad-b911-629cffe3e107 osd.17 down in weight 1 up_from 91 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.102:6824/14678 192.168.10.2:6816/14678 192.168.10.2:6817/14678 172.17.2.102:6825/14678 exists 39246a8d-4682-456e-8dc8-684cc608b7b6 osd.18 down in weight 1 up_from 96 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6800/27242 192.168.10.3:6800/27242 192.168.10.3:6801/27242 172.17.2.103:6801/27242 exists 3917ddeb-5dee-4a30-a456-3afc3bc811e4 osd.19 down in weight 1 up_from 101 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6803/29034 192.168.10.3:6802/29034 192.168.10.3:6803/29034 172.17.2.103:6804/29034 exists e1228cb6-66ef-42b5-a473-fa6649988687 osd.20 down in weight 1 up_from 106 up_thru 761 down_at 771 last_clean_interval [0,0) 172.17.2.103:6806/31125 192.168.10.3:6804/31125 192.168.10.3:6805/31125 172.17.2.103:6807/31125 exists f51c3d09-4e1a-4896-87d9-72305d86e914 osd.21 down in weight 1 up_from 111 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6809/807 192.168.10.3:6806/807 192.168.10.3:6807/807 172.17.2.103:6810/807 exists caf28803-86a2-4306-a905-040f4dad301d osd.22 up in weight 1 up_from 116 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.103:6812/3922 192.168.10.3:6808/3922 192.168.10.3:6809/3922 172.17.2.103:6813/3922 exists,up 966ba5e5-0a24-4c68-80b7-96f3b12ae99a osd.23 down in weight 1 up_from 121 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6815/6592 192.168.10.3:6810/6592 192.168.10.3:6811/6592 172.17.2.103:6816/6592 exists 57f9b192-abff-4104-868c-90280ad7a0f8 osd.24 down in weight 1 up_from 126 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.103:6818/10086 192.168.10.3:6812/10086 192.168.10.3:6813/10086 172.17.2.103:6819/10086 exists f22ece32-e881-4a0f-a576-920d3ead7ec8 osd.25 up in weight 1 up_from 131 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.103:6821/13774 192.168.10.3:6814/13774 192.168.10.3:6815/13774 172.17.2.103:6822/13774 exists,up 59b9ba37-7012-48b7-8b92-ba49b81709b3 osd.26 down in weight 1 up_from 136 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.103:6824/18275 192.168.10.3:6816/18275 192.168.10.3:6817/18275 172.17.2.103:6825/18275 exists fe5491af-7e62-460c-8c40-cc1c5480360a osd.27 down in weight 1 up_from 141 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6827/3855 192.168.10.1:6818/3855 192.168.10.1:6819/3855 172.17.2.101:6828/3855 exists 360ed9be-74c3-4ac8-8dbf-f551fc33d0d5 osd.28 down in weight 1 up_from 146 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6830/10951 192.168.10.1:6820/10951 192.168.10.1:6821/10951 172.17.2.101:6831/10951 exists dd6ec013-a35f-47bf-a7a0-4b0f7b582296 osd.29 down in weight 1 up_from 151 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.101:6833/13172 192.168.10.1:6822/13172 192.168.10.1:6823/13172 172.17.2.101:6834/13172 exists bb9fc725-bd18-49fd-98fa-f28d9a61bf15 osd.30 down in weight 1 up_from 156 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6836/22226 192.168.10.1:6824/22226 192.168.10.1:6825/22226 172.17.2.101:6837/22226 exists 28627a6f-dd1a-4f52-bb9a-4876e69e39f0 osd.31 down in weight 1 up_from 162 up_thru 761 down_at 765 last_clean_interval [0,0) 172.17.2.101:6839/24592 192.168.10.1:6826/24592 192.168.10.1:6827/24592 172.17.2.101:6840/24592 exists a08621bd-ff6c-449b-99cd-40611b373b27 osd.32 down in weight 1 up_from 167 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6842/30921 192.168.10.1:6828/30921 192.168.10.1:6829/30921 172.17.2.101:6843/30921 exists 5f5515e9-8b4b-4232-92f6-2a58a94dc5e9 osd.33 down in weight 1 up_from 172 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6845/6678 192.168.10.1:6830/6678 192.168.10.1:6831/6678 172.17.2.101:6846/6678 exists 265ed209-9d48-44e1-9258-adb877dd7561 osd.34 down in weight 1 up_from 177 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.101:6848/14129 192.168.10.1:6832/14129 192.168.10.1:6833/14129 172.17.2.101:6849/14129 exists bf36641a-9794-46ca-91f9-a467d31f672f osd.35 down in weight 1 up_from 182 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6827/19902 192.168.10.2:6818/19902 192.168.10.2:6819/19902 172.17.2.102:6828/19902 exists 13db3191-852b-4f3d-b85a-9bd27a5078de osd.36 down in weight 1 up_from 187 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6830/27053 192.168.10.2:6820/27053 192.168.10.2:6821/27053 172.17.2.102:6831/27053 exists 31bc953c-7868-4d54-8f95-3baa23c186d3 osd.37 down in weight 1 up_from 192 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.102:6833/29737 192.168.10.2:6822/29737 192.168.10.2:6823/29737 172.17.2.102:6834/29737 exists faf54dcb-d55a-4ae1-9e5e-f48592a8be02 osd.38 down in weight 1 up_from 197 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6836/4271 192.168.10.2:6824/4271 192.168.10.2:6825/4271 172.17.2.102:6837/4271 exists 16d6516a-08dc-4a99-92e7-9f810e5d91de osd.39 down in weight 1 up_from 202 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6839/11985 192.168.10.2:6826/11985 192.168.10.2:6827/11985 172.17.2.102:6840/11985 exists e7a92cd0-ce51-4f1e-8342-369c8a403d8f osd.40 up in weight 1 up_from 207 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.102:6842/17300 192.168.10.2:6828/17300 192.168.10.2:6829/17300 172.17.2.102:6843/17300 exists,up 2d2d29bf-6384-4691-aec6-8b2925fded7e osd.41 down in weight 1 up_from 212 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6845/23095 192.168.10.2:6830/23095 192.168.10.2:6831/23095 172.17.2.102:6846/23095 exists 0dad4bc6-1377-4fff-9cbb-4de0b1ceca49 osd.42 down in weight 1 up_from 217 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6848/31079 192.168.10.2:6832/31079 192.168.10.2:6833/31079 172.17.2.102:6849/31079 exists 368f967d-ab92-425d-900b-5734fd169734 osd.43 up in weight 1 up_from 222 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.103:6827/23337 192.168.10.3:6818/23337 192.168.10.3:6819/23337 172.17.2.103:6828/23337 exists,up 51132962-11ba-4466-9a54-c228bab82a04 osd.44 down in weight 1 up_from 227 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6830/28950 192.168.10.3:6820/28950 192.168.10.3:6821/28950 172.17.2.103:6831/28950 exists 279aaced-03f4-4f1c-9bd0-7ecea3163b73 osd.45 down in weight 1 up_from 232 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6833/2894 192.168.10.3:6822/2894 192.168.10.3:6823/2894 172.17.2.103:6834/2894 exists 037abf3e-35a7-4150-85a0-54405f0f04c5 osd.46 up in weight 1 up_from 237 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.103:6836/9870 192.168.10.3:6824/9870 192.168.10.3:6825/9870 172.17.2.103:6837/9870 exists,up 3e622b75-9fd4-44af-a8ae-5efae22c4a52 osd.47 down in weight 1 up_from 242 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6839/12775 192.168.10.3:6826/12775 192.168.10.3:6827/12775 172.17.2.103:6840/12775 exists 406eb6c3-bdfc-4236-a1d0-daac2e464e22 osd.48 up in weight 1 up_from 247 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.103:6842/19376 192.168.10.3:6828/19376 192.168.10.3:6829/19376 172.17.2.103:6843/19376 exists,up 60599ed4-d674-4358-9a0d-f9629e37e953 osd.49 down in weight 1 up_from 252 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6845/30469 192.168.10.3:6830/30469 192.168.10.3:6831/30469 172.17.2.103:6846/30469 exists 534a0440-adc6-40df-a690-cf37d61376e8 osd.50 up in weight 1 up_from 257 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.103:6848/5921 192.168.10.3:6832/5921 192.168.10.3:6833/5921 172.17.2.103:6849/5921 exists,up 055e28e4-6d6f-4b38-b0a4-56f7e70f4891 osd.51 up in weight 1 up_from 262 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.101:6851/26797 192.168.10.1:6834/26797 192.168.10.1:6835/26797 172.17.2.101:6852/26797 exists,up af235d8a-5876-4c8f-bbc0-2cb3962a957f osd.52 down in weight 1 up_from 267 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6854/6878 192.168.10.1:6836/6878 192.168.10.1:6837/6878 172.17.2.101:6855/6878 exists 83aabda3-88b3-4f89-b839-fb79b396d466 osd.53 down in weight 1 up_from 272 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6857/14586 192.168.10.1:6838/14586 192.168.10.1:6839/14586 172.17.2.101:6858/14586 exists e3839ffe-7d54-4916-8ec8-177f4b527810 osd.54 down in weight 1 up_from 279 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.101:6860/21039 192.168.10.1:6840/21039 192.168.10.1:6841/21039 172.17.2.101:6861/21039 exists 1ad59aa3-4930-4a8f-ae5f-b9800c34a8bd osd.55 down in weight 1 up_from 285 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.101:6863/3241 192.168.10.1:6842/3241 192.168.10.1:6843/3241 172.17.2.101:6864/3241 exists 59bfeab3-6158-4a82-8461-c8ff1b25f5cb osd.56 down in weight 1 up_from 290 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6866/12915 192.168.10.1:6844/12915 192.168.10.1:6845/12915 172.17.2.101:6867/12915 exists 592ec023-57c0-4d6d-9427-2e4ba84aa7dc osd.57 down in weight 1 up_from 295 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6869/23809 192.168.10.1:6846/23809 192.168.10.1:6847/23809 172.17.2.101:6870/23809 exists 54e9bbe3-d31b-4fb1-b0d8-9feb69a92b58 osd.58 down in weight 1 up_from 300 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.101:6872/11463 192.168.10.1:6848/11463 192.168.10.1:6849/11463 172.17.2.101:6873/11463 exists b6fbc8ae-2865-4d08-a764-d59ed2b6b906 osd.59 down in weight 1 up_from 305 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6851/10212 192.168.10.2:6834/10212 192.168.10.2:6835/10212 172.17.2.102:6852/10212 exists 7a61f4a1-b08a-45f7-83d1-c8ce3e22eb05 osd.60 down in weight 1 up_from 310 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6854/20899 192.168.10.2:6836/20899 192.168.10.2:6837/20899 172.17.2.102:6855/20899 exists 9380f199-345c-4069-992b-3ba2242537ad osd.61 down in weight 1 up_from 315 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.102:6857/29600 192.168.10.2:6838/29600 192.168.10.2:6839/29600 172.17.2.102:6858/29600 exists 69b6a0de-a325-47eb-9cf7-43d3f3ab9ca7 osd.62 down in weight 1 up_from 320 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6860/7793 192.168.10.2:6840/7793 192.168.10.2:6841/7793 172.17.2.102:6861/7793 exists db2be7ff-7237-4400-8465-c16614d2a555 osd.63 down in weight 1 up_from 325 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6863/16444 192.168.10.2:6842/16444 192.168.10.2:6843/16444 172.17.2.102:6864/16444 exists ef7a6cdf-b0be-4b3b-8dc5-c6705625a590 osd.64 down in weight 1 up_from 330 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6866/31201 192.168.10.2:6844/31201 192.168.10.2:6845/31201 172.17.2.102:6867/31201 exists 58be1e1b-c08a-4d23-85db-4adb56b27e58 osd.65 down in weight 1 up_from 334 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.102:6869/13669 192.168.10.2:6846/13669 192.168.10.2:6847/13669 172.17.2.102:6870/13669 exists da673610-7852-46e9-8266-3f05986a72d3 osd.66 down in weight 1 up_from 339 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6872/27404 192.168.10.2:6848/27404 192.168.10.2:6849/27404 172.17.2.102:6873/27404 exists 2c9437f2-162b-45b4-a6c3-5accf0c077a0 osd.67 up in weight 1 up_from 343 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.103:6851/15201 192.168.10.3:6834/15201 192.168.10.3:6835/15201 172.17.2.103:6852/15201 exists,up 671d70d0-7c6f-4a40-9396-f21f6499f129 osd.68 up in weight 1 up_from 348 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.103:6854/21469 192.168.10.3:6836/21469 192.168.10.3:6837/21469 172.17.2.103:6855/21469 exists,up e0365888-3efd-4481-a697-a3f93c71e3c1 osd.69 down in weight 1 up_from 353 up_thru 761 down_at 771 last_clean_interval [0,0) 172.17.2.103:6857/31051 192.168.10.3:6838/31051 192.168.10.3:6839/31051 172.17.2.103:6858/31051 exists 0fbdd408-629a-4005-a59e-67d104af65f6 osd.70 down in weight 1 up_from 358 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6860/13866 192.168.10.3:6840/13866 192.168.10.3:6841/13866 172.17.2.103:6861/13866 exists 6613eb94-4223-44e8-ab00-ac2ddbe5d1a5 osd.71 down in weight 1 up_from 363 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6863/24628 192.168.10.3:6842/24628 192.168.10.3:6843/24628 172.17.2.103:6864/24628 exists 869c012d-ac44-4686-9186-94d0a2df71c5 osd.72 down in weight 1 up_from 368 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.103:6866/5055 192.168.10.3:6844/5055 192.168.10.3:6845/5055 172.17.2.103:6867/5055 exists 6185380e-f154-4cc3-a1b5-bdf3bebffef2 osd.73 down in weight 1 up_from 373 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6869/12940 192.168.10.3:6846/12940 192.168.10.3:6847/12940 172.17.2.103:6870/12940 exists a5573982-1de2-4fee-8d67-ba20b3a0d7d0 osd.74 down in weight 1 up_from 378 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6872/25328 192.168.10.3:6848/25328 192.168.10.3:6849/25328 172.17.2.103:6873/25328 exists 038e7ca2-8cb3-45c4-8a9c-e99eacfeccf5 osd.75 down in weight 1 up_from 383 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6875/28195 192.168.10.1:6850/28195 192.168.10.1:6851/28195 172.17.2.101:6876/28195 exists 802b5668-ae54-44e3-b3c7-1b503f571839 osd.76 down in weight 1 up_from 388 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.101:6878/2341 192.168.10.1:6852/2341 192.168.10.1:6853/2341 172.17.2.101:6879/2341 exists 39b7ae9a-37d3-41d1-b790-644b33c4e3ff osd.77 down in weight 1 up_from 393 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6881/18365 192.168.10.1:6854/18365 192.168.10.1:6855/18365 172.17.2.101:6882/18365 exists c62dbf05-ab16-4cc9-b512-c9fdd205ecff osd.78 down in weight 1 up_from 398 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6884/2115 192.168.10.1:6856/2115 192.168.10.1:6857/2115 172.17.2.101:6885/2115 exists e5ae202f-7abd-4181-ba78-b015faeb8de9 osd.79 down in weight 1 up_from 403 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6887/27650 192.168.10.1:6858/27650 192.168.10.1:6859/27650 172.17.2.101:6888/27650 exists 7dc0f6e9-57c2-444a-8148-1fed310a1a0f osd.80 down in weight 1 up_from 409 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6890/16015 192.168.10.1:6860/16015 192.168.10.1:6861/16015 172.17.2.101:6891/16015 exists f5d90e21-2803-4ee4-b294-e71ea9f3e96b osd.81 up in weight 1 up_from 414 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.101:6893/5068 192.168.10.1:6862/5068 192.168.10.1:6863/5068 172.17.2.101:6894/5068 exists,up 54ad19e7-7b59-4471-ad5d-097052f461e0 osd.82 down in weight 1 up_from 419 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6896/12719 192.168.10.1:6864/12719 192.168.10.1:6865/12719 172.17.2.101:6897/12719 exists b248a6ee-f399-421e-84b7-32015303e8c3 osd.83 down in weight 1 up_from 425 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.101:6899/2173 192.168.10.1:6866/2173 192.168.10.1:6867/2173 172.17.2.101:6900/2173 exists 021c41d3-57ef-4102-9060-570164010a95 osd.84 down in weight 1 up_from 430 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.102:6875/3442 192.168.10.2:6850/3442 192.168.10.2:6851/3442 172.17.2.102:6876/3442 exists 74749bb3-dcd9-458e-b763-f19c3fac1e3a osd.85 down in weight 1 up_from 435 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6878/18636 192.168.10.2:6852/18636 192.168.10.2:6853/18636 172.17.2.102:6879/18636 exists a6d27cf5-32f3-4121-8b48-1e53b77f760c osd.86 down in weight 1 up_from 440 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6881/1734 192.168.10.2:6854/1734 192.168.10.2:6855/1734 172.17.2.102:6882/1734 exists b37b6f52-680c-4d89-af91-29715465133f osd.87 down in weight 1 up_from 445 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6884/18119 192.168.10.2:6856/18119 192.168.10.2:6857/18119 172.17.2.102:6885/18119 exists 5c357bad-595a-4c38-8f58-cd39de2711b1 osd.88 up in weight 1 up_from 450 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.102:6887/2864 192.168.10.2:6858/2864 192.168.10.2:6859/2864 172.17.2.102:6888/2864 exists,up 4a903b04-25e4-4a46-975a-ba868cb0b3ec osd.89 down in weight 1 up_from 455 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6890/22246 192.168.10.2:6860/22246 192.168.10.2:6861/22246 172.17.2.102:6891/22246 exists 29a9ff57-d9ae-4fc8-9fcc-8b6ac3689222 osd.90 down in weight 1 up_from 460 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6893/14348 192.168.10.2:6862/14348 192.168.10.2:6863/14348 172.17.2.102:6894/14348 exists be0c52ad-52d5-4ccf-b13f-dff872b69277 osd.91 down in weight 1 up_from 465 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6896/8185 192.168.10.2:6864/8185 192.168.10.2:6865/8185 172.17.2.102:6897/8185 exists b56bc89c-aca7-4845-8e8f-29298a0b886b osd.92 down in weight 1 up_from 470 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6899/1182 192.168.10.2:6866/1182 192.168.10.2:6867/1182 172.17.2.102:6900/1182 exists 40e6e19d-3385-41b4-9199-49d1e8314fcc osd.93 down in weight 1 up_from 471 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.103:6875/7270 192.168.10.3:6850/7270 192.168.10.3:6851/7270 172.17.2.103:6876/7270 exists d6fe9768-f969-418d-9ccf-c5ad2e496438 osd.94 down in weight 1 up_from 477 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6878/22341 192.168.10.3:6852/22341 192.168.10.3:6853/22341 172.17.2.103:6879/22341 exists e1800ba9-023d-4cc6-ac80-db130d72d017 osd.95 down in weight 1 up_from 483 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6881/5553 192.168.10.3:6854/5553 192.168.10.3:6855/5553 172.17.2.103:6882/5553 exists 96dd19a9-42f2-429d-9ce4-8645a6d5fd1c osd.96 down in weight 1 up_from 488 up_thru 761 down_at 769 last_clean_interval [0,0) 172.17.2.103:6884/1508 192.168.10.3:6856/1508 192.168.10.3:6857/1508 172.17.2.103:6885/1508 exists 8b4777ad-4cfd-4756-b7e0-cbfe0430694f osd.97 up in weight 1 up_from 493 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.103:6887/20093 192.168.10.3:6858/20093 192.168.10.3:6859/20093 172.17.2.103:6888/20093 exists,up 2d29d0f7-ce06-465d-a328-b48de66007e6 osd.98 up in weight 1 up_from 498 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.103:6890/30464 192.168.10.3:6860/30464 192.168.10.3:6861/30464 172.17.2.103:6891/30464 exists,up 41bdd9dc-6b3f-4a52-8b13-6504d2deb6dc osd.99 down in weight 1 up_from 503 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6893/16899 192.168.10.3:6862/16899 192.168.10.3:6863/16899 172.17.2.103:6894/16899 exists 9ebcf40b-408b-4172-8e9e-5a03e0eb7e41 osd.100 down in weight 1 up_from 508 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6896/32609 192.168.10.3:6864/32609 192.168.10.3:6865/32609 172.17.2.103:6897/32609 exists 67a48c51-16dc-4a8c-8b16-2bb79bfa0257 osd.101 down in weight 1 up_from 513 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6899/1309 192.168.10.3:6866/1309 192.168.10.3:6867/1309 172.17.2.103:6900/1309 exists 4461fdfc-7a50-4b06-8470-1c317daa38bd osd.102 down in weight 1 up_from 517 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.101:6902/27098 192.168.10.1:6868/27098 192.168.10.1:6869/27098 172.17.2.101:6903/27098 exists e42a3900-7a94-4f71-aa0d-40ceb2829d68 osd.103 down in weight 1 up_from 522 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.101:6905/17691 192.168.10.1:6870/17691 192.168.10.1:6871/17691 172.17.2.101:6906/17691 exists 720fbc82-fcf5-4754-bc61-7c04129c5d13 osd.104 up in weight 1 up_from 529 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.101:6908/10311 192.168.10.1:6872/10311 192.168.10.1:6873/10311 172.17.2.101:6909/10311 exists,up 7a9bf923-d8a3-4359-b0e9-bd12564623ce osd.105 up in weight 1 up_from 534 up_thru 774 down_at 0 last_clean_interval [0,0) 172.17.2.101:6911/4931 192.168.10.1:6874/4931 192.168.10.1:6875/4931 172.17.2.101:6912/4931 exists,up 1b370ac4-dc89-4522-8776-243ba807670e osd.106 down in weight 1 up_from 539 up_thru 761 down_at 765 last_clean_interval [0,0) 172.17.2.101:6914/5754 192.168.10.1:6876/5754 192.168.10.1:6877/5754 172.17.2.101:6915/5754 exists 61e432e1-1873-495a-9424-ef31977370df osd.107 down in weight 1 up_from 545 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6917/3769 192.168.10.1:6878/3769 192.168.10.1:6879/3769 172.17.2.101:6918/3769 exists 74240818-f571-4147-9768-910d83a5ac05 osd.108 down in weight 1 up_from 550 up_thru 761 down_at 765 last_clean_interval [0,0) 172.17.2.101:6920/28263 192.168.10.1:6880/28263 192.168.10.1:6881/28263 172.17.2.101:6921/28263 exists 6156250e-a801-45eb-a3c4-911c98723755 osd.109 down in weight 1 up_from 555 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6923/27285 192.168.10.1:6882/27285 192.168.10.1:6883/27285 172.17.2.101:6924/27285 exists 8c449085-a359-498c-9836-c76e9dfd71e8 osd.110 down in weight 1 up_from 560 up_thru 761 down_at 765 last_clean_interval [0,0) 172.17.2.102:6902/8238 192.168.10.2:6868/8238 192.168.10.2:6869/8238 172.17.2.102:6903/8238 exists 740a0816-26d9-465c-b5f1-9814cbe60473 osd.111 down in weight 1 up_from 565 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6905/18197 192.168.10.2:6870/18197 192.168.10.2:6871/18197 172.17.2.102:6906/18197 exists 30585bcf-aa02-449b-a503-af0f67635c99 osd.112 down in weight 1 up_from 570 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6908/12571 192.168.10.2:6872/12571 192.168.10.2:6873/12571 172.17.2.102:6909/12571 exists 632a318a-5604-4bbd-bbbf-1e775c4e2b76 osd.113 down in weight 1 up_from 576 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6911/22956 192.168.10.2:6874/22956 192.168.10.2:6875/22956 172.17.2.102:6912/22956 exists e4dccc25-3617-4018-8835-a4644b50c5f1 osd.114 down in weight 1 up_from 581 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6914/29952 192.168.10.2:6876/29952 192.168.10.2:6877/29952 172.17.2.102:6915/29952 exists 9feb8137-e578-46e4-9158-353fc9902099 osd.115 down in weight 1 up_from 586 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6917/27143 192.168.10.2:6878/27143 192.168.10.2:6879/27143 172.17.2.102:6918/27143 exists eb59e951-38db-4931-b435-b3d43269ad06 osd.116 down in weight 1 up_from 591 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6920/2258 192.168.10.2:6880/2258 192.168.10.2:6881/2258 172.17.2.102:6921/2258 exists 60050768-f14c-4bae-bb4d-7ed9ca9987e7 osd.117 down in weight 1 up_from 596 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6923/1261 192.168.10.2:6882/1261 192.168.10.2:6883/1261 172.17.2.102:6924/1261 exists 0e211a71-d0db-4a4b-a854-ab3b1578989c osd.118 down in weight 1 up_from 601 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6902/20993 192.168.10.3:6868/20993 192.168.10.3:6869/20993 172.17.2.103:6903/20993 exists 33b07107-c1dd-4daf-a8e1-c46c23cdd648 osd.119 down in weight 1 up_from 606 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6905/5570 192.168.10.3:6870/5570 192.168.10.3:6871/5570 172.17.2.103:6906/5570 exists 95fb42ea-f7fc-4ba7-9160-66aba13389da osd.120 down in weight 1 up_from 611 up_thru 761 down_at 769 last_clean_interval [0,0) 172.17.2.103:6908/14964 192.168.10.3:6872/14964 192.168.10.3:6873/14964 172.17.2.103:6909/14964 exists 8d32ce2c-d77d-4db4-8cee-7a4fdddbf717 osd.121 down in weight 1 up_from 616 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6911/26957 192.168.10.3:6874/26957 192.168.10.3:6875/26957 172.17.2.103:6912/26957 exists d5eabbf2-fe87-4804-97cb-802c8aca2fd6 osd.122 down in weight 1 up_from 620 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6914/7923 192.168.10.3:6876/7923 192.168.10.3:6877/7923 172.17.2.103:6915/7923 exists 780b027b-f084-41e9-850e-189417f2fe53 osd.123 down in weight 1 up_from 626 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6917/8511 192.168.10.3:6878/8511 192.168.10.3:6879/8511 172.17.2.103:6918/8511 exists 35d38d75-9756-44ec-8156-6908bb4f3c62 osd.124 down in weight 1 up_from 630 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6920/20734 192.168.10.3:6880/20734 192.168.10.3:6881/20734 172.17.2.103:6921/20734 exists 8b8e2bf6-926c-4465-9f6a-0a2bbd518326 osd.125 down in weight 1 up_from 634 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6923/19824 192.168.10.3:6882/19824 192.168.10.3:6883/19824 172.17.2.103:6924/19824 exists 1a253057-dd6c-4d14-a202-0300862d5d16 osd.126 down in weight 1 up_from 638 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6926/4648 192.168.10.1:6884/4648 192.168.10.1:6885/4648 172.17.2.101:6927/4648 exists 403a8f61-92a5-4842-adc0-9c7303b8cd2c osd.127 down in weight 1 up_from 644 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.101:6929/1540 192.168.10.1:6886/1540 192.168.10.1:6887/1540 172.17.2.101:6930/1540 exists 5810d709-69ca-4ded-b240-dba7b1a65816 osd.128 down in weight 1 up_from 648 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.101:6932/5890 192.168.10.1:6888/5890 192.168.10.1:6889/5890 172.17.2.101:6933/5890 exists 41bf6d8c-4371-4b66-931e-854366f5c9dd osd.129 down in weight 1 up_from 653 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.101:6935/12632 192.168.10.1:6890/12632 192.168.10.1:6891/12632 172.17.2.101:6936/12632 exists bb59a04d-1b0e-4997-b371-21872268febc osd.130 down in weight 1 up_from 658 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6938/31700 192.168.10.1:6892/31700 192.168.10.1:6893/31700 172.17.2.101:6939/31700 exists 7a35fece-dbdf-4d2d-a26d-2fd8dca5ed51 osd.131 down in weight 1 up_from 663 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.101:6941/5784 192.168.10.1:6894/5784 192.168.10.1:6895/5784 172.17.2.101:6942/5784 exists cd322867-26ce-4439-a024-7c474431b705 osd.132 down in weight 1 up_from 668 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.101:6944/4264 192.168.10.1:6896/4264 192.168.10.1:6897/4264 172.17.2.101:6945/4264 exists abb6958c-448b-4cd4-b306-66baa554b39a osd.133 down in weight 1 up_from 673 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.101:6947/28624 192.168.10.1:6898/28624 192.168.10.1:6899/28624 172.17.2.101:6948/28624 exists 3139ba2c-dc8d-4ee8-bbc5-3156d55d914a osd.134 down in weight 1 up_from 678 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.102:6926/2936 192.168.10.2:6884/2936 192.168.10.2:6885/2936 172.17.2.102:6927/2936 exists 9779a279-86e2-46a4-93b8-767c2c906309 osd.135 down in weight 1 up_from 683 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6929/28462 192.168.10.2:6886/28462 192.168.10.2:6887/28462 172.17.2.102:6930/28462 exists 59addf92-521d-4e0c-9c79-e7fc31230dad osd.136 down in weight 1 up_from 688 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6932/24967 192.168.10.2:6888/24967 192.168.10.2:6889/24967 172.17.2.102:6933/24967 exists 5ff7655a-bd9b-4aa9-870c-2f12c0e9a8c7 osd.137 down in weight 1 up_from 693 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6935/13338 192.168.10.2:6890/13338 192.168.10.2:6891/13338 172.17.2.102:6936/13338 exists c6a0a137-7533-4873-9157-a4bf9df4cba0 osd.138 down in weight 1 up_from 698 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6938/20294 192.168.10.2:6892/20294 192.168.10.2:6893/20294 172.17.2.102:6939/20294 exists 18e2673a-0230-4dfe-98d4-eeff79fe2dd4 osd.139 down in weight 1 up_from 702 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.102:6941/3753 192.168.10.2:6894/3753 192.168.10.2:6895/3753 172.17.2.102:6942/3753 exists 1cfa60a7-97ee-43f4-8e64-9de8bba77b68 osd.140 down in weight 1 up_from 707 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.102:6944/12254 192.168.10.2:6896/12254 192.168.10.2:6897/12254 172.17.2.102:6945/12254 exists 559d87bf-bb07-4840-a9a7-5e3b43932614 osd.141 down in weight 1 up_from 712 up_thru 761 down_at 763 last_clean_interval [0,0) 172.17.2.102:6947/10995 192.168.10.2:6898/10995 192.168.10.2:6899/10995 172.17.2.102:6948/10995 exists 9c5da6b5-faf4-4396-b678-9fd67b771eec osd.142 up in weight 1 up_from 717 up_thru 773 down_at 0 last_clean_interval [0,0) 172.17.2.103:6926/31823 192.168.10.3:6884/31823 192.168.10.3:6885/31823 172.17.2.103:6927/31823 exists,up 464e950b-3680-4a45-a21a-7f0a797be735 osd.143 down in weight 1 up_from 722 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6929/9420 192.168.10.3:6886/9420 192.168.10.3:6887/9420 172.17.2.103:6930/9420 exists cba6a961-b852-48c8-89b2-0931cc03ae57 osd.144 down in weight 1 up_from 727 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6932/23701 192.168.10.3:6888/23701 192.168.10.3:6889/23701 172.17.2.103:6933/23701 exists 6e0c8c68-ccb6-459b-b083-e44940931f95 osd.145 down in weight 1 up_from 732 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6935/27912 192.168.10.3:6890/27912 192.168.10.3:6891/27912 172.17.2.103:6936/27912 exists 8f15701d-eb8d-4c86-a549-127b8c147da7 osd.146 down in weight 1 up_from 737 up_thru 761 down_at 766 last_clean_interval [0,0) 172.17.2.103:6938/5612 192.168.10.3:6892/5612 192.168.10.3:6893/5612 172.17.2.103:6939/5612 exists 11a310c5-22a4-470f-9d5b-7eec4811a7f8 osd.147 down in weight 1 up_from 742 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6941/16491 192.168.10.3:6894/16491 192.168.10.3:6895/16491 172.17.2.103:6942/16491 exists af17b2db-df25-4767-87ce-61ea29417abe osd.148 down in weight 1 up_from 747 up_thru 761 down_at 772 last_clean_interval [0,0) 172.17.2.103:6944/21417 192.168.10.3:6896/21417 192.168.10.3:6897/21417 172.17.2.103:6945/21417 exists 98842223-bae2-4d73-89e0-3a940a1fe30a osd.149 down in weight 1 up_from 752 up_thru 761 down_at 770 last_clean_interval [0,0) 172.17.2.103:6947/31998 192.168.10.3:6898/31998 192.168.10.3:6899/31998 172.17.2.103:6948/31998 exists db575139-d618-45a4-8892-2f002fc0cd80 pg_temp 2.407 [50,40] pg_temp 2.414 [43,104] pg_temp 2.418 [43,51,50] pg_temp 2.41f [46,43] pg_temp 2.42c [8,104] pg_temp 2.42d [25,8] pg_temp 2.436 [97,81] pg_temp 2.445 [46,88,67] pg_temp 2.458 [22,46] pg_temp 2.45e [51,98] pg_temp 2.45f [51,67] pg_temp 2.48f [51,67] pg_temp 2.495 [68,88] pg_temp 2.496 [50,46] pg_temp 2.49b [46,88] pg_temp 2.4a9 [81,67] pg_temp 2.4ac [50,142] pg_temp 2.4ad [81,51] pg_temp 2.4c0 [25,67] pg_temp 2.4cc [81,40,98] pg_temp 2.4e7 [43,48] pg_temp 2.4ea [88,22] pg_temp 2.4f7 [25,50] pg_temp 2.511 [97,68] pg_temp 2.517 [142,104] pg_temp 2.51c [46,81] pg_temp 2.524 [46,50] pg_temp 2.534 [25,67] pg_temp 2.535 [68,104,81] pg_temp 2.542 [98,81] pg_temp 2.54a [8,48,51] pg_temp 2.54e [88,104] pg_temp 2.54f [68,8] pg_temp 2.55a [68,81,25] pg_temp 2.55c [25,68] pg_temp 2.55f [68,8] pg_temp 2.577 [22,97] pg_temp 2.583 [81,48] pg_temp 2.588 [105,98] pg_temp 2.590 [22,81] pg_temp 2.593 [46,142] pg_temp 2.5a2 [48,40] pg_temp 2.5a4 [46,43] pg_temp 2.5cf [25,105] pg_temp 2.5d1 [142,46] pg_temp 2.5d6 [142,98] pg_temp 2.5da [48,22] pg_temp 2.5e4 [105,50] pg_temp 2.5ef [67,104] pg_temp 2.5f6 [48,68] pg_temp 2.5fc [68,40] pg_temp 2.5fd [22,105] pg_temp 2.601 [50,81] pg_temp 2.616 [142,48] pg_temp 2.619 [46,97] pg_temp 2.623 [50,142] pg_temp 2.651 [88,50] pg_temp 2.659 [51,50,48] pg_temp 2.662 [67,43,81] pg_temp 2.66d [81,67] pg_temp 2.678 [88,50,104] pg_temp 2.67e [97,88,8] pg_temp 2.687 [104,88] pg_temp 2.690 [98,48] pg_temp 2.6a5 [105,50,88] pg_temp 2.6ab [43,8] pg_temp 2.6cc [50,8,48] pg_temp 2.6d3 [8,67] pg_temp 2.6dd [22,8] pg_temp 2.6ed [98,105] pg_temp 2.700 [48,51] pg_temp 2.708 [81,25] pg_temp 2.71a [46,88] pg_temp 2.71b [22,142] pg_temp 2.722 [48,104,50] pg_temp 2.723 [88,104] pg_temp 2.728 [46,43] pg_temp 2.733 [104,50] pg_temp 2.736 [22,40,97] pg_temp 2.750 [25,8] pg_temp 2.75f [48,67,105] pg_temp 2.760 [142,8] pg_temp 2.78c [98,22] pg_temp 2.78d [88,142] pg_temp 2.792 [50,88] pg_temp 2.79b [142,81,98] pg_temp 2.7a3 [43,142] pg_temp 2.7a9 [105,98] pg_temp 2.7d2 [40,104] pg_temp 2.7f7 [68,105] [root@jktcb2cpstg01p ~]# vi ceph.log [root@jktcb2cpstg01p ~]# vi ceph.log [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy new jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.new][DEBUG ] Creating new cluster named ceph [ceph_deploy.new][DEBUG ] Resolving host jktcb2ndstg01p [ceph_deploy.new][DEBUG ] Monitor jktcb2ndstg01p at 172.17.2.101 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [jktcb2ndstg01p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2ndstg01p][INFO ] Running command: ssh -CT -o BatchMode=yes jktcb2ndstg01p [ceph_deploy.new][DEBUG ] Resolving host jktcb2ndstg02p [ceph_deploy.new][DEBUG ] Monitor jktcb2ndstg02p at 172.17.2.102 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [jktcb2ndstg02p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2ndstg02p][INFO ] Running command: ssh -CT -o BatchMode=yes jktcb2ndstg02p [ceph_deploy.new][DEBUG ] Resolving host jktcb2ndstg03p [ceph_deploy.new][DEBUG ] Monitor jktcb2ndstg03p at 172.17.2.103 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [jktcb2ndstg03p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2ndstg03p][INFO ] Running command: ssh -CT -o BatchMode=yes jktcb2ndstg03p [ceph_deploy.new][DEBUG ] Monitor initial members are ['jktcb2ndstg01p', 'jktcb2ndstg02p', 'jktcb2ndstg03p'] [ceph_deploy.new][DEBUG ] Monitor addrs are ['172.17.2.101', '172.17.2.102', '172.17.2.103'] [ceph_deploy.new][DEBUG ] Creating a random mon key... [ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf... [ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring... [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.7): /usr/bin/ceph-deploy install jktcb2cpstg01p jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.install][DEBUG ] Installing stable version firefly on cluster ceph hosts jktcb2cpstg01p jktcb2ndstg01p jktcb2ndstg02p jktcb2ndstg03p [ceph_deploy.install][DEBUG ] Detecting platform for host jktcb2cpstg01p ... [jktcb2cpstg01p][DEBUG ] connected to host: jktcb2cpstg01p [jktcb2cpstg01p][DEBUG ] detect platform information from remote host [jktcb2cpstg01p][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: CentOS 6.5 Final [jktcb2cpstg01p][INFO ] installing ceph on jktcb2cpstg01p [jktcb2cpstg01p][INFO ] Running command: yum clean all [jktcb2cpstg01p][DEBUG ] Loaded plugins: fastestmirror, priorities [jktcb2cpstg01p][DEBUG ] Cleaning repos: Ceph Ceph-noarch base ceph-source epel extras updates "ceph.log" 13941L, 1166836C