Actions
Bug #4820
closedceph-deploy : intermittent errors during install
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
not often, but see this error at the end of install. It would be nice to make this error look better or let the user know if installation should be retried or its successful.ceph.log doesn't seem to have much information as well.
tamil@ubuntu:~/ceph-deploy-latest/ceph-deploy$ ./ceph-deploy install --dev=next burnupi06 burnupi07 OK Get:1 http://gitbuilder.ceph.com precise InRelease [4,477 B] Hit http://gitbuilder.ceph.com precise InRelease Hit http://gitbuilder.ceph.com precise InRelease Get:2 http://gitbuilder.ceph.com precise/main amd64 Packages [5,884 B] Get:3 http://gitbuilder.ceph.com precise/main i386 Packages [436 B] Ign http://gitbuilder.ceph.com precise/main TranslationIndex Hit http://gitbuilder.ceph.com precise/main amd64 Packages Hit http://gitbuilder.ceph.com precise/main i386 Packages Ign http://gitbuilder.ceph.com precise/main TranslationIndex Hit http://gitbuilder.ceph.com precise/main amd64 Packages Hit http://gitbuilder.ceph.com precise/main i386 Packages Ign http://gitbuilder.ceph.com precise/main TranslationIndex Ign http://gitbuilder.ceph.com precise/main Translation-en_US Ign http://gitbuilder.ceph.com precise/main Translation-en Ign http://gitbuilder.ceph.com precise/main Translation-en_US Ign http://gitbuilder.ceph.com precise/main Translation-en Ign http://gitbuilder.ceph.com precise/main Translation-en_US Ign http://gitbuilder.ceph.com precise/main Translation-en Ign http://security.ubuntu.com precise-security InRelease Ign http://us.archive.ubuntu.com precise InRelease Ign http://us.archive.ubuntu.com precise-updates InRelease Ign http://us.archive.ubuntu.com precise-backports InRelease Get:4 http://security.ubuntu.com precise-security Release.gpg [198 B] Hit http://us.archive.ubuntu.com precise Release.gpg Get:5 http://us.archive.ubuntu.com precise-updates Release.gpg [198 B] Get:6 http://security.ubuntu.com precise-security Release [49.6 kB] Get:7 http://us.archive.ubuntu.com precise-backports Release.gpg [198 B] Hit http://us.archive.ubuntu.com precise Release Get:8 http://us.archive.ubuntu.com precise-updates Release [49.6 kB] Get:9 http://security.ubuntu.com precise-security/main Sources [69.6 kB] Get:10 http://us.archive.ubuntu.com precise-backports Release [49.6 kB] Hit http://us.archive.ubuntu.com precise/main Sources Hit http://us.archive.ubuntu.com precise/restricted Sources Hit http://us.archive.ubuntu.com precise/universe Sources Hit http://us.archive.ubuntu.com precise/multiverse Sources Hit http://us.archive.ubuntu.com precise/main amd64 Packages Hit http://us.archive.ubuntu.com precise/restricted amd64 Packages Hit http://us.archive.ubuntu.com precise/universe amd64 Packages Hit http://us.archive.ubuntu.com precise/multiverse amd64 Packages Hit http://us.archive.ubuntu.com precise/main i386 Packages Get:11 http://security.ubuntu.com precise-security/restricted Sources [2,494 B] Get:12 http://security.ubuntu.com precise-security/universe Sources [24.0 kB] Get:13 http://security.ubuntu.com precise-security/multiverse Sources [1,389 B] Get:14 http://security.ubuntu.com precise-security/main amd64 Packages [248 kB] Hit http://us.archive.ubuntu.com precise/restricted i386 Packages Hit http://us.archive.ubuntu.com precise/universe i386 Packages Hit http://us.archive.ubuntu.com precise/multiverse i386 Packages Hit http://us.archive.ubuntu.com precise/main TranslationIndex Hit http://us.archive.ubuntu.com precise/multiverse TranslationIndex Hit http://us.archive.ubuntu.com precise/restricted TranslationIndex Hit http://us.archive.ubuntu.com precise/universe TranslationIndex Get:15 http://us.archive.ubuntu.com precise-updates/main Sources [379 kB] Get:16 http://security.ubuntu.com precise-security/restricted amd64 Packages [4,627 B] Get:17 http://security.ubuntu.com precise-security/universe amd64 Packages [71.5 kB] Get:18 http://security.ubuntu.com precise-security/multiverse amd64 Packages [2,182 B] Get:19 http://security.ubuntu.com precise-security/main i386 Packages [259 kB] Get:20 http://us.archive.ubuntu.com precise-updates/restricted Sources [5,467 B] Get:21 http://us.archive.ubuntu.com precise-updates/universe Sources [85.4 kB] Get:22 http://security.ubuntu.com precise-security/restricted i386 Packages [4,620 B] Get:23 http://security.ubuntu.com precise-security/universe i386 Packages [73.4 kB] Get:24 http://us.archive.ubuntu.com precise-updates/multiverse Sources [6,562 B] Get:25 http://us.archive.ubuntu.com precise-updates/main amd64 Packages [601 kB] Get:26 http://security.ubuntu.com precise-security/multiverse i386 Packages [2,368 B] Hit http://security.ubuntu.com precise-security/main TranslationIndex Hit http://security.ubuntu.com precise-security/multiverse TranslationIndex Hit http://security.ubuntu.com precise-security/restricted TranslationIndex Hit http://security.ubuntu.com precise-security/universe TranslationIndex Hit http://security.ubuntu.com precise-security/main Translation-en Hit http://security.ubuntu.com precise-security/multiverse Translation-en Hit http://security.ubuntu.com precise-security/restricted Translation-en Hit http://security.ubuntu.com precise-security/universe Translation-en Get:27 http://us.archive.ubuntu.com precise-updates/restricted amd64 Packages [10.1 kB] Get:28 http://us.archive.ubuntu.com precise-updates/universe amd64 Packages [195 kB] Get:29 http://us.archive.ubuntu.com precise-updates/multiverse amd64 Packages [13.6 kB] Get:30 http://us.archive.ubuntu.com precise-updates/main i386 Packages [612 kB] Get:31 http://us.archive.ubuntu.com precise-updates/restricted i386 Packages [10.0 kB] Get:32 http://us.archive.ubuntu.com precise-updates/universe i386 Packages [197 kB] Get:33 http://us.archive.ubuntu.com precise-updates/multiverse i386 Packages [13.8 kB] Hit http://us.archive.ubuntu.com precise-updates/main TranslationIndex Hit http://us.archive.ubuntu.com precise-updates/multiverse TranslationIndex Hit http://us.archive.ubuntu.com precise-updates/restricted TranslationIndex Hit http://us.archive.ubuntu.com precise-updates/universe TranslationIndex Get:34 http://us.archive.ubuntu.com precise-backports/main Sources [2,422 B] Get:35 http://us.archive.ubuntu.com precise-backports/restricted Sources [14 B] Get:36 http://us.archive.ubuntu.com precise-backports/universe Sources [24.2 kB] Get:37 http://us.archive.ubuntu.com precise-backports/multiverse Sources [2,669 B] Get:38 http://us.archive.ubuntu.com precise-backports/main amd64 Packages [1,945 B] Get:39 http://us.archive.ubuntu.com precise-backports/restricted amd64 Packages [14 B] Get:40 http://us.archive.ubuntu.com precise-backports/universe amd64 Packages [24.5 kB] Get:41 http://us.archive.ubuntu.com precise-backports/multiverse amd64 Packages [2,489 B] Get:42 http://us.archive.ubuntu.com precise-backports/main i386 Packages [1,941 B] Get:43 http://us.archive.ubuntu.com precise-backports/restricted i386 Packages [14 B] Get:44 http://us.archive.ubuntu.com precise-backports/universe i386 Packages [24.5 kB] Get:45 http://us.archive.ubuntu.com precise-backports/multiverse i386 Packages [2,504 B] Get:46 http://us.archive.ubuntu.com precise-backports/main TranslationIndex [72 B] Get:47 http://us.archive.ubuntu.com precise-backports/multiverse TranslationIndex [72 B] Get:48 http://us.archive.ubuntu.com precise-backports/restricted TranslationIndex [70 B] Get:49 http://us.archive.ubuntu.com precise-backports/universe TranslationIndex [73 B] Hit http://us.archive.ubuntu.com precise/main Translation-en Hit http://us.archive.ubuntu.com precise/multiverse Translation-en Hit http://us.archive.ubuntu.com precise/restricted Translation-en Hit http://us.archive.ubuntu.com precise/universe Translation-en Hit http://us.archive.ubuntu.com precise-updates/main Translation-en Hit http://us.archive.ubuntu.com precise-updates/multiverse Translation-en Hit http://us.archive.ubuntu.com precise-updates/restricted Translation-en Hit http://us.archive.ubuntu.com precise-updates/universe Translation-en Hit http://us.archive.ubuntu.com precise-backports/main Translation-en Hit http://us.archive.ubuntu.com precise-backports/multiverse Translation-en Hit http://us.archive.ubuntu.com precise-backports/restricted Translation-en Hit http://us.archive.ubuntu.com precise-backports/universe Translation-en Fetched 3,140 kB in 2s (1,225 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... gdisk is already the newest version. The following packages were automatically installed and are no longer required: msr-tools seabios cpu-checker vgabios kvm-ipxe fuse-utils bridge-utils qemu-common Use 'apt-get autoremove' to remove them. The following extra packages will be installed: librados2 librbd1 Recommended packages: ceph-fuse libcephfs1 The following NEW packages will be installed: ceph ceph-common ceph-fs-common ceph-mds The following packages will be upgraded: librados2 librbd1 2 upgraded, 4 newly installed, 0 to remove and 87 not upgraded. Need to get 17.8 MB of archives. After this operation, 48.6 MB of additional disk space will be used. Get:1 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main librbd1 amd64 0.60-664-gb0ba412-1precise [256 kB] Get:2 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main librados2 amd64 0.60-664-gb0ba412-1precise [1,349 kB] Get:3 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph-common amd64 0.60-664-gb0ba412-1precise [6,150 kB] Get:4 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph amd64 0.60-664-gb0ba412-1precise [7,833 kB] Get:5 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph-fs-common amd64 0.60-664-gb0ba412-1precise [27.8 kB] Get:6 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph-mds amd64 0.60-664-gb0ba412-1precise [2,222 kB] Fetched 17.8 MB in 1s (16.5 MB/s) (Reading database ... 64590 files and directories currently installed.) Preparing to replace librbd1 0.60-660-g42ab1f4-1precise (using .../librbd1_0.60-664-gb0ba412-1precise_amd64.deb) ... Unpacking replacement librbd1 ... Preparing to replace librados2 0.60-660-g42ab1f4-1precise (using .../librados2_0.60-664-gb0ba412-1precise_amd64.deb) ... Unpacking replacement librados2 ... Selecting previously unselected package ceph-common. Unpacking ceph-common (from .../ceph-common_0.60-664-gb0ba412-1precise_amd64.deb) ... Selecting previously unselected package ceph. Unpacking ceph (from .../ceph_0.60-664-gb0ba412-1precise_amd64.deb) ... Selecting previously unselected package ceph-fs-common. Unpacking ceph-fs-common (from .../ceph-fs-common_0.60-664-gb0ba412-1precise_amd64.deb) ... Selecting previously unselected package ceph-mds. Unpacking ceph-mds (from .../ceph-mds_0.60-664-gb0ba412-1precise_amd64.deb) ... Processing triggers for man-db ... Processing triggers for ureadahead ... Setting up librados2 (0.60-664-gb0ba412-1precise) ... Setting up librbd1 (0.60-664-gb0ba412-1precise) ... Setting up ceph-common (0.60-664-gb0ba412-1precise) ... Setting up ceph (0.60-664-gb0ba412-1precise) ... ceph-all start/running Setting up ceph-fs-common (0.60-664-gb0ba412-1precise) ... Setting up ceph-mds (0.60-664-gb0ba412-1precise) ... ceph-mds-all start/running Processing triggers for libc-bin ... ldconfig deferred processing now taking place Exception in thread Thread-2 (most likely raised during interpreter shutdown): Traceback (most recent call last): File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner File "/usr/lib/python2.7/threading.py", line 504, in run File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 266, in serve_forever File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 377, in __waitForRequest File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 601, in __recv File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 104, in receive_message File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/message.py", line 98, in unpack <type 'exceptions.TypeError'>: 'NoneType' object is not callable tamil@ubuntu:~/ceph-deploy-latest/ceph-deploy$ cat ceph.log 2013-04-25 13:57:03,091 ceph_deploy.new DEBUG Creating new cluster named ceph 2013-04-25 13:57:03,091 ceph_deploy.new DEBUG Resolving host burnupi07 2013-04-25 13:57:14,018 ceph_deploy.new DEBUG Creating new cluster named ceph 2013-04-25 13:57:14,018 ceph_deploy.new DEBUG Resolving host burnupi07.front.sepia.ceph.com 2013-04-25 13:57:14,021 ceph_deploy.new DEBUG Monitor burnupi07 at 10.214.134.38 2013-04-25 13:57:14,021 ceph_deploy.new DEBUG Resolving host burnupi06.front.sepia.ceph.com 2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Monitor burnupi06 at 10.214.133.8 2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Monitor initial members are ['burnupi07', 'burnupi06'] 2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Monitor addrs are ['10.214.134.38', '10.214.133.8'] 2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Creating a random mon key... 2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Writing initial config to ceph.conf... 2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Writing monitor keyring to ceph.conf... 2013-04-25 13:57:29,313 ceph_deploy.install DEBUG Installing dev version next on cluster ceph hosts burnupi06.front.sepia.ceph.com burnupi07.front.sepia.ceph.com 2013-04-25 13:57:29,313 ceph_deploy.install DEBUG Detecting platform for host burnupi06.front.sepia.ceph.com ... 2013-04-25 13:57:40,178 ceph_deploy.install DEBUG Installing dev version next on cluster ceph hosts burnupi06 burnupi07 2013-04-25 13:57:40,178 ceph_deploy.install DEBUG Detecting platform for host burnupi06 ... 2013-04-25 13:57:40,554 ceph_deploy.install DEBUG Distro Ubuntu release 12.04 codename precise 2013-04-25 13:57:40,554 ceph_deploy.install DEBUG Installing on host burnupi06 ... 2013-04-25 13:57:48,861 ceph_deploy.install DEBUG Detecting platform for host burnupi07 ... 2013-04-25 13:57:49,387 ceph_deploy.install DEBUG Distro Ubuntu release 12.04 codename precise 2013-04-25 13:57:49,387 ceph_deploy.install DEBUG Installing on host burnupi07 ...
however the ceph install is complete on burnupi07.
ubuntu@burnupi07:~$ sudo ceph -v
ceph version 0.60-664-gb0ba412 (b0ba41235af901bd7e64588e2a247c6a56ec5cfa)
ubuntu@burnupi07:~$ dpkg -l | grep ceph
ii ceph 0.60-664-gb0ba412-1precise distributed storage and file system
ii ceph-common 0.60-664-gb0ba412-1precise common utilities to mount and interact with a ceph storage cluster
ii ceph-fs-common 0.60-664-gb0ba412-1precise common utilities to mount and interact with a ceph file system
ii ceph-mds 0.60-664-gb0ba412-1precise metadata server for the ceph distributed file system
ubuntu@burnupi07:~$
Actions