Project

General

Profile

Bug #4820

ceph-deploy : intermittent errors during install

Added by Tamilarasi muthamizhan almost 7 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
ceph-deploy
Target version:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

not often, but see this error at the end of install. It would be nice to make this error look better or let the user know if installation should be retried or its successful.ceph.log doesn't seem to have much information as well.

tamil@ubuntu:~/ceph-deploy-latest/ceph-deploy$ ./ceph-deploy install --dev=next burnupi06 burnupi07
OK
Get:1 http://gitbuilder.ceph.com precise InRelease [4,477 B]
Hit http://gitbuilder.ceph.com precise InRelease
Hit http://gitbuilder.ceph.com precise InRelease
Get:2 http://gitbuilder.ceph.com precise/main amd64 Packages [5,884 B]
Get:3 http://gitbuilder.ceph.com precise/main i386 Packages [436 B]
Ign http://gitbuilder.ceph.com precise/main TranslationIndex
Hit http://gitbuilder.ceph.com precise/main amd64 Packages
Hit http://gitbuilder.ceph.com precise/main i386 Packages
Ign http://gitbuilder.ceph.com precise/main TranslationIndex
Hit http://gitbuilder.ceph.com precise/main amd64 Packages
Hit http://gitbuilder.ceph.com precise/main i386 Packages
Ign http://gitbuilder.ceph.com precise/main TranslationIndex
Ign http://gitbuilder.ceph.com precise/main Translation-en_US
Ign http://gitbuilder.ceph.com precise/main Translation-en
Ign http://gitbuilder.ceph.com precise/main Translation-en_US
Ign http://gitbuilder.ceph.com precise/main Translation-en
Ign http://gitbuilder.ceph.com precise/main Translation-en_US
Ign http://gitbuilder.ceph.com precise/main Translation-en
Ign http://security.ubuntu.com precise-security InRelease
Ign http://us.archive.ubuntu.com precise InRelease
Ign http://us.archive.ubuntu.com precise-updates InRelease
Ign http://us.archive.ubuntu.com precise-backports InRelease
Get:4 http://security.ubuntu.com precise-security Release.gpg [198 B]
Hit http://us.archive.ubuntu.com precise Release.gpg
Get:5 http://us.archive.ubuntu.com precise-updates Release.gpg [198 B]
Get:6 http://security.ubuntu.com precise-security Release [49.6 kB]
Get:7 http://us.archive.ubuntu.com precise-backports Release.gpg [198 B]
Hit http://us.archive.ubuntu.com precise Release
Get:8 http://us.archive.ubuntu.com precise-updates Release [49.6 kB]
Get:9 http://security.ubuntu.com precise-security/main Sources [69.6 kB]
Get:10 http://us.archive.ubuntu.com precise-backports Release [49.6 kB]
Hit http://us.archive.ubuntu.com precise/main Sources
Hit http://us.archive.ubuntu.com precise/restricted Sources
Hit http://us.archive.ubuntu.com precise/universe Sources
Hit http://us.archive.ubuntu.com precise/multiverse Sources
Hit http://us.archive.ubuntu.com precise/main amd64 Packages
Hit http://us.archive.ubuntu.com precise/restricted amd64 Packages
Hit http://us.archive.ubuntu.com precise/universe amd64 Packages
Hit http://us.archive.ubuntu.com precise/multiverse amd64 Packages
Hit http://us.archive.ubuntu.com precise/main i386 Packages
Get:11 http://security.ubuntu.com precise-security/restricted Sources [2,494 B]
Get:12 http://security.ubuntu.com precise-security/universe Sources [24.0 kB]
Get:13 http://security.ubuntu.com precise-security/multiverse Sources [1,389 B]
Get:14 http://security.ubuntu.com precise-security/main amd64 Packages [248 kB]
Hit http://us.archive.ubuntu.com precise/restricted i386 Packages
Hit http://us.archive.ubuntu.com precise/universe i386 Packages
Hit http://us.archive.ubuntu.com precise/multiverse i386 Packages
Hit http://us.archive.ubuntu.com precise/main TranslationIndex
Hit http://us.archive.ubuntu.com precise/multiverse TranslationIndex
Hit http://us.archive.ubuntu.com precise/restricted TranslationIndex
Hit http://us.archive.ubuntu.com precise/universe TranslationIndex
Get:15 http://us.archive.ubuntu.com precise-updates/main Sources [379 kB]
Get:16 http://security.ubuntu.com precise-security/restricted amd64 Packages [4,627 B]
Get:17 http://security.ubuntu.com precise-security/universe amd64 Packages [71.5 kB]
Get:18 http://security.ubuntu.com precise-security/multiverse amd64 Packages [2,182 B]
Get:19 http://security.ubuntu.com precise-security/main i386 Packages [259 kB]
Get:20 http://us.archive.ubuntu.com precise-updates/restricted Sources [5,467 B]
Get:21 http://us.archive.ubuntu.com precise-updates/universe Sources [85.4 kB]
Get:22 http://security.ubuntu.com precise-security/restricted i386 Packages [4,620 B]
Get:23 http://security.ubuntu.com precise-security/universe i386 Packages [73.4 kB]
Get:24 http://us.archive.ubuntu.com precise-updates/multiverse Sources [6,562 B]
Get:25 http://us.archive.ubuntu.com precise-updates/main amd64 Packages [601 kB]
Get:26 http://security.ubuntu.com precise-security/multiverse i386 Packages [2,368 B]
Hit http://security.ubuntu.com precise-security/main TranslationIndex
Hit http://security.ubuntu.com precise-security/multiverse TranslationIndex
Hit http://security.ubuntu.com precise-security/restricted TranslationIndex
Hit http://security.ubuntu.com precise-security/universe TranslationIndex
Hit http://security.ubuntu.com precise-security/main Translation-en
Hit http://security.ubuntu.com precise-security/multiverse Translation-en
Hit http://security.ubuntu.com precise-security/restricted Translation-en
Hit http://security.ubuntu.com precise-security/universe Translation-en
Get:27 http://us.archive.ubuntu.com precise-updates/restricted amd64 Packages [10.1 kB]
Get:28 http://us.archive.ubuntu.com precise-updates/universe amd64 Packages [195 kB]
Get:29 http://us.archive.ubuntu.com precise-updates/multiverse amd64 Packages [13.6 kB]
Get:30 http://us.archive.ubuntu.com precise-updates/main i386 Packages [612 kB]
Get:31 http://us.archive.ubuntu.com precise-updates/restricted i386 Packages [10.0 kB]
Get:32 http://us.archive.ubuntu.com precise-updates/universe i386 Packages [197 kB]
Get:33 http://us.archive.ubuntu.com precise-updates/multiverse i386 Packages [13.8 kB]
Hit http://us.archive.ubuntu.com precise-updates/main TranslationIndex
Hit http://us.archive.ubuntu.com precise-updates/multiverse TranslationIndex
Hit http://us.archive.ubuntu.com precise-updates/restricted TranslationIndex
Hit http://us.archive.ubuntu.com precise-updates/universe TranslationIndex
Get:34 http://us.archive.ubuntu.com precise-backports/main Sources [2,422 B]
Get:35 http://us.archive.ubuntu.com precise-backports/restricted Sources [14 B]
Get:36 http://us.archive.ubuntu.com precise-backports/universe Sources [24.2 kB]
Get:37 http://us.archive.ubuntu.com precise-backports/multiverse Sources [2,669 B]
Get:38 http://us.archive.ubuntu.com precise-backports/main amd64 Packages [1,945 B]
Get:39 http://us.archive.ubuntu.com precise-backports/restricted amd64 Packages [14 B]
Get:40 http://us.archive.ubuntu.com precise-backports/universe amd64 Packages [24.5 kB]
Get:41 http://us.archive.ubuntu.com precise-backports/multiverse amd64 Packages [2,489 B]
Get:42 http://us.archive.ubuntu.com precise-backports/main i386 Packages [1,941 B]
Get:43 http://us.archive.ubuntu.com precise-backports/restricted i386 Packages [14 B]
Get:44 http://us.archive.ubuntu.com precise-backports/universe i386 Packages [24.5 kB]
Get:45 http://us.archive.ubuntu.com precise-backports/multiverse i386 Packages [2,504 B]
Get:46 http://us.archive.ubuntu.com precise-backports/main TranslationIndex [72 B]
Get:47 http://us.archive.ubuntu.com precise-backports/multiverse TranslationIndex [72 B]
Get:48 http://us.archive.ubuntu.com precise-backports/restricted TranslationIndex [70 B]
Get:49 http://us.archive.ubuntu.com precise-backports/universe TranslationIndex [73 B]
Hit http://us.archive.ubuntu.com precise/main Translation-en
Hit http://us.archive.ubuntu.com precise/multiverse Translation-en
Hit http://us.archive.ubuntu.com precise/restricted Translation-en
Hit http://us.archive.ubuntu.com precise/universe Translation-en
Hit http://us.archive.ubuntu.com precise-updates/main Translation-en
Hit http://us.archive.ubuntu.com precise-updates/multiverse Translation-en
Hit http://us.archive.ubuntu.com precise-updates/restricted Translation-en
Hit http://us.archive.ubuntu.com precise-updates/universe Translation-en
Hit http://us.archive.ubuntu.com precise-backports/main Translation-en
Hit http://us.archive.ubuntu.com precise-backports/multiverse Translation-en
Hit http://us.archive.ubuntu.com precise-backports/restricted Translation-en
Hit http://us.archive.ubuntu.com precise-backports/universe Translation-en
Fetched 3,140 kB in 2s (1,225 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
gdisk is already the newest version.
The following packages were automatically installed and are no longer required:
  msr-tools seabios cpu-checker vgabios kvm-ipxe fuse-utils bridge-utils
  qemu-common
Use 'apt-get autoremove' to remove them.
The following extra packages will be installed:
  librados2 librbd1
Recommended packages:
  ceph-fuse libcephfs1
The following NEW packages will be installed:
  ceph ceph-common ceph-fs-common ceph-mds
The following packages will be upgraded:
  librados2 librbd1
2 upgraded, 4 newly installed, 0 to remove and 87 not upgraded.
Need to get 17.8 MB of archives.
After this operation, 48.6 MB of additional disk space will be used.
Get:1 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main librbd1 amd64 0.60-664-gb0ba412-1precise [256 kB]
Get:2 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main librados2 amd64 0.60-664-gb0ba412-1precise [1,349 kB]
Get:3 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph-common amd64 0.60-664-gb0ba412-1precise [6,150 kB]
Get:4 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph amd64 0.60-664-gb0ba412-1precise [7,833 kB]
Get:5 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph-fs-common amd64 0.60-664-gb0ba412-1precise [27.8 kB]
Get:6 http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/next/ precise/main ceph-mds amd64 0.60-664-gb0ba412-1precise [2,222 kB]
Fetched 17.8 MB in 1s (16.5 MB/s)
(Reading database ... 64590 files and directories currently installed.)
Preparing to replace librbd1 0.60-660-g42ab1f4-1precise (using .../librbd1_0.60-664-gb0ba412-1precise_amd64.deb) ...
Unpacking replacement librbd1 ...
Preparing to replace librados2 0.60-660-g42ab1f4-1precise (using .../librados2_0.60-664-gb0ba412-1precise_amd64.deb) ...
Unpacking replacement librados2 ...
Selecting previously unselected package ceph-common.
Unpacking ceph-common (from .../ceph-common_0.60-664-gb0ba412-1precise_amd64.deb) ...
Selecting previously unselected package ceph.
Unpacking ceph (from .../ceph_0.60-664-gb0ba412-1precise_amd64.deb) ...
Selecting previously unselected package ceph-fs-common.
Unpacking ceph-fs-common (from .../ceph-fs-common_0.60-664-gb0ba412-1precise_amd64.deb) ...
Selecting previously unselected package ceph-mds.
Unpacking ceph-mds (from .../ceph-mds_0.60-664-gb0ba412-1precise_amd64.deb) ...
Processing triggers for man-db ...
Processing triggers for ureadahead ...
Setting up librados2 (0.60-664-gb0ba412-1precise) ...
Setting up librbd1 (0.60-664-gb0ba412-1precise) ...
Setting up ceph-common (0.60-664-gb0ba412-1precise) ...
Setting up ceph (0.60-664-gb0ba412-1precise) ...
ceph-all start/running
Setting up ceph-fs-common (0.60-664-gb0ba412-1precise) ...
Setting up ceph-mds (0.60-664-gb0ba412-1precise) ...
ceph-mds-all start/running
Processing triggers for libc-bin ...
ldconfig deferred processing now taking place
Exception in thread Thread-2 (most likely raised during interpreter shutdown):
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 551, in __bootstrap_inner
  File "/usr/lib/python2.7/threading.py", line 504, in run
  File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 266, in serve_forever
  File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 377, in __waitForRequest
  File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 601, in __recv
  File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/baseconnection.py", line 104, in receive_message
  File "/home/tamil/ceph-deploy-latest/ceph-deploy/virtualenv/local/lib/python2.7/site-packages/pushy-0.5.1-py2.7.egg/pushy/protocol/message.py", line 98, in unpack
<type 'exceptions.TypeError'>: 'NoneType' object is not callable

tamil@ubuntu:~/ceph-deploy-latest/ceph-deploy$ cat ceph.log
2013-04-25 13:57:03,091 ceph_deploy.new DEBUG Creating new cluster named ceph
2013-04-25 13:57:03,091 ceph_deploy.new DEBUG Resolving host burnupi07
2013-04-25 13:57:14,018 ceph_deploy.new DEBUG Creating new cluster named ceph
2013-04-25 13:57:14,018 ceph_deploy.new DEBUG Resolving host burnupi07.front.sepia.ceph.com
2013-04-25 13:57:14,021 ceph_deploy.new DEBUG Monitor burnupi07 at 10.214.134.38
2013-04-25 13:57:14,021 ceph_deploy.new DEBUG Resolving host burnupi06.front.sepia.ceph.com
2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Monitor burnupi06 at 10.214.133.8
2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Monitor initial members are ['burnupi07', 'burnupi06']
2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Monitor addrs are ['10.214.134.38', '10.214.133.8']
2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Creating a random mon key...
2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Writing initial config to ceph.conf...
2013-04-25 13:57:14,023 ceph_deploy.new DEBUG Writing monitor keyring to ceph.conf...
2013-04-25 13:57:29,313 ceph_deploy.install DEBUG Installing dev version next on cluster ceph hosts burnupi06.front.sepia.ceph.com burnupi07.front.sepia.ceph.com
2013-04-25 13:57:29,313 ceph_deploy.install DEBUG Detecting platform for host burnupi06.front.sepia.ceph.com ...
2013-04-25 13:57:40,178 ceph_deploy.install DEBUG Installing dev version next on cluster ceph hosts burnupi06 burnupi07
2013-04-25 13:57:40,178 ceph_deploy.install DEBUG Detecting platform for host burnupi06 ...
2013-04-25 13:57:40,554 ceph_deploy.install DEBUG Distro Ubuntu release 12.04 codename precise
2013-04-25 13:57:40,554 ceph_deploy.install DEBUG Installing on host burnupi06 ...
2013-04-25 13:57:48,861 ceph_deploy.install DEBUG Detecting platform for host burnupi07 ...
2013-04-25 13:57:49,387 ceph_deploy.install DEBUG Distro Ubuntu release 12.04 codename precise
2013-04-25 13:57:49,387 ceph_deploy.install DEBUG Installing on host burnupi07 ...

however the ceph install is complete on burnupi07.

ubuntu@burnupi07:~$ sudo ceph -v
ceph version 0.60-664-gb0ba412 (b0ba41235af901bd7e64588e2a247c6a56ec5cfa)
ubuntu@burnupi07:~$ dpkg -l | grep ceph
ii ceph 0.60-664-gb0ba412-1precise distributed storage and file system
ii ceph-common 0.60-664-gb0ba412-1precise common utilities to mount and interact with a ceph storage cluster
ii ceph-fs-common 0.60-664-gb0ba412-1precise common utilities to mount and interact with a ceph file system
ii ceph-mds 0.60-664-gb0ba412-1precise metadata server for the ceph distributed file system
ubuntu@burnupi07:~$

History

#1 Updated by Anonymous almost 7 years ago

  • Status changed from New to Resolved

Also available in: Atom PDF