Project

General

Profile

Actions

Bug #6255

closed

ceph-deploy: fail to parse json from mon_status

Added by Sage Weil over 10 years ago. Updated over 10 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
ceph-deploy
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2013-09-07T16:38:20.452 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;34mDEBUGESC[0m ] determining if provided host has same hostname in remote
2013-09-07T16:38:20.458 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;33mWARNINESC[0m] ********************************************************************************
2013-09-07T16:38:20.458 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;33mWARNINESC[0m] provided hostname must match remote hostname
2013-09-07T16:38:20.458 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;33mWARNINESC[0m] provided hostname: plana14.front.sepia.ceph.com
2013-09-07T16:38:20.459 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;33mWARNINESC[0m] remote hostname: plana14
2013-09-07T16:38:20.459 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;33mWARNINESC[0m] monitors may not reach quorum and create-keys will not complete
2013-09-07T16:38:20.459 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;33mWARNINESC[0m] ********************************************************************************
2013-09-07T16:38:20.459 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;34mDEBUGESC[0m ] deploying mon to plana14.front.sepia.ceph.com
2013-09-07T16:38:20.464 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;34mDEBUGESC[0m ] remote hostname: plana14
2013-09-07T16:38:20.476 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] write cluster configuration to /etc/ceph/{cluster}.conf
2013-09-07T16:38:20.543 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] creating path: /var/lib/ceph/mon/ceph-plana14
2013-09-07T16:38:20.547 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;34mDEBUGESC[0m ] checking for done path: /var/lib/ceph/mon/ceph-plana14/done
2013-09-07T16:38:20.553 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;34mDEBUGESC[0m ] done path does not exist: /var/lib/ceph/mon/ceph-plana14/done
2013-09-07T16:38:20.559 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] creating keyring file: /var/lib/ceph/tmp/ceph-plana14.mon.keyring
2013-09-07T16:38:20.570 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] create the monitor keyring file
2013-09-07T16:38:20.591 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] Running command: ceph-mon --cluster ceph --mkfs -i plana14 --keyring /var/lib/ceph/tmp/ceph-plana14.mon.keyring
2013-09-07T16:38:20.793 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] ceph-mon: mon.noname-a 10.214.131.26:6789/0 is local, renaming to mon.plana14
2013-09-07T16:38:20.793 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] ceph-mon: set fsid to 9db14bc0-5bbd-44b3-8b5b-155b134aad67
2013-09-07T16:38:20.793 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-plana14 for mon.plana14
2013-09-07T16:38:20.798 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] unlinking keyring file /var/lib/ceph/tmp/ceph-plana14.mon.keyring
2013-09-07T16:38:20.814 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] create a done file to avoid re-doing the mon deployment
2013-09-07T16:38:20.847 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] create the init path if it does not exist
2013-09-07T16:38:20.868 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] Running command: initctl emit ceph-mon cluster=ceph id=plana14
2013-09-07T16:38:22.924 INFO:teuthology.orchestra.run.err:[10.214.131.26]: [ESC[1mplana14.front.sepia.ceph.comESC[0m][ESC[1;37mINFOESC[0m  ] Running command: ceph daemon mon.plana14.front.sepia.ceph.com mon_status
2013-09-07T16:38:23.071 INFO:teuthology.orchestra.run.err:[10.214.131.26]: Traceback (most recent call last):
2013-09-07T16:38:23.071 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "./ceph-deploy", line 9, in <module>
2013-09-07T16:38:23.071 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     load_entry_point('ceph-deploy==1.2.3', 'console_scripts', 'ceph-deploy')()
2013-09-07T16:38:23.071 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/home/ubuntu/cephtest/25364/ceph-deploy/ceph_deploy/util/decorators.py", line 83, in newfunc
2013-09-07T16:38:23.071 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     return f(*a, **kw)
2013-09-07T16:38:23.071 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/home/ubuntu/cephtest/25364/ceph-deploy/ceph_deploy/cli.py", line 147, in main
2013-09-07T16:38:23.071 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     return args.func(args)
2013-09-07T16:38:23.072 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/home/ubuntu/cephtest/25364/ceph-deploy/ceph_deploy/mon.py", line 229, in mon
2013-09-07T16:38:23.072 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     mon_create(args)
2013-09-07T16:38:23.072 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/home/ubuntu/cephtest/25364/ceph-deploy/ceph_deploy/mon.py", line 94, in mon_create
2013-09-07T16:38:23.072 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     mon_status(distro.sudo_conn, rlogger, hostname)
2013-09-07T16:38:23.072 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/home/ubuntu/cephtest/25364/ceph-deploy/ceph_deploy/mon.py", line 35, in mon_status
2013-09-07T16:38:23.072 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     mon_info = json.loads(out)
2013-09-07T16:38:23.072 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/usr/lib/python2.7/json/__init__.py", line 326, in loads
2013-09-07T16:38:23.099 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     return _default_decoder.decode(s)
2013-09-07T16:38:23.099 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/usr/lib/python2.7/json/decoder.py", line 366, in decode
2013-09-07T16:38:23.100 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     obj, end = self.raw_decode(s, idx=_w(s, 0).end())
2013-09-07T16:38:23.100 INFO:teuthology.orchestra.run.err:[10.214.131.26]:   File "/usr/lib/python2.7/json/decoder.py", line 384, in raw_decode
2013-09-07T16:38:23.100 INFO:teuthology.orchestra.run.err:[10.214.131.26]:     raise ValueError("No JSON object could be decoded")
2013-09-07T16:38:23.100 INFO:teuthology.orchestra.run.err:[10.214.131.26]: ValueError: No JSON object could be decoded

probably is not handling the case where the daemon is still starting and the command doesn't output valid json yet?

ubuntu@teuthology:/a/teuthology-2013-09-07_13:41:07-ceph-deploy-dumpling-testing-basic-plana/25364

Actions #1

Updated by Alfredo Deza over 10 years ago

  • Status changed from New to Fix Under Review
Actions #2

Updated by Sage Weil over 10 years ago

  • Status changed from Fix Under Review to Resolved

commit:f957f89

Actions

Also available in: Atom PDF