Actions
Bug #7692
closedmon: monitor fails to form quorum
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
For some reason it is looking at 0.0.0.0 and of course that fails:
2014-03-12 05:22:07.058374 7fb95bcbc700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).writer: state = connecting policy.server=0 2014-03-12 05:22:07.058406 7fb95bcbc700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).connect 0 2014-03-12 05:22:07.058438 7fb95bcbc700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).connecting to 0.0.0.0:0/1 2014-03-12 05:22:07.058503 7fb954399700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).writer: state = connecting policy.server=0 2014-03-12 05:22:07.058534 7fb954399700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).connect 0 2014-03-12 05:22:07.058563 7fb954399700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).connecting to 0.0.0.0:0/2 2014-03-12 05:22:07.058600 7fb954298700 10 -- 10.214.138.102:6789/0 >> 10.214.138.121:6789/0 pipe(0x39f9680 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3951a20).writer: state = connecting policy.server=0 2014-03-12 05:22:07.058633 7fb954298700 10 -- 10.214.138.102:6789/0 >> 10.214.138.121:6789/0 pipe(0x39f9680 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3951a20).connect 0 2014-03-12 05:22:07.058661 7fb954298700 10 -- 10.214.138.102:6789/0 >> 10.214.138.121:6789/0 pipe(0x39f9680 sd=23 :0 s=1 pgs=0 cs=0 l=0 c=0x3951a20).connecting to 10.214.138.121:6789/0 2014-03-12 05:22:07.058781 7fb954197700 10 -- 10.214.138.102:6789/0 >> 10.214.138.140:6789/0 pipe(0x39f9180 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3951760).writer: state = connecting policy.server=0 2014-03-12 05:22:07.058817 7fb954197700 10 -- 10.214.138.102:6789/0 >> 10.214.138.140:6789/0 pipe(0x39f9180 sd=-1 :0 s=1 pgs=0 cs=0 l=0 c=0x3951760).connect 0 2014-03-12 05:22:07.058846 7fb954197700 10 -- 10.214.138.102:6789/0 >> 10.214.138.140:6789/0 pipe(0x39f9180 sd=24 :0 s=1 pgs=0 cs=0 l=0 c=0x3951760).connecting to 10.214.138.140:6789/0 2014-03-12 05:22:07.058925 7fb954399700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).connect error 0.0.0.0:0/2, 111: Connection refused 2014-03-12 05:22:07.059003 7fb954399700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).fault 111: Connection refused 2014-03-12 05:22:07.059032 7fb954399700 0 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).fault 2014-03-12 05:22:07.059054 7fb954399700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).writer: state = connecting policy.server=0 2014-03-12 05:22:07.059075 7fb954399700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).connect 0 2014-03-12 05:22:07.059104 7fb954399700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).connecting to 0.0.0.0:0/2 2014-03-12 05:22:07.059186 7fb95bcbc700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).connect error 0.0.0.0:0/1, 111: Connection refused 2014-03-12 05:22:07.059217 7fb95bcbc700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).fault 111: Connection refused 2014-03-12 05:22:07.059239 7fb95bcbc700 0 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).fault 2014-03-12 05:22:07.059258 7fb95bcbc700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).writer: state = connecting policy.server=0 2014-03-12 05:22:07.059284 7fb95bcbc700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).connect 0 2014-03-12 05:22:07.059345 7fb95bcbc700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).connecting to 0.0.0.0:0/1 2014-03-12 05:22:07.059400 7fb95bcbc700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).connect error 0.0.0.0:0/1, 111: Connection refused 2014-03-12 05:22:07.059429 7fb95bcbc700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).fault 111: Connection refused 2014-03-12 05:22:07.059452 7fb95bcbc700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/1 pipe(0x39f8280 sd=21 :0 s=1 pgs=0 cs=0 l=0 c=0x3951080).fault waiting 0.200000 2014-03-12 05:22:07.059475 7fb954399700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).connect error 0.0.0.0:0/2, 111: Connection refused 2014-03-12 05:22:07.059498 7fb954399700 2 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).fault 111: Connection refused 2014-03-12 05:22:07.059520 7fb954399700 10 -- 10.214.138.102:6789/0 >> 0.0.0.0:0/2 pipe(0x39f8a00 sd=22 :0 s=1 pgs=0 cs=0 l=0 c=0x3950dc0).fault waiting 0.200000
The above excerpt from the mon log at http://qa-proxy.ceph.com/teuthology/teuthology-2014-03-12_01:10:21-ceph-deploy-firefly-distro-basic-vps/127125/remote/ubuntu@vpm052.front.sepia.ceph.com/log/
Other logs for the failed test: http://qa-proxy.ceph.com/teuthology/teuthology-2014-03-12_01:10:21-ceph-deploy-firefly-distro-basic-vps/127125/
Actions