Project

General

Profile

Actions
Copy link

Bug #19521

closed

connect got BADAUTHORIZER for mon on all/rebuild-mondb.yaml

Added by Sage Weil about 7 years ago. Updated about 7 years ago.

Status:
Duplicate
Priority:
Immediate
Assignee:
Kefu Chai
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

teuthology:990784  03:01 PM $ zcat ./remote/smithi101/log/ceph-client.0.13685.log.gz
2017-04-05 21:45:52.401442 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:52.401568 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:52.602046 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:52.602116 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:52.999856 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:52.999957 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:53.801174 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:53.801295 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:55.407852 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:55.407979 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:58.612017 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:45:58.612165 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:46:03.371425 7f35fad78700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6800/13422 conn(0x565239318590 :-1 s=STATE_OPEN pgs=13 cs=1 l=1)._try_send injecting socket failure
2017-04-05 21:46:03.682357 7f35fad78700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6800/13422 conn(0x7f35e0012980 :-1 s=STATE_OPEN pgs=15 cs=1 l=1).read_until injecting socket failure
2017-04-05 21:46:05.015856 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:46:05.016010 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:46:17.820962 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER
2017-04-05 21:46:17.821081 7f35fa577700  0 -- 172.21.15.101:0/410133088 >> 172.21.15.101:6804/12652 conn(0x7f35e000c6e0 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=1).handle_connect_reply connect got BADAUTHORIZER

it's mons:
teuthology:990784  03:01 PM $ grep BADAUTHORIZER remote/*/log/*mon*
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:43.011128 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:43.011397 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:43.215949 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:43.216221 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:43.620017 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:43.620242 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:44.423232 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:44.423478 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:46.025942 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:46.026123 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
remote/smithi101/log/ceph-mon.a.log:2017-04-05 21:45:49.229557 7fb7249d9700  0 -- 172.21.15.101:0/13317 >> 172.21.15.101:6804/12652 conn(0x55c229a22800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got BADAUTHORIZER
...

similar for mon.b and mon.c.

/a/sage-2017-04-05_18:31:27-rados-wip-sage-testing---basic-smithi/990784

Related issues 1 (0 open — 1 closed)

Is duplicate of Ceph - Bug #19439: rebuild_mondb fails after the transition to ceph-mgrResolvedKefu Chai03/31/2017

Actions
Actions
Copy link
 #1

Updated by Sage Weil about 7 years ago

/a/sage-2017-04-07_19:56:10-rados-wip-sage-testing2---basic-smithi/997662

Actions
Copy link
 #2

Updated by Sage Weil about 7 years ago

/a/sage-2017-04-09_20:30:53-rados-wip-sage-testing---basic-smithi/1005417

Actions
Copy link
 #3

Updated by Kefu Chai about 7 years ago 

2017-04-14 14:24:07.199014 7f8561e9e700  1 -- 172.21.9.136:6800/19103 >> - conn(0x55c750241800 :6800 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=17 -
2017-04-14 14:24:07.199363 7f8561e9e700 10 cephx: verify_authorizer decrypted service mgr secret_id=2
2017-04-14 14:24:07.199420 7f8561e9e700  0 cephx: verify_authorizer could not decrypt ticket info: error: NSS AES final round failed: -8190
2017-04-14 14:24:07.199424 7f8561e9e700  0 -- 172.21.9.136:6800/19103 >> 172.21.9.136:0/1602325145 conn(0x55c750241800 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: got bad authorizer

in /a/kchai-2017-04-14_14:15:23-rados-wip-move-lec-to-mgr-kefu---basic-mira/1024544/remote/mira111/log/ceph-mgr.x.log.gz

but, only with mgr

Actions
Copy link
 #4

Updated by Sage Weil about 7 years ago

  • Subject changed from connect got BADAUTHORIZER for mon to connect got BADAUTHORIZER for mon on all/rebuild-mondb.yaml

oh! this is always all/rebuild-mondb.yaml.

Actions
Copy link
 #5

Updated by Sage Weil about 7 years ago

  • Assignee set to Kefu Chai
Actions
Copy link
 #6

Updated by Kefu Chai about 7 years ago

  • Is duplicate of Bug #19439: rebuild_mondb fails after the transition to ceph-mgr added
Actions
Copy link
 #7

Updated by Kefu Chai about 7 years ago

  • Status changed from 12 to Duplicate
Actions
Copy link

Also available in: Atom PDF