Project

General

Profile

Actions
Copy link

Bug #19648

closed

ceph-mgr aborted after start

Added by Vitaliy Dutchak about 7 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
ceph-mgr
Target version:
-
% Done:

0%

Source:
Tags:
kraken
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

We are updated to jewel from infernalis then to kraken (11.2.0) and cannot start ceph-mgr daemon
Immediately after start ceph-mgr is terminating with aborted status.

OS: Linux host 4.8.0-46-generic #49~16.04.1-Ubuntu SMP Fri Mar 31 14:51:03 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

Here peace of log
172.16.0.10 - mon.0
172.16.0.11 - mon.1 where try to run mgr daemon

18/Apr/2017:04:41:32] ENGINE Bus STARTING
[18/Apr/2017:04:41:32] ENGINE Started monitor thread '_TimeoutMonitor'.
[18/Apr/2017:04:41:32] ENGINE Serving on http://127.0.0.1:8002
[18/Apr/2017:04:41:32] ENGINE Bus STARTED
2017-04-18 04:41:32.539113 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 19 0x560d1d198500 mgrdigest v1
2017-04-18 04:41:32.539186 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 19 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198500 con 0x560d1c6c5000
2017-04-18 04:41:32.539240 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:32.539245 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:32.539483 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:32.539577 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:32.539647 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:32.539704 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:32.539761 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:32.545105 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:32.582825 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 20 0x560d1d198780 mgrdigest v1
2017-04-18 04:41:32.582891 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 20 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198780 con 0x560d1c6c5000
2017-04-18 04:41:32.582921 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:32.582924 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:32.583102 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:32.583189 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:32.583259 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:32.583316 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:32.583377 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:32.588426 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.466728 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 21 0x560d1d8e6280 mgrdigest v1
2017-04-18 04:41:33.466773 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 21 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6280 con 0x560d1c6c5000
2017-04-18 04:41:33.466812 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.466815 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.467046 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.467136 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.467204 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.467261 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.467321 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.472647 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.504847 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 22 0x560d1d8e6500 mgrdigest v1
2017-04-18 04:41:33.504915 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 22 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6500 con 0x560d1c6c5000
2017-04-18 04:41:33.504949 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.504952 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.505110 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.505197 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.505265 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.505328 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.505390 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.510461 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.704881 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 23 0x560d1d8e6780 mgrdigest v1
2017-04-18 04:41:33.704945 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 23 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6780 con 0x560d1c6c5000
2017-04-18 04:41:33.704975 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.704978 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.705143 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.705231 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.705304 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.705363 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.705421 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.710495 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.764633 7f5c73974700  2 Event(0x560d1c5aa680 nevent=5000 time_id=2).wakeup
2017-04-18 04:41:33.848611 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 24 0x560d1d8e6a00 mgrdigest v1
2017-04-18 04:41:33.848675 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 24 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6a00 con 0x560d1c6c5000
2017-04-18 04:41:33.848705 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.848708 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.848870 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.848959 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.849030 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.849087 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.849144 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.854209 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.000229 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 25 0x560d1d8e6c80 mgrdigest v1
2017-04-18 04:41:34.000304 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 25 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6c80 con 0x560d1c6c5000
2017-04-18 04:41:34.000334 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.000337 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.000493 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.000581 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.000651 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.000709 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.000766 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.005810 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.629868 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 26 0x560d1d8e6280 mgrdigest v1
2017-04-18 04:41:34.629939 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 26 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6280 con 0x560d1c6c5000
2017-04-18 04:41:34.629966 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.629970 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.630188 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.630279 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.630348 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.630406 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.630465 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.635811 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.922136 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 27 0x560d1d8e6f00 mgrdigest v1
2017-04-18 04:41:34.922203 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 27 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6f00 con 0x560d1c6c5000
2017-04-18 04:41:34.922234 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.922237 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.922402 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.922489 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.922557 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.922633 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.922697 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.927791 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.943624 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 28 0x560d1d198000 mgrdigest v1
2017-04-18 04:41:34.943704 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 28 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198000 con 0x560d1c6c5000
2017-04-18 04:41:34.943735 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.943739 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.943892 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.943978 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.944046 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.944104 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.944162 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.949083 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:35.411640 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 29 0x560d1d198280 mgrdigest v1
2017-04-18 04:41:35.411728 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 29 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198280 con 0x560d1c6c5000
2017-04-18 04:41:35.411768 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:35.411776 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:35.411946 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:35.412033 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:35.412102 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:35.412159 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:35.412218 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:35.417537 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:35.769515 7f5c72972700  1 mgr send_beacon active
2017-04-18 04:41:35.769563 7f5c72972700  1 -- 172.16.0.11:0/3186134139 --> 172.16.0.10:6789/0 -- mgrbeacon mgr.osd104(35658264, 172.16.0.11:6805/33058, 1) v1 -- 0x560d1d8e13c0 con 0
2017-04-18 04:41:35.769592 7f5c72972700  2 Event(0x560d1c5aa680 nevent=5000 time_id=2).wakeup
2017-04-18 04:41:36.031360 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 30 0x560d1d198500 mgrdigest v1
2017-04-18 04:41:36.031439 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 30 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198500 con 0x560d1c6c5000
2017-04-18 04:41:36.031465 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:36.031469 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:36.031703 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:36.031796 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:36.031865 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:36.031924 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:36.031984 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:36.037343 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:36.300775 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 31 0x560d1d198780 mgrdigest v1
2017-04-18 04:41:36.300844 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 31 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198780 con 0x560d1c6c5000
2017-04-18 04:41:36.300870 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:36.300874 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:36.301099 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:36.301190 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:36.301259 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:36.301316 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:36.301374 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:36.306423 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:36.648323 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 32 0x560d1d8e6500 mgrdigest v1
2017-04-18 04:41:36.648360 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 32 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6500 con 0x560d1c6c5000
2017-04-18 04:41:36.648401 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:36.648405 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:36.648567 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:36.648650 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:36.648722 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:36.648779 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:36.648837 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:36.653916 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:36.655394 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 33 0x560d1d8e6780 mgrmap(e 125) v1
2017-04-18 04:41:36.655430 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 33 ==== mgrmap(e 125) v1 ==== 68+0+0 (3572558822 0 0) 0x560d1d8e6780 con 0x560d1c6c5000
2017-04-18 04:41:36.655472 7f5c74976700  4 mgr ms_dispatch active mgrmap(e 125) v1
2017-04-18 04:41:36.655478 7f5c74976700  4 mgr handle_mgr_map received map epoch 125
2017-04-18 04:41:36.655480 7f5c74976700  4 mgr handle_mgr_map active in map: 1 active is 35658264
2017-04-18 04:41:36.655855 7f5c78118700  2 Event(0x560d1c5aa680 nevent=5000 time_id=2).wakeup
2017-04-18 04:41:36.655955 7f5c78118700  2 Event(0x560d1c5aaa80 nevent=5000 time_id=1).wakeup
2017-04-18 04:41:36.656128 7f5c78118700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1d9db000 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=24 -
2017-04-18 04:41:36.656167 7f5c77116700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1db82000 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=26 -
2017-04-18 04:41:36.656223 7f5c78118700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1db83800 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=27 -
2017-04-18 04:41:36.656531 7f5c78118700  0 mgr.server ms_verify_authorizer No AuthAuthorizeHandler found for protocol 0
*** Caught signal (Aborted) **
 in thread 7f5c78118700 thread_name:ceph-mgr
2017-04-18 04:41:36.656873 7f5c77116700  2 -- 172.16.0.11:6805/33058 >> 88.99.201.146:6804/3221757129 conn(0x560d1db82000 :6805 s=STATE_ACCEPTING_WAIT_SEQ pgs=1179 cs=1 l=0).handle_connect_msg accept write reply msg done
2017-04-18 04:41:36.656917 7f5c77917700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1d9d9800 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=25 -
2017-04-18 04:41:36.657069 7f5c77116700  2 -- 172.16.0.11:6805/33058 >> 88.99.201.146:6804/3221757129 conn(0x560d1db82000 :6805 s=STATE_ACCEPTING_WAIT_SEQ pgs=1179 cs=1 l=0)._process_connection accept get newly_acked_seq 0
2017-04-18 04:41:36.657260 7f5c77917700  0 mgr.server ms_verify_authorizer No AuthAuthorizeHandler found for protocol 0
Aborted

Related issues 1 (1 open — 0 closed)

Related to RADOS - Bug #36748: ms_deliver_verify_authorizer no AuthAuthorizeHandler found for protocol 0New

Actions
Actions
Copy link
 #1

Updated by Vitaliy Dutchak about 7 years ago

We are updated to jewel from infernalis then to kraken (11.2.0) and cannot start ceph-mgr daemon
Immediately after start ceph-mgr is terminating with aborted status.

OS: Linux host 4.8.0-46-generic #49~16.04.1-Ubuntu SMP Fri Mar 31 14:51:03 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

Here peace of log
172.16.0.10 - mon.0 + active mds
172.16.0.11 - mon.1 + standby mds - where try to run mgr daemon
172.16.0.12 - mon.2 + standby mds

18/Apr/2017:04:41:32] ENGINE Bus STARTING
[18/Apr/2017:04:41:32] ENGINE Started monitor thread '_TimeoutMonitor'.
[18/Apr/2017:04:41:32] ENGINE Serving on http://127.0.0.1:8002
[18/Apr/2017:04:41:32] ENGINE Bus STARTED
2017-04-18 04:41:32.539113 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 19 0x560d1d198500 mgrdigest v1
2017-04-18 04:41:32.539186 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 19 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198500 con 0x560d1c6c5000
2017-04-18 04:41:32.539240 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:32.539245 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:32.539483 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:32.539577 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:32.539647 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:32.539704 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:32.539761 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:32.545105 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:32.582825 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 20 0x560d1d198780 mgrdigest v1
2017-04-18 04:41:32.582891 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 20 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198780 con 0x560d1c6c5000
2017-04-18 04:41:32.582921 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:32.582924 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:32.583102 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:32.583189 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:32.583259 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:32.583316 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:32.583377 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:32.588426 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.466728 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 21 0x560d1d8e6280 mgrdigest v1
2017-04-18 04:41:33.466773 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 21 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6280 con 0x560d1c6c5000
2017-04-18 04:41:33.466812 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.466815 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.467046 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.467136 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.467204 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.467261 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.467321 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.472647 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.504847 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 22 0x560d1d8e6500 mgrdigest v1
2017-04-18 04:41:33.504915 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 22 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6500 con 0x560d1c6c5000
2017-04-18 04:41:33.504949 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.504952 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.505110 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.505197 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.505265 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.505328 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.505390 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.510461 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.704881 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 23 0x560d1d8e6780 mgrdigest v1
2017-04-18 04:41:33.704945 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 23 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6780 con 0x560d1c6c5000
2017-04-18 04:41:33.704975 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.704978 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.705143 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.705231 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.705304 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.705363 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.705421 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.710495 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:33.764633 7f5c73974700  2 Event(0x560d1c5aa680 nevent=5000 time_id=2).wakeup
2017-04-18 04:41:33.848611 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 24 0x560d1d8e6a00 mgrdigest v1
2017-04-18 04:41:33.848675 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 24 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6a00 con 0x560d1c6c5000
2017-04-18 04:41:33.848705 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:33.848708 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:33.848870 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:33.848959 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:33.849030 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:33.849087 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:33.849144 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:33.854209 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.000229 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 25 0x560d1d8e6c80 mgrdigest v1
2017-04-18 04:41:34.000304 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 25 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6c80 con 0x560d1c6c5000
2017-04-18 04:41:34.000334 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.000337 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.000493 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.000581 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.000651 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.000709 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.000766 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.005810 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.629868 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 26 0x560d1d8e6280 mgrdigest v1
2017-04-18 04:41:34.629939 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 26 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6280 con 0x560d1c6c5000
2017-04-18 04:41:34.629966 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.629970 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.630188 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.630279 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.630348 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.630406 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.630465 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.635811 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.922136 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 27 0x560d1d8e6f00 mgrdigest v1
2017-04-18 04:41:34.922203 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 27 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6f00 con 0x560d1c6c5000
2017-04-18 04:41:34.922234 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.922237 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.922402 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.922489 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.922557 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.922633 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.922697 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.927791 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:34.943624 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 28 0x560d1d198000 mgrdigest v1
2017-04-18 04:41:34.943704 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 28 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198000 con 0x560d1c6c5000
2017-04-18 04:41:34.943735 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:34.943739 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:34.943892 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:34.943978 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:34.944046 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:34.944104 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:34.944162 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:34.949083 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:35.411640 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 29 0x560d1d198280 mgrdigest v1
2017-04-18 04:41:35.411728 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 29 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198280 con 0x560d1c6c5000
2017-04-18 04:41:35.411768 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:35.411776 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:35.411946 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:35.412033 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:35.412102 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:35.412159 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:35.412218 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:35.417537 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:35.769515 7f5c72972700  1 mgr send_beacon active
2017-04-18 04:41:35.769563 7f5c72972700  1 -- 172.16.0.11:0/3186134139 --> 172.16.0.10:6789/0 -- mgrbeacon mgr.osd104(35658264, 172.16.0.11:6805/33058, 1) v1 -- 0x560d1d8e13c0 con 0
2017-04-18 04:41:35.769592 7f5c72972700  2 Event(0x560d1c5aa680 nevent=5000 time_id=2).wakeup
2017-04-18 04:41:36.031360 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 30 0x560d1d198500 mgrdigest v1
2017-04-18 04:41:36.031439 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 30 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198500 con 0x560d1c6c5000
2017-04-18 04:41:36.031465 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:36.031469 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:36.031703 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:36.031796 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:36.031865 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:36.031924 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:36.031984 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:36.037343 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:36.300775 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 31 0x560d1d198780 mgrdigest v1
2017-04-18 04:41:36.300844 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 31 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d198780 con 0x560d1c6c5000
2017-04-18 04:41:36.300870 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:36.300874 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:36.301099 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:36.301190 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:36.301259 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:36.301316 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:36.301374 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:36.306423 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:36.648323 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 32 0x560d1d8e6500 mgrdigest v1
2017-04-18 04:41:36.648360 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 32 ==== mgrdigest v1 ==== 2018+0+0 (2277589243 0 0) 0x560d1d8e6500 con 0x560d1c6c5000
2017-04-18 04:41:36.648401 7f5c74976700  4 mgr ms_dispatch active mgrdigest v1
2017-04-18 04:41:36.648405 7f5c74976700 -1 mgr ms_dispatch mgrdigest v1
2017-04-18 04:41:36.648567 7f5c71970700  4 mgr[rest] Notify mon_status
2017-04-18 04:41:36.648650 7f5c71970700  1 mgr[rest] Unhandled notification type 'mon_status'
2017-04-18 04:41:36.648722 7f5c71970700  4 mgr[rest] Notify health
2017-04-18 04:41:36.648779 7f5c71970700  1 mgr[rest] Unhandled notification type 'health'
2017-04-18 04:41:36.648837 7f5c71970700  4 mgr[rest] Notify pg_summary
2017-04-18 04:41:36.653916 7f5c71970700  4 mgr[rest] RequestCollection.on_map: <class 'rest.app.types.PgSummary'>
2017-04-18 04:41:36.655394 7f5c77917700  5 -- 172.16.0.11:0/3186134139 >> 172.16.0.10:6789/0 conn(0x560d1c6c5000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106239 cs=1 l=1). rx mon.0 seq 33 0x560d1d8e6780 mgrmap(e 125) v1
2017-04-18 04:41:36.655430 7f5c74976700  1 -- 172.16.0.11:0/3186134139 <== mon.0 172.16.0.10:6789/0 33 ==== mgrmap(e 125) v1 ==== 68+0+0 (3572558822 0 0) 0x560d1d8e6780 con 0x560d1c6c5000
2017-04-18 04:41:36.655472 7f5c74976700  4 mgr ms_dispatch active mgrmap(e 125) v1
2017-04-18 04:41:36.655478 7f5c74976700  4 mgr handle_mgr_map received map epoch 125
2017-04-18 04:41:36.655480 7f5c74976700  4 mgr handle_mgr_map active in map: 1 active is 35658264
2017-04-18 04:41:36.655855 7f5c78118700  2 Event(0x560d1c5aa680 nevent=5000 time_id=2).wakeup
2017-04-18 04:41:36.655955 7f5c78118700  2 Event(0x560d1c5aaa80 nevent=5000 time_id=1).wakeup
2017-04-18 04:41:36.656128 7f5c78118700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1d9db000 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=24 -
2017-04-18 04:41:36.656167 7f5c77116700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1db82000 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=26 -
2017-04-18 04:41:36.656223 7f5c78118700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1db83800 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=27 -
2017-04-18 04:41:36.656531 7f5c78118700  0 mgr.server ms_verify_authorizer No AuthAuthorizeHandler found for protocol 0
*** Caught signal (Aborted) **
 in thread 7f5c78118700 thread_name:ceph-mgr
2017-04-18 04:41:36.656873 7f5c77116700  2 -- 172.16.0.11:6805/33058 >> 172.16.0.12:6804/3221757129 conn(0x560d1db82000 :6805 s=STATE_ACCEPTING_WAIT_SEQ pgs=1179 cs=1 l=0).handle_connect_msg accept write reply msg done
2017-04-18 04:41:36.656917 7f5c77917700  1 -- 172.16.0.11:6805/33058 >> - conn(0x560d1d9d9800 :6805 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=25 -
2017-04-18 04:41:36.657069 7f5c77116700  2 -- 172.16.0.11:6805/33058 >> 172.16.0.12:6804/3221757129 conn(0x560d1db82000 :6805 s=STATE_ACCEPTING_WAIT_SEQ pgs=1179 cs=1 l=0)._process_connection accept get newly_acked_seq 0
2017-04-18 04:41:36.657260 7f5c77917700  0 mgr.server ms_verify_authorizer No AuthAuthorizeHandler found for protocol 0
Aborted
Actions
Copy link
 #2

Updated by Sage Weil almost 7 years ago

  • Status changed from New to Resolved
Actions
Copy link
 #3

Updated by Greg Farnum over 4 years ago

  • Related to Bug #36748: ms_deliver_verify_authorizer no AuthAuthorizeHandler found for protocol 0 added
Actions
Copy link

Also available in: Atom PDF