Project

General

Profile

Actions
Copy link

Bug #63337

open

monmap's features are sometimes 0

Added by tongshuai song 6 months ago. Updated 6 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
v14.2.23
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

in function mommap.get_required_monitor_features(), rados clinet init.
'features' is my debug info mommap.get_required_monitor_features().get_raw().It should return 31, not 0.
it will affect some mgr command with 'mgrclient.set_mgr_optional()'

2023-10-27 16:39:30.543 7f11e9f76700 1 librados: starting msgr at
2023-10-27 16:39:30.543 7f11e9f76700 1 librados: starting objecter
2023-10-27 16:39:30.544 7f11e9f76700 1 librados: setting wanted keys
2023-10-27 16:39:30.544 7f11e9f76700 1 librados: calling monclient init
2023-10-27 16:39:30.544 7f11e9f76700 10 monclient: init
2023-10-27 16:39:30.544 7f11e9f76700 10 monclient: _reopen_session rank -1
2023-10-27 16:39:30.544 7f11e9f76700 10 monclient(hunting): picked mon.a con 0x7f11dc0d07c0 addr v1:192.168.1.220:6789/0
2023-10-27 16:39:30.544 7f11e9f76700 10 monclient(hunting): picked mon.c con 0x7f11dc19e0a0 addr v1:192.168.1.222:6789/0
2023-10-27 16:39:30.544 7f11e9f76700 10 monclient(hunting): picked mon.b con 0x7f11dc1a1d10 addr v1:192.168.1.221:6789/0
2023-10-27 16:39:30.544 7f11e9f76700 10 monclient(hunting): _renew_subs
2023-10-27 16:39:30.544 7f11e9f76700 10 monclient(hunting): authenticate will time out at 2023-10-27 16:44:30.545257
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): _init_auth method 1
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): my global_id is 39796620
2023-10-27 16:39:30.545 7f1193fff700 10 monclient: _finish_hunting 0
2023-10-27 16:39:30.545 7f1193fff700 1 monclient: found mon.a
2023-10-27 16:39:30.545 7f1193fff700 10 monclient: _send_mon_message to mon.a at v1:192.168.1.220:6789/0
2023-10-27 16:39:30.545 7f1193fff700 10 monclient: _finish_auth 0
2023-10-27 16:39:30.545 7f11e9f76700 5 monclient: authenticate success, global_id 39796620
2023-10-27 16:39:30.545 7f11e9f76700 1 librados: features: 0
2023-10-27 16:39:30.545 7f11e9f76700 1 librados: mon_feature_t([luminous])
2023-10-27 16:39:30.545 7f11e9f76700 10 monclient: _renew_subs
2023-10-27 16:39:30.545 7f11e9f76700 10 monclient: _send_mon_message to mon.a at v1:192.168.1.220:6789/0
2023-10-27 16:39:30.545 7f1193fff700 10 monclient: handle_monmap mon_map magic: 0 v1
2023-10-27 16:39:30.545 7f1193fff700 10 monclient: got monmap 1 from mon.a (according to old e1)
2023-10-27 16:39:30.545 7f1193fff700 10 monclient: dump:
epoch 1
fsid f2b60627-ccac-42c6-a6d4-17a368d988f2
last_changed 2023-04-25 23:50:46.511216
created 2023-04-25 23:50:46.511216
min_mon_release 14 (nautilus)
0: [v2:192.168.1.220:3300/0,v1:192.168.1.220:6789/0] mon.a
1: [v2:192.168.1.221:3300/0,v1:192.168.1.221:6789/0] mon.b
2: [v2:192.168.1.222:3300/0,v1:192.168.1.222:6789/0] mon.c

2023-10-27 16:39:30.545 7f1193fff700 1 monclient: mon.0 has (v2) addrs [v2:192.168.1.220:3300/0,v1:192.168.1.220:6789/0] but i'm connected to v1:192.168.1.220:6789/0, reconnecting
2023-10-27 16:39:30.545 7f1193fff700 10 monclient: _reopen_session rank -1
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): picked mon.c con 0x7f1174003420 addr [v2:192.168.1.222:3300/0,v1:192.168.1.222:6789/0]
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): picked mon.a con 0x7f1174005ff0 addr [v2:192.168.1.220:3300/0,v1:192.168.1.220:6789/0]
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): picked mon.b con 0x7f1174008c00 addr [v2:192.168.1.221:3300/0,v1:192.168.1.221:6789/0]
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): start opening mon connection
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): start opening mon connection
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): start opening mon connection
2023-10-27 16:39:30.545 7f1193fff700 10 monclient(hunting): _renew_subs
2023-10-27 16:39:30.546 7f11e9f76700 10 monclient(hunting): _renew_subs
2023-10-27 16:39:30.546 7f11e9f76700 1 librados: init done
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient(hunting): get_auth_request con 0x7f1174003420 auth_method 0
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient(hunting): get_auth_request method 1 preferred_modes [1]
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient(hunting): _init_auth method 1
2023-10-27 16:39:30.546 7f11c7fff700 10 monclient(hunting): get_auth_request con 0x7f1174005ff0 auth_method 0
2023-10-27 16:39:30.546 7f11c7fff700 10 monclient(hunting): get_auth_request method 1 preferred_modes [1]
2023-10-27 16:39:30.546 7f11c7fff700 10 monclient(hunting): _init_auth method 1
2023-10-27 16:39:30.546 7f11dbfff700 10 monclient(hunting): get_auth_request con 0x7f1174008c00 auth_method 0
2023-10-27 16:39:30.546 7f11dbfff700 10 monclient(hunting): get_auth_request method 1 preferred_modes [1]
2023-10-27 16:39:30.546 7f11dbfff700 10 monclient(hunting): _init_auth method 1
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient(hunting): handle_auth_done global_id 39796620 payload 0
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient: _finish_hunting 0
2023-10-27 16:39:30.546 7f11d5bfe700 1 monclient: found mon.c
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient: _send_mon_message to mon.c at v2:192.168.1.222:3300/0
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient: _send_mon_message to mon.c at v2:192.168.1.222:3300/0
2023-10-27 16:39:30.546 7f11d5bfe700 10 monclient: _finish_auth 0
2023-10-27 16:39:30.547 7f1193fff700 10 monclient: handle_monmap mon_map magic: 0 v1
2023-10-27 16:39:30.547 7f1193fff700 10 monclient: got monmap 1 from mon.c (according to old e1)
2023-10-27 16:39:30.547 7f1193fff700 10 monclient: dump:
epoch 1
fsid f2b60627-ccac-42c6-a6d4-17a368d988f2
last_changed 2023-04-25 23:50:46.511216
created 2023-04-25 23:50:46.511216
min_mon_release 14 (nautilus)
0: [v2:192.168.1.220:3300/0,v1:192.168.1.220:6789/0] mon.a
1: [v2:192.168.1.221:3300/0,v1:192.168.1.221:6789/0] mon.b
2: [v2:192.168.1.222:3300/0,v1:192.168.1.222:6789/0] mon.c

2023-10-27 16:39:30.547 7f1193fff700 10 monclient: handle_config config(0 keys) v1
2023-10-27 16:39:30.547 7f11813fc700 4 set_mon_vals no callback set
2023-10-27 16:39:30.548 7f1193fff700 10 monclient: handle_monmap mon_map magic: 0 v1
2023-10-27 16:39:30.548 7f1193fff700 10 monclient: got monmap 1 from mon.c (according to old e1)
2023-10-27 16:39:30.548 7f1193fff700 10 monclient: dump:
epoch 1
fsid f2b60627-ccac-42c6-a6d4-17a368d988f2
last_changed 2023-04-25 23:50:46.511216
created 2023-04-25 23:50:46.511216
min_mon_release 14 (nautilus)
0: [v2:192.168.1.220:3300/0,v1:192.168.1.220:6789/0] mon.a
1: [v2:192.168.1.221:3300/0,v1:192.168.1.221:6789/0] mon.b
2: [v2:192.168.1.222:3300/0,v1:192.168.1.222:6789/0] mon.c

2023-10-27 16:39:30.548 7f11c7fff700 10 monclient: get_auth_request con 0x7f1174012e90 auth_method 0
2023-10-27 16:39:30.587 7f11e9f76700 10 monclient: start_mon_command cmd=[{"prefix": "get_command_descriptions"}]
2023-10-27 16:39:30.587 7f11e9f76700 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}]
2023-10-27 16:39:30.587 7f11e9f76700 10 monclient: _send_mon_message to mon.c at v2:192.168.1.222:3300/0
2023-10-27 16:39:30.594 7f1193fff700 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}]
2023-10-27 16:39:30.594 7f1193fff700 10 monclient: _finish_command 1 = 0
2023-10-27 16:39:31.065 7f11e9f76700 10 monclient: start_mon_command cmd=[{"prefix": "status"}]
2023-10-27 16:39:31.065 7f11e9f76700 10 monclient: _send_command 2 [{"prefix": "status"}]
2023-10-27 16:39:31.065 7f11e9f76700 10 monclient: _send_mon_message to mon.c at v2:192.168.1.222:3300/0
2023-10-27 16:39:31.066 7f1193fff700 10 monclient: handle_mon_command_ack 2 [{"prefix": "status"}]
2023-10-27 16:39:31.066 7f1193fff700 10 monclient: _finish_command 2 = 0
cluster:
id: f2b60627-ccac-42c6-a6d4-17a368d988f2
health: HEALTH_OK

services:
    mon: 3 daemons, quorum a,b,c (age 22m)
    mgr: a(active, since 22m)
    osd: 3 osds: 3 up (since 22m), 3 in (since 6M)
data:
    pools:   2 pools, 192 pgs
    objects: 40 objects, 55 MiB
    usage:   33 GiB used, 86 GiB / 120 GiB avail
    pgs:     192 active+clean
io:
    client:   170 B/s wr, 0 op/s rd, 0 op/s wr

2023-10-27 16:39:31.072 7f11e9f76700 10 monclient: shutdown
2023-10-27 16:39:31.073 7f11e9f76700 1 librados: shutdown

Actions
Copy link
 #1

Updated by tongshuai song 6 months ago

monclient int is async. Rados client will get mon map from monclint before monclient init success.

Actions
Copy link

Also available in: Atom PDF