Project

General

Profile

Actions

Bug #23482

closed

ceph-mgr --help stopped working (regression in master)

Added by Nathan Cutler about 6 years ago. Updated about 6 years ago.

Status:
Resolved
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

(Opening with increased priority since this appears to be a regression)

With a recent master, ceph-mgr --help stopped working. Instead of a help message, it displays:

# ceph-mgr --help
failed to fetch mon config (--no-mon-config to skip)

Also, not just ceph-mgr --help, but also trying to start the ceph-mgr process fails with the same error message.

Ricardo Dias found a workaround:

[mgr]
keyring = /var/lib/ceph/mgr/ceph-target137074025108/keyring

With this in ceph.conf, it becomes possible to start the ceph-mgr process with --no-mon-config

(NOTE: this is a Python 3 system; no Python 2 installed.)

An earlier build of master - 820dac980e9416fe05998d50cac633c81a87b9e3, v13.0.1-3181-g820dac980e - did not exhibit this problem in the same environment: that's why I believe it is a regression.

Actions #1

Updated by Nathan Cutler about 6 years ago

  • Description updated (diff)
Actions #2

Updated by Nathan Cutler about 6 years ago

  • Description updated (diff)
Actions #3

Updated by Nathan Cutler about 6 years ago

If my regression hypothesis is correct, the "culprit" would be one or more of these:

$ git log --reverse --oneline --merges 820dac980e9416fe05998d50cac633c81a87b9e3..607f6024d1c4eba22724bd3c385fc72c3b6be52c
---BISECT BASELINE--- 820dac980e9416fe05998d50cac633c81a87b9e3
f22a9017bd Merge pull request #20888 from majianpeng/fix-vstop
3221b80f88 Merge pull request #20958 from votdev/remove_useless_code
b472c7913d Merge pull request #20966 from dillaman/wip-23399
ac78d7f252 Merge pull request #20969 from smithfarm/wip-23238
84ef01e3e0 Merge pull request #20977 from smithfarm/wip-23424
42cfc9172b Merge pull request #20941 from dillaman/wip-dashboard-rbd
ac98cfd713 Merge pull request #20978 from votdev/improve_formatter
7c9f4806ea Merge pull request #20970 from ashishkumsingh/doc-fix-resharding-formatting
fee6bcef3b Merge pull request #20847 from votdev/improve_auth_interceptor
ebd78796e7 Merge pull request #20989 from ricardoasmarques/wip-npm-start
79ee94969e Merge pull request #20933 from dzafman/wip-22902
44f16c903a Merge pull request #20986 from jecluis/wip-vstart
f0b780f616 Merge pull request #21019 from majianpeng/fix-vstart
7a490ac6b4 Merge pull request #20971 from ricardoasmarques/wip-helper-component
9a031bad0f Merge pull request #20972 from ricardoasmarques/wip-dimless-binary-directive
f21ed94d90 Merge pull request #21021 from sebastian-philipp/dashboard-auth-qa-fix
f97159c31d Merge pull request #20846 from theanalyst/rgw/fix-empty-stats
6329d44301 Merge pull request #20842 from mkogan1/wip-rgw-23147
2a0bb28e20 Merge pull request #20841 from oritwas/wip-rgw-metadata
6a5bab7dd4 Merge pull request #20981 from cbodley/wip-qa-fix-ssl
3c5f24a626 Merge pull request #21008 from trociny/wip-23430
f1936a2702 Merge pull request #21013 from dzafman/wip-remove-bc
235f211901 Merge pull request #21002 from smithfarm/wip-23437
d5763de318 Merge pull request #20865 from sebastian-philipp/dashboard_v2_pool-create
5867292162 Merge pull request #21006 from rjfd/wip-dashboard-fix-auth-py3
a392e612cc Merge pull request #21007 from rjfd/wip-dashboard-fix-py3
4198558162 Merge pull request #21036 from xiexingguo/wip-wrong-tip
0754b797e1 Merge pull request #21020 from trociny/wip-vstart-no-mon-config
---BISECT 1--- (everything up to and including 0754b797e1)
bf82cb2075 Merge pull request #21032 from simransinghal/fixtypo
765b346aee Merge pull request #21011 from tspmelo/wip-submit-btn
b71eb01705 Merge pull request #19439 from chardan/jfw-wip-14363-normalize-rm
6b59fbfcc6 Merge pull request #21027 from cbodley/wip-qa-swift-force-branch
c9e5d782d5 Merge pull request #21047 from rjfd/wip-mgr-smart-fix-py3
43e5097c2f Merge pull request #20873 from sebastian-philipp/dashboard_v2-simple-html-debug
914faf2c1e Merge pull request #21004 from s0nea/wip-dashboard-skip-datapool-testcase
d5e54fda5c Merge pull request #21024 from s0nea/wip-dashboard-return-features-list
b4a7955034 Merge pull request #21005 from rjfd/wip-mgr-fix-error-handling
81b00f58e0 Merge pull request #20314 from ovh/bp-librados-nntk
a1f204edf5 Merge pull request #20558 from chardan/jfw-wip-show_compression_methods-22420
fc86c2b76f Merge pull request #20774 from rishabh-d-dave/fix-tilde-expansion
f2545d2b84 Merge pull request #20900 from ifed01/wip-ifed-fix-interals-in-repair
648a3111a0 Merge pull request #21034 from rzarzynski/wip-bs-reorder-bluefs_extent_t
7b20a15020 Merge pull request #20951 from tchaikov/wip-FTBFS-bluestore-armhf
c9903b5b9c Merge pull request #21037 from guzhongyan/bf-format
5b5638ebef Merge pull request #21043 from wido/zabbix-osd-numpgs
625faf00bd Merge pull request #21063 from guzhongyan/bs-cleanup
c7049c103a Merge pull request #20494 from wido/influx-time-fixes
b2fc3fac30 Merge pull request #21070 from ceph/wip-cv-vagrant-reload
c0a70f31f7 Merge PR #21012 into master
d007cf9fa9 Merge PR #20997 into master
5a6c248fa0 Merge PR #20913 into master
2320106ab0 Merge PR #20908 into master
272b6f641c Merge PR #20854 into master
cc6b607a55 Merge PR #20828 into master
607f6024d1 Merge PR #20798 into master

Bisect notes:

1. make sure make-dist uses python 3 (setup-virtualenv.sh)
2. BISECT_BRANCH=wip-23482-bisect-1 (e.g.)

ceph-workbench ceph-qa-suite --verbose --name smithfarm --simultaneous-jobs 20 \
--ceph-repo https://github.com/SUSE/ceph.git --ceph $BISECT_BRANCH \
--suite-repo https://github.com/SUSE/ceph.git --suite-branch ses6 \
--suite deepsea/basic/health-ok --filter sle --filter-out cli \
~/custom_yaml/wip-982-1011.yaml

3. use --suite-repo https://github.com/SUSE/ceph.git --suite-branch ses6
4. BISECT BASELINE : wip-23482-bisect-baseline : test result
5. BISECT 1        : wip-23482-bisect-1        : test result
Actions #4

Updated by Greg Farnum about 6 years ago

  • Project changed from Ceph to mgr
  • Category deleted (MonClient)
Actions #5

Updated by Sage Weil about 6 years ago

  • Status changed from New to Fix Under Review

This is mostly fixed in master, except for this bit: https://github.com/ceph/ceph/pull/21401

Actions #6

Updated by Kefu Chai about 6 years ago

  • Status changed from Fix Under Review to Resolved
Actions

Also available in: Atom PDF