Bug #44257
closedvstart.sh: failed by waiting for mgr dashboard module to start
0%
Description
# uname -a
Linux lxbceph0 5.6.0-rc1 #1 SMP Wed Feb 19 23:51:19 EST 2020 x86_64 x86_64 x86_64 GNU/Linux
# cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
# MDS=3 MON=3 OSD=3 MGR=1 ../src/vstart.sh -n -X -G --msgr1
...
added key for mgr.x
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf config set mgr mgr/dashboard/x/ssl_server_port 41981 --force
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf config set mgr mgr/restful/x/server_port 42981 --force
Starting mgr.x
/data/ceph/build/bin/ceph-mgr -i x -c /data/ceph/build/ceph.conf
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h
waiting for mgr dashboard module to start
...
It will loop and wait the dashboard module to start forever.
The mgr.x.log:
2020-02-23T21:25:01.778-0500 7fa5fba15cc0 0 ceph version 15.1.0-1107-g18ca1819 (18ca1819bc5afb822f9d950a63e7e330f0ec90a0) octopus (rc), process ceph-mgr, pid 27620 2020-02-23T21:25:01.826-0500 7fa5fba15cc0 1 mgr[py] Loading python module 'alerts' 2020-02-23T21:25:01.925-0500 7fa5fba15cc0 1 mgr[py] Loading python module 'balancer' 2020-02-23T21:25:01.982-0500 7fa5fba15cc0 1 mgr[py] Loading python module 'cephadm' 2020-02-23T21:25:02.071-0500 7fa5fba15cc0 -1 mgr[py] Module not found: 'cephadm' 2020-02-23T21:25:02.071-0500 7fa5fba15cc0 -1 mgr[py] Traceback (most recent call last): File "/data/ceph/src/pybind/mgr/cephadm/__init__.py", line 6, in <module> from .module import CephadmOrchestrator File "/data/ceph/src/pybind/mgr/cephadm/module.py", line 33, in <module> import orchestrator File "/data/ceph/src/pybind/mgr/orchestrator/__init__.py", line 3, in <module> from .module import OrchestratorCli File "/data/ceph/src/pybind/mgr/orchestrator/module.py", line 4, in <module> import yaml ModuleNotFoundError: No module named 'yaml' 2020-02-23T21:25:02.073-0500 7fa5fba15cc0 -1 mgr[py] Class not found in module 'cephadm' 2020-02-23T21:25:02.073-0500 7fa5fba15cc0 -1 mgr[py] Error loading module 'cephadm': (2) No such file or directory 2020-02-23T21:25:02.073-0500 7fa5fba15cc0 1 mgr[py] Loading python module 'crash' 2020-02-23T21:25:02.140-0500 7fa5fba15cc0 1 mgr[py] Loading python module 'dashboard' 2020-02-23T21:25:02.320-0500 7fa5fba15cc0 -1 mgr[py] Module not found: 'dashboard' 2020-02-23T21:25:02.320-0500 7fa5fba15cc0 -1 mgr[py] Traceback (most recent call last): File "/data/ceph/src/pybind/mgr/dashboard/__init__.py", line 27, in <module> from .module import Module, StandbyModule # noqa: F401 File "/data/ceph/src/pybind/mgr/dashboard/module.py", line 27, in <module> from .services.sso import load_sso_db File "/data/ceph/src/pybind/mgr/dashboard/services/sso.py", line 16, in <module> from ..tools import prepare_url_prefix File "/data/ceph/src/pybind/mgr/dashboard/tools.py", line 19, in <module> import cherrypy ModuleNotFoundError: No module named 'cherrypy' ...
Updated by Patrick Donnelly about 4 years ago
Xiubo, I think you're missing some dependencies. Have you run `./install-deps.sh`?
Updated by Xiubo Li about 4 years ago
Yeah, all the install-deps.sh and do_cmake.sh no any error. But I have to manually install all the them again to make this work.
It seems the install-deps.sh does not work well in centos release.
Updated by Varsha Rao about 4 years ago
I had the same issue on fedora 30 with yaml module not installed.
Updated by Patrick Donnelly about 4 years ago
- Status changed from New to Resolved
Updated by Laura Flores almost 3 years ago
I just ran into this same issue, where "waiting for mgr dashboard module to start" runs on a loop. Checking mgr.log.x in ceph/build/out told me that one of the lines I had added to mgr_module.py was indented incorrectly. Fixing the indent solved my problem.
For anyone else running into this issue, make sure to check the output of your logs! (ceph/build/out/**.log) They are very helpful.
I know this issue has already been closed, but I wanted to add more context to it in case any other developers are stumped by the same scenario.