Project

General

Profile

Actions

Bug #44257

closed

vstart.sh: failed by waiting for mgr dashboard module to start

Added by Xiubo Li about 4 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description


# uname -a
Linux lxbceph0 5.6.0-rc1 #1 SMP Wed Feb 19 23:51:19 EST 2020 x86_64 x86_64 x86_64 GNU/Linux

# cat /etc/os-release 
NAME="CentOS Linux" 
VERSION="7 (Core)" 
ID="centos" 
ID_LIKE="rhel fedora" 
VERSION_ID="7" 
PRETTY_NAME="CentOS Linux 7 (Core)" 
ANSI_COLOR="0;31" 
CPE_NAME="cpe:/o:centos:centos:7" 
HOME_URL="https://www.centos.org/" 
BUG_REPORT_URL="https://bugs.centos.org/" 

CENTOS_MANTISBT_PROJECT="CentOS-7" 
CENTOS_MANTISBT_PROJECT_VERSION="7" 
REDHAT_SUPPORT_PRODUCT="centos" 
REDHAT_SUPPORT_PRODUCT_VERSION="7" 

# MDS=3 MON=3 OSD=3 MGR=1 ../src/vstart.sh -n -X -G --msgr1

...

added key for mgr.x
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf config set mgr mgr/dashboard/x/ssl_server_port 41981 --force 
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf config set mgr mgr/restful/x/server_port 42981 --force 
Starting mgr.x
/data/ceph/build/bin/ceph-mgr -i x -c /data/ceph/build/ceph.conf 
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
/data/ceph/build/bin/ceph -c /data/ceph/build/ceph.conf -h 
waiting for mgr dashboard module to start
...

It will loop and wait the dashboard module to start forever.

The mgr.x.log:


2020-02-23T21:25:01.778-0500 7fa5fba15cc0  0 ceph version 15.1.0-1107-g18ca1819 (18ca1819bc5afb822f9d950a63e7e330f0ec90a0) octopus (rc), process ceph-mgr, pid 27620
2020-02-23T21:25:01.826-0500 7fa5fba15cc0  1 mgr[py] Loading python module 'alerts'
2020-02-23T21:25:01.925-0500 7fa5fba15cc0  1 mgr[py] Loading python module 'balancer'
2020-02-23T21:25:01.982-0500 7fa5fba15cc0  1 mgr[py] Loading python module 'cephadm'
2020-02-23T21:25:02.071-0500 7fa5fba15cc0 -1 mgr[py] Module not found: 'cephadm'
2020-02-23T21:25:02.071-0500 7fa5fba15cc0 -1 mgr[py] Traceback (most recent call last):
  File "/data/ceph/src/pybind/mgr/cephadm/__init__.py", line 6, in <module>
    from .module import CephadmOrchestrator
  File "/data/ceph/src/pybind/mgr/cephadm/module.py", line 33, in <module>
    import orchestrator
  File "/data/ceph/src/pybind/mgr/orchestrator/__init__.py", line 3, in <module>
    from .module import OrchestratorCli
  File "/data/ceph/src/pybind/mgr/orchestrator/module.py", line 4, in <module>
    import yaml
ModuleNotFoundError: No module named 'yaml'

2020-02-23T21:25:02.073-0500 7fa5fba15cc0 -1 mgr[py] Class not found in module 'cephadm'
2020-02-23T21:25:02.073-0500 7fa5fba15cc0 -1 mgr[py] Error loading module 'cephadm': (2) No such file or directory
2020-02-23T21:25:02.073-0500 7fa5fba15cc0  1 mgr[py] Loading python module 'crash'
2020-02-23T21:25:02.140-0500 7fa5fba15cc0  1 mgr[py] Loading python module 'dashboard'
2020-02-23T21:25:02.320-0500 7fa5fba15cc0 -1 mgr[py] Module not found: 'dashboard'
2020-02-23T21:25:02.320-0500 7fa5fba15cc0 -1 mgr[py] Traceback (most recent call last):
  File "/data/ceph/src/pybind/mgr/dashboard/__init__.py", line 27, in <module>
    from .module import Module, StandbyModule  # noqa: F401
  File "/data/ceph/src/pybind/mgr/dashboard/module.py", line 27, in <module>
    from .services.sso import load_sso_db
  File "/data/ceph/src/pybind/mgr/dashboard/services/sso.py", line 16, in <module>
    from ..tools import prepare_url_prefix
  File "/data/ceph/src/pybind/mgr/dashboard/tools.py", line 19, in <module>
    import cherrypy
ModuleNotFoundError: No module named 'cherrypy'

...

Actions #1

Updated by Patrick Donnelly about 4 years ago

Xiubo, I think you're missing some dependencies. Have you run `./install-deps.sh`?

Actions #2

Updated by Xiubo Li about 4 years ago

Yeah, all the install-deps.sh and do_cmake.sh no any error. But I have to manually install all the them again to make this work.

It seems the install-deps.sh does not work well in centos release.

Actions #3

Updated by Varsha Rao about 4 years ago

I had the same issue on fedora 30 with yaml module not installed.

Actions #4

Updated by Patrick Donnelly about 4 years ago

  • Status changed from New to Resolved
Actions #5

Updated by Laura Flores almost 3 years ago

I just ran into this same issue, where "waiting for mgr dashboard module to start" runs on a loop. Checking mgr.log.x in ceph/build/out told me that one of the lines I had added to mgr_module.py was indented incorrectly. Fixing the indent solved my problem.

For anyone else running into this issue, make sure to check the output of your logs! (ceph/build/out/**.log) They are very helpful.

I know this issue has already been closed, but I wanted to add more context to it in case any other developers are stumped by the same scenario.

Actions

Also available in: Atom PDF