Project

General

Profile

Actions

Bug #63439

open

crash in the dashboard when enabling/disabling secure_monitoring_stack

Added by Redouane Kachach Elhichou 6 months ago. Updated 6 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Following crashes are observed in the transition (while cephadm is reconfiguring the daemons).

When enabling secure monitoring (ceph config set mgr mgr/cephadm/secure_monitoring_stack true)

Nov 06 09:06:33 ceph-node-0 ceph-mgr[2993]: [dashboard ERROR exception] Dashboard Exception
                                            Traceback (most recent call last):
                                              File "/usr/share/ceph/mgr/dashboard/controllers/prometheus.py", line 105, in _proxy
                                                content = json.loads(response.content, strict=False)
                                              File "/lib64/python3.6/json/__init__.py", line 367, in loads
                                                return cls(**kw).decode(s)
                                              File "/lib64/python3.6/json/decoder.py", line 339, in decode
                                                obj, end = self.raw_decode(s, idx=_w(s, 0).end())
                                              File "/lib64/python3.6/json/decoder.py", line 357, in raw_decode
                                                raise JSONDecodeError("Expecting value", s, err.value) from None
                                            json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

                                            During handling of the above exception, another exception occurred:

                                            Traceback (most recent call last):
                                              File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 47, in dashboard_exception_handler
                                                return handler(*args, **kwargs)
                                              File "/lib/python3.6/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
                                                return self.callable(*self.args, **self.kwargs)
                                              File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 263, in inner
                                                ret = func(*args, **kwargs)
                                              File "/usr/share/ceph/mgr/dashboard/controllers/_rest_controller.py", line 191, in wrapper
                                                return func(*vpath, **params)
                                              File "/usr/share/ceph/mgr/dashboard/controllers/prometheus.py", line 135, in get_prometeus_data
                                                return self.prometheus_proxy('GET', '/query_range', params)
                                              File "/usr/share/ceph/mgr/dashboard/controllers/prometheus.py", line 39, in prometheus_proxy
                                                user=user, password=password, verify=verify)
                                              File "/usr/share/ceph/mgr/dashboard/controllers/prometheus.py", line 109, in _proxy
                                                component='prometheus')
                                            dashboard.exceptions.DashboardException: Error parsing Prometheus Alertmanager response: Expecting value

When disabling secure monitoring (ceph config set mgr mgr/cephadm/secure_monitoring_stack false)

Nov 06 09:26:47 ceph-node-0 ceph-mgr[2993]: [dashboard ERROR exception] Dashboard Exception
                                            Traceback (most recent call last):
                                              File "/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
                                                chunked=chunked)
                                              File "/lib/python3.6/site-packages/urllib3/connectionpool.py", line 343, in _make_request
                                                self._validate_conn(conn)
                                              File "/lib/python3.6/site-packages/urllib3/connectionpool.py", line 839, in _validate_conn
                                                conn.connect()
                                              File "/lib/python3.6/site-packages/urllib3/connection.py", line 358, in connect
                                                ssl_context=context)
                                              File "/lib/python3.6/site-packages/urllib3/util/ssl_.py", line 354, in ssl_wrap_socket
                                                return context.wrap_socket(sock, server_hostname=server_hostname)
                                              File "/lib64/python3.6/ssl.py", line 365, in wrap_socket
                                                _context=self, _session=session)
                                              File "/lib64/python3.6/ssl.py", line 810, in __init__
                                                self.do_handshake()
                                              File "/lib64/python3.6/ssl.py", line 1070, in do_handshake
                                                self._sslobj.do_handshake()
                                              File "/lib64/python3.6/ssl.py", line 648, in do_handshake
                                                self._sslobj.do_handshake()
                                            ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:897)

                                            During handling of the above exception, another exception occurred:

Actions #1

Updated by Redouane Kachach Elhichou 6 months ago

  • Project changed from Orchestrator to Dashboard
Actions

Also available in: Atom PDF