Project

General

Profile

Bug #51312

mgr/dashboard: Alertmanager fails to POST alerts

Added by Ernesto Puerta almost 3 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
General - Back-end
Target version:
% Done:

0%

Source:
Development
Tags:
Backport:
pacific
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

In alertmanager logs:

Jun 22 10:37:01 mon0 conmon[108680]: level=debug ts=2021-06-22T10:37:01.698541042Z caller=notify.go:670 component=dispatcher msg="Notify attempt failed" attempt=1 integration=webhook receiver=ceph-dashboard err="unexpected status code 415 from https://mgr0:8443/api/prometheus_receiver" 
Jun 22 10:37:01 mon0 conmon[108680]: level=error ts=2021-06-22T10:37:01.698745262Z caller=notify.go:332 component=dispatcher msg="Error on notify" err="cancelling notify retry for \"webhook\" due to unrecoverable error: unexpected status code 415 from https://mgr0:8443/api/prometheus_receiver" 
Jun 22 10:37:01 mon0 conmon[108680]: level=error ts=2021-06-22T10:37:01.698849369Z caller=dispatch.go:177 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="cancelling notify retry for \"webhook\" due to unrecoverable error: unexpected status code 415 from https://mgr0:8443/api/prometheus_receiver

In mgr logs:

Jun 22 09:19:16 mgr0 conmon[35287]: 2021-06-22T09:19:16.525+0000 7f8f81407700  0 [dashboard ERROR exception] Internal Server Error
Jun 22 09:19:16 mgr0 conmon[35287]: Traceback (most recent call last):
Jun 22 09:19:16 mgr0 conmon[35287]:   File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 46, in dashboard_exception_handler
Jun 22 09:19:16 mgr0 conmon[35287]:     return handler(*args, **kwargs)
Jun 22 09:19:16 mgr0 conmon[35287]:   File "/lib/python3.6/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
Jun 22 09:19:16 mgr0 conmon[35287]:     return self.callable(*self.args, **self.kwargs)
Jun 22 09:19:16 mgr0 conmon[35287]:   File "/usr/share/ceph/mgr/dashboard/controllers/__init__.py", line 714, in inner
Jun 22 09:19:16 mgr0 conmon[35287]:     raise cherrypy.HTTPError(415, "Unable to find version in request header")
Jun 22 09:19:16 mgr0 conmon[35287]: cherrypy._cperror.HTTPError: (415, 'Unable to find version in request header')
Jun 22 09:19:16 mgr0 conmon[35287]: 2021-06-22T09:19:16.542+0000 7f8f84c0e700  0 [dashboard ERROR exception] Internal Server Error
Jun 22 09:19:16 mgr0 conmon[35287]: Traceback (most recent call last):
Jun 22 09:19:16 mgr0 conmon[35287]:   File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 46, in dashboard_exception_handler
Jun 22 09:19:16 mgr0 conmon[35287]:     return handler(*args, **kwargs)
Jun 22 09:19:16 mgr0 conmon[35287]:   File "/lib/python3.6/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__
Jun 22 09:19:16 mgr0 conmon[35287]:     return self.callable(*self.args, **self.kwargs)
Jun 22 09:19:16 mgr0 conmon[35287]:   File "/usr/share/ceph/mgr/dashboard/controllers/__init__.py", line 714, in inner
Jun 22 09:19:16 mgr0 conmon[35287]:     raise cherrypy.HTTPError(415, "Unable to find version in request header")
Jun 22 09:19:16 mgr0 conmon[35287]: cherrypy._cperror.HTTPError: (415, 'Unable to find version in request header')

Fix:

Disable versioning:
@Endpoint('POST', path="", version=None)


Related issues

Related to Dashboard - Bug #51360: mgr/dashboard: fix POST alerts request Rejected
Copied to Dashboard - Backport #51326: pacific: mgr/dashboard: Alertmanager fails to POST alerts Resolved

History

#1 Updated by Avan Thakkar almost 3 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 41974

#2 Updated by Ernesto Puerta almost 3 years ago

  • Status changed from Fix Under Review to Pending Backport

#3 Updated by Backport Bot almost 3 years ago

  • Copied to Backport #51326: pacific: mgr/dashboard: Alertmanager fails to POST alerts added

#4 Updated by Ernesto Puerta almost 3 years ago

  • Status changed from Pending Backport to Resolved

#5 Updated by Avan Thakkar almost 3 years ago

  • Related to Bug #51360: mgr/dashboard: fix POST alerts request added

Also available in: Atom PDF