Project

General

Profile

Actions

Cleanup #45415

closed

mgr/dashboard: test prometheus/alertmanager rules through promtool

Added by Ernesto Puerta about 4 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
High
Category:
Monitoring
Target version:
% Done:

0%

Tags:
Backport:
pacific,octopus,nautilus
Reviewed:
Affected Versions:
Pull request ID:

Description

Given the increasing number of issues found on monitoring, some validation/testing should be put in place to avoid manual/integration testing.

Fortunately Prometheus Alertmanager offers a tool (promtool) for generating fake timeseries and test rules with them: https://prometheus.io/docs/prometheus/latest/configuration/unit_testing_rules/.


Related issues 5 (1 open4 closed)

Related to Dashboard - Bug #45448: mgr/dashboard: automated tests for Prometheus configurationNewPatrick Seidensal

Actions
Related to Ceph - Bug #49695: install-deps: docker-ce, docker-ce-cli, containerd.io not found on f33Closed

Actions
Copied to Dashboard - Backport #49656: nautilus: mgr/dashboard: test prometheus/alertmanager rules through promtoolResolvedAashish SharmaActions
Copied to Dashboard - Backport #49657: octopus: mgr/dashboard: test prometheus/alertmanager rules through promtoolResolvedAashish SharmaActions
Copied to Dashboard - Backport #49658: pacific: mgr/dashboard: test prometheus/alertmanager rules through promtoolResolvedAashish SharmaActions
Actions #1

Updated by Ernesto Puerta about 4 years ago

  • Related to Bug #45448: mgr/dashboard: automated tests for Prometheus configuration added
Actions #2

Updated by Alfonso Martínez about 4 years ago

Alertmanager also has its own tool to check its config:

amtool check-config <config.yml>

Actions #3

Updated by Ernesto Puerta over 3 years ago

  • Tracker changed from Bug to Tasks
Actions #4

Updated by Aashish Sharma over 3 years ago

  • Status changed from New to In Progress
  • Assignee set to Aashish Sharma
  • Pull request ID set to 39246
Actions #5

Updated by Aashish Sharma over 3 years ago

  • Subject changed from mgr/dashboard: run alertmanager rules through promtool to mgr/dashboard: test prometheus/alertmanager rules through promtool
Actions #6

Updated by Patrick Seidensal about 3 years ago

  • Status changed from In Progress to Fix Under Review
Actions #7

Updated by Ernesto Puerta about 3 years ago

  • Tracker changed from Tasks to Cleanup
  • Status changed from Fix Under Review to Pending Backport
  • Backport set to pacific,octopus,nautilus

Given that we currently don't have any kind of testing covering alert rules, I'd suggest to backport this to all the maintained releases.

Actions #8

Updated by Backport Bot about 3 years ago

  • Copied to Backport #49656: nautilus: mgr/dashboard: test prometheus/alertmanager rules through promtool added
Actions #9

Updated by Backport Bot about 3 years ago

  • Copied to Backport #49657: octopus: mgr/dashboard: test prometheus/alertmanager rules through promtool added
Actions #10

Updated by Backport Bot about 3 years ago

  • Copied to Backport #49658: pacific: mgr/dashboard: test prometheus/alertmanager rules through promtool added
Actions #11

Updated by Brad Hubbard about 3 years ago

  • Status changed from Pending Backport to In Progress

Please don't backport this until the problems discussed in the most recent comments of https://github.com/ceph/ceph/pull/39246 have been worked through.

Actions #12

Updated by Brad Hubbard about 3 years ago

  • Related to Bug #49695: install-deps: docker-ce, docker-ce-cli, containerd.io not found on f33 added
Actions #13

Updated by Aashish Sharma about 3 years ago

  • Status changed from In Progress to Pending Backport
Actions #14

Updated by Ernesto Puerta about 3 years ago

  • Project changed from mgr to Dashboard
  • Category changed from 148 to Monitoring
Actions #15

Updated by Ernesto Puerta about 3 years ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF