Project

General

Profile

Actions

Bug #61256

open

Upgrade test fails after prometheus_receiver connection is refused

Added by Laura Flores 11 months ago. Updated 11 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Description: rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}}
/a/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271256

2023-05-12T07:08:06.778 INFO:journalctl@ceph.alertmanager.a.smithi023.stdout:May 12 07:08:06 smithi023 ceph-6f431edc-f031-11ed-9b02-001a4aab830c-alertmanager-a[145467]: level=error ts=2023-05-12T07:08:06.500Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi155.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.155:8443: connect: connection refused" 
2023-05-12T07:08:06.778 INFO:journalctl@ceph.alertmanager.a.smithi023.stdout:May 12 07:08:06 smithi023 ceph-6f431edc-f031-11ed-9b02-001a4aab830c-alertmanager-a[145467]: level=warn ts=2023-05-12T07:08:06.501Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi155.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.155:8443: connect: connection refused" 

Actions #1

Updated by Laura Flores 11 months ago

/a/yuriw-2023-05-11_15:01:38-rados-wip-yuri8-testing-2023-05-10-1402-distro-default-smithi/7271101

Actions #2

Updated by Laura Flores 11 months ago

/a/yuriw-2023-05-19_19:19:25-rados-wip-yuri11-testing-2023-05-19-0836-distro-default-smithi/7279401
/a/yuriw-2023-05-19_19:19:25-rados-wip-yuri11-testing-2023-05-19-0836-distro-default-smithi/7279246

Actions

Also available in: Atom PDF