Project

General

Profile

Bug #45628

cephadm qa: smoke should verify daemons are actually running

Added by Sebastian Wagner 5 months ago. Updated 3 months ago.

Status:
New
Priority:
High
Assignee:
-
Category:
teuthology
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
low-hanging-fruit
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

RGW failed:

2020-05-20T13:08:09.186 INFO:teuthology.orchestra.run.smithi203.stdout:NAME              HOST       STATUS          REFRESHED  AGE   VERSION                   IMAGE NAME                                                     IMAGE ID      CONTAINER ID
2020-05-20T13:08:09.186 INFO:teuthology.orchestra.run.smithi203.stdout:alertmanager.a    smithi203  running (47s)   33s ago    75s   0.20.0                    docker.io/prom/alertmanager:latest                             0881eb8f169f  9bcf1765c9f6
2020-05-20T13:08:09.187 INFO:teuthology.orchestra.run.smithi203.stdout:grafana.a         smithi060  running (58s)   31s ago    58s   6.6.2                     docker.io/ceph/ceph-grafana:latest                             87a51ecf0b1c  8731e3e51a0c
2020-05-20T13:08:09.187 INFO:teuthology.orchestra.run.smithi203.stdout:mgr.x             smithi060  running (4m)    31s ago    4m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  1cd43976a17e
2020-05-20T13:08:09.187 INFO:teuthology.orchestra.run.smithi203.stdout:mgr.y             smithi203  running (5m)    33s ago    5m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  678f88e3c420
2020-05-20T13:08:09.187 INFO:teuthology.orchestra.run.smithi203.stdout:mon.a             smithi203  running (5m)    33s ago    6m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  68e1b9162747
2020-05-20T13:08:09.187 INFO:teuthology.orchestra.run.smithi203.stdout:mon.b             smithi060  running (4m)    31s ago    4m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  d1383c8a0cf6
2020-05-20T13:08:09.188 INFO:teuthology.orchestra.run.smithi203.stdout:mon.c             smithi203  running (4m)    33s ago    4m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  27a1a4d7af30
2020-05-20T13:08:09.188 INFO:teuthology.orchestra.run.smithi203.stdout:node-exporter.a   smithi203  running (80s)   33s ago    85s   0.18.1                    docker.io/prom/node-exporter:latest                            e5a616e4b9cf  e725ba55bfd7
2020-05-20T13:08:09.188 INFO:teuthology.orchestra.run.smithi203.stdout:node-exporter.b   smithi060  running (82s)   31s ago    86s   0.18.1                    docker.io/prom/node-exporter:latest                            e5a616e4b9cf  da71c458ed71
2020-05-20T13:08:09.188 INFO:teuthology.orchestra.run.smithi203.stdout:osd.0             smithi203  running (3m)    33s ago    3m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  fbd8df58b740
2020-05-20T13:08:09.188 INFO:teuthology.orchestra.run.smithi203.stdout:osd.1             smithi203  running (3m)    33s ago    3m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  f82a0984e8cb
2020-05-20T13:08:09.188 INFO:teuthology.orchestra.run.smithi203.stdout:osd.2             smithi203  running (3m)    33s ago    3m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  885fb5dfd287
2020-05-20T13:08:09.189 INFO:teuthology.orchestra.run.smithi203.stdout:osd.3             smithi203  running (2m)    33s ago    2m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  4e6e5b008f2e
2020-05-20T13:08:09.189 INFO:teuthology.orchestra.run.smithi203.stdout:osd.4             smithi060  running (2m)    31s ago    2m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  f1714bd9a240
2020-05-20T13:08:09.189 INFO:teuthology.orchestra.run.smithi203.stdout:osd.5             smithi060  running (2m)    31s ago    2m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  e00f2801348c
2020-05-20T13:08:09.189 INFO:teuthology.orchestra.run.smithi203.stdout:osd.6             smithi060  running (2m)    31s ago    2m    16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  73b01fddb7dd
2020-05-20T13:08:09.189 INFO:teuthology.orchestra.run.smithi203.stdout:osd.7             smithi060  running (107s)  31s ago    110s  16.0.0-1734-gc1cc5045b00  quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  06207838c6be  cebb5c6bf000
2020-05-20T13:08:09.190 INFO:teuthology.orchestra.run.smithi203.stdout:prometheus.a      smithi060  running (42s)   31s ago    88s   2.18.1                    docker.io/prom/prometheus:latest                               de242295e225  34d837c4f530
2020-05-20T13:08:09.190 INFO:teuthology.orchestra.run.smithi203.stdout:rgw.realm.zone.a  smithi203  unknown         33s ago    102s  <unknown>                 quay.io/ceph-ci/ceph:c1cc5045b00842201e98ed965e87b16c8b2acec8  <unknown>     <unknown>

still the job succeeded:

http://pulpito.ceph.com/swagner-2020-05-20_12:38:40-rados:cephadm-wip-swagner3-testing-2020-05-20-1009-distro-basic-smithi/5072816/

History

#1 Updated by Sebastian Wagner 5 months ago

  • Description updated (diff)

#2 Updated by Sebastian Wagner 4 months ago

I think we should solve this by creating a HEALTH_WARN, if a daemon enters

error

state

#3 Updated by Sebastian Wagner 3 months ago

  • Category changed from cephadm to teuthology

Also available in: Atom PDF