Bug #41758: Ceph status in some cases does not report slow ops - RADOS - Ceph

Actions

Copy link

Bug #41758

closed

Ceph status in some cases does not report slow ops

Added by Sridhar Seshasayee over 4 years ago. Updated over 4 years ago.

Status:

Duplicate

Priority:

High

Assignee:

Sridhar Seshasayee

Category:

Administration/Usability

Target version:

% Done:

Source:

Development

Tags:

Backport:

mimic,nautilus

Regression:

Severity:

2 - major

Reviewed:

Affected Versions:

ceph-qa-suite:

Component(RADOS):

Monitor, OSD

Pull request ID:

30337

Crash signature (v1):

Crash signature (v2):

Description

In cases when only osds report slow ops, it is observed that ceph summary status doesn't report the same. This issue was reported on mimic #40993 and upon further investigation the same issue was also seen to be present on the master. This tracker will be used to track the fix on the master and then back-ported to all appropriate downstream branches where the issue is present.

Related issues 2 (0 open — 2 closed)

Actions

Copy link

Updated by Sridhar Seshasayee over 4 years ago

Related to Backport #40993: mimic: Ceph status in some cases does not report slow ops added

Actions

Copy link

Updated by Sridhar Seshasayee over 4 years ago

Pull request ID set to 30337

PR https://github.com/ceph/ceph/pull/30337 addresses this issue.

Actions

Copy link

Updated by Sridhar Seshasayee over 4 years ago

After applying the fix, health warning pertaining to slow ops show up as shown below,

$ bin/ceph -s
*** DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH ***
2019-09-11T16:53:32.198+0530 7f65a12c1700 -1 WARNING: all dangerous and experimental features are enabled.
2019-09-11T16:53:32.217+0530 7f65a12c1700 -1 WARNING: all dangerous and experimental features are enabled.
  cluster:
    id:     e093c322-66ca-4a6c-b4e2-19b8c373472d
    health: HEALTH_WARN
            55 slow ops, oldest one blocked for 5 sec, daemons [osd,0,osd,1,osd,2,mon,a,mon,b,mon,c] have slow ops.

  services:
    mon: 3 daemons, quorum a,b,c (age 2m)
    mgr: x(active, since 2m)
    mds: a:1 {0=a=up:active} 2 up:standby
    osd: 3 osds: 3 up (since 66s), 3 in (since 66s)

  task status:
    scrub status:
        mds.0: idle

  data:
    pools:   3 pools, 34 pgs
    objects: 2.38k objects, 1.2 MiB
    usage:   6.1 GiB used, 3.0 TiB / 3.0 TiB avail
    pgs:     34 active+clean

  io:
    client:   103 KiB/s wr, 0 op/s rd, 103 op/s wr

Actions

Copy link