Project

General

Profile

Bug #53591

mgr/dashboard: NaN Undefined - Pools Read_ops and Write_ops

Added by A. Saber Shenouda over 2 years ago. Updated 2 months ago.

Status:
Triaged
Priority:
Normal
Category:
Component - Pools
Target version:
% Done:

0%

Source:
Community (user)
Tags:
Backport:
pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Description of problem

here

Environment

  • ceph version string: 16.2.7
  • Platform (OS/distro/release): Ubuntu
  • Cluster details (nodes, monitors, OSDs): 3x mons, 35 nodes
  • Browser used (e.g.: Version 86.0.4240.198 (Official Build) (64-bit)): Firefox 95.0

How reproducible
Dashboard -> Pools

A pool will stay read_ops and write_ops: NaN undefined /s (and there IS activity!)

here

Actual results

Expected to read_ops and write_ops data

Please add logs and/or screenshots

View attached screenshot

Screen Shot 2021-12-12 at 9.50.08 PM.png View (28.6 KB) A. Saber Shenouda, 12/13/2021 02:51 AM

pool.png View (114 KB) Ernesto Puerta, 12/23/2021 04:14 PM

History

#1 Updated by Neha Ojha over 2 years ago

  • Project changed from mgr to Dashboard

#2 Updated by Alfonso Martínez over 2 years ago

Hi A. Saber Shenouda,

Can you provide mgr logs, actions/steps performed for read/write activity in the pool?

The aim is to be able to reproduce the bug (currently not reproducible in my local environment).

Thanks in advance.

#3 Updated by Ernesto Puerta over 2 years ago

It'd be very useful if you could open the "Developer Tools" (CTRL+SHIFT+I in Firefox or Chrome) in your browser, click on "Network tab" and look for a request to the /pool?stats=true endpoint (please see the attached screenshot). You should see the JSON payload of the request as a clickable tree. The key information is under 0 > stats > wr > rate and 0 > stats > rd > rate (please replace the first "0" with the number of the pool where this is happening):

Thanks!

#4 Updated by Ernesto Puerta over 2 years ago

  • Category set to Component - Pools
  • Status changed from New to Triaged
  • Assignee set to Alfonso Martínez
  • Target version set to v17.0.0
  • Source set to Community (user)
  • Backport set to pacific
  • Affected Versions v16.2.7 added

#5 Updated by Lukasz Engel 2 months ago

I observe similar behavior on ceph 17.2.5 - it looks like ALL values for "read ops" and "write ops" greater than 999/s are presented as "NaN Undefined/s" (I have never seen value for ops/s >= 1000 there, but smaller values are presented correctly). Problem is 100% reproducible both in firefox and chrome/chromium browsers. (I don't know if it's important - I use non-english (Polish) browsers localization).
When I clicked-down data returned by "/pool?stats=true" request mentioned above I see "good looking" values in json data for pool's "rd" or "wr" stats elements (shown as "NaN" in html output page), example below (and rate value is >=1000 in these cases):

    "rd": {
        "latest": 1975201324,
        "rate": 7712.354756671364,
        "rates": [
            [
                1705279470.7706478,
                6452.021273942038
            ],
            [
                1705279475.95219,
                4420.49862782171
            ],
            [
                1705279481.1479256,
                6855.429549301261
            ],
            [
                1705279486.0751393,
                5446.0800370381985
            ],
            [
                1705279491.0149243,
                7520.975097591771
            ],
            [
                1705279496.0664318,
                4557.847360040265
            ],
            [
                1705279500.7962675,
                8538.562890124687
            ],
            [
                1705279505.9070985,
                5153.369361122044
            ],
            [
                1705279511.0821717,
                7712.354756671364
            ]
        ]
    }

(I can copy the whole stats json if it helps)

For me it looks like problem in javascript generating html output from json data..

Also available in: Atom PDF