Project

General

Profile

Feature #50491

mgr/dashboard: centralized logging

Added by Ernesto Puerta over 2 years ago. Updated about 1 year ago.

Status:
Pending Backport
Priority:
Normal
Category:
Monitoring
Target version:
% Done:

0%

Source:
Tags:
backport_processed
Backport:
quincy pacific
Reviewed:
Affected Versions:
Pull request ID:

Description

User Story

As a Ceph operator I want to have a unified view of the logs from the different daemons, so that:
  • I can perform a backward/post-mortem analysis of events leading to an issue,
  • I can monitor cluster events in real-time.

Persona

  • Ceph cluster operator/sys admin
  • Support engineer
  • Developers

Context

Every daemon in Ceph stores its logs locally (there's a "cluster log" but it's extremely concise, and not useful for troubleshooting). This means that if a user wants to perform a post-mortem analysis of an issue, they have first to collect log traces from multiple hosts, which involves to:
  1. Identify on which host a daemon is running,
  2. Log in to that host,
  3. Look for the log file in the filesystem,
  4. Open the log and perform a search.

For debugging a Ceph issue, users often have to follow the operational events from multiple daemons, so this tasks gets more and more complicated. Additionally, it's almost impossible to perform real-time (vs. post-mortem) troubleshooting.

Implementation details

To explore multiple stacks: ELK, Fluentd, Loki, etc.

This might be embedded via iframe as already done for Grafana dashboards, or accessed stand-alone.

References

SUSE's Ceph + ELK


Related issues

Copied to Dashboard - Backport #54582: pacific: mgr/dashboard: centralized logging New
Copied to Dashboard - Backport #54583: quincy: mgr/dashboard: centralized logging Resolved

History

#1 Updated by Ernesto Puerta almost 2 years ago

  • Description updated (diff)

#2 Updated by Aashish Sharma over 1 year ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 44751

#3 Updated by Ernesto Puerta over 1 year ago

  • Description updated (diff)

#4 Updated by Ernesto Puerta over 1 year ago

  • Description updated (diff)

#5 Updated by Ernesto Puerta over 1 year ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport set to quincy pacific

#6 Updated by Backport Bot over 1 year ago

  • Copied to Backport #54582: pacific: mgr/dashboard: centralized logging added

#7 Updated by Backport Bot over 1 year ago

  • Copied to Backport #54583: quincy: mgr/dashboard: centralized logging added

#8 Updated by Backport Bot about 1 year ago

  • Tags set to backport_processed

Also available in: Atom PDF