Project

General

Profile

Actions

Bug #61844

open

mgr/dashboard: dashboard thread abort

Added by yite gu 11 months ago. Updated 2 months ago.

Status:
Pending Backport
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
Community (dev)
Tags:
backport_processed
Backport:
reef,quincy,squid
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Description of problem

    -5> 2023-06-28T07:34:54.383+0000 7fc3e33e4700  0 [dashboard DEBUG auth] checking authorization...
    -4> 2023-06-28T07:34:54.383+0000 7fc3e33e4700  0 [dashboard DEBUG auth] checking '['read']' access to 'cephfs' scope
    -3> 2023-06-28T07:34:54.384+0000 7fc5591c8700  0 [dashboard DEBUG viewcache] starting execution of <function CephFSClients.get at 0x7fc78d7a5ae8>
     0> 2023-06-28T07:34:54.386+0000 7fc5591c8700 -1 *** Caught signal (Aborted) **
 in thread 7fc5591c8700 thread_name:dashboard

 ceph version 16.2.13 (4165348e9832868203044cb5561f34995fe29e82) pacific (stable)
 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc7a5672cf0]
 2: gsignal()
 3: abort()
 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fc7a4a7109b]
 5: /lib64/libstdc++.so.6(+0x9653c) [0x7fc7a4a7753c]
 6: /lib64/libstdc++.so.6(+0x96597) [0x7fc7a4a77597]
 7: /lib64/libstdc++.so.6(+0x967f8) [0x7fc7a4a777f8]
 8: /lib64/libstdc++.so.6(+0x9204b) [0x7fc7a4a7304b]
 9: (Client::resolve_mds(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<mds_gid_t, std::allocator<mds_gid_t> >*)+0x1413) [0x55a5dc096453]
 10: (Client::mds_command(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, ceph::buffer::v15_2_0::list const&, ceph::buffer::v15_2_0::list*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*, Context*)+0x111) [0x55a5dc09a041]
 11: ceph-mgr(+0x1c936a) [0x55a5dbee736a]
 12: /lib64/libpython3.6m.so.1.0(+0x19d0d7) [0x7fc7af85b0d7]
 13: _PyEval_EvalFrameDefault()
 14: /lib64/libpython3.6m.so.1.0(+0xf9984) [0x7fc7af7b7984]
 15: /lib64/libpython3.6m.so.1.0(+0x17a030) [0x7fc7af838030]
 16: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377]
 17: _PyEval_EvalFrameDefault()
 18: /lib64/libpython3.6m.so.1.0(+0xf9984) [0x7fc7af7b7984]
 19: /lib64/libpython3.6m.so.1.0(+0x17a030) [0x7fc7af838030]
 20: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377]
 21: _PyEval_EvalFrameDefault()
 22: /lib64/libpython3.6m.so.1.0(+0xf9984) [0x7fc7af7b7984]
 23: /lib64/libpython3.6m.so.1.0(+0x19c14f) [0x7fc7af85a14f]
 24: PyObject_Call()
 25: _PyEval_EvalFrameDefault()
 26: /lib64/libpython3.6m.so.1.0(+0x179e48) [0x7fc7af837e48]
 27: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377]
 28: _PyEval_EvalFrameDefault()
 29: /lib64/libpython3.6m.so.1.0(+0x179e48) [0x7fc7af837e48]
 30: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377]
 31: _PyEval_EvalFrameDefault()
 32: _PyFunction_FastCallDict()
 33: _PyObject_FastCallDict()
 34: /lib64/libpython3.6m.so.1.0(+0x10db30) [0x7fc7af7cbb30]
 35: PyObject_Call()
 36: /lib64/libpython3.6m.so.1.0(+0x20e012) [0x7fc7af8cc012]
 37: /lib64/libpython3.6m.so.1.0(+0x1b44c4) [0x7fc7af8724c4]
 38: /lib64/libpthread.so.0(+0x81ca) [0x7fc7a56681ca]
 39: clone()
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

Environment

  • ceph version string:
  • Platform (OS/distro/release):
  • Cluster details (nodes, monitors, OSDs):
  • Did it happen on a stable environment or after a migration/upgrade?:
  • Browser used (e.g.: Version 86.0.4240.198 (Official Build) (64-bit)):
    "ceph_version": "16.2.13"
    "utsname_sysname": "Linux",
    "utsname_release": "5.4.56.bsk.9-amd64",
    "utsname_version": "#5.4.56.bsk.9 SMP Debian 5.4.56.bsk.9 Wed Aug 25 03:42:38 UTC 20",
    "utsname_machine": "x86_64",
    "os_name": "CentOS Stream",
    "os_id": "centos",
    "os_version_id": "8",
    "os_version": "8",
    h3. How reproducible

Steps:
1. ceph fs fail <fs name>
2. call restful api

curl  "http://172.18.237.22:8080/ceph-dashboard/api/cephfs/6/clients" -H  "Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJjZXBoLWRhc2hib2FyZCIsImp0aSI6IjE4NDFhZDEyLTIzNDItNGE4Yi04YzUzLTJjOTBhNmEyM2M1OSIsImV4cCI6MTY4Nzk2NDIzNSwiaWF0IjoxNjg3OTM1NDM1LCJ1c2VybmFtZSI6ImFkbWluIn0.KtIBZ6phAW7WoeyrQ3ZAiMk9pGBBuVXtD_W7Mb2gwtM" -H  "Accept: application/vnd.ceph.api.v1.0+json" 

3. mgr crash

Actual results

mgr crash

Expected results

mgr will not crash

Additional info


Related issues 3 (3 open0 closed)

Copied to Dashboard - Backport #64604: reef: mgr/dashboard: dashboard thread abortNewActions
Copied to Dashboard - Backport #64605: quincy: mgr/dashboard: dashboard thread abortNewActions
Copied to Dashboard - Backport #64606: squid: mgr/dashboard: dashboard thread abortNewActions
Actions #1

Updated by yite gu 11 months ago

curl  "http://172.18.237.22:8080/ceph-dashboard/api/cephfs/6/clients" -H  "Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJjZXBoLWRhc2hib2FyZCIsImp0aSI6IjE4NDFhZDEyLTIzNDItNGE4Yi04YzUzLTJjOTBhNmEyM2M1OSIsImV4cCI6MTY4Nzk2NDIzNSwiaWF0IjoxNjg3OTM1NDM1LCJ1c2VybmFtZSI6ImFkbWluIn0.KtIBZ6phAW7WoeyrQ3ZAiMk9pGBBuVXtD_W7Mb2gwtM" -H  "Accept: application/vnd.ceph.api.v1.0+json" 
curl: (52) Empty reply from server
Actions #3

Updated by Patrick Donnelly 10 months ago

  • Status changed from New to Fix Under Review
  • Assignee set to yite gu
  • Target version set to v19.0.0
  • Source set to Community (dev)
  • Backport set to reef,quincy,pacific
  • Pull request ID set to 52258
Actions #4

Updated by Venky Shankar 2 months ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from reef,quincy,pacific to reef,quincy,squid
Actions #5

Updated by Backport Bot 2 months ago

  • Copied to Backport #64604: reef: mgr/dashboard: dashboard thread abort added
Actions #6

Updated by Backport Bot 2 months ago

  • Copied to Backport #64605: quincy: mgr/dashboard: dashboard thread abort added
Actions #7

Updated by Backport Bot 2 months ago

  • Copied to Backport #64606: squid: mgr/dashboard: dashboard thread abort added
Actions #8

Updated by Backport Bot 2 months ago

  • Tags set to backport_processed
Actions

Also available in: Atom PDF