Bug #61844
mgr/dashboard: dashboard thread abort
% Done:
0%
Source:
Community (dev)
Tags:
Backport:
reef,quincy,pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Description
Description of problem¶
-5> 2023-06-28T07:34:54.383+0000 7fc3e33e4700 0 [dashboard DEBUG auth] checking authorization... -4> 2023-06-28T07:34:54.383+0000 7fc3e33e4700 0 [dashboard DEBUG auth] checking '['read']' access to 'cephfs' scope -3> 2023-06-28T07:34:54.384+0000 7fc5591c8700 0 [dashboard DEBUG viewcache] starting execution of <function CephFSClients.get at 0x7fc78d7a5ae8> 0> 2023-06-28T07:34:54.386+0000 7fc5591c8700 -1 *** Caught signal (Aborted) ** in thread 7fc5591c8700 thread_name:dashboard ceph version 16.2.13 (4165348e9832868203044cb5561f34995fe29e82) pacific (stable) 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc7a5672cf0] 2: gsignal() 3: abort() 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fc7a4a7109b] 5: /lib64/libstdc++.so.6(+0x9653c) [0x7fc7a4a7753c] 6: /lib64/libstdc++.so.6(+0x96597) [0x7fc7a4a77597] 7: /lib64/libstdc++.so.6(+0x967f8) [0x7fc7a4a777f8] 8: /lib64/libstdc++.so.6(+0x9204b) [0x7fc7a4a7304b] 9: (Client::resolve_mds(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<mds_gid_t, std::allocator<mds_gid_t> >*)+0x1413) [0x55a5dc096453] 10: (Client::mds_command(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, ceph::buffer::v15_2_0::list const&, ceph::buffer::v15_2_0::list*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*, Context*)+0x111) [0x55a5dc09a041] 11: ceph-mgr(+0x1c936a) [0x55a5dbee736a] 12: /lib64/libpython3.6m.so.1.0(+0x19d0d7) [0x7fc7af85b0d7] 13: _PyEval_EvalFrameDefault() 14: /lib64/libpython3.6m.so.1.0(+0xf9984) [0x7fc7af7b7984] 15: /lib64/libpython3.6m.so.1.0(+0x17a030) [0x7fc7af838030] 16: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377] 17: _PyEval_EvalFrameDefault() 18: /lib64/libpython3.6m.so.1.0(+0xf9984) [0x7fc7af7b7984] 19: /lib64/libpython3.6m.so.1.0(+0x17a030) [0x7fc7af838030] 20: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377] 21: _PyEval_EvalFrameDefault() 22: /lib64/libpython3.6m.so.1.0(+0xf9984) [0x7fc7af7b7984] 23: /lib64/libpython3.6m.so.1.0(+0x19c14f) [0x7fc7af85a14f] 24: PyObject_Call() 25: _PyEval_EvalFrameDefault() 26: /lib64/libpython3.6m.so.1.0(+0x179e48) [0x7fc7af837e48] 27: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377] 28: _PyEval_EvalFrameDefault() 29: /lib64/libpython3.6m.so.1.0(+0x179e48) [0x7fc7af837e48] 30: /lib64/libpython3.6m.so.1.0(+0x19d377) [0x7fc7af85b377] 31: _PyEval_EvalFrameDefault() 32: _PyFunction_FastCallDict() 33: _PyObject_FastCallDict() 34: /lib64/libpython3.6m.so.1.0(+0x10db30) [0x7fc7af7cbb30] 35: PyObject_Call() 36: /lib64/libpython3.6m.so.1.0(+0x20e012) [0x7fc7af8cc012] 37: /lib64/libpython3.6m.so.1.0(+0x1b44c4) [0x7fc7af8724c4] 38: /lib64/libpthread.so.0(+0x81ca) [0x7fc7a56681ca] 39: clone() NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Environment¶
ceph version
string:- Platform (OS/distro/release):
- Cluster details (nodes, monitors, OSDs):
- Did it happen on a stable environment or after a migration/upgrade?:
- Browser used (e.g.:
Version 86.0.4240.198 (Official Build) (64-bit)
):
"ceph_version": "16.2.13"
"utsname_sysname": "Linux",
"utsname_release": "5.4.56.bsk.9-amd64",
"utsname_version": "#5.4.56.bsk.9 SMP Debian 5.4.56.bsk.9 Wed Aug 25 03:42:38 UTC 20",
"utsname_machine": "x86_64",
"os_name": "CentOS Stream",
"os_id": "centos",
"os_version_id": "8",
"os_version": "8",
h3. How reproducible
Steps:
1. ceph fs fail <fs name>
2. call restful api
curl "http://172.18.237.22:8080/ceph-dashboard/api/cephfs/6/clients" -H "Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJjZXBoLWRhc2hib2FyZCIsImp0aSI6IjE4NDFhZDEyLTIzNDItNGE4Yi04YzUzLTJjOTBhNmEyM2M1OSIsImV4cCI6MTY4Nzk2NDIzNSwiaWF0IjoxNjg3OTM1NDM1LCJ1c2VybmFtZSI6ImFkbWluIn0.KtIBZ6phAW7WoeyrQ3ZAiMk9pGBBuVXtD_W7Mb2gwtM" -H "Accept: application/vnd.ceph.api.v1.0+json"
3. mgr crash
Actual results¶
mgr crash
Expected results¶
mgr will not crash
Additional info¶
History
#1 Updated by yite gu 5 months ago
curl "http://172.18.237.22:8080/ceph-dashboard/api/cephfs/6/clients" -H "Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJjZXBoLWRhc2hib2FyZCIsImp0aSI6IjE4NDFhZDEyLTIzNDItNGE4Yi04YzUzLTJjOTBhNmEyM2M1OSIsImV4cCI6MTY4Nzk2NDIzNSwiaWF0IjoxNjg3OTM1NDM1LCJ1c2VybmFtZSI6ImFkbWluIn0.KtIBZ6phAW7WoeyrQ3ZAiMk9pGBBuVXtD_W7Mb2gwtM" -H "Accept: application/vnd.ceph.api.v1.0+json" curl: (52) Empty reply from server
#3 Updated by Patrick Donnelly 5 months ago
- Status changed from New to Fix Under Review
- Assignee set to yite gu
- Target version set to v19.0.0
- Source set to Community (dev)
- Backport set to reef,quincy,pacific
- Pull request ID set to 52258