Project

General

Profile

Actions

Bug #41335

open

mgr/dashboard: Ceph Dashboard RGW Object Management Frontend - Unable to list Daemons/Users/Buckets

Added by sam samc over 4 years ago. Updated about 3 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Component - RGW
Target version:
-
% Done:

0%

Source:
Tags:
dashboard/rgw
Backport:
nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Trying to follow the instructions here:-
https://docs.ceph.com/docs/nautilus/mgr/dashboard/#enabling-the-object-gateway-management-frontend

Setting the following parameters:
radosgw-admin user info --uid="ceph_dashboard_user"
ceph dashboard set-rgw-api-access-key XXXXXXXXXXX
ceph dashboard set-rgw-api-secret-key XXXXXXXXXXX
ceph dashboard set-rgw-api-port 7980
ceph dashboard set-rgw-api-admin-resource admin
ceph dashboard set-rgw-api-user-id ceph_dashboard_user

ceph mgr module disable dashboard
ceph mgr module enable dashboard

Results in the following in /var/log/ceph/ceph-mgr.$HOST.log
2019-08-19 11:48:52.919 7f683c9b8700 0 mgr[dashboard] RGW REST API failed GET, connection error: [errno: -3] Temporary failure in name resolution

This never resolves/changes

Using other available options/parameters does not change the situation:

We have a set up of 9 RGW daemons, 3 serving SWIFT API, 6 serving S3 API - These are all functioning correctly:

root@ceph-mon0:~# ceph -s
...
services:
mon: 3 daemons, quorum ceph-mon0,ceph-mon2,ceph-mon1 (age 3d)
mgr: ceph-mon0(active, since 25m), standbys: ceph-mon1, ceph-mon2
osd: 78 osds: 78 up (since 6d), 78 in
rgw: 9 daemons active (ceph-rgw0.rgw0, ceph-rgw1.rgw0, ceph-rgw2.rgw0, rgw101.rgw0, rgw102.rgw0, rgw201.rgw0, rgw202.rgw0, rgw301.rgw0, rgw302.rgw0)
...

Is this a configuration we should expect to work?

Actions #1

Updated by Patrick Donnelly over 4 years ago

  • Project changed from Ceph to mgr
  • Subject changed from Ceph Dashboard RGW Object Management Frontend - Unable to list Daemons/Users/Buckets to mgr/dashboard: Ceph Dashboard RGW Object Management Frontend - Unable to list Daemons/Users/Buckets
  • Category deleted (common)
  • Target version deleted (v14.2.2)
  • Start date deleted (08/19/2019)
  • Backport set to nautilus
Actions #2

Updated by Kiefer Chang over 4 years ago

Hi, Thanks for reporting an issue. Can you provide more information about the problem?

  • What version of Ceph are you running?
  • Can you resolve RGW hostnames on active MGR node?
  • Can't you even see the Object Gateways -> Daemons page? Any error pop-up on the page?
Actions #3

Updated by sam samc over 4 years ago

Hi,

Were Running Ceph Nautilus 14.2.2, deployed using ceph-ansible.

Yes all 9 RGW instance hostnames are resolvable from active MGR node (3 serve SWIFT API, 6 serve S3 API)

Dashboard > Object > Gateways > Daemons; shows a blue information dialogue :-
"RGW REST API cannot be reached: Temporary failure in name resolution [errno -3]. Please check your configuration and that the API endpoint is accessible
Please consult the documentation on how to configure and enable the Object Gateway management functionality."

Results in following message in /var/log/ceph/ceph-mgr.$HOST.log:
2019-08-20 09:26:24.837 7f68389b0700 0 mgr[dashboard] RGW REST API failed GET, connection error: [errno: -3] Temporary failure in name resolution

Please let me know if you need further info or log output, thanks.

Actions #4

Updated by Sebastian Wagner over 4 years ago

  • Category set to 143
Actions #5

Updated by sam samc over 4 years ago

Hi some further log output I noticed - I have not seen this message again since disabling/re-enabling the dashboard module.

From /var/log/ceph/ceph-mgr.$HOST.log:

2019-08-15 13:01:26.592 7fca374e0700  0 mgr[dashboard] [15/Aug/2019:13:01:26] HTTP 
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/cherrypy/_cprequest.py", line 670, in respond
    response.body = self.handler()
  File "/usr/lib/python2.7/dist-packages/cherrypy/lib/encoding.py", line 220, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/cherrypy/_cptools.py", line 237, in wrap
    return self.newhandler(innerfunc, *args, **kwargs)
  File "/usr/share/ceph/mgr/dashboard/services/exception.py", line 88, in dashboard_exception_handler
    return handler(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/cherrypy/_cpdispatch.py", line 60, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/usr/share/ceph/mgr/dashboard/controllers/__init__.py", line 649, in inner
    ret = func(*args, **kwargs)
  File "/usr/share/ceph/mgr/dashboard/controllers/rgw.py", line 28, in status
    if not instance.is_service_online():
  File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 507, in func_wrapper
    **kwargs)
  File "/usr/share/ceph/mgr/dashboard/services/rgw_client.py", line 304, in is_service_online
    _ = request({'format': 'json'})
  File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 313, in __call__
    data, raw_content)
  File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 445, in do_request
    ex.args[0].reason.args[0])
  File "/usr/lib/python2.7/re.py", line 141, in match
    return _compile(pattern, flags).match(string)
TypeError: expected string or buffer
2019-08-15 13:01:26.592 7fca374e0700  0 mgr[dashboard] [::ffff:10.31.129.22:52508] [GET] [500] [15.020s] [admin] [1.7K] /api/rgw/status

Notice the mashed up ipv4/ipv6 addresses after the stack trace.

After re-enabling dashboard the only log message seen is as per last post

2019-08-20 09:26:24.837 7f68389b0700 0 mgr[dashboard] RGW REST API failed GET, connection error: [errno: -3] Temporary failure in name resolution

Actions #6

Updated by Ernesto Puerta about 3 years ago

  • Project changed from mgr to Dashboard
  • Category changed from 143 to Component - RGW
Actions

Also available in: Atom PDF