Project

General

Profile

Actions

Bug #64028

open

Ceph dasbboard shows RGW REST API failed request with status code 403 (InvalidAccessKeyId)

Added by Morteza Bashsiz 4 months ago. Updated 4 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

After upgrading ceph to 18.2.0 we faced with this issue https://tracker.ceph.com/issues/63698
Now after upgrading to 18.2.1 Object Gateway part of the ceph dashboard is not working and show error

Error connecting to Object Gateway: RGW REST API failed request with status code 403 (b'{"Code":"InvalidAccessKeyId","Message":"","RequestId":"tx00000da77a9856259c1' b'ab-0065a52386-1ed8cf0-host","HostId":"host"}')
[~]>$ ceph dashboard get-rgw-api-secret-key
{'realm': 'secret-key-string-sssssssssssssssssssssssss'}

[~]>$ ceph dashboard get-rgw-api-access-key
{'realm': 'access-key-string-aaaaaaaaaaa'}

[~]>$ ceph dashboard get-rgw-api-ssl-verify 
False

[~]>$ radosgw-admin user info --uid dashboard
{
    "user_id": "dashboard",
    "display_name": "Ceph Dashboard",
    "email": "",
    "suspended": 0,
    "max_buckets": 1000,
    "subusers": [],
    "keys": [
        {
            "user": "dashboard",
            "access_key": "access-key-string-aaaaaaaaaaa",
            "secret_key": "secret-key-string-sssssssssssssssssssssssss" 
        }
    ],
    "swift_keys": [],
    "caps": [],
    "op_mask": "read, write, delete",
    "system": true,
    "default_placement": "",
    "default_storage_class": "",
    "placement_tags": [],
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "user_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "temp_url_keys": [],
    "type": "rgw",
    "mfa_ids": []
}

ceph-mgr log

[dashboard ERROR rest_client] RGW REST API failed GET req status: 403
[dashboard ERROR rgw_client] RGW REST API failed request with status code 403
     (b'{"Code":"InvalidAccessKeyId","Message":"","RequestId":"tx00000da77a9856259c1'
      b'ab-0065a52386-1ed8cf0-host1","HostId":"1ed8cf0-host1-host"}')
     Traceback (most recent call last):
       File "/usr/share/ceph/mgr/dashboard/services/rgw_client.py", line 431, in __init__
         self.userid = self._get_user_id(self.admin_path) if self.got_keys_from_config \
       File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 542, in func_wrapper
         **kwargs)
       File "/usr/share/ceph/mgr/dashboard/services/rgw_client.py", line 466, in _get_user_id
         response = request()
       File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 325, in __call__
         data, raw_content, headers)
       File "/usr/share/ceph/mgr/dashboard/rest_client.py", line 428, in do_request
         resp.content)
     dashboard.rest_client.RequestException: RGW REST API failed request with status code 403
     (b'{"Code":"InvalidAccessKeyId","Message":"","RequestId":"tx00000da77a9856259c1'
      b'ab-0065a52386-1ed8cf0-host1","HostId":"1ed8cf0-host1-host"}')

rgw log

====== starting new request req=0x7fcf96400660 =====
req 9769990003208590416 0.000000000s s3:get_obj No stored secret string, cache miss
req 9769990003208590416 0.019999748s s3:get_obj No stored secret string, cache miss
req 9769990003208590416 0.043999448s op->ERRORHANDLER: err_no=-2028 new_err_no=-2028
====== req done req=0x7fcf96400660 op status=0 http_status=403 latency=0.043999448s ======

Actions

Also available in: Atom PDF