Ceph » mgr » Dashboard

Tested Dashboard login with Nautilus 14.1.0 (2019-02-22, https://download.ceph.com/rpm-nautilus/el7/x86_64/):

Issue not reproducible (it works as expected).

Can you test this version?

The RGW REST API controller had a problem that might cause this issue. If the RGW Admin OPS API returned an 401 it was directly forwarded to the UI which forces a logout. This has been fixed ages ago with https://github.com/ceph/ceph/commit/ee5c9ad03c9d301d01716e56710fe24a67f0f869. Nowadays all errors raised by the RGW Admin OPS API are returned as 500 (see https://github.com/ceph/ceph/blob/master/src/pybind/mgr/dashboard/controllers/rgw.py#L103).

2019-02-22 13:44:33.919 7fbecd4fe700 0 mgr[dashboard] frontend error (https://192.168.1.142:8443/#/login): Http failure response for https://192.168.1.142:8443/api/summary: 401 Unauthorized

To me it looks like the /api/summary API call is responsible for this. But the controller code itself does not throw exceptions, so it might happen somewhere on the way when the REST call is processed.

Hi Lokesh, something in your report looks incorrect:

Lokesh Pashine wrote:

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-host

cephaio

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-port
8003

cephaio:/var/log/ceph # ceph mgr services {
"dashboard": "https://0.0.0.0:8443/",
"restful": "https://cephaio:8003/"
}

This looks to me as if you've configured the dashboard to talk to the restful module on https://cephaio:8003/ is if it was the RGW API endpoint. Note that the restful module is not needed by the dashboard. If you want to manage RGW via the dashboard, make sure to use the correct hostname/TCP port to talk to the RGW admin ops API.

Lenz Grimmer wrote:

Hi Lokesh, something in your report looks incorrect:

Lokesh Pashine wrote:

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-host

cephaio

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-port
8003

cephaio:/var/log/ceph # ceph mgr services {
"dashboard": "https://0.0.0.0:8443/",
"restful": "https://cephaio:8003/"
}

This looks to me as if you've configured the dashboard to talk to the restful module on https://cephaio:8003/ is if it was the RGW API endpoint. Note that the restful module is not needed by the dashboard. If you want to manage RGW via the dashboard, make sure to use the correct hostname/TCP port to talk to the RGW admin ops API.

==============

Hi Lenz,

I also noticed the configuration missmatch and corrected it already but issue is still the same

cephaio:~ # ceph dashboard get-rgw-api-access-key
35S5T7IHEXPDRGZ012A6
cephaio:~ # ceph dashboard get-rgw-api-secret-key
mKkouV45flvszN5w4z7BAAL6EHO5375HhVQMyWj4
cephaio:~ # ceph dashboard get-rgw-api-host
cephaio
cephaio:~ # ceph dashboard get-rgw-api-port
7480
cephaio:~ # ceph dashboard get-rgw-api-ssl-verify
False
cephaio:~ # ceph dashboard get-rgw-api-user-id
radosadm
cephaio:~ # lsof -i:7480
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
radosgw 1559 ceph 40u IPv4 28900 0t0 TCP *:7480 (LISTEN)
cephaio:~ #

Please suggest what is wrong here and if I have to try upgrading the dashboard package?

! ceph-dashboard-response.jpg!

!"C:\Users\I355971\Desktop\Temp\ceph-dashboard-response.jpg!

Alfonso MH wrote:

Tested Dashboard login with Nautilus 14.1.0 (2019-02-22, https://download.ceph.com/rpm-nautilus/el7/x86_64/):

Issue not reproducible (it works as expected).

Can you test this version?

=========
Hello Alfonso,

DO I need to upgrade all the components or just by upgrading ceph-mgr will do?

DO I need to upgrade all the components or just by upgrading ceph-mgr will do?

As a general rule, always upgrade all components (RPMs, DEBs). As a project, Ceph is rather monolithic and there are many interdependencies between the components.

In this specific case, it's possible the fix is contained within the ceph-mgr-dashboard package, in which case only that package would need to be upgraded.

It looks like i have not only eth, but can i fix it

迁 文 wrote:

It looks like i have not only eth, but how can i fix it

迁 文 wrote:

Lokesh Pashine wrote:

Hello Team,

I have set up the ceph dashboard and its allowing me to login but immediately after login it log me out.

From logs I can see below
2019-02-22 13:44:33.919 7fbecd4fe700 0 mgr[dashboard] frontend error (https://192.168.1.142:8443/#/login): Http failure response for https://192.168.1.142:8443/api/summary: 401 Unauthorized

cephaio:/var/log/ceph # netstat -an| grep 8443
tcp 0 0 0.0.0.0:8443 0.0.0.0:* LISTEN

cephaio:/usr/lib64/ceph/mgr/dashboard # radosgw-admin user info --uid ceph-admin {
"user_id": "ceph-admin",
"display_name": "ceph admin",
"email": "",
"suspended": 0,
"max_buckets": 1000,
"subusers": [],
"keys": [ {
"user": "ceph-admin",
"access_key": "ANXQI47HUI7T00G1UQFC",
"secret_key": "EShhS8EcAFeEvBXDabzUV9JCaAJjvB93CsQD9Nqg"
}
],
"swift_keys": [],
"caps": [],
"op_mask": "read, write, delete",
"system": "true",
"default_placement": "",
"default_storage_class": "",
"placement_tags": [],
"bucket_quota": {
"enabled": false,
"check_on_raw": false,
"max_size": -1,
"max_size_kb": 0,
"max_objects": -1
},
"user_quota": {
"enabled": false,
"check_on_raw": false,
"max_size": -1,
"max_size_kb": 0,
"max_objects": -1
},
"temp_url_keys": [],
"type": "rgw",
"mfa_ids": []
}

cephaio:/usr/lib64/ceph/mgr/dashboard # sudo ceph dashboard get-rgw-api-user-id
ceph-admin

cephaio:/usr/lib64/ceph/mgr/dashboard # ceph dashboard get-rgw-api-access-key
ANXQI47HUI7T00G1UQFC

cephaio:/usr/lib64/ceph/mgr/dashboard # ceph dashboard get-rgw-api-secret-key
EShhS8EcAFeEvBXDabzUV9JCaAJjvB93CsQD9Nqg

cephaio:/usr/lib64/ceph/mgr/dashboard # ceph dashboard get-rgw-api-ssl-verify
False

cephaio:/var/log/ceph # ceph dashboard ac-user-show ceph-admin {"username": "ceph-admin", "password": "$2b$12$62HYc/RwUN4T/Sdp.z5SgexAlJghnRvAS8htab9aXO.pGsgh4CTNi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1550721565}
cephaio:/var/log/ceph #

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-access-key
ANXQI47HUI7T00G1UQFC

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-secret-key
EShhS8EcAFeEvBXDabzUV9JCaAJjvB93CsQD9Nqg

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-host

cephaio

cephaio:/var/log/ceph # ceph dashboard get-rgw-api-port
8003

cephaio:/var/log/ceph # ceph mgr services {
"dashboard": "https://0.0.0.0:8443/",
"restful": "https://cephaio:8003/"
}

cephaio:/var/log/ceph # ceph --version
ceph version 14.0.1-3975-g14d8f3cab5 (14d8f3cab592c4b3ac85000ccd8fc9fe03398428) nautilus (dev)
cephaio:/var/log/ceph #

cluster:
id: bfdfbe86-3ee9-417e-a3bd-0818694a18d0
health: HEALTH_WARN
application not enabled on 2 pool(s)

services:
mon: 1 daemons, quorum cephaio (age 2h)
mgr: cephaio(active, since 2m)
osd: 1 osds: 1 up (since 2h), 1 in (since 27h)
rgw: 1 daemon active

data:
pools: 6 pools, 34 pgs
objects: 191 objects, 5.2 KiB
usage: 45 MiB used, 979 MiB / 1 GiB avail
pgs: 34 active+clean

cephaio:/var/log/ceph #

I resolved this bug by change my timezone from CST to EDT.

一帆 师 wrote:

I resolved this bug by change my timezone from CST to EDT.

Can you please share where you changed the time zone?

Im on 14.2.0 changing timezone.. issue still there.. 401 api/summary

Fareez Azhar wrote:

Im on 14.2.0 changing timezone.. issue still there.. 401 api/summary

try more time zone, my computer's time zone is Asia/Shanghai, and my server's time need to be EDT.

so if your computer's time zone is not CST, maybe another time zone of your server different of EDT will work.

Lenz Grimmer wrote:

A patch for this has been proposed: https://github.com/ceph/ceph/pull/27098

thks,I changed the code as "https://github.com/ceph/ceph/pull/27098",I works now.

Can you please try the following:

1. Manually apply the change posted at https://github.com/ceph/ceph/pull/27942/files to the file /usr/share/ceph/mgr/dashboard/services/access_control.py on all nodes running the dashboard
2. Restart the dashboard using ceph mgr module disable dashboard; ceph mgr module enable dashboard
3. Update the timestamp on admin's password: ceph dashboard ac-user-set-password admin <same_password_as_before>
4. Try to login again

That patch is already applied in 14.2.1, and I have reset passwords many times already.

It looks like in my case it was caused by some sort of corruption of the config database. I began to suspect it when I noticed some odd behaviour when trying to set config options. I tried to change an option (mon_osd_down_out_subtree_limit) and it made a duplicate setting instead. I could remove the duplicate, but not the original. I ended up moving my config back into ceph.conf, using "ceph config reset" to revert the config db to the original version, and restarting all the mons. After that, I am now able to log in to the dashboard.

I'm still concerned about the config db situation though. Is anyone aware of any open tickets/known issues causing config corruption? If not, I'll create one. Is there some way to complete remove/recreate the config db?

+1 I have this same problem, upgrade from mimic , unable to login to dashboard

added comment here https://github.com/ceph/ceph/pull/27098 ..
the timezone fix from above breaks the login I was forced to manually revert it in /usr/share/ceph/mgr/dashboard/services/auth.py

Looks like there is a different bug that causes these 401 errors than what this issue was initially about. See #40051 for a follow-up.