Project

General

Profile

Bug #51642

Updated by Jiffin Tony Thottan over 2 years ago

I have created the ceph cluster via cephadm and it looks fine but when I tried to deploy RGW it was failing and does not much info in logs regarding the failure(says failed to intialise). Any help in debugging will be much appreciated.

* Bootstrap ceph cluster via cephadm bootstrap --mon-ip<IP> in fedora 34 VM which uses podman
* add host as VM to ceph cluster
* add three storage disks and create osd's via ceph orch daemon add osd *<host>*:*<device-path>*
* now deployed rgw via ceph orch apply rgw newstore1 --port=7080 --placement=1

<pre>

# ceph status
cluster:
id: bd183ab8-dfd8-11eb-83cf-525400bf929c
health: HEALTH_WARN
1 failed cephadm daemon(s)
Reduced data availability: 33 pgs inactive
Degraded data redundancy: 33 pgs undersized

services:
mon: 1 daemons, quorum fedora (age 85m)
mgr: fedora.vrlaif(active, since 85m)
osd: 3 osds: 3 up (since 85m), 3 in (since 5d)

data:
pools: 2 pools, 33 pgs
objects: 0 objects, 0 B
usage: 17 MiB used, 30 GiB / 30 GiB avail
pgs: 100.000% pgs not active
33 undersized+peered

</pre>

<pre>
# ceph osd pool ls
device_health_metrics
.rgw.root

</pre>

<pre>
# ceph orch ps
NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID
alertmanager.fedora fedora *:9093,9094 running (99m) 7m ago 5d 0.20.0 0881eb8f169f 97a9a4130594
crash.fedora fedora running (99m) 7m ago 5d 16.2.4 8d91d370c2b8 7eab2bef9692
grafana.fedora fedora *:3000 running (99m) 7m ago 5d 6.7.4 ae5c36c3d3cd 5e98deb7ac7a
mgr.fedora.vrlaif fedora *:9283 running (99m) 7m ago 5d 16.2.4 8d91d370c2b8 f33d98b6edd7
mon.fedora fedora running (99m) 7m ago 5d 16.2.4 8d91d370c2b8 c7e1168011c6
node-exporter.fedora fedora *:9100 running (99m) 7m ago 5d 0.18.1 e5a616e4b9cf a397fbac7bb0
osd.0 fedora running (99m) 7m ago 5d 16.2.4 8d91d370c2b8 fc1c1f9ac6dc
osd.1 fedora running (99m) 7m ago 5d 16.2.4 8d91d370c2b8 5379d795c1fb
osd.2 fedora running (99m) 7m ago 5d 16.2.4 8d91d370c2b8 99c5d3447c44
prometheus.fedora fedora *:9095 running (99m) 7m ago 5d 2.18.1 de242295e225 e2e71c2f9bcf
rgw.newstore1.fedora.mkhhgr fedora *:7080 error 7m ago 4d <unknown> <unknown> <unknown>

</pre>


attaching logs, rgw pod spec and systemctl status of rgw as file

Back