Project

General

Profile

Bug #51642

Updated by Sebastian Wagner almost 3 years ago

I have created the ceph cluster via cephadm and it looks fine but when I tried to deploy RGW it was failing and does not much info in logs regarding the failure(says failed to intialise). Any help in debugging will be much appreciated. 

 * Bootstrap ceph cluster via cephadm bootstrap --mon-ip<IP> in fedora 34 VM which uses podman 
 * add host as VM to ceph cluster 
 * add three storage disks and create osd's via ceph orch daemon add osd *<host>*:*<device-path>* 
 * now deployed rgw via ceph orch apply rgw newstore1 --port=7080 --placement=1 

 <pre> 

 # ceph status 
   cluster: 
     id:       bd183ab8-dfd8-11eb-83cf-525400bf929c 
     health: HEALTH_WARN 
             1 failed cephadm daemon(s) 
             Reduced data availability: 33 pgs inactive 
             Degraded data redundancy: 33 pgs undersized 
 
   services: 
     mon: 1 daemons, quorum fedora (age 85m) 
     mgr: fedora.vrlaif(active, since 85m) 
     osd: 3 osds: 3 up (since 85m), 3 in (since 5d) 
 
   data: 
     pools:     2 pools, 33 pgs 
     objects: 0 objects, 0 B 
     usage:     17 MiB used, 30 GiB / 30 GiB avail 
     pgs:       100.000% pgs not active 
              33 undersized+peered 

 </pre> 

 <pre> 
 # ceph osd pool ls 
 device_health_metrics 
 .rgw.root 

 </pre> 

 <pre> 
 # ceph orch ps 
 NAME                           HOST      PORTS          STATUS           REFRESHED    AGE    VERSION      IMAGE ID        CONTAINER ID   
 alertmanager.fedora            fedora    *:9093,9094    running (99m)    7m ago       5d     0.20.0       0881eb8f169f    97a9a4130594   
 crash.fedora                   fedora                 running (99m)    7m ago       5d     16.2.4       8d91d370c2b8    7eab2bef9692   
 grafana.fedora                 fedora    *:3000         running (99m)    7m ago       5d     6.7.4        ae5c36c3d3cd    5e98deb7ac7a   
 mgr.fedora.vrlaif              fedora    *:9283         running (99m)    7m ago       5d     16.2.4       8d91d370c2b8    f33d98b6edd7   
 mon.fedora                     fedora                 running (99m)    7m ago       5d     16.2.4       8d91d370c2b8    c7e1168011c6   
 node-exporter.fedora           fedora    *:9100         running (99m)    7m ago       5d     0.18.1       e5a616e4b9cf    a397fbac7bb0   
 osd.0                          fedora                 running (99m)    7m ago       5d     16.2.4       8d91d370c2b8    fc1c1f9ac6dc   
 osd.1                          fedora                 running (99m)    7m ago       5d     16.2.4       8d91d370c2b8    5379d795c1fb   
 osd.2                          fedora                 running (99m)    7m ago       5d     16.2.4       8d91d370c2b8    99c5d3447c44   
 prometheus.fedora              fedora    *:9095         running (99m)    7m ago       5d     2.18.1       de242295e225    e2e71c2f9bcf   
 rgw.newstore1.fedora.mkhhgr    fedora    *:7080         error            7m ago       4d     <unknown>    <unknown>       <unknown> 

 </pre> 

 attaching logs, rgw pod spec and systemctl status of rgw as file

Back