Project

General

Profile

Actions

Bug #24265

open

Ceph Luminous radosgw/rgw failed to start Couldn't init storage provider (RADOS)

Added by Saputro Aryulianto almost 6 years ago. Updated almost 6 years ago.

Status:
Need More Info
Priority:
Normal
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
ceph-deploy
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Hello,

After deploying ceph storage cluster with stable version of ceph luminous all is well

[root@ceph-mon ~]# ceph -v
ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)

[root@ceph-mon ~]# cat /etc/redhat-release 
CentOS Linux release 7.5.1804 (Core)

[root@ceph-mon ~]# rpm -qa |grep ceph-deploy
ceph-deploy-1.5.39-0.noarch

[root@ceph-mon ~]# ceph -s
  cluster:
    id:     4e7229b5-1ab2-493f-aa35-028d7e246d88
    health: HEALTH_OK

  services:
    mon: 1 daemons, quorum ceph-mon
    mgr: ceph-mon(active)
    osd: 4 osds: 4 up, 4 in

  data:
    pools:   5 pools, 400 pgs
    objects: 34 objects, 41223 kB
    usage:   4265 MB used, 77250 MB / 81515 MB avail
    pgs:     400 active+clean

  io:
    client:   0 B/s rd, 0 op/s rd, 0 op/s wr

an then I try to create rgw and I'm getting error radosgw failed to start:

[root@ceph-mon ceph-rgw.ceph-mon]# systemctl status ceph-radosgw@rgw.ceph-mon.service
● ceph-radosgw@rgw.ceph-mon.service - Ceph rados gateway
   Loaded: loaded (/usr/lib/systemd/system/ceph-radosgw@.service; enabled; vendor preset: disabled)
   Active: failed (Result: start-limit) since Thu 2018-05-24 12:57:40 WIB; 799ms ago
  Process: 55275 ExecStart=/usr/bin/radosgw -f --cluster ${CLUSTER} --name client.%i --setuser ceph --setgroup ceph (code=exited, status=5)
 Main PID: 55275 (code=exited, status=5)

May 24 12:57:39 ceph-mon systemd[1]: Unit ceph-radosgw@rgw.ceph-mon.service entered failed state.
May 24 12:57:39 ceph-mon systemd[1]: ceph-radosgw@rgw.ceph-mon.service failed.
May 24 12:57:40 ceph-mon systemd[1]: ceph-radosgw@rgw.ceph-mon.service holdoff time over, scheduling restart.
May 24 12:57:40 ceph-mon systemd[1]: start request repeated too quickly for ceph-radosgw@rgw.ceph-mon.service
May 24 12:57:40 ceph-mon systemd[1]: Failed to start Ceph rados gateway.
May 24 12:57:40 ceph-mon systemd[1]: Unit ceph-radosgw@rgw.ceph-mon.service entered failed state.
May 24 12:57:40 ceph-mon systemd[1]: ceph-radosgw@rgw.ceph-mon.service failed.
[root@ceph-mon ~]# /usr/bin/radosgw -f --cluster ${CLUSTER} --name client.%i --setuser ceph --setgroup ceph
2018-05-24 13:11:37.950849 7f6d4b54de80 -1 did not load config file, using default settings.
2018-05-24 13:11:37.953098 7f6d4b54de80 -1 Errors while parsing config file!
2018-05-24 13:11:37.953105 7f6d4b54de80 -1 parse_file: cannot open /etc/ceph/--name.conf: (2) No such file or directory
2018-05-24 13:11:37.953106 7f6d4b54de80 -1 parse_file: cannot open ~/.ceph/--name.conf: (2) No such file or directory
2018-05-24 13:11:37.953106 7f6d4b54de80 -1 parse_file: cannot open --name.conf: (2) No such file or directory
2018-05-24 13:11:37.954673 7f6d4b54de80 -1 Errors while parsing config file!
2018-05-24 13:11:37.954678 7f6d4b54de80 -1 parse_file: cannot open /etc/ceph/--name.conf: (2) No such file or directory
2018-05-24 13:11:37.954679 7f6d4b54de80 -1 parse_file: cannot open ~/.ceph/--name.conf: (2) No such file or directory
2018-05-24 13:11:37.954679 7f6d4b54de80 -1 parse_file: cannot open --name.conf: (2) No such file or directory
unable to get monitor info from DNS SRV with service name: ceph-mon
2018-05-24 13:11:37.975625 7f6d4b54de80 -1 failed for service _ceph-mon._tcp
no monitors specified to connect to.
2018-05-24 13:11:37.975807 7f6d4b54de80 -1 Couldn't init storage provider (RADOS)
this is my ceph configuration:
[root@ceph-mon ~]# cat /etc/ceph/ceph.conf 
[global]
fsid = 4e7229b5-1ab2-493f-aa35-028d7e246d88
mon_initial_members = ceph-mon
mon_host = 10.90.90.30
auth_cluster_required = cephx
auth_service_required = cephx
auth_client_required = cephx

osd pool default size = 2
rbd default features = 1

[client.radosgw.ceph-mon]
host = ceph-mon
keyring = /var/lib/ceph/radosgw/ceph-rgw.ceph-mon/keyring
rgw socket path = /var/run/ceph/ceph.radosgw.ceph-mon.fastcgi.sock
log file = /var/log/ceph/ceph-rgw-ceph-mon.log
rgw frontends = civetweb port=8080    
  1. LOG
    [root@ceph-mon ~]# tailf /var/log/ceph/ceph-rgw-ceph-mon.log 
    2018-05-23 12:48:25.736453 7fe3271b8e80 -1 Couldn't init storage provider (RADOS)
    2018-05-23 12:48:25.994700 7f3a9f799e80  0 deferred set uid:gid to 167:167 (ceph:ceph)
    2018-05-23 12:48:25.994759 7f3a9f799e80  0 ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable), process (unknown), pid 46248
    2018-05-23 12:48:26.742680 7f3a9f799e80 -1 Couldn't init storage provider (RADOS)
    2018-05-23 12:48:27.018208 7fc8d0e61e80  0 deferred set uid:gid to 167:167 (ceph:ceph)
    2018-05-23 12:48:27.018364 7fc8d0e61e80  0 ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable), process (unknown), pid 46274
    2018-05-23 12:48:27.748867 7fc8d0e61e80 -1 Couldn't init storage provider (RADOS)
    2018-05-23 12:48:27.995938 7f669b8bde80  0 deferred set uid:gid to 167:167 (ceph:ceph)
    2018-05-23 12:48:27.995991 7f669b8bde80  0 ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable), process (unknown), pid 46299
    2018-05-23 12:48:28.755961 7f669b8bde80 -1 Couldn't init storage provider (RADOS)
    

    [root@ceph-mon ~]# tailf /var/log/ceph/ceph-client.rgw.ceph-mon.log 
    2018-05-24 13:00:07.031310 7f1109fbbe80 -1 Couldn't init storage provider (RADOS)
    2018-05-24 13:00:07.249651 7fe4c8ed1e80  0 deferred set uid:gid to 167:167 (ceph:ceph)
    2018-05-24 13:00:07.249734 7fe4c8ed1e80  0 ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable), process (unknown), pid 55581
    2018-05-24 13:00:08.028856 7fe4c8ed1e80 -1 Couldn't init storage provider (RADOS)
    2018-05-24 13:00:08.239778 7f70fe3ece80  0 deferred set uid:gid to 167:167 (ceph:ceph)
    2018-05-24 13:00:08.239828 7f70fe3ece80  0 ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable), process (unknown), pid 55631
    2018-05-24 13:00:09.031804 7f70fe3ece80 -1 Couldn't init storage provider (RADOS)
    2018-05-24 13:00:09.237235 7fd2dc4b0e80  0 deferred set uid:gid to 167:167 (ceph:ceph)
    2018-05-24 13:00:09.237285 7fd2dc4b0e80  0 ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable), process (unknown), pid 55659
    2018-05-24 13:00:10.035899 7fd2dc4b0e80 -1 Couldn't init storage provider (RADOS)
    

Any suggestions on how to get rgw running?
Thank you

Actions #1

Updated by Alfredo Deza almost 6 years ago

  • Project changed from 18 to rgw
Actions #2

Updated by Abhishek Lekshmanan almost 6 years ago

  • Status changed from New to Need More Info
  • Assignee set to Abhishek Lekshmanan

the systemd service name must match the ceph.conf section after client. In this case try starting rgw service as radosgw.ceph-mon ie systemctls start

Actions

Also available in: Atom PDF