Ceph » devops

A convention needs to be followed to retrieve the correct GPG Key from the local repo. Currently, ceph-deploy uses this:

"https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/{key}.asc".format(key=key)

Where `key` is usually: `release`.

Yes, I suddenly thought about the keys too. Filename can also be an arg (--use-repo-key) ?

The key can be a regular file too, but then I would need to push that to nodes.

Also, it should be noted that for RPMs (have not checked DEBs yet) we use a package that creates `/etc/yum.repos.d/ceph.repo` for us with these contents:

[ceph]
name=Ceph packages for $basearch
baseurl=http://ceph.com/rpm-dumpling/el6/$basearch
enabled=1
gpgcheck=1
type=rpm-md
gpgkey=https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc

[ceph-noarch]
name=Ceph noarch packages
baseurl=http://ceph.com/rpm-dumpling/el6/noarch
enabled=1
gpgcheck=1
type=rpm-md
gpgkey=https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc

[ceph-source]
name=Ceph source packages
baseurl=http://ceph.com/rpm-dumpling/el6/SRPMS
enabled=0
gpgcheck=1
type=rpm-md
gpgkey=https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc

This means that we would need to create this without that helper package (currently: ceph-release-1-0.el6.noarch.rpm) with extra
care to be able to update/change this whenever the URL changes.

For DEBs we just write the correct URL to

/etc/apt/sources.list.d/ceph.list

So I would say that we need to implement a similar functionality for RPMs. I can get started with the same structure of that ceph.repo file for RPMs
in the meantime

A bunch of progress, we are now allowing a couple of flags: --repo-url and --gpg-url. When GPG is not passed in it will fallback to the public one (ideally you wouldn't do this, since it defeats the purpose).

Example output:

ceph-deploy install --repo-url http://example.org/rpms/ node2
[ceph_deploy.cli][INFO  ] Invoked (1.3.2): /Users/alfredo/.virtualenvs/ceph-deploy/bin/ceph-deploy install --repo-url http://example.org/rpms/ node2
[ceph_deploy.install][DEBUG ] Installing stable version emperor on cluster ceph hosts node2
[ceph_deploy.install][DEBUG ] Detecting platform for host node2 ...
[node2][DEBUG ] connected to host: node2
[node2][DEBUG ] detect platform information from remote host
[node2][DEBUG ] detect machine type
[ceph_deploy.install][INFO  ] Distro info: CentOS 6.4 Final
[node2][INFO  ] installing ceph on node2
[node2][INFO  ] using custom repository location: http://example.org/rpms/
[node2][WARNIN] --gpg-url was not used, will fallback
[node2][WARNIN] using GPG fallback: https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc
[node2][INFO  ] Running command: sudo yum -y -q install wget
[node2][ERROR ] http://example.org/rpms/x86_64/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found" 
[node2][ERROR ] Trying other mirror.
[node2][ERROR ] http://example.org/rpms/noarch/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found" 
[node2][ERROR ] Trying other mirror.
[node2][DEBUG ] Package wget-1.12-1.8.el6.x86_64 already installed and latest version
[node2][INFO  ] Running command: sudo rpm --import https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc
[node2][DEBUG ] set the contents of /etc/yum.repos.d/ceph.repo
[node2][INFO  ] Running command: sudo yum -y -q install ceph
[node2][ERROR ] http://example.org/rpms/x86_64/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found" 
[node2][ERROR ] Trying other mirror.
[node2][ERROR ] http://example.org/rpms/noarch/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found" 
[node2][ERROR ] Trying other mirror.
[node2][DEBUG ] Package ceph-0.67.4-0.el6.x86_64 already installed and latest version
[node2][INFO  ] Running command: sudo ceph --version
[node2][DEBUG ] ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7)

Note how it lets you know that you are in fact using a custom repo URL:

[node2][INFO  ] using custom repository location: http://example.org/rpms/

Now a fully working version with environment variables:

CEPH_DEPLOY_REPO_URL=http://192.168.1.131/rpm-emperor/el6/ CEPH_DEPLOY_GPG_URL=http://192.168.1.131/keys/release.asc ceph-deploy install node2
[ceph_deploy.cli][INFO  ] Invoked (1.3.2): /Users/alfredo/.virtualenvs/ceph-deploy/bin/ceph-deploy install node2
[ceph_deploy.install][DEBUG ] Installing stable version emperor on cluster ceph hosts node2
[ceph_deploy.install][DEBUG ] Detecting platform for host node2 ...
[node2][DEBUG ] connected to host: node2
[node2][DEBUG ] detect platform information from remote host
[node2][DEBUG ] detect machine type
[ceph_deploy.install][INFO  ] Distro info: CentOS 6.4 Final
[node2][INFO  ] installing ceph on node2
[node2][INFO  ] using custom repository location: http://192.168.1.131/rpm-emperor/el6/
[node2][INFO  ] Running command: sudo rpm --import http://192.168.1.131/keys/release.asc
[node2][DEBUG ] set the contents of /etc/yum.repos.d/ceph.repo
[node2][INFO  ] Running command: sudo yum -y -q install wget
[node2][DEBUG ] Package wget-1.12-1.8.el6.x86_64 already installed and latest version
[node2][INFO  ] Running command: sudo yum -y -q install ceph
[node2][INFO  ] Running command: sudo ceph --version
[node2][DEBUG ] ceph version 0.72.1 (4d923861868f6a15dcb33fef7f50f674997322de)