Ceph

What are the minimum version requirements for these new dependencies?

I think most will be in Ubuntu/Debian development so we'll need backports for older Ubuntu and Debian releases.

"-cloud: google-{api-python-client, auth, auth-httplib2}, googleapis-common-protos, grpc, grpc-google-{logging-v2, pubsub-v1}, grpcio"

This set might be challenging - predominately not package to-date.

The existing code was written with requirements.txt as such, so I guess that's at least a version that is known to work:

google-api-python-client==1.7.3
google-auth==1.5.0
google-auth-httplib2==0.0.3
googleapis-common-protos==1.5.3
grpc==0.3.post19
grpc-google-logging-v2==0.8.1
grpc-google-pubsub-v1==0.8.1
grpcio==1.14.1
numpy==1.15.1
scikit-learn==0.19.2
scipy==1.1.0

Not clear about python-kubernetes; whatever's current in pypi is probably the closest to an answer.

And, yes, I don't think anyone's tried to package the google stuff at all yet. I'm hacking at a Debian package for grpc.

trying to build grpc into a .deb, I find that

1) it hasn't been released on pypi since June 2016, and
2) it uses a now-deprecated module in gevent, "coros", removed in Dec 2016, and
3) the latest source on https://bitbucket.org/seewind/grpc doesn't fix the issue

I...don't understand.

for -root and -local:

https://launchpad.net/~james-page/+archive/ubuntu/ceph-backport-testing

contains backports for bionic - do we need xenial as well?

Does this tracker apply to a new build machine? The pyopenssl is needed for a local build machine run-standalone.sh to pass.

I have this tracker: http://tracker.ceph.com/issues/38262

Something like this.

Install new machine
git clone ....ceph.git
cd ceph
sudo install-deps.sh
./do-cmake.sh
cd build
make
../qa/run-standalone.sh "test-ceph-helpers.sh test_wait_for_health_ok" 

Fails with:

HEALTH_WARN Module 'restful' has failed dependency: No module named OpenSSL
MGR_MODULE_DEPENDENCY Module 'restful' has failed dependency: No module named OpenSSL
   Module 'restful' has failed dependency: No module named OpenSSL

Adding the SSH orchestrator manager module to this list.

The dependency is the remoto package version >= 0.35: https://github.com/ceph/remoto

The main dependencies are:

https://packages.debian.org/source/buster/apipkg
  https://packages.debian.org/source/buster/execnet

It looks like Ken Dryer built some packages a while back (https://launchpad.net/~kdreyer-redhat/+archive/ubuntu/ceph-medic), but they are out of date.

The confusion about grpc in https://tracker.ceph.com/issues/38088#note-5 is because grpc is nothing to do with this code; it's extraneous nonsense in the requirements.txt file. Glad the developers were careful with their dependencies and making sure they existed in the distros.

python-kubernetes also added to:

https://launchpad.net/~james-page/+archive/ubuntu/ceph-backport-testing

alongside the -local depends (which I also added a copy of smartmontools 7.0 to - I need to see if I can get that into current Ubuntu development).