Ceph » rbd

Support for handling failed group operations was prematurely removed. Luminous does support groups, but it never supported adding images to a group. Ignore the '-EOPNOTSUPP' error code when querying the image's group upon refresh.

2019-03-20 17:47:48.062625 I | exec: Running command: rbd create replicapool/pvc-032e5745-4b38-11e9-8154-080027b3ec48 --size 20480 --cluster=rook-ceph --conf=/var/lib/rook/rook-ceph/rook-ceph.config --keyring=/var/lib/rook/rook-ceph/client.admin.keyring
I0320 17:47:48.064758       6 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"mysql-pv-claim", UID:"032e5745-4b38-11e9-8154-080027b3ec48", APIVersion:"v1", ResourceVersion:"3112", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/mysql-pv-claim" 
2019-03-20 17:47:48.133798 W | cephclient: Requested image pvc-032e5745-4b38-11e9-8154-080027b3ec48 exists in pool replicapool. Continuing
2019-03-20 17:47:48.134127 I | exec: Running command: rbd info replicapool/pvc-032e5745-4b38-11e9-8154-080027b3ec48 --cluster=rook-ceph --conf=/var/lib/rook/rook-ceph/rook-ceph.config --keyring=/var/lib/rook/rook-ceph/client.admin.keyring --format json
W0320 17:47:48.205158       6 controller.go:685] Retrying syncing claim "default/mysql-pv-claim" because failures 3 < threshold 15
E0320 17:47:48.205640       6 controller.go:700] error syncing claim "default/mysql-pv-claim": failed to provision volume with StorageClass "rook-ceph-block": Failed to create rook block image replicapool/pvc-032e5745-4b38-11e9-8154-080027b3ec48: failed to get image pvc-032e5745-4b38-11e9-8154-080027b3ec48 info after successfully creating it: failed to get image replicapool/pvc-032e5745-4b38-11e9-8154-080027b3ec48 info: Failed to complete '': exit status 95. 2019-03-20 17:47:48.198 7f4a3affd700 -1 librbd::image::RefreshRequest: failed to retrieve group: (95) Operation not supported
2019-03-20 17:47:48.198 7f4a3a7fc700 -1 librbd::image::OpenRequest: failed to refresh image: (95) Operation not supported
2019-03-20 17:47:48.198 7f4a3affd700 -1 librbd::image::RefreshRequest: failed to retrieve group: (95) Operation not supported
2019-03-20 17:47:48.198 7f4a3a7fc700 -1 librbd::image::OpenRequest: failed to refresh image: (95) Operation not supported
2019-03-20 17:47:48.198 7f4a3a7fc700 -1 librbd::ImageState: 0x5593fc10bfe0 failed to open image: (95) Operation not supported
2019-03-20 17:47:48.198 7f4a3a7fc700 -1 librbd::ImageState: 0x5593fc10bfe0 failed to open image: (95) Operation not supported
rbd: error opening image pvc-032e5745-4b38-11e9-8154-080027b3ec48: (95) Operation not supported
I0320 17:47:48.205499       6 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"mysql-pv-claim", UID:"032e5745-4b38-11e9-8154-080027b3ec48", APIVersion:"v1", ResourceVersion:"3112", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "rook-ceph-block": Failed to create rook block image replicapool/pvc-032e5745-4b38-11e9-8154-080027b3ec48: failed to get image pvc-032e5745-4b38-11e9-8154-080027b3ec48 info after successfully creating it: failed to get image replicapool/pvc-032e5745-4b38-11e9-8154-080027b3ec48 info: Failed to complete '': exit status 95. 2019-03-20 17:47:48.198 7f4a3affd700 -1 librbd::image::RefreshRequest: failed to retrieve group: (95) Operation not supported

Note: this is only applicable to the nautilus branch since the master (octopus) branch will not support luminous clusters.