Bug #3285
rbd map w/ cephx
0%
Description
"rbd map" with "auth supported = cephx" doesn't work (using ceph at commit c8721b956):
# rbd create test1 --size 10248 --format 1
# grep auth /etc/ceph/ceph.conf
auth supported = cephx
# rbd map test1
add failed: (2) No such file or directory
# rbd showmapped
# perl -pi -e 's/cephx/none/' /etc/ceph/ceph.conf
# service ceph restart
# rbd map test1
# rbd showmapped
id pool image snap device
1 rbd test1 - /dev/rbd1
History
#1 Updated by Greg Farnum almost 11 years ago
Did you perhaps add the cephx option after enabling your monitors? If you tell the client to use cephx but it's not enabled in the monitors things aren't going to work.
#2 Updated by Chris Dunlop almost 11 years ago
I just tested again, ensuring a complete ceph restart on all devices after setting auth cephx. The mapping failed as above.
#3 Updated by Josh Durgin almost 11 years ago
Can you post the output of 'strace -f rbd map test1'?
#4 Updated by Chris Dunlop almost 11 years ago
- File trace added
Attached output of "strace -o /tmp/trace -s 60 -f rbd map test1"
#5 Updated by Josh Durgin almost 11 years ago
What kernel version are you using? That error is coming directly from the kernel rbd module.
#6 Updated by Chris Dunlop almost 11 years ago
self-compiled 3.4.12
#7 Updated by Josh Durgin almost 11 years ago
After you the map fails, is there anything added to dmesg?
#8 Updated by Chris Dunlop almost 11 years ago
Augh. Sorry, I should have noticed that before:
[79683.055935] libceph: client0 fsid c6618970-0ce0-4cb2-bc9a-dd5f29b62e24 [79683.059286] libceph: error -2 building auth method x request
#9 Updated by Josh Durgin almost 11 years ago
The only path I'm seeing that could lead to that error is if the kernel wasn't compiled with support for "cbc(aes)" with the CRYPTO_ALG_ASYNC flag. I'd guess any of the CRYTPO_AES* build options (with CRYPTO_BLKCIPHER2?) would be sufficient.
#10 Updated by Chris Dunlop almost 11 years ago
Aha! That did it, thanks.
After installing cbc.ko (already had aes):
# grep auth /etc/ceph/ceph.conf
auth supported = cephx
# modprobe rbd
# lsmod | egrep 'aes|cbc|rbd'
rbd 19378 0
libceph 122328 1 rbd
# rbd map test1
# rbd showmapped
id pool image snap device
1 rbd test1 - /dev/rbd1
# lsmod | egrep 'aes|cbc|rbd'
aes_x86_64 7920 0
aes_generic 27295 1 aes_x86_64
cbc 2814 0
rbd 19378 1
libceph 122328 1 rbd
Interesting, no google hits on the 2nd "error -2 building auth" message. Perhaps the kernel message and/or docs could be enhanced to suggest a solution? (Not that it would have helped me until you prompted me to check!). Of course, if/when Google indexes this page the point becomes moot!
#11 Updated by Josh Durgin almost 11 years ago
- Status changed from New to Closed
Cool, glad that fixed it. Probably the best way to get the solution indexed is to email ceph-devel. The list archives rank pretty highly.