Project

General

Profile

Bug #3285

rbd map w/ cephx

Added by Chris Dunlop over 11 years ago. Updated over 11 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

"rbd map" with "auth supported = cephx" doesn't work (using ceph at commit c8721b956):

# rbd create test1 --size 10248 --format 1
# grep auth /etc/ceph/ceph.conf
      auth supported = cephx
# rbd map test1
add failed: (2) No such file or directory
# rbd showmapped

# perl -pi -e 's/cephx/none/' /etc/ceph/ceph.conf
# service ceph restart
# rbd map test1
# rbd showmapped
id    pool    image    snap    device
1    rbd    test1    -    /dev/rbd1

trace (27.6 KB) Chris Dunlop, 10/10/2012 06:17 PM

History

#1 Updated by Greg Farnum over 11 years ago

Did you perhaps add the cephx option after enabling your monitors? If you tell the client to use cephx but it's not enabled in the monitors things aren't going to work.

#2 Updated by Chris Dunlop over 11 years ago

I just tested again, ensuring a complete ceph restart on all devices after setting auth cephx. The mapping failed as above.

#3 Updated by Josh Durgin over 11 years ago

Can you post the output of 'strace -f rbd map test1'?

#4 Updated by Chris Dunlop over 11 years ago

Attached output of "strace -o /tmp/trace -s 60 -f rbd map test1"

#5 Updated by Josh Durgin over 11 years ago

What kernel version are you using? That error is coming directly from the kernel rbd module.

#6 Updated by Chris Dunlop over 11 years ago

self-compiled 3.4.12

#7 Updated by Josh Durgin over 11 years ago

After you the map fails, is there anything added to dmesg?

#8 Updated by Chris Dunlop over 11 years ago

Augh. Sorry, I should have noticed that before:

[79683.055935] libceph: client0 fsid c6618970-0ce0-4cb2-bc9a-dd5f29b62e24
[79683.059286] libceph: error -2 building auth method x request

#9 Updated by Josh Durgin over 11 years ago

The only path I'm seeing that could lead to that error is if the kernel wasn't compiled with support for "cbc(aes)" with the CRYPTO_ALG_ASYNC flag. I'd guess any of the CRYTPO_AES* build options (with CRYPTO_BLKCIPHER2?) would be sufficient.

#10 Updated by Chris Dunlop over 11 years ago

Aha! That did it, thanks.

After installing cbc.ko (already had aes):

# grep auth /etc/ceph/ceph.conf 
      auth supported = cephx
# modprobe rbd
# lsmod | egrep 'aes|cbc|rbd'
rbd                    19378  0 
libceph               122328  1 rbd
# rbd map test1
# rbd showmapped
id    pool    image    snap    device
1    rbd    test1    -    /dev/rbd1
# lsmod | egrep 'aes|cbc|rbd'
aes_x86_64              7920  0 
aes_generic            27295  1 aes_x86_64
cbc                     2814  0 
rbd                    19378  1 
libceph               122328  1 rbd

Interesting, no google hits on the 2nd "error -2 building auth" message. Perhaps the kernel message and/or docs could be enhanced to suggest a solution? (Not that it would have helped me until you prompted me to check!). Of course, if/when Google indexes this page the point becomes moot!

#11 Updated by Josh Durgin over 11 years ago

  • Status changed from New to Closed

Cool, glad that fixed it. Probably the best way to get the solution indexed is to email ceph-devel. The list archives rank pretty highly.

Also available in: Atom PDF