Bug #15552
closed
cephfs kernel client timeout error 110
Added by Heath Jepson about 8 years ago.
Updated about 8 years ago.
Description
After upgrading my test environment from infernalis to the latest jewel release candidate last night, I cannot mount cephfs via the kernel client on debian jessie.
Fuse client works without issue and I can read and write files. the kernel client worked on infernalis.
I have separate frontend and backend networks.
- Project changed from Ceph to Linux kernel client
which version of kernel do you use
more info, I see this pop up on the mon when running in debug mode:
2016-04-23 21:03:28.685457 7f2eead54700 1 -- 10.0.1.42:6789/0 >> :/0 pipe(0x5647718bf400 sd=28 :6789 s=0 pgs=0 cs=0 l=0 c=0x564771505480).accept sd=28 10.0.1.42:50636/0
2016-04-23 21:03:28.685491 7f2eead54700 0 -- 10.0.1.42:6789/0 >> 10.0.1.42:0/851816053 pipe(0x5647718bf400 sd=28 :6789 s=0 pgs=0 cs=0 l=0 c=0x564771505480).accept peer addr is really 10.0.1.42:0/851816053 (socket is 10.0.1.42:50636/0)
2016-04-23 21:03:28.685512 7f2eead54700 1 -- 10.0.1.42:6789/0 >> 10.0.1.42:0/851816053 pipe(0x5647718bf400 sd=28 :6789 s=0 pgs=0 cs=0 l=1 c=0x564771505480).peer missing required features 400000000000000
2016-04-23 21:03:28.701394 7f2eead54700 2 -- 10.0.1.42:6789/0 >> 10.0.1.42:0/851816053 pipe(0x5647718bf400 sd=28 :6789 s=4 pgs=0 cs=0 l=1 c=0x564771505480).fault (0) Success
is "peer missing required features" what could cause this? I don't really know where to proceed from here. I'm running debian jessie and have made sure its up to date.
I ran apt-get update and apt-get dist-upgrade, a few updates were installed, but the kernel client still fails.
I'm now on the jewel release 10.2.0 and as noted before, my kernel is 4.3.0-0.bpo.1-amd64
Thanks for your help
OK, so my last update led me to trying a shot in the dark.
running:
ceph osd crush tunables legacy
Allowed me to mount cephfs using the kernel client, but this doesn't exactly give me the "warm-fuzzies" can I consider cephfs to be stable in this sort of config?
I cannot find any guides to upgrade or recompile my cephfs kernel client. Could you please point me in the right direction, so I can be sure that I'm running the current version?
This does result in the following health warning:
health HEALTH_WARN
crush map has straw_calc_version=0
Thanks in advance.
I found a solution I can live with.
I set:
ceph osd crush tunables default
And this works without generating health warnings
The reason this was not set correctly in the first place is because I originally reacted to a health warning after upgrading from infernalis. As a result, I set:
ceph osd crush tunables jewel
Which unknowingly broke compatibility with the kernel client in debian jessie.
- Status changed from New to Closed
Also available in: Atom
PDF