Project

General

Profile

Actions

Bug #15552

closed

cephfs kernel client timeout error 110

Added by Heath Jepson almost 8 years ago. Updated almost 8 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Community (user)
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

After upgrading my test environment from infernalis to the latest jewel release candidate last night, I cannot mount cephfs via the kernel client on debian jessie.

Fuse client works without issue and I can read and write files. the kernel client worked on infernalis.

I have separate frontend and backend networks.

Actions #1

Updated by Zheng Yan almost 8 years ago

  • Project changed from Ceph to Linux kernel client

which version of kernel do you use

Actions #2

Updated by Heath Jepson almost 8 years ago

4.3.0-0.bpo.1-amd64

Actions #3

Updated by Heath Jepson almost 8 years ago

more info, I see this pop up on the mon when running in debug mode:

2016-04-23 21:03:28.685457 7f2eead54700 1 -- 10.0.1.42:6789/0 >> :/0 pipe(0x5647718bf400 sd=28 :6789 s=0 pgs=0 cs=0 l=0 c=0x564771505480).accept sd=28 10.0.1.42:50636/0
2016-04-23 21:03:28.685491 7f2eead54700 0 -- 10.0.1.42:6789/0 >> 10.0.1.42:0/851816053 pipe(0x5647718bf400 sd=28 :6789 s=0 pgs=0 cs=0 l=0 c=0x564771505480).accept peer addr is really 10.0.1.42:0/851816053 (socket is 10.0.1.42:50636/0)
2016-04-23 21:03:28.685512 7f2eead54700 1 -- 10.0.1.42:6789/0 >> 10.0.1.42:0/851816053 pipe(0x5647718bf400 sd=28 :6789 s=0 pgs=0 cs=0 l=1 c=0x564771505480).peer missing required features 400000000000000
2016-04-23 21:03:28.701394 7f2eead54700 2 -- 10.0.1.42:6789/0 >> 10.0.1.42:0/851816053 pipe(0x5647718bf400 sd=28 :6789 s=4 pgs=0 cs=0 l=1 c=0x564771505480).fault (0) Success

is "peer missing required features" what could cause this? I don't really know where to proceed from here. I'm running debian jessie and have made sure its up to date.

I ran apt-get update and apt-get dist-upgrade, a few updates were installed, but the kernel client still fails.

I'm now on the jewel release 10.2.0 and as noted before, my kernel is 4.3.0-0.bpo.1-amd64

Thanks for your help

Actions #4

Updated by Heath Jepson almost 8 years ago

OK, so my last update led me to trying a shot in the dark.

running:

ceph osd crush tunables legacy

Allowed me to mount cephfs using the kernel client, but this doesn't exactly give me the "warm-fuzzies" can I consider cephfs to be stable in this sort of config?

I cannot find any guides to upgrade or recompile my cephfs kernel client. Could you please point me in the right direction, so I can be sure that I'm running the current version?

This does result in the following health warning:

health HEALTH_WARN
crush map has straw_calc_version=0

Thanks in advance.

Actions #5

Updated by Heath Jepson almost 8 years ago

I found a solution I can live with.

I set:

ceph osd crush tunables default

And this works without generating health warnings

The reason this was not set correctly in the first place is because I originally reacted to a health warning after upgrading from infernalis. As a result, I set:

ceph osd crush tunables jewel

Which unknowingly broke compatibility with the kernel client in debian jessie.

Actions #6

Updated by Zheng Yan almost 8 years ago

  • Status changed from New to Closed
Actions

Also available in: Atom PDF