Project

General

Profile

Actions
Copy link

Bug #8226

closed

0.80~rc1: RBD read errors (ENXIO)

Added by Dmitry Smirnov about 10 years ago. Updated about 8 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Ilya Dryomov
Category:
rbd
Target version:
-
% Done:

0%

Source:
Community (user)
Tags:
Backport:
Regression:
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

With Ceph_0.80~rc1 and Linux_3.14.1 I'm getting read errors on RBD devices.

from '/var/log/messages':

Apr 26 20:06:32 deblab kernel: [ 7964.417701] rbd: rbd0: read 30000 at d17400000 (0)
Apr 26 20:06:32 deblab kernel: [ 7964.417701] 
Apr 26 20:06:32 deblab kernel: [ 7964.417708] rbd: rbd0:   result -6 xferred 30000
Apr 26 20:06:32 deblab kernel: [ 7964.417708] 
Apr 26 20:06:32 deblab kernel: [ 7964.419285] rbd: rbd0: read 40000 at d17430000 (30000)
Apr 26 20:06:32 deblab kernel: [ 7964.419285] 
Apr 26 20:06:32 deblab kernel: [ 7964.419293] rbd: rbd0:   result -6 xferred 40000
Apr 26 20:06:32 deblab kernel: [ 7964.419293] 
Apr 26 20:06:32 deblab kernel: [ 7964.419596] rbd: rbd0: read 1000 at d17400000 (0)
Apr 26 20:06:32 deblab kernel: [ 7964.419596] 
Apr 26 20:06:32 deblab kernel: [ 7964.419602] rbd: rbd0:   result -6 xferred 1000

I have 'ext4' file system on RBD and attempt to read some files ends with "Input/output error".
I confirmed this problem with 'md5sum' and 'badblocks' utilities.

Cluster is degraded/recovering after replacing some OSDs, 1 PG inconsistent:
"1 active+degraded+remapped+inconsistent+wait_backfill"

All pools configured with "replicated size 4 min_size 2".
There are no "unfound" objects.

I wonder if this is an error or expected behaviour?

Before 0.80~rc1 (and with Linux-3.13) I've seen no read errors on RBD devices whatsoever.

Is this correct that even for inconsistent PG there shall be no read errors as long as correct object can be found?

Files

Download all files
crushmap (904 Bytes) crushmap Dmitry Smirnov, 05/02/2014 03:51 PM
osdmap (9.09 KB) osdmap Dmitry Smirnov, 05/02/2014 03:51 PM
32514.osdmap (15.8 KB) 32514.osdmap Dmitry Smirnov, 05/09/2014 12:21 AM
osdmap.32513 (15.6 KB) osdmap.32513 Dmitry Smirnov, 05/09/2014 12:48 AM
osdmap.32550 (15.6 KB) osdmap.32550 Dmitry Smirnov, 05/09/2014 12:51 AM
patch (563 Bytes) patch Ilya Dryomov, 05/09/2014 08:11 AM
crushmap (1.48 KB) crushmap Ruslan Usifov, 02/24/2016 11:26 PM
osdmap (25.1 KB) osdmap Ruslan Usifov, 02/24/2016 11:27 PM
Actions
Copy link

Also available in: Atom PDF