Bug #14901
closedmisdirected requests on 4.2 during rebalancing
0%
Description
On ceph version 9.2.0 (bb2ecea240f3a1d525bcb35670cb07bd1f0ca299) Linux server4 4.2.0-27-generic #32~14.04.1-Ubuntu SMP Fri Jan 22 15:32:26 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
We're getting errors with rbd after rebalance
/var/log/syslog:Feb 26 11:00:08 server4 kernel: [1364195.648855] rbd: rbd0: result -6 xferred 1000
Feb 26 11:00:08 server4 kernel: [1364195.648857] blk_update_request: I/O error, dev rbd0, sector 470086560
Feb 26 11:00:11 server4 kernel: [1364198.837281] rbd: rbd0: read 4000 at 3711fd7000 (3d7000)
Feb 26 11:00:11 server4 kernel: [1364198.837287] rbd: rbd0: result -6 xferred 4000
Feb 26 11:00:11 server4 kernel: [1364198.837290] blk_update_request: I/O error, dev rbd0, sector 461962936
Feb 26 11:00:11 server4 kernel: [1364198.846163] rbd: rbd0: read 1000 at 3711fd7000 (3d7000)
Feb 26 11:00:11 server4 kernel: [1364198.846166] rbd: rbd0: result -6 xferred 1000
Feb 26 11:00:11 server4 kernel: [1364198.846168] blk_update_request: I/O error, dev rbd0, sector 461962936
Feb 26 11:00:11 server4 kernel: [1364198.934545] blk_update_request: I/O error, dev rbd0, sector 461961904
Feb 26 11:21:34 server4 kernel: [1365481.867101] rbd: rbd0: read 1000 at 3482027000 (27000)
Feb 26 11:21:34 server4 kernel: [1365481.867106] rbd: rbd0: result -6 xferred 1000
Feb 26 11:21:34 server4 kernel: [1365481.867109] blk_update_request: I/O error, dev rbd0, sector 440467768
Feb 26 11:21:34 server4 kernel: [1365481.875329] EXT4-fs warning (device rbd0): htree_dirblock_to_tree:959: inode #13763564: lblock 0: comm mc: error -5 reading directory block
Feb 26 11:21:41 server4 kernel: [1365488.690117] rbd: rbd0: read 1000 at 3482027000 (27000)
Feb 26 11:21:41 server4 kernel: [1365488.690122] rbd: rbd0: result -6 xferred 1000
Feb 26 11:21:41 server4 kernel: [1365488.690125] blk_update_request: I/O error, dev rbd0, sector 440467768
Feb 26 11:21:41 server4 kernel: [1365488.698154] EXT4-fs warning (device rbd0): htree_dirblock_to_tree:959: inode #13763564: lblock 0: comm mc: error -5 reading directory block
Feb 26 11:21:47 server4 kernel: [1365494.610039] rbd: rbd0: read 1000 at 3482027000 (27000)
Feb 26 11:21:47 server4 kernel: [1365494.610044] rbd: rbd0: result -6 xferred 1000
Feb 26 11:21:47 server4 kernel: [1365494.610047] blk_update_request: I/O error, dev rbd0, sector 440467768
Feb 26 11:21:47 server4 kernel: [1365494.617864] EXT4-fs warning (device rbd0): htree_dirblock_to_tree:959: inode #13763564: lblock 0: comm mc: error -5 reading directory block
Feb 26 11:21:56 server4 kernel: [1365503.442835] rbd: rbd0: read 1000 at 3482027000 (27000)
Feb 26 11:21:56 server4 kernel: [1365503.442840] rbd: rbd0: result -6 xferred 1000
Feb 26 11:21:56 server4 kernel: [1365503.442844] blk_update_request: I/O error, dev rbd0, sector 440467768
Feb 26 11:21:56 server4 kernel: [1365503.450469] EXT4-fs warning (device rbd0): htree_dirblock_to_tree:959: inode #13763564: lblock 0: comm mc: error -5 reading directory block
Feb 26 11:22:05 server4 kernel: [1365512.593962] rbd: rbd0: read 1000 at 348203e000 (3e000)
Feb 26 11:22:05 server4 kernel: [1365512.593969] rbd: rbd0: result -6 xferred 1000
Feb 26 11:22:05 server4 kernel: [1365512.593972] blk_update_request: I/O error, dev rbd0, sector 440467952
It has happened several times already after cluster rebalance and only with rbd devices. TGT iSCSI targets seems to be fine.
Files