Project

General

Profile

Bug #23204

missing primary copy of object in mixed luminous<->master cluster with bluestore

Added by Josh Durgin about 6 years ago. Updated almost 6 years ago.

Status:
Duplicate
Priority:
High
Assignee:
-
Category:
Correctness/Safety
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

The dead jobs here failed due to this:

http://pulpito.ceph.com/yuriw-2018-03-01_22:45:38-upgrade:luminous-x-wip-yuri-master-3.1.18-distro-basic-smithi/

In particular, http://pulpito.ceph.com/yuriw-2018-03-01_22:45:38-upgrade:luminous-x-wip-yuri-master-3.1.18-distro-basic-smithi/2240617/ has cluster logs.

2018-03-02 09:33:46.259472 osd.1 osd.1 172.21.15.11:6805/36291 1 : cluster [ERR] 2.3 full-object read crc 0xe67cba05 != expected 0xad05ab5d on 2:c91d4a1d:::mds0_inotable:head
2018-03-02 09:33:46.259528 osd.1 osd.1 172.21.15.11:6805/36291 2 : cluster [ERR] 2.3 missing primary copy of 2:c91d4a1d:::mds0_inotable:head, will try copies on 0
2018-03-02 09:33:46.264270 osd.0 osd.0 172.21.15.11:6801/36226 1 : cluster [ERR] 2.0 full-object read crc 0xe908899d != expected 0xe626317a on 2:292cf221:::200.00000000:head
2018-03-02 09:33:46.264308 osd.0 osd.0 172.21.15.11:6801/36226 2 : cluster [ERR] 2.0 missing primary copy of 2:292cf221:::200.00000000:head, will try copies on 3

These are all using bluestore, so I'm guessing this is from some of the fault injection handling difference between luminous and master. These are appearing on osd 0 and 1, after they're restarted with master, but with osd 2 and 3 still running luminous.


Related issues

Duplicates RADOS - Bug #23871: luminous->mimic: missing primary copy of xxx, wil try copies on 3, then full-object read crc mismatch Resolved 04/25/2018

History

#1 Updated by Greg Farnum almost 6 years ago

  • Priority changed from Urgent to High

We should see this again as we run the upgrade suite for mimic...

#2 Updated by Sage Weil almost 6 years ago

  • Duplicates Bug #23871: luminous->mimic: missing primary copy of xxx, wil try copies on 3, then full-object read crc mismatch added

#3 Updated by Sage Weil almost 6 years ago

  • Status changed from New to Duplicate

Also available in: Atom PDF