Bug #41367: rocksdb: submit_transaction error: Corruption: block checksum mismatch code = 2 - bluestore - Ceph

Actions

Copy link

Bug #41367

closed

rocksdb: submit_transaction error: Corruption: block checksum mismatch code = 2

Added by Stefan Priebe over 4 years ago. Updated over 4 years ago.

Status:

Duplicate

Priority:

Normal

Assignee:

Target version:

Ceph - v12.2.13

% Done:

Source:

Community (user)

Tags:

Backport:

Regression:

Yes

Severity:

2 - major

Reviewed:

Affected Versions:

Ceph - v12.2.12, Ceph - v12.2.13

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Since several weeks we have daily 1-8 OSD crashes since ceph 12.2.12.

The OSD log is attached.

```
Trace:
2019-07-24 08:36:48.995397 7fb19a711700 -1 rocksdb: submit_transaction error: Corruption: block checksum mismatch code = 2 Rocksdb transaction:
Put( Prefix = M key = 0x00000000000009a5'.0000916366.00000000000074680351' Value size = 184)
Put( Prefix = M key = 0x00000000000009a5'._fastinfo' Value size = 186)
Put( Prefix = O key = 0x7f8000000000000003bb605f'd!rbd_data.afe49a6b8b4567.0000000000003c11!='0xfffffffffffffffeffffffffffffffff6f00240000'x' Value size = 530)
Put( Prefix = O key = 0x7f8000000000000003bb605f'd!rbd_data.afe49a6b8b4567.0000000000003c11!='0xfffffffffffffffeffffffffffffffff'o' Value size = 510)
Put( Prefix = L key = 0x0000000010ba60f1 Value size = 4135)
2019-07-24 08:36:49.012110 7fb19a711700 -1 /build/ceph/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7fb19a711700 time 2019-07-24 08:36:48.995415
/build/ceph/src/os/bluestore/BlueStore.cc: 8808: FAILED assert(r == 0)

ceph version 12.2.12-7-g1321c5e91f (1321c5e91f3d5d35dd5aa5a0029a54b9a8ab9498) luminous (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x5653a010e222]
 2: (BlueStore::_kv_sync_thread()+0x24c5) [0x56539ff964b5]
 3: (BlueStore::KVSyncThread::entry()+0xd) [0x56539ffd708d]
 4: (()+0x7494) [0x7fb1ab2f6494]
 5: (clone()+0x3f) [0x7fb1aa37dacf]
 NOTE: a copy of the executable, or `objdump -rdS &lt;executable&gt;` is needed to interpret this.

```

Files

ceph-osd.6.log.1.gz (136 KB) ceph-osd.6.log.1.gz

Stefan Priebe, 08/21/2019 07:20 AM

Related issues 1 (1 open — 0 closed)