Project

General

Profile

Actions

Bug #53544

open

src/test/osd/RadosModel.h: ceph_abort_msg("racing read got wrong version") in thrash_cache_writeback_proxy_none tests

Added by Neha Ojha over 2 years ago. Updated 9 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Tiering
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
quincy
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2021-12-07T22:12:51.393 INFO:tasks.rados.rados.0.smithi163.stderr:Error: racing read on 2803 returned version 2453 rather than version 2455
2021-12-07T22:12:51.394 INFO:tasks.rados.rados.0.smithi163.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9455-g02e20d03/rpm/el8/BUILD/ceph-17.0.0-9455-g02e20d03/src/test/osd/RadosModel.h: In function 'virtual void WriteOp::_finish(TestOp::CallbackInfo*)' thread 7f6bbde56700 time 2021-12-07T22:12:51.393917+0000
2021-12-07T22:12:51.394 INFO:tasks.rados.rados.0.smithi163.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9455-g02e20d03/rpm/el8/BUILD/ceph-17.0.0-9455-g02e20d03/src/test/osd/RadosModel.h: 1078: ceph_abort_msg("racing read got wrong version")
2021-12-07T22:12:51.394 INFO:tasks.rados.rados.0.smithi163.stderr: ceph version 17.0.0-9455-g02e20d03 (02e20d0396c1e49054be17c5f0527ae529a28c91) quincy (dev)
2021-12-07T22:12:51.394 INFO:tasks.rados.rados.0.smithi163.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f6bc4752391]
2021-12-07T22:12:51.395 INFO:tasks.rados.rados.0.smithi163.stderr: 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5b6) [0x55eac7e57676]
2021-12-07T22:12:51.395 INFO:tasks.rados.rados.0.smithi163.stderr: 3: (write_callback(void*, void*)+0x1d) [0x55eac7e776dd]
2021-12-07T22:12:51.395 INFO:tasks.rados.rados.0.smithi163.stderr: 4: /lib64/librados.so.2(+0xa99d6) [0x7f6bc5bfb9d6]
2021-12-07T22:12:51.396 INFO:tasks.rados.rados.0.smithi163.stderr: 5: /lib64/librados.so.2(+0xc4755) [0x7f6bc5c16755]
2021-12-07T22:12:51.396 INFO:tasks.rados.rados.0.smithi163.stderr: 6: /lib64/librados.so.2(+0xc6848) [0x7f6bc5c18848]
2021-12-07T22:12:51.396 INFO:tasks.rados.rados.0.smithi163.stderr: 7: /lib64/librados.so.2(+0xcbbea) [0x7f6bc5c1dbea]
2021-12-07T22:12:51.396 INFO:tasks.rados.rados.0.smithi163.stderr: 8: /lib64/libstdc++.so.6(+0xc2ba3) [0x7f6bc3211ba3]
2021-12-07T22:12:51.397 INFO:tasks.rados.rados.0.smithi163.stderr: 9: /lib64/libpthread.so.0(+0x814a) [0x7f6bc3dd214a]
2021-12-07T22:12:51.397 INFO:tasks.rados.rados.0.smithi163.stderr: 10: clone()

Seems to have resurfaced again.

/a/yuriw-2021-12-07_16:04:59-rados-wip-yuri5-testing-2021-12-06-1619-distro-default-smithi/6550749

Actions #1

Updated by Laura Flores about 2 years ago

/a/nojha-2022-03-25_19:43:39-rados-wip-quincy-fast-shutdown-backports-distro-basic-smithi/6762122

2022-03-25T22:41:46.581 INFO:tasks.rados.rados.0.smithi107.stderr:Error: racing read on 2700 returned version 2393 rather than version 2396
2022-03-25T22:41:46.581 INFO:tasks.rados.rados.0.smithi107.stderr:/build/ceph-17.1.0-90-gf8bae789/src/test/osd/RadosModel.h: In function 'virtual void WriteOp::_finish(TestOp::CallbackInfo*)' thread 7fdb7bfff700 time 2022-03-25T22:41:46.574917+0000
2022-03-25T22:41:46.581 INFO:tasks.rados.rados.0.smithi107.stderr:/build/ceph-17.1.0-90-gf8bae789/src/test/osd/RadosModel.h: 1078: ceph_abort_msg("racing read got wrong version")
2022-03-25T22:41:46.581 INFO:tasks.rados.rados.0.smithi107.stderr: ceph version 17.1.0-90-gf8bae789 (f8bae78956976eb41022af2d864d805106c0d6fd) quincy (dev)
2022-03-25T22:41:46.582 INFO:tasks.rados.rados.0.smithi107.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe0) [0x7fdb8452af17]
2022-03-25T22:41:46.582 INFO:tasks.rados.rados.0.smithi107.stderr: 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x652) [0x55e96300bdb2]
2022-03-25T22:41:46.582 INFO:tasks.rados.rados.0.smithi107.stderr: 3: (write_callback(void*, void*)+0x1e) [0x55e96302d51e]
2022-03-25T22:41:46.582 INFO:tasks.rados.rados.0.smithi107.stderr: 4: /lib/librados.so.2(+0xbcfb2) [0x7fdb84f0efb2]
2022-03-25T22:41:46.583 INFO:tasks.rados.rados.0.smithi107.stderr: 5: /lib/librados.so.2(+0xdd8e5) [0x7fdb84f2f8e5]
2022-03-25T22:41:46.583 INFO:tasks.rados.rados.0.smithi107.stderr: 6: /lib/librados.so.2(+0xdf118) [0x7fdb84f31118]
2022-03-25T22:41:46.583 INFO:tasks.rados.rados.0.smithi107.stderr: 7: /lib/librados.so.2(+0xe4dba) [0x7fdb84f36dba]
2022-03-25T22:41:46.583 INFO:tasks.rados.rados.0.smithi107.stderr: 8: /lib/x86_64-linux-gnu/libstdc++.so.6(+0xd6de4) [0x7fdb83eaade4]
2022-03-25T22:41:46.584 INFO:tasks.rados.rados.0.smithi107.stderr: 9: /lib/x86_64-linux-gnu/libpthread.so.0(+0x9609) [0x7fdb83fbf609]
2022-03-25T22:41:46.584 INFO:tasks.rados.rados.0.smithi107.stderr: 10: clone()

Actions #2

Updated by Laura Flores about 2 years ago

  • Backport set to quincy
Actions #3

Updated by Neha Ojha about 2 years ago

  • Category set to Tiering
Actions #4

Updated by Aishwarya Mathuria 9 days ago

@Laura Flores FYI seeing this one after a while in one of the main runs - /a/yuriw-2024-04-09_14:35:50-rados-wip-yuri5-testing-2024-03-21-0833-distro-default-smithi/7648797/

Actions

Also available in: Atom PDF