Bug #62330: ObjectStore/StoreTest.BluestoreRepairGlobalStats/1 is broken - bluestore - Ceph

Actions

Copy link

Bug #62330

open

ObjectStore/StoreTest.BluestoreRepairGlobalStats/1 is broken

Added by Igor Fedotov 10 months ago. Updated 2 months ago.

Status:

Pending Backport

Priority:

Normal

Assignee:

Target version:

% Done:

Source:

Tags:

backport_processed

Backport:

quincy, reef, pacific

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

53178

Crash signature (v1):

Crash signature (v2):

Description

If run on SSD drive getting the following

[ RUN ] ObjectStore/StoreTest.BluestoreRepairGlobalStats/1
create collection + write
per-pool statfs
/home/if/ceph.3/src/test/objectstore/store_test.cc:9679: Failure
Expected equality of these values:
bstore->fsck(false)
Which is: 0
1

The following commit fixes this
https://github.com/ceph/ceph/pull/51439/commits/85f03d314e7ea5a3ed22fdd3eaca1349e5c23710

Related issues 3 (2 open — 1 closed)

Actions

Copy link

Updated by Igor Fedotov 10 months ago

Backport set to quincy, reef

Actions

Copy link

Updated by Igor Fedotov 10 months ago

Pull request ID set to 52817

Actions

Copy link

Updated by Igor Fedotov 9 months ago

Status changed from In Progress to Fix Under Review

Actions

Copy link

Updated by Laura Flores 5 months ago

Hey @Igor Gajowiak, is this failure the same as the one you logged in this tracker?

/a/yuriw-2023-12-08_21:24:43-rados-wip-yuri5-testing-2023-12-07-0740-pacific-distro-default-smithi/7485064/

2023-12-09T02:37:34.746 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN      ] ObjectStore/StoreTestSpecificAUSize.BluestoreRepairSharedBlobTest/2
2023-12-09T02:37:37.613 INFO:teuthology.orchestra.run.smithi070.stderr:introduce 2 non-overlapped extents in a shared blob
2023-12-09T02:37:39.990 INFO:teuthology.orchestra.run.smithi070.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.14-365-g451ceae1/rpm/el8/BUILD/ceph-16.2.14-365-g451ceae1/src/test/objectstore/store_test.cc:9023: Failure
2023-12-09T02:37:39.990 INFO:teuthology.orchestra.run.smithi070.stdout:Expected equality of these values:
2023-12-09T02:37:39.990 INFO:teuthology.orchestra.run.smithi070.stdout:  bstore->fsck(false)
2023-12-09T02:37:39.990 INFO:teuthology.orchestra.run.smithi070.stdout:    Which is: 11
2023-12-09T02:37:39.991 INFO:teuthology.orchestra.run.smithi070.stdout:  2
2023-12-09T02:37:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.14-365-g451ceae1/rpm/el8/BUILD/ceph-16.2.14-365-g451ceae1/src/os/bluestore/BlueStore.cc: In function 'virtual int BlueStore::umount()' thread 7f6d80ebc880 time 2023-12-09T02:37:39.989471+0000
2023-12-09T02:37:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.14-365-g451ceae1/rpm/el8/BUILD/ceph-16.2.14-365-g451ceae1/src/os/bluestore/BlueStore.cc: 7046: FAILED ceph_assert(_kv_only || mounted)
2023-12-09T02:37:39.992 INFO:teuthology.orchestra.run.smithi070.stderr: ceph version 16.2.14-365-g451ceae1 (451ceae11b5d4caee05e94372fe658621eefc0b1) pacific (stable)
2023-12-09T02:37:39.992 INFO:teuthology.orchestra.run.smithi070.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f6d76059c54]
2023-12-09T02:37:39.992 INFO:teuthology.orchestra.run.smithi070.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x279e6e) [0x7f6d76059e6e]
2023-12-09T02:37:39.992 INFO:teuthology.orchestra.run.smithi070.stderr: 3: (BlueStore::umount()+0x6a9) [0x56228a77a129]
2023-12-09T02:37:39.992 INFO:teuthology.orchestra.run.smithi070.stderr: 4: (StoreTestFixture::TearDown()+0x68) [0x56228a611048]
2023-12-09T02:37:39.992 INFO:teuthology.orchestra.run.smithi070.stderr: 5: (void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*)+0x8f) [0x56228a88cc7f]
2023-12-09T02:37:39.992 INFO:teuthology.orchestra.run.smithi070.stderr: 6: (testing::TestInfo::Run()+0x135) [0x56228a8807c5]
2023-12-09T02:37:39.993 INFO:teuthology.orchestra.run.smithi070.stderr: 7: (testing::TestSuite::Run()+0xc1) [0x56228a880d21]
2023-12-09T02:37:39.993 INFO:teuthology.orchestra.run.smithi070.stderr: 8: (testing::internal::UnitTestImpl::RunAllTests()+0x445) [0x56228a882935]
2023-12-09T02:37:39.993 INFO:teuthology.orchestra.run.smithi070.stderr: 9: (bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*)+0x8f) [0x56228a88d1ef]
2023-12-09T02:37:39.993 INFO:teuthology.orchestra.run.smithi070.stderr: 10: (testing::UnitTest::Run()+0xa0) [0x56228a880890]
2023-12-09T02:37:39.993 INFO:teuthology.orchestra.run.smithi070.stderr: 11: main()
2023-12-09T02:37:39.993 INFO:teuthology.orchestra.run.smithi070.stderr: 12: __libc_start_main()
2023-12-09T02:37:39.993 INFO:teuthology.orchestra.run.smithi070.stderr: 13: _start()

If so, it'll need to be backported to Pacific.

Actions

Copy link