Project

General

Profile

Actions
Copy link

Bug #42284

closed

fastbmap_allocator_impl.h: FAILED ceph_assert(available >= allocated) in upgrade:luminous-x-nautilus

Added by Yuri Weinstein over 4 years ago. Updated over 4 years ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/luminous-x
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://qa-proxy.ceph.com/teuthology/teuthology-2019-10-11_02:25:02-upgrade:luminous-x-nautilus-distro-basic-smithi/4400505/teuthology.log
Jobs: '4400505', '4400519', '4400520', '4400510', '4400511', '4400532', '4400527', '4400526', '4400516', '4400521', '4400503', '4400518', '4400517', '4400533', '4400534', '4400504'
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2019-10-11_02:25:02-upgrade:luminous-x-nautilus-distro-basic-smithi/4400505/teuthology.log

2019-10-11T08:56:32.771 INFO:tasks.ceph.osd.0.smithi103.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.4-230-g6bd64f3/rpm/el7/BUILD/ceph-14.2.4-230-g6bd64f3/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7fda77434e00 time 2019-10-11 08:56:32.776616
2019-10-11T08:56:32.771 INFO:tasks.ceph.osd.0.smithi103.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.4-230-g6bd64f3/rpm/el7/BUILD/ceph-14.2.4-230-g6bd64f3/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
2019-10-11T08:56:32.778 INFO:tasks.ceph.osd.0.smithi103.stderr: ceph version 14.2.4-230-g6bd64f3 (6bd64f37f60816660a82db0da2abcc49f30d9ddd) nautilus (stable)
2019-10-11T08:56:32.779 INFO:tasks.ceph.osd.0.smithi103.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x55fba0e94a24]
2019-10-11T08:56:32.779 INFO:tasks.ceph.osd.0.smithi103.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x55fba0e94bf2]
2019-10-11T08:56:32.779 INFO:tasks.ceph.osd.0.smithi103.stderr: 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0x55fba14c600c]
2019-10-11T08:56:32.779 INFO:tasks.ceph.osd.0.smithi103.stderr: 4: (BlueFS::mount()+0x2aa) [0x55fba149022a]
2019-10-11T08:56:32.779 INFO:tasks.ceph.osd.0.smithi103.stderr: 5: (BlueStore::_open_bluefs(bool)+0x41) [0x55fba136ed51]
2019-10-11T08:56:32.779 INFO:tasks.ceph.osd.0.smithi103.stderr: 6: (BlueStore::_open_db(bool, bool, bool)+0x5ec) [0x55fba136fd6c]
2019-10-11T08:56:32.780 INFO:tasks.ceph.osd.0.smithi103.stderr: 7: (BlueStore::_open_db_and_around(bool)+0x44) [0x55fba138d254]
2019-10-11T08:56:32.780 INFO:tasks.ceph.osd.0.smithi103.stderr: 8: (BlueStore::_fsck(bool, bool)+0xe5c) [0x55fba13bfcbc]
2019-10-11T08:56:32.780 INFO:tasks.ceph.osd.0.smithi103.stderr: 9: (BlueStore::_mount(bool, bool)+0x203) [0x55fba13cb7d3]
2019-10-11T08:56:32.780 INFO:tasks.ceph.osd.0.smithi103.stderr: 10: (OSD::init()+0x3aa) [0x55fba0f3eefa]
2019-10-11T08:56:32.780 INFO:tasks.ceph.osd.0.smithi103.stderr: 11: (main()+0x14fa) [0x55fba0e991da]
2019-10-11T08:56:32.780 INFO:tasks.ceph.osd.0.smithi103.stderr: 12: (__libc_start_main()+0xf5) [0x7fda72e69495]
2019-10-11T08:56:32.780 INFO:tasks.ceph.osd.0.smithi103.stderr: 13: (()+0x4b2695) [0x55fba0ece695]
2019-10-11T08:56:32.781 INFO:tasks.ceph.osd.0.smithi103.stderr:*** Caught signal (Aborted) **
2019-10-11T08:56:32.781 INFO:tasks.ceph.osd.0.smithi103.stderr: in thread 7fda77434e00 thread_name:ceph-osd
2019-10-11T08:56:32.781 INFO:tasks.ceph.osd.0.smithi103.stderr:2019-10-11 08:56:32.783 7fda77434e00 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.4-230-g6bd64f3/rpm/el7/BUILD/ceph-14.2.4-230-g6bd64f3/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7fda77434e00 time 2019-10-11 08:56:32.776616
2019-10-11T08:56:32.781 INFO:tasks.ceph.osd.0.smithi103.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.4-230-g6bd64f3/rpm/el7/BUILD/ceph-14.2.4-230-g6bd64f3/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
2019-10-11T08:56:32.781 INFO:tasks.ceph.osd.0.smithi103.stderr:
2019-10-11T08:56:32.781 INFO:tasks.ceph.osd.0.smithi103.stderr: ceph version 14.2.4-230-g6bd64f3 (6bd64f37f60816660a82db0da2abcc49f30d9ddd) nautilus (stable)
2019-10-11T08:56:32.781 INFO:tasks.ceph.osd.0.smithi103.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x55fba0e94a24]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x55fba0e94bf2]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0x55fba14c600c]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 4: (BlueFS::mount()+0x2aa) [0x55fba149022a]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 5: (BlueStore::_open_bluefs(bool)+0x41) [0x55fba136ed51]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 6: (BlueStore::_open_db(bool, bool, bool)+0x5ec) [0x55fba136fd6c]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 7: (BlueStore::_open_db_and_around(bool)+0x44) [0x55fba138d254]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 8: (BlueStore::_fsck(bool, bool)+0xe5c) [0x55fba13bfcbc]
2019-10-11T08:56:32.782 INFO:tasks.ceph.osd.0.smithi103.stderr: 9: (BlueStore::_mount(bool, bool)+0x203) [0x55fba13cb7d3]
2019-10-11T08:56:32.783 INFO:tasks.ceph.osd.0.smithi103.stderr: 10: (OSD::init()+0x3aa) [0x55fba0f3eefa]
2019-10-11T08:56:32.783 INFO:tasks.ceph.osd.0.smithi103.stderr: 11: (main()+0x14fa) [0x55fba0e991da]
2019-10-11T08:56:32.783 INFO:tasks.ceph.osd.0.smithi103.stderr: 12: (__libc_start_main()+0xf5) [0x7fda72e69495]
2019-10-11T08:56:32.783 INFO:tasks.ceph.osd.0.smithi103.stderr: 13: (()+0x4b2695) [0x55fba0ece695]
2019-10-11T08:56:32.783 INFO:tasks.ceph.osd.0.smithi103.stderr:
2019-10-11T08:56:32.785 INFO:tasks.ceph.osd.0.smithi103.stderr: ceph version 14.2.4-230-g6bd64f3 (6bd64f37f60816660a82db0da2abcc49f30d9ddd) nautilus (stable)
2019-10-11T08:56:32.785 INFO:tasks.ceph.osd.0.smithi103.stderr: 1: (()+0xf5d0) [0x7fda740865d0]
2019-10-11T08:56:32.785 INFO:tasks.ceph.osd.0.smithi103.stderr: 2: (gsignal()+0x37) [0x7fda72e7d2c7]
2019-10-11T08:56:32.785 INFO:tasks.ceph.osd.0.smithi103.stderr: 3: (abort()+0x148) [0x7fda72e7e9b8]
2019-10-11T08:56:32.786 INFO:tasks.ceph.osd.0.smithi103.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x199) [0x55fba0e94a73]
2019-10-11T08:56:32.786 INFO:tasks.ceph.osd.0.smithi103.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x55fba0e94bf2]
2019-10-11T08:56:32.786 INFO:tasks.ceph.osd.0.smithi103.stderr: 6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0x55fba14c600c]
2019-10-11T08:56:32.786 INFO:tasks.ceph.osd.0.smithi103.stderr: 7: (BlueFS::mount()+0x2aa) [0x55fba149022a]
2019-10-11T08:56:32.786 INFO:tasks.ceph.osd.0.smithi103.stderr: 8: (BlueStore::_open_bluefs(bool)+0x41) [0x55fba136ed51]
2019-10-11T08:56:32.786 INFO:tasks.ceph.osd.0.smithi103.stderr: 9: (BlueStore::_open_db(bool, bool, bool)+0x5ec) [0x55fba136fd6c]
2019-10-11T08:56:32.786 INFO:tasks.ceph.osd.0.smithi103.stderr: 10: (BlueStore::_open_db_and_around(bool)+0x44) [0x55fba138d254]
2019-10-11T08:56:32.787 INFO:tasks.ceph.osd.0.smithi103.stderr: 11: (BlueStore::_fsck(bool, bool)+0xe5c) [0x55fba13bfcbc]
2019-10-11T08:56:32.787 INFO:tasks.ceph.osd.0.smithi103.stderr: 12: (BlueStore::_mount(bool, bool)+0x203) [0x55fba13cb7d3]
2019-10-11T08:56:32.787 INFO:tasks.ceph.osd.0.smithi103.stderr: 13: (OSD::init()+0x3aa) [0x55fba0f3eefa]
2019-10-11T08:56:32.787 INFO:tasks.ceph.osd.0.smithi103.stderr: 14: (main()+0x14fa) [0x55fba0e991da]
2019-10-11T08:56:32.787 INFO:tasks.ceph.osd.0.smithi103.stderr: 15: (__libc_start_main()+0xf5) [0x7fda72e69495]
2019-10-11T08:56:32.788 INFO:tasks.ceph.osd.0.smithi103.stderr: 16: (()+0x4b2695) [0x55fba0ece695]
2019-10-11T08:56:32.788 INFO:tasks.ceph.osd.0.smithi103.stderr:2019-10-11 08:56:32.790 7fda77434e00 -1 *** Caught signal (Aborted) **
2019-10-11T08:56:32.789 INFO:tasks.ceph.osd.0.smithi103.stderr: in thread 7fda77434e00 thread_name:ceph-osd

Related issues 1 (0 open — 1 closed)

Is duplicate of bluestore - Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)ResolvedIgor Fedotov

Actions
Actions
Copy link
 #1

Updated by Jason Dillaman over 4 years ago

  • Project changed from rbd to RADOS

Bluestore crash -- moving to RADOS

Actions
Copy link
 #2

Updated by Neha Ojha over 4 years ago

  • Project changed from RADOS to bluestore
  • Subject changed from *** Caught signal (Aborted) ** in upgrade:luminous-x-nautilus to fastbmap_allocator_impl.h: FAILED ceph_assert(available >= allocated) in upgrade:luminous-x-nautilus
Actions
Copy link
 #3

Updated by Igor Fedotov over 4 years ago

  • Status changed from New to Duplicate

haha - we've finally got it locally...

https://tracker.ceph.com/issues/42223

Actions
Copy link
 #4

Updated by Igor Fedotov over 4 years ago

  • Is duplicate of Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated) added
Actions
Copy link

Also available in: Atom PDF