Project

General

Profile

Bug #23266

"terminate called after throwing an instance of 'std::bad_alloc'" in upgrade:kraken-x-luminous-distro-basic-smithi

Added by Yuri Weinstein about 6 years ago. Updated about 6 years ago.

Status:
Won't Fix
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/kraken-x
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Out of memory ?

Run: http://pulpito.ceph.com/teuthology-2018-03-07_03:25:02-upgrade:kraken-x-luminous-distro-basic-smithi/
Job: 2260328
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2018-03-07_03:25:02-upgrade:kraken-x-luminous-distro-basic-smithi/2260328/teuthology.log

2018-03-07T13:47:07.781 INFO:teuthology.orchestra.run.smithi192:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops'
2018-03-07T13:47:07.781 INFO:tasks.ceph.osd.3.smithi185.stderr:terminate called after throwing an instance of 'std::bad_alloc'
2018-03-07T13:47:07.782 INFO:tasks.ceph.osd.3.smithi185.stderr:  what():  std::bad_alloc
2018-03-07T13:47:07.807 INFO:tasks.ceph.osd.3.smithi185.stderr:*** Caught signal (Aborted) **
2018-03-07T13:47:07.807 INFO:tasks.ceph.osd.3.smithi185.stderr: in thread 7fa483bb7980 thread_name:ceph-osd
2018-03-07T13:47:07.829 INFO:tasks.ceph.osd.1.smithi192.stderr:2018-03-07 13:47:07.833444 7f46c54ef700 -1 received  signal: Hangup from  PID: 13060 task name: /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1  UID: 0
2018-03-07T13:47:07.896 INFO:tasks.ceph.osd.3.smithi185.stderr: ceph version 11.2.1-12-gad30823 (ad30823c0d7544205669d09d1a6b0279f29ceab4)
2018-03-07T13:47:07.896 INFO:tasks.ceph.osd.3.smithi185.stderr: 1: (()+0x915bd2) [0x7fa483352bd2]
2018-03-07T13:47:07.896 INFO:tasks.ceph.osd.3.smithi185.stderr: 2: (()+0x10330) [0x7fa481aef330]
2018-03-07T13:47:07.896 INFO:tasks.ceph.osd.3.smithi185.stderr: 3: (gsignal()+0x37) [0x7fa480171c37]
2018-03-07T13:47:07.896 INFO:tasks.ceph.osd.3.smithi185.stderr: 4: (abort()+0x148) [0x7fa480175028]
2018-03-07T13:47:07.898 INFO:tasks.ceph.osd.3.smithi185.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7fa480a80535]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 6: (()+0x5e6d6) [0x7fa480a7e6d6]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 7: (()+0x5e703) [0x7fa480a7e703]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 8: (()+0x5e922) [0x7fa480a7e922]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 9: (()+0x3a339f) [0x7fa482de039f]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 10: (ceph::buffer::create_aligned(unsigned int, unsigned int)+0x2b8) [0x7fa483670b88]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 11: (KernelDevice::read(unsigned long, unsigned long, ceph::buffer::list*, IOContext*, bool)+0xe9) [0x7fa48333bd09]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 12: (()+0x7ed015) [0x7fa48322a015]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 13: (bluestore_blob_t::map(unsigned long, unsigned long, std::function<int (unsigned long, unsigned long)>) const+0xa0) [0x7fa483287850]
2018-03-07T13:47:07.899 INFO:tasks.ceph.osd.3.smithi185.stderr: 14: (BlueStore::_do_read(BlueStore::Collection*, boost::intrusive_ptr<BlueStore::Onode>, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0xd4b) [0x7fa48325e17b]
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: 15: (BlueStore::fsck(bool)+0x303b) [0x7fa4832774db]
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: 16: (BlueStore::mount()+0x259) [0x7fa48326e269]
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: 17: (OSD::init()+0x283) [0x7fa482eac993]
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: 18: (main()+0x29cd) [0x7fa482de397d]
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: 19: (__libc_start_main()+0xf5) [0x7fa48015cf45]
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: 20: (()+0x421186) [0x7fa482e5e186]
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr:2018-03-07 13:47:07.894327 7fa483bb7980 -1 *** Caught signal (Aborted) **
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: in thread 7fa483bb7980 thread_name:ceph-osd
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr:
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: ceph version 11.2.1-12-gad30823 (ad30823c0d7544205669d09d1a6b0279f29ceab4)
2018-03-07T13:47:07.900 INFO:tasks.ceph.osd.3.smithi185.stderr: 1: (()+0x915bd2) [0x7fa483352bd2]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 2: (()+0x10330) [0x7fa481aef330]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 3: (gsignal()+0x37) [0x7fa480171c37]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 4: (abort()+0x148) [0x7fa480175028]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7fa480a80535]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 6: (()+0x5e6d6) [0x7fa480a7e6d6]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 7: (()+0x5e703) [0x7fa480a7e703]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 8: (()+0x5e922) [0x7fa480a7e922]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 9: (()+0x3a339f) [0x7fa482de039f]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 10: (ceph::buffer::create_aligned(unsigned int, unsigned int)+0x2b8) [0x7fa483670b88]
2018-03-07T13:47:07.901 INFO:tasks.ceph.osd.3.smithi185.stderr: 11: (KernelDevice::read(unsigned long, unsigned long, ceph::buffer::list*, IOContext*, bool)+0xe9) [0x7fa48333bd09]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 12: (()+0x7ed015) [0x7fa48322a015]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 13: (bluestore_blob_t::map(unsigned long, unsigned long, std::function<int (unsigned long, unsigned long)>) const+0xa0) [0x7fa483287850]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 14: (BlueStore::_do_read(BlueStore::Collection*, boost::intrusive_ptr<BlueStore::Onode>, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0xd4b) [0x7fa48325e17b]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 15: (BlueStore::fsck(bool)+0x303b) [0x7fa4832774db]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 16: (BlueStore::mount()+0x259) [0x7fa48326e269]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 17: (OSD::init()+0x283) [0x7fa482eac993]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 18: (main()+0x29cd) [0x7fa482de397d]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 19: (__libc_start_main()+0xf5) [0x7fa48015cf45]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: 20: (()+0x421186) [0x7fa482e5e186]
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2018-03-07T13:47:07.902 INFO:tasks.ceph.osd.3.smithi185.stderr:

History

#1 Updated by Greg Farnum about 6 years ago

  • Project changed from Ceph to bluestore

#2 Updated by Greg Farnum about 6 years ago

  • Priority changed from Urgent to Normal

#3 Updated by Sage Weil about 6 years ago

  • Status changed from New to Won't Fix

don't care about kraken

Also available in: Atom PDF