Project

General

Profile

Actions

Bug #14347

closed

Failed after 'ceph::buffer::bad_alloc' in upgrade:infernalis-x-jewel-distro-basic-vps

Added by Yuri Weinstein over 8 years ago. Updated about 7 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/infernalis-x
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2016-01-11_17:10:02-upgrade:infernalis-x-jewel-distro-basic-vps/
Job: 24770
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2016-01-11_17:10:02-upgrade:infernalis-x-jewel-distro-basic-vps/24770/teuthology.log

2016-01-11T23:08:35.101 INFO:teuthology.orchestra.run.vpm046:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph pg dump --format json'
2016-01-11T23:08:37.017 INFO:tasks.ceph.mon.c.vpm193.stderr:terminate called after throwing an instance of 'ceph::buffer::bad_alloc'
2016-01-11T23:08:37.018 INFO:tasks.ceph.mon.c.vpm193.stderr:  what():  buffer::bad_alloc
2016-01-11T23:08:37.039 INFO:tasks.ceph.mon.c.vpm193.stderr:*** Caught signal (Aborted) **
2016-01-11T23:08:37.039 INFO:tasks.ceph.mon.c.vpm193.stderr: in thread 7f89ace58700
2016-01-11T23:08:37.327 INFO:tasks.ceph.mon.c.vpm193.stderr: ceph version 10.0.1-638-g20ac64f (20ac64f139263cf10db6dd1601c751031dfead31)
2016-01-11T23:08:37.328 INFO:tasks.ceph.mon.c.vpm193.stderr: 1: (()+0x48c96a) [0x7f89b59e096a]
2016-01-11T23:08:37.328 INFO:tasks.ceph.mon.c.vpm193.stderr: 2: (()+0x10340) [0x7f89b463a340]
2016-01-11T23:08:37.328 INFO:tasks.ceph.mon.c.vpm193.stderr: 3: (gsignal()+0x39) [0x7f89b2adbcc9]
2016-01-11T23:08:37.328 INFO:tasks.ceph.mon.c.vpm193.stderr: 4: (abort()+0x148) [0x7f89b2adf0d8]
2016-01-11T23:08:37.328 INFO:tasks.ceph.mon.c.vpm193.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f89b33e6535]
2016-01-11T23:08:37.328 INFO:tasks.ceph.mon.c.vpm193.stderr: 6: (()+0x5e6d6) [0x7f89b33e46d6]
2016-01-11T23:08:37.329 INFO:tasks.ceph.mon.c.vpm193.stderr: 7: (()+0x5e703) [0x7f89b33e4703]
2016-01-11T23:08:37.329 INFO:tasks.ceph.mon.c.vpm193.stderr: 8: (()+0x5e922) [0x7f89b33e4922]
2016-01-11T23:08:37.329 INFO:tasks.ceph.mon.c.vpm193.stderr: 9: (ceph::buffer::create_aligned(unsigned int, unsigned int)+0x273) [0x7f89b5ae8143]
2016-01-11T23:08:37.329 INFO:tasks.ceph.mon.c.vpm193.stderr: 10: (ceph::buffer::list::append(char const*, unsigned int)+0x48) [0x7f89b5ae8338]
2016-01-11T23:08:37.329 INFO:tasks.ceph.mon.c.vpm193.stderr: 11: (ceph::buffer::list::append(std::istream&)+0x82) [0x7f89b5ae8462]
2016-01-11T23:08:37.330 INFO:tasks.ceph.mon.c.vpm193.stderr: 12: (PGMonitor::preprocess_command(std::shared_ptr<MonOpRequest>)+0xca3) [0x7f89b5896c83]
2016-01-11T23:08:37.330 INFO:tasks.ceph.mon.c.vpm193.stderr: 13: (PGMonitor::preprocess_query(std::shared_ptr<MonOpRequest>)+0x3c2) [0x7f89b5899b52]
2016-01-11T23:08:37.330 INFO:tasks.ceph.mon.c.vpm193.stderr: 14: (PaxosService::dispatch(std::shared_ptr<MonOpRequest>)+0x883) [0x7f89b57eb8a3]
2016-01-11T23:08:37.330 INFO:tasks.ceph.mon.c.vpm193.stderr: 15: (Monitor::handle_command(std::shared_ptr<MonOpRequest>)+0x1d8b) [0x7f89b57b03db]
2016-01-11T23:08:37.330 INFO:tasks.ceph.mon.c.vpm193.stderr: 16: (Monitor::dispatch_op(std::shared_ptr<MonOpRequest>)+0x32b) [0x7f89b57b422b]
2016-01-11T23:08:37.330 INFO:tasks.ceph.mon.c.vpm193.stderr: 17: (Monitor::_ms_dispatch(Message*)+0x66b) [0x7f89b57b550b]
2016-01-11T23:08:37.331 INFO:tasks.ceph.mon.c.vpm193.stderr: 18: (Monitor::ms_dispatch(Message*)+0x23) [0x7f89b57d4503]
2016-01-11T23:08:37.331 INFO:tasks.ceph.mon.c.vpm193.stderr: 19: (DispatchQueue::entry()+0x64a) [0x7f89b5bc6f8a]
2016-01-11T23:08:37.331 INFO:tasks.ceph.mon.c.vpm193.stderr: 20: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f89b5ac92bd]
2016-01-11T23:08:37.331 INFO:tasks.ceph.mon.c.vpm193.stderr: 21: (()+0x8182) [0x7f89b4632182]
2016-01-11T23:08:37.331 INFO:tasks.ceph.mon.c.vpm193.stderr: 22: (clone()+0x6d) [0x7f89b2b9f47d]
Actions #1

Updated by Samuel Just about 8 years ago

  • Status changed from New to Need More Info
  • Assignee set to Kefu Chai

Kefu: did this just hit an oom?

Actions #2

Updated by Josh Durgin about 7 years ago

  • Status changed from Need More Info to Rejected

This is a symptom of being out of memory - which was not hard to hit on vps with little ram.

Actions

Also available in: Atom PDF