Project

General

Profile

Actions

Bug #10210

closed

"Caught signal" in upgrade:dumpling-x-firefly-distro-basic-vps run

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
Joao Eduardo Luis
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-11-29_19:13:03-upgrade:dumpling-x-firefly-distro-basic-vps/626494/

2014-11-30T19:42:42.244 INFO:tasks.rados.rados.0.vpm177.stdout:2702: oids not in use 493
2014-11-30T19:42:42.244 INFO:tasks.rados.rados.0.vpm177.stdout:RollingBack 332 to 278
2014-11-30T19:42:42.601 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 1 to vpm17725100-80
2014-11-30T19:42:42.705 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 1 to vpm17725100-48
2014-11-30T19:42:42.706 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 2 to vpm17725100-48
2014-11-30T19:42:42.706 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 3 to vpm17725100-48
2014-11-30T19:42:42.706 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 4 to vpm17725100-48
2014-11-30T19:42:43.518 INFO:tasks.rados.rados.0.vpm177.stdout:2703: oids not in use 495
2014-11-30T19:42:43.518 INFO:tasks.rados.rados.0.vpm177.stdout:Deleting 383 current snap is 284
2014-11-30T19:42:47.532 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 1 to vpm17725100-65
2014-11-30T19:42:47.532 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 1 to vpm17725100-127
2014-11-30T19:42:48.444 INFO:tasks.ceph.mon.b.vpm042.stderr:terminate called after throwing an instance of 'std::bad_alloc'
2014-11-30T19:42:48.444 INFO:tasks.ceph.mon.b.vpm042.stderr:  what():  std::bad_alloc
2014-11-30T19:42:48.444 INFO:tasks.ceph.mon.b.vpm042.stderr:*** Caught signal (Aborted) **
2014-11-30T19:42:48.445 INFO:tasks.ceph.mon.b.vpm042.stderr: in thread 7fdabcdf9700
2014-11-30T19:42:48.467 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 2 to vpm17725100-127
2014-11-30T19:42:48.570 INFO:tasks.rados.rados.0.vpm177.stdout:finishing write tid 3 to vpm17725100-127
2014-11-30T19:42:50.105 INFO:tasks.ceph.mon.b.vpm042.stderr: ceph version 0.80.7-131-g4a148df (4a148df544978383c1ed7cd8b90f590adb563f3d)
2014-11-30T19:42:50.105 INFO:tasks.ceph.mon.b.vpm042.stderr: 1: ceph-mon() [0x90e1b2]
2014-11-30T19:42:50.105 INFO:tasks.ceph.mon.b.vpm042.stderr: 2: (()+0xf030) [0x7fdac2cee030]
2014-11-30T19:42:50.106 INFO:tasks.ceph.mon.b.vpm042.stderr: 3: (gsignal()+0x35) [0x7fdac1861475]
2014-11-30T19:42:50.106 INFO:tasks.ceph.mon.b.vpm042.stderr: 4: (abort()+0x180) [0x7fdac18646f0]
2014-11-30T19:42:50.106 INFO:tasks.ceph.mon.b.vpm042.stderr: 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fdac20b689d]
2014-11-30T19:42:50.106 INFO:tasks.ceph.mon.b.vpm042.stderr: 6: (()+0x63996) [0x7fdac20b4996]
2014-11-30T19:42:50.107 INFO:tasks.ceph.mon.b.vpm042.stderr: 7: (()+0x639c3) [0x7fdac20b49c3]
2014-11-30T19:42:50.107 INFO:tasks.ceph.mon.b.vpm042.stderr: 8: (()+0x63bee) [0x7fdac20b4bee]
2014-11-30T19:42:50.107 INFO:tasks.ceph.mon.b.vpm042.stderr: 9: (tc_new()+0x48e) [0x7fdac3184aee]
2014-11-30T19:42:50.107 INFO:tasks.ceph.mon.b.vpm042.stderr: 10: (std::string::_Rep::_S_create(unsigned long, unsigned long, std::allocator<char> const&)+0x59) [0x7fdac2110999]
2014-11-30T19:42:50.108 INFO:tasks.ceph.mon.b.vpm042.stderr: 11: (std::string::_Rep::_M_clone(std::allocator<char> const&, unsigned long)+0x28) [0x7fdac2111708]
2014-11-30T19:42:50.108 INFO:tasks.ceph.mon.b.vpm042.stderr: 12: (std::string::reserve(unsigned long)+0x30) [0x7fdac21117f0]
2014-11-30T19:42:50.108 INFO:tasks.ceph.mon.b.vpm042.stderr: 13: (std::string::append(char const*, unsigned long)+0xb5) [0x7fdac2111ab5]
2014-11-30T19:42:50.108 INFO:tasks.ceph.mon.b.vpm042.stderr: 14: (LevelDBStore::LevelDBTransactionImpl::set(std::string const&, std::string const&, ceph::buffer::list const&)+0x112) [0x8c9442]
2014-11-30T19:42:50.109 INFO:tasks.ceph.mon.b.vpm042.stderr: 15: (MonitorDBStore::apply_transaction(MonitorDBStore::Transaction const&)+0x196) [0x5fbee6]
2014-11-30T19:42:50.109 INFO:tasks.ceph.mon.b.vpm042.stderr: 16: (Paxos::handle_begin(MMonPaxos*)+0x30b) [0x65e82b]
2014-11-30T19:42:50.109 INFO:tasks.ceph.mon.b.vpm042.stderr: 17: (Paxos::dispatch(PaxosServiceMessage*)+0x22b) [0x66467b]
2014-11-30T19:42:50.109 INFO:tasks.ceph.mon.b.vpm042.stderr: 18: (Monitor::dispatch(MonSession*, Message*, bool)+0x4bc) [0x6374dc]
2014-11-30T19:42:50.110 INFO:tasks.ceph.mon.b.vpm042.stderr: 19: (Monitor::_ms_dispatch(Message*)+0x1c6) [0x637876]
2014-11-30T19:42:50.110 INFO:tasks.ceph.mon.b.vpm042.stderr: 20: (Monitor::ms_dispatch(Message*)+0x32) [0x654c22]
2014-11-30T19:42:50.110 INFO:tasks.ceph.mon.b.vpm042.stderr: 21: (DispatchQueue::entry()+0x4eb) [0x8dee0b]
2014-11-30T19:42:50.111 INFO:tasks.ceph.mon.b.vpm042.stderr: 22: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f89bd]
2014-11-30T19:42:50.111 INFO:tasks.ceph.mon.b.vpm042.stderr: 23: (()+0x6b50) [0x7fdac2ce5b50]
2014-11-30T19:42:50.111 INFO:tasks.ceph.mon.b.vpm042.stderr: 24: (clone()+0x6d) [0x7fdac1909a7d]
Actions #1

Updated by Samuel Just over 9 years ago

  • Assignee set to Joao Eduardo Luis
  • Priority changed from Normal to Urgent
Actions #2

Updated by Joao Eduardo Luis over 9 years ago

  • Status changed from New to Closed

This looks a lot like an ENOMEM. I've seen this happening on vps and sometimes during memory hungry operations (say, synchronizing several hundred GB stores) in memory-constrained environments.

Actions

Also available in: Atom PDF