Ceph » rgw

logs were turned off, so not much of that, but here's the backtrace. Happened on 7fc97e6 during a performance test (rwtest).

./include/xlist.h: In function 'void xlist<T>::remove(xlist<T>::item*) [with T = Objecter::Op*]', in thread '7fc33987e700'
./include/xlist.h: 130: FAILED assert((bool)_front == (bool)_size)
ceph version 0.39-79-g7fc97e6 (commit:7fc97e6f291f22e306ffc5416e769447f195bbf6)
1: (()+0xb0349) [0x7fc33e6f7349]
2: (Objecter::handle_osd_op_reply(MOSDOpReply*)+0xb8b) [0x7fc33e6ef06b]
3: (librados::RadosClient::_dispatch(Message*)+0x6c) [0x7fc33e6cdd3c]
4: (librados::RadosClient::ms_dispatch(Message*)+0x33) [0x7fc33e6cddc3]
5: (SimpleMessenger::dispatch_entry()+0x869) [0x7fc33e779b89]
6: (SimpleMessenger::DispatchThread::entry()+0x1c) [0x7fc33e6db1dc]
7: (()+0x68ba) [0x7fc33dfd28ba]
8: (clone()+0x6d) [0x7fc33ccc602d]
ceph version 0.39-79-g7fc97e6 (commit:7fc97e6f291f22e306ffc5416e769447f195bbf6)
1: (()+0xb0349) [0x7fc33e6f7349]
2: (Objecter::handle_osd_op_reply(MOSDOpReply*)+0xb8b) [0x7fc33e6ef06b]
3: (librados::RadosClient::_dispatch(Message*)+0x6c) [0x7fc33e6cdd3c]
4: (librados::RadosClient::ms_dispatch(Message*)+0x33) [0x7fc33e6cddc3]
5: (SimpleMessenger::dispatch_entry()+0x869) [0x7fc33e779b89]
6: (SimpleMessenger::DispatchThread::entry()+0x1c) [0x7fc33e6db1dc]
7: (()+0x68ba) [0x7fc33dfd28ba]
8: (clone()+0x6d) [0x7fc33ccc602d]

• Caught signal (Aborted) *
  in thread 7fc33987e700
  ceph version 0.39-79-g7fc97e6 (commit:7fc97e6f291f22e306ffc5416e769447f195bbf6)
  1: /usr/bin/radosgw() [0x495879]
  2: (()+0xef60) [0x7fc33dfdaf60]
  3: (gsignal()+0x35) [0x7fc33cc29165]
  4: (abort()+0x180) [0x7fc33cc2bf70]
  5: (_gnu_cxx::_verbose_terminate_handler()+0x115) [0x7fc33d4bcdc5]
  6: (()+0xcb166) [0x7fc33d4bb166]
  7: (()+0xcb193) [0x7fc33d4bb193]
  8: (()+0xcb28e) [0x7fc33d4bb28e]
  9: (ceph::__ceph_assert_fail(char const, char const*, int, char const*)+0x3a7) [0x4a7b17]
  10: (()+0xb0349) [0x7fc33e6f7349]
  11: (Objecter::handle_osd_op_reply(MOSDOpReply*)+0xb8b) [0x7fc33e6ef06b]
  12: (librados::RadosClient::_dispatch(Message*)+0x6c) [0x7fc33e6cdd3c]
  13: (librados::RadosClient::ms_dispatch(Message*)+0x33) [0x7fc33e6cddc3]
  14: (SimpleMessenger::dispatch_entry()+0x869) [0x7fc33e779b89]
  15: (SimpleMessenger::DispatchThread::entry()+0x1c) [0x7fc33e6db1dc]
  16: (()+0x68ba) [0x7fc33dfd28ba]
  17: (clone()+0x6d) [0x7fc33ccc602d]