Bug #39279: "terminate called after throwing an instance of 'ceph::buffer::malformed_input'" in upgrade:nautilus-p2p - Ceph - Ceph

Actions

Copy link

Bug #39279

closed

"terminate called after throwing an instance of 'ceph::buffer::malformed_input'" in upgrade:nautilus-p2p

Added by Yuri Weinstein about 5 years ago. Updated over 4 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

nautilus

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

v14.2.1

ceph-qa-suite:

upgrade/nautilus-p2p

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Run: http://pulpito.ceph.com/nojha-2019-04-12_02:03:08-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/
Jobs: '3835043', '3835041', '3835047', '3835045'
Logs:/a/nojha-2019-04-12_02:03:08-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/3835041/teuthology.log

2019-04-12T02:42:46.297 INFO:tasks.ceph.osd.0.smithi121.stderr:terminate called after throwing an instance of 'ceph::buffer::malformed_input'
2019-04-12T02:42:46.297 INFO:tasks.ceph.osd.0.smithi121.stderr:  what():  buffer::malformed_input: void object_stat_sum_t::decode(ceph::buffer::v14_2_0::list::const_iterator&) decode past end of struct encoding
2019-04-12T02:42:46.297 INFO:tasks.ceph.osd.0.smithi121.stderr:*** Caught signal (Aborted) **
2019-04-12T02:42:46.298 INFO:tasks.ceph.osd.0.smithi121.stderr: in thread 7f17a12cdd80 thread_name:ceph-osd
2019-04-12T02:42:46.301 INFO:tasks.ceph.osd.0.smithi121.stderr: ceph version 14.2.0-232-ga5f8538 (a5f853800c23317121878b4c718cbde419b92aea) nautilus (stable)
2019-04-12T02:42:46.301 INFO:tasks.ceph.osd.0.smithi121.stderr: 1: (()+0xf6d0) [0x7f179df206d0]
2019-04-12T02:42:46.301 INFO:tasks.ceph.osd.0.smithi121.stderr: 2: (gsignal()+0x37) [0x7f179cd19277]
2019-04-12T02:42:46.301 INFO:tasks.ceph.osd.0.smithi121.stderr: 3: (abort()+0x148) [0x7f179cd1a968]
2019-04-12T02:42:46.302 INFO:tasks.ceph.osd.0.smithi121.stderr: 4: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f179d6287d5]
2019-04-12T02:42:46.302 INFO:tasks.ceph.osd.0.smithi121.stderr: 5: (()+0x5e746) [0x7f179d626746]
2019-04-12T02:42:46.302 INFO:tasks.ceph.osd.0.smithi121.stderr: 6: (()+0x5e773) [0x7f179d626773]
2019-04-12T02:42:46.302 INFO:tasks.ceph.osd.0.smithi121.stderr: 7: (()+0x5e993) [0x7f179d626993]
2019-04-12T02:42:46.302 INFO:tasks.ceph.osd.0.smithi121.stderr: 8: (object_stat_sum_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x706) [0x557d7a707776]
2019-04-12T02:42:46.303 INFO:tasks.ceph.osd.0.smithi121.stderr: 9: (object_stat_collection_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x69) [0x557d7a70e6e9]
2019-04-12T02:42:46.303 INFO:tasks.ceph.osd.0.smithi121.stderr: 10: (pg_stat_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x1d8) [0x557d7a713c18]
2019-04-12T02:42:46.303 INFO:tasks.ceph.osd.0.smithi121.stderr: 11: (pg_info_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x130) [0x557d7a7143c0]
2019-04-12T02:42:46.303 INFO:tasks.ceph.osd.0.smithi121.stderr: 12: (PG::read_info(ObjectStore*, spg_t, coll_t const&, pg_info_t&, PastIntervals&, unsigned char&)+0x242) [0x557d7a544ce2]
2019-04-12T02:42:46.303 INFO:tasks.ceph.osd.0.smithi121.stderr: 13: (PG::read_state(ObjectStore*)+0x56) [0x557d7a590b96]
2019-04-12T02:42:46.303 INFO:tasks.ceph.osd.0.smithi121.stderr: 14: (OSD::load_pgs()+0x696) [0x557d7a4ab7d6]
2019-04-12T02:42:46.304 INFO:tasks.ceph.osd.0.smithi121.stderr: 15: (OSD::init()+0x297b) [0x557d7a4d434b]
2019-04-12T02:42:46.304 INFO:tasks.ceph.osd.0.smithi121.stderr: 16: (main()+0x14fa) [0x557d7a36e1da]
2019-04-12T02:42:46.304 INFO:tasks.ceph.osd.0.smithi121.stderr: 17: (__libc_start_main()+0xf5) [0x7f179cd05445]
2019-04-12T02:42:46.304 INFO:tasks.ceph.osd.0.smithi121.stderr: 18: (()+0x564555) [0x557d7a462555]
2019-04-12T02:42:46.305 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-04-12 02:42:46.246 7f17a12cdd80 -1 *** Caught signal (Aborted) **
2019-04-12T02:42:46.305 INFO:tasks.ceph.osd.0.smithi121.stderr: in thread 7f17a12cdd80 thread_name:ceph-osd
2019-04-12T02:42:46.305 INFO:tasks.ceph.osd.0.smithi121.stderr:
2019-04-12T02:42:46.305 INFO:tasks.ceph.osd.0.smithi121.stderr: ceph version 14.2.0-232-ga5f8538 (a5f853800c23317121878b4c718cbde419b92aea) nautilus (stable)
2019-04-12T02:42:46.305 INFO:tasks.ceph.osd.0.smithi121.stderr: 1: (()+0xf6d0) [0x7f179df206d0]
2019-04-12T02:42:46.305 INFO:tasks.ceph.osd.0.smithi121.stderr: 2: (gsignal()+0x37) [0x7f179cd19277]
2019-04-12T02:42:46.306 INFO:tasks.ceph.osd.0.smithi121.stderr: 3: (abort()+0x148) [0x7f179cd1a968]
2019-04-12T02:42:46.306 INFO:tasks.ceph.osd.0.smithi121.stderr: 4: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f179d6287d5]
2019-04-12T02:42:46.306 INFO:tasks.ceph.osd.0.smithi121.stderr: 5: (()+0x5e746) [0x7f179d626746]
2019-04-12T02:42:46.306 INFO:tasks.ceph.osd.0.smithi121.stderr: 6: (()+0x5e773) [0x7f179d626773]
2019-04-12T02:42:46.306 INFO:tasks.ceph.osd.0.smithi121.stderr: 7: (()+0x5e993) [0x7f179d626993]
2019-04-12T02:42:46.307 INFO:tasks.ceph.osd.0.smithi121.stderr: 8: (object_stat_sum_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x706) [0x557d7a707776]
2019-04-12T02:42:46.307 INFO:tasks.ceph.osd.0.smithi121.stderr: 9: (object_stat_collection_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x69) [0x557d7a70e6e9]
2019-04-12T02:42:46.307 INFO:tasks.ceph.osd.0.smithi121.stderr: 10: (pg_stat_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x1d8) [0x557d7a713c18]
2019-04-12T02:42:46.307 INFO:tasks.ceph.osd.0.smithi121.stderr: 11: (pg_info_t::decode(ceph::buffer::v14_2_0::list::iterator_impl<true>&)+0x130) [0x557d7a7143c0]
2019-04-12T02:42:46.307 INFO:tasks.ceph.osd.0.smithi121.stderr: 12: (PG::read_info(ObjectStore*, spg_t, coll_t const&, pg_info_t&, PastIntervals&, unsigned char&)+0x242) [0x557d7a544ce2]
2019-04-12T02:42:46.307 INFO:tasks.ceph.osd.0.smithi121.stderr: 13: (PG::read_state(ObjectStore*)+0x56) [0x557d7a590b96]
2019-04-12T02:42:46.307 INFO:tasks.ceph.osd.0.smithi121.stderr: 14: (OSD::load_pgs()+0x696) [0x557d7a4ab7d6]
2019-04-12T02:42:46.308 INFO:tasks.ceph.osd.0.smithi121.stderr: 15: (OSD::init()+0x297b) [0x557d7a4d434b]
2019-04-12T02:42:46.308 INFO:tasks.ceph.osd.0.smithi121.stderr: 16: (main()+0x14fa) [0x557d7a36e1da]
2019-04-12T02:42:46.308 INFO:tasks.ceph.osd.0.smithi121.stderr: 17: (__libc_start_main()+0xf5) [0x7f179cd05445]
2019-04-12T02:42:46.308 INFO:tasks.ceph.osd.0.smithi121.stderr: 18: (()+0x564555) [0x557d7a462555]
2019-04-12T02:42:46.308 INFO:tasks.ceph.osd.0.smithi121.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.