Ceph » mgr

I've recently set up a CEPH cluster using cephadm, but noticed that sometimes manager daemons die 2-5 times a day due to segmentation fault:

Apr 29 06:04:33 beta dockerd-current[7064]: *** Caught signal (Segmentation fault) **
Apr 29 06:04:33 beta dockerd-current[7064]:  in thread 7fb54bb0a700 thread_name:mgr-fin
Apr 29 06:04:33 beta dockerd-current[7064]:  ceph version 15.2.1 (9fd2f65f91d9246fae2c841a6222d34d121680ee) octopus (stable)
Apr 29 06:04:33 beta dockerd-current[7064]:  1: (()+0x12dc0) [0x7fb5acc02dc0]
Apr 29 06:04:33 beta dockerd-current[7064]:  2: (PyDict_SetItem()+0x2be) [0x7fb5ade9195e]
Apr 29 06:04:33 beta dockerd-current[7064]:  3: (PyFormatter::dump_pyobject(std::basic_string_view<char, std::char_traits<char> >, _object*)+0x61) [0x56491338ebc1]
Apr 29 06:04:33 beta dockerd-current[7064]:  4: (LogEntry::dump(ceph::Formatter*) const+0x5a0) [0x7fb5ae5ea6c0]
Apr 29 06:04:33 beta dockerd-current[7064]:  5: (ActivePyModule::notify_clog(LogEntry const&)+0x2f0) [0x5649132e5780]
Apr 29 06:04:33 beta dockerd-current[7064]:  6: (Context::complete(int)+0xd) [0x5649132f3d9d]
Apr 29 06:04:33 beta dockerd-current[7064]:  7: (Finisher::finisher_thread_entry()+0x1a5) [0x7fb5ae5bb7d5]
Apr 29 06:04:33 beta dockerd-current[7064]:  8: (()+0x82de) [0x7fb5acbf82de]
Apr 29 06:04:33 beta dockerd-current[7064]:  9: (clone()+0x43) [0x7fb5ab78b133]
Apr 29 06:04:33 beta dockerd-current[7064]: debug 2020-04-29T03:04:33.732+0000 7fb54bb0a700 -1 *** Caught signal (Segmentation fault) **
Apr 29 06:04:33 beta dockerd-current[7064]:  in thread 7fb54bb0a700 thread_name:mgr-fin
Apr 29 06:04:33 beta dockerd-current[7064]:
Apr 29 06:04:33 beta dockerd-current[7064]:  ceph version 15.2.1 (9fd2f65f91d9246fae2c841a6222d34d121680ee) octopus (stable)
Apr 29 06:04:33 beta dockerd-current[7064]:  1: (()+0x12dc0) [0x7fb5acc02dc0]
Apr 29 06:04:33 beta dockerd-current[7064]:  2: (PyDict_SetItem()+0x2be) [0x7fb5ade9195e]
Apr 29 06:04:33 beta dockerd-current[7064]:  3: (PyFormatter::dump_pyobject(std::basic_string_view<char, std::char_traits<char> >, _object*)+0x61) [0x56491338ebc1]
Apr 29 06:04:33 beta dockerd-current[7064]:  4: (LogEntry::dump(ceph::Formatter*) const+0x5a0) [0x7fb5ae5ea6c0]
Apr 29 06:04:33 beta dockerd-current[7064]:  5: (ActivePyModule::notify_clog(LogEntry const&)+0x2f0) [0x5649132e5780]
Apr 29 06:04:33 beta dockerd-current[7064]:  6: (Context::complete(int)+0xd) [0x5649132f3d9d]
Apr 29 06:04:33 beta dockerd-current[7064]:  7: (Finisher::finisher_thread_entry()+0x1a5) [0x7fb5ae5bb7d5]
Apr 29 06:04:33 beta dockerd-current[7064]:  8: (()+0x82de) [0x7fb5acbf82de]
Apr 29 06:04:33 beta dockerd-current[7064]:  9: (clone()+0x43) [0x7fb5ab78b133]
Apr 29 06:04:33 beta dockerd-current[7064]:  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.