Bug #13783
closedmonitors crashing constantly with 0.94.5
0%
Description
Deployed a new ceph hammer cluster on hardware using puppet. Last time we tested was with 0.94.3 which went fine, but this deployment with 0.94.5 does not work. The monitors keep crashing with a 'segmentation fault'. Already happened when we had one monitor. Now that we have three, usually two or all three go down. Seen this when processing crushmap, auth and osd commands so can't narrow down the cause.
Added logs of all three monitors with debug_mon level 20.
Could be a duplicate of issue #13748 but I can't tell so I created a separate ticket.
Definitely critical because this is making it impossible for us to run ceph!
Files
Updated by Tom Verdaat over 8 years ago
- File ceph-mon.00219ba7d71d.log.tar.gz ceph-mon.00219ba7d71d.log.tar.gz added
- File ceph-mon.f04da200e0ee.log.tar.gz ceph-mon.f04da200e0ee.log.tar.gz added
- File ceph-mon.f04da200dc1d.log.1.tar.gz ceph-mon.f04da200dc1d.log.1.tar.gz added
- File ceph-mon.f04da200dc1d.log.2.tar.gz ceph-mon.f04da200dc1d.log.2.tar.gz added
Logs now small enough to be attached :)
Updated by Joao Eduardo Luis over 8 years ago
Yep, looks like a duplicate. Let me make the same request I made on the other ticket: can you share your monitor's store.db?
Updated by Tom Verdaat over 8 years ago
Done! They were slightly large so I sent them to you by e-mail.
Updated by Nathan Cutler over 8 years ago
- Related to Bug #13748: ceph-mons crashing constantly after 0.94.3->0.94.5 upgrade added
Updated by Joao Eduardo Luis over 8 years ago
- Category set to Monitor
- Priority changed from Normal to Urgent
Updated by Tom Verdaat over 8 years ago
Quick note: we've upgraded to infernalis and it runs as expected, as also confirmed by Logan V in the other ticket. Means this regression is limited to hammer!
Updated by Joao Eduardo Luis over 8 years ago
- Status changed from New to Duplicate
From the trace I can tell this is indeed a duplicate of #13748. Will follow up there.