Actions
Bug #11100
closed"FAILED assert(beacon_seq_stamp[seq]" in upgrade:dumpling-x-firefly-distro-basic-vps run
Status:
Duplicate
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Run: http://pulpito.ceph.com/teuthology-2015-03-08_19:13:02-upgrade:dumpling-x-firefly-distro-basic-vps/
Job: 796074
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2015-03-08_19:13:02-upgrade:dumpling-x-firefly-distro-basic-vps/796074/
In teuthology@teuthology:/a/teuthology-2015-03-08_19:13:02-upgrade:dumpling-x-firefly-distro-basic-vps/796074/remote/vpm065/log$ zgrep "^ ceph version" ceph-mds.a.log.gz -b10 -a30
ceph-mds.a.log.gz:183389- 0> 2015-03-11 09:14:13.306171 7f5a99dd8700 -1 mds/MDS.cc: In function 'void MDS::handle_mds_beacon(MMDSBeacon*)' thread 7f5a99dd8700 time 2015-03-11 09:14:13.305324 ceph-mds.a.log.gz:183559-mds/MDS.cc: 666: FAILED assert(beacon_seq_stamp[seq] > beacon_last_acked_stamp) ceph-mds.a.log.gz:183639- ceph-mds.a.log.gz:183640: ceph version 0.61.9-11-ge146934 (e146934ea488219075209816ee96dd16b6d89da2) ceph-mds.a.log.gz:183716- 1: (MDS::handle_mds_beacon(MMDSBeacon*)+0x16b) [0x4b7c6b] ceph-mds.a.log.gz:183775- 2: (MDS::handle_core_message(Message*)+0x923) [0x4cc893] ceph-mds.a.log.gz:183833- 3: (MDS::_dispatch(Message*)+0x2f) [0x4cc97f] ceph-mds.a.log.gz:183880- 4: (MDS::ms_dispatch(Message*)+0x19b) [0x4ce42b] ceph-mds.a.log.gz:183930- 5: (DispatchQueue::entry()+0x421) [0x84dea1] ceph-mds.a.log.gz:183976- 6: (DispatchQueue::DispatchThread::entry()+0xd) [0x8207bd] ceph-mds.a.log.gz:184036- 7: (()+0x79d1) [0x7f5a9f32c9d1] ceph-mds.a.log.gz:184069- 8: (clone()+0x6d) [0x7f5a9e26086d] ceph-mds.a.log.gz:184105- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. ceph-mds.a.log.gz:184198- ceph-mds.a.log.gz:184199---- logging levels --- ceph-mds.a.log.gz:184222- 0/ 5 none ceph-mds.a.log.gz:184235- 0/ 1 lockdep ceph-mds.a.log.gz:184251- 0/ 1 context ceph-mds.a.log.gz:184267- 1/ 1 crush ceph-mds.a.log.gz:184281- 1/ 5 mds ceph-mds.a.log.gz:184293- 1/ 5 mds_balancer ceph-mds.a.log.gz:184314- 1/ 5 mds_locker ceph-mds.a.log.gz:184333- 1/ 5 mds_log ceph-mds.a.log.gz:184349- 1/ 5 mds_log_expire ceph-mds.a.log.gz:184372- 1/ 5 mds_migrator ceph-mds.a.log.gz:184393- 0/ 1 buffer ceph-mds.a.log.gz:184408- 0/ 1 timer ceph-mds.a.log.gz:184422- 0/ 1 filer ceph-mds.a.log.gz:184436- 0/ 1 striper ceph-mds.a.log.gz:184452- 0/ 1 objecter ceph-mds.a.log.gz:184469- 0/ 5 rados ceph-mds.a.log.gz:184483- 0/ 5 rbd ceph-mds.a.log.gz:184495- 0/ 5 journaler ceph-mds.a.log.gz:184513- 0/ 5 objectcacher ceph-mds.a.log.gz:184534- 0/ 5 client ceph-mds.a.log.gz:184549- 0/ 5 osd ceph-mds.a.log.gz:184561- 0/ 5 optracker ceph-mds.a.log.gz:184579- 0/ 5 objclass ceph-mds.a.log.gz:184596- 1/ 3 filestore ceph-mds.a.log.gz:184614- 1/ 3 journal ceph-mds.a.log.gz:184630- 0/ 5 ms ceph-mds.a.log.gz:184641- 1/ 5 mon ceph-mds.a.log.gz:184653- 0/10 monc ceph-mds.a.log.gz:184666- 0/ 5 paxos ceph-mds.a.log.gz:184680- 0/ 5 tp ceph-mds.a.log.gz:184691- 1/ 5 auth ceph-mds.a.log.gz:184704- 1/ 5 crypto ceph-mds.a.log.gz:184719- 1/ 1 finisher ceph-mds.a.log.gz:184736- 1/ 5 heartbeatmap ceph-mds.a.log.gz:184757- 1/ 5 perfcounter ceph-mds.a.log.gz:184777- 1/ 5 rgw ceph-mds.a.log.gz:184789- 1/ 5 hadoop ceph-mds.a.log.gz:184804- 1/ 5 javaclient ceph-mds.a.log.gz:184823- 1/ 5 asok ceph-mds.a.log.gz:184836- 1/ 1 throttle ceph-mds.a.log.gz:184853- -2/-2 (syslog threshold) ceph-mds.a.log.gz:184880- -1/-1 (stderr threshold) ceph-mds.a.log.gz:184907- max_recent 10000 ceph-mds.a.log.gz:184930- max_new 1000 ceph-mds.a.log.gz:184953- log_file /var/log/ceph/ceph-mds.a.log ceph-mds.a.log.gz:184993---- end dump of recent events --- ceph-mds.a.log.gz:185027-2015-03-11 09:14:13.320806 7f5a99dd8700 -1 *** Caught signal (Aborted) ** ceph-mds.a.log.gz:185101- in thread 7f5a99dd8700 ceph-mds.a.log.gz:185125- ceph-mds.a.log.gz:185126: ceph version 0.61.9-11-ge146934 (e146934ea488219075209816ee96dd16b6d89da2) ceph-mds.a.log.gz:185202- 1: ceph-mds() [0x85a781] ceph-mds.a.log.gz:185228- 2: (()+0xf710) [0x7f5a9f334710] ceph-mds.a.log.gz:185261- 3: (gsignal()+0x35) [0x7f5a9e1aa635] ceph-mds.a.log.gz:185299- 4: (abort()+0x175) [0x7f5a9e1abe15] ceph-mds.a.log.gz:185336- 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f5a9ea64a5d] ceph-mds.a.log.gz:185406- 6: (()+0xbcbe6) [0x7f5a9ea62be6] ceph-mds.a.log.gz:185440- 7: (()+0xbcc13) [0x7f5a9ea62c13] ceph-mds.a.log.gz:185474- 8: (()+0xbcd0e) [0x7f5a9ea62d0e] ceph-mds.a.log.gz:185508- 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f2) [0x76b242] ceph-mds.a.log.gz:185600- 10: (MDS::handle_mds_beacon(MMDSBeacon*)+0x16b) [0x4b7c6b] ceph-mds.a.log.gz:185660- 11: (MDS::handle_core_message(Message*)+0x923) [0x4cc893] ceph-mds.a.log.gz:185719- 12: (MDS::_dispatch(Message*)+0x2f) [0x4cc97f] ceph-mds.a.log.gz:185767- 13: (MDS::ms_dispatch(Message*)+0x19b) [0x4ce42b] ceph-mds.a.log.gz:185818- 14: (DispatchQueue::entry()+0x421) [0x84dea1] ceph-mds.a.log.gz:185865- 15: (DispatchQueue::DispatchThread::entry()+0xd) [0x8207bd] ceph-mds.a.log.gz:185926- 16: (()+0x79d1) [0x7f5a9f32c9d1] ceph-mds.a.log.gz:185960- 17: (clone()+0x6d) [0x7f5a9e26086d] ceph-mds.a.log.gz:185997- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. ceph-mds.a.log.gz:186090- ceph-mds.a.log.gz:186091---- begin dump of recent events --- ceph-mds.a.log.gz:186127- 0> 2015-03-11 09:14:13.320806 7f5a99dd8700 -1 *** Caught signal (Aborted) ** ceph-mds.a.log.gz:186209- in thread 7f5a99dd8700 ceph-mds.a.log.gz:186233- ceph-mds.a.log.gz:186234: ceph version 0.61.9-11-ge146934 (e146934ea488219075209816ee96dd16b6d89da2) ceph-mds.a.log.gz:186310- 1: ceph-mds() [0x85a781] ceph-mds.a.log.gz:186336- 2: (()+0xf710) [0x7f5a9f334710] ceph-mds.a.log.gz:186369- 3: (gsignal()+0x35) [0x7f5a9e1aa635] ceph-mds.a.log.gz:186407- 4: (abort()+0x175) [0x7f5a9e1abe15] ceph-mds.a.log.gz:186444- 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f5a9ea64a5d] ceph-mds.a.log.gz:186514- 6: (()+0xbcbe6) [0x7f5a9ea62be6] ceph-mds.a.log.gz:186548- 7: (()+0xbcc13) [0x7f5a9ea62c13] ceph-mds.a.log.gz:186582- 8: (()+0xbcd0e) [0x7f5a9ea62d0e] ceph-mds.a.log.gz:186616- 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f2) [0x76b242] ceph-mds.a.log.gz:186708- 10: (MDS::handle_mds_beacon(MMDSBeacon*)+0x16b) [0x4b7c6b] ceph-mds.a.log.gz:186768- 11: (MDS::handle_core_message(Message*)+0x923) [0x4cc893] ceph-mds.a.log.gz:186827- 12: (MDS::_dispatch(Message*)+0x2f) [0x4cc97f] ceph-mds.a.log.gz:186875- 13: (MDS::ms_dispatch(Message*)+0x19b) [0x4ce42b] ceph-mds.a.log.gz:186926- 14: (DispatchQueue::entry()+0x421) [0x84dea1] ceph-mds.a.log.gz:186973- 15: (DispatchQueue::DispatchThread::entry()+0xd) [0x8207bd] ceph-mds.a.log.gz:187034- 16: (()+0x79d1) [0x7f5a9f32c9d1] ceph-mds.a.log.gz:187068- 17: (clone()+0x6d) [0x7f5a9e26086d] ceph-mds.a.log.gz:187105- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Actions