Project

General

Profile

Bug #11100

"FAILED assert(beacon_seq_stamp[seq]" in upgrade:dumpling-x-firefly-distro-basic-vps run

Added by Yuri Weinstein over 4 years ago. Updated over 4 years ago.

Status:
Duplicate
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
Start date:
03/11/2015
Due date:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:

Description

Run: http://pulpito.ceph.com/teuthology-2015-03-08_19:13:02-upgrade:dumpling-x-firefly-distro-basic-vps/
Job: 796074
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2015-03-08_19:13:02-upgrade:dumpling-x-firefly-distro-basic-vps/796074/

In teuthology@teuthology:/a/teuthology-2015-03-08_19:13:02-upgrade:dumpling-x-firefly-distro-basic-vps/796074/remote/vpm065/log$ zgrep "^ ceph version" ceph-mds.a.log.gz -b10 -a30

ceph-mds.a.log.gz:183389-     0> 2015-03-11 09:14:13.306171 7f5a99dd8700 -1 mds/MDS.cc: In function 'void MDS::handle_mds_beacon(MMDSBeacon*)' thread 7f5a99dd8700 time 2015-03-11 09:14:13.305324
ceph-mds.a.log.gz:183559-mds/MDS.cc: 666: FAILED assert(beacon_seq_stamp[seq] > beacon_last_acked_stamp)
ceph-mds.a.log.gz:183639-
ceph-mds.a.log.gz:183640: ceph version 0.61.9-11-ge146934 (e146934ea488219075209816ee96dd16b6d89da2)
ceph-mds.a.log.gz:183716- 1: (MDS::handle_mds_beacon(MMDSBeacon*)+0x16b) [0x4b7c6b]
ceph-mds.a.log.gz:183775- 2: (MDS::handle_core_message(Message*)+0x923) [0x4cc893]
ceph-mds.a.log.gz:183833- 3: (MDS::_dispatch(Message*)+0x2f) [0x4cc97f]
ceph-mds.a.log.gz:183880- 4: (MDS::ms_dispatch(Message*)+0x19b) [0x4ce42b]
ceph-mds.a.log.gz:183930- 5: (DispatchQueue::entry()+0x421) [0x84dea1]
ceph-mds.a.log.gz:183976- 6: (DispatchQueue::DispatchThread::entry()+0xd) [0x8207bd]
ceph-mds.a.log.gz:184036- 7: (()+0x79d1) [0x7f5a9f32c9d1]
ceph-mds.a.log.gz:184069- 8: (clone()+0x6d) [0x7f5a9e26086d]
ceph-mds.a.log.gz:184105- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
ceph-mds.a.log.gz:184198-
ceph-mds.a.log.gz:184199---- logging levels ---
ceph-mds.a.log.gz:184222-   0/ 5 none
ceph-mds.a.log.gz:184235-   0/ 1 lockdep
ceph-mds.a.log.gz:184251-   0/ 1 context
ceph-mds.a.log.gz:184267-   1/ 1 crush
ceph-mds.a.log.gz:184281-   1/ 5 mds
ceph-mds.a.log.gz:184293-   1/ 5 mds_balancer
ceph-mds.a.log.gz:184314-   1/ 5 mds_locker
ceph-mds.a.log.gz:184333-   1/ 5 mds_log
ceph-mds.a.log.gz:184349-   1/ 5 mds_log_expire
ceph-mds.a.log.gz:184372-   1/ 5 mds_migrator
ceph-mds.a.log.gz:184393-   0/ 1 buffer
ceph-mds.a.log.gz:184408-   0/ 1 timer
ceph-mds.a.log.gz:184422-   0/ 1 filer
ceph-mds.a.log.gz:184436-   0/ 1 striper
ceph-mds.a.log.gz:184452-   0/ 1 objecter
ceph-mds.a.log.gz:184469-   0/ 5 rados
ceph-mds.a.log.gz:184483-   0/ 5 rbd
ceph-mds.a.log.gz:184495-   0/ 5 journaler
ceph-mds.a.log.gz:184513-   0/ 5 objectcacher
ceph-mds.a.log.gz:184534-   0/ 5 client
ceph-mds.a.log.gz:184549-   0/ 5 osd
ceph-mds.a.log.gz:184561-   0/ 5 optracker
ceph-mds.a.log.gz:184579-   0/ 5 objclass
ceph-mds.a.log.gz:184596-   1/ 3 filestore
ceph-mds.a.log.gz:184614-   1/ 3 journal
ceph-mds.a.log.gz:184630-   0/ 5 ms
ceph-mds.a.log.gz:184641-   1/ 5 mon
ceph-mds.a.log.gz:184653-   0/10 monc
ceph-mds.a.log.gz:184666-   0/ 5 paxos
ceph-mds.a.log.gz:184680-   0/ 5 tp
ceph-mds.a.log.gz:184691-   1/ 5 auth
ceph-mds.a.log.gz:184704-   1/ 5 crypto
ceph-mds.a.log.gz:184719-   1/ 1 finisher
ceph-mds.a.log.gz:184736-   1/ 5 heartbeatmap
ceph-mds.a.log.gz:184757-   1/ 5 perfcounter
ceph-mds.a.log.gz:184777-   1/ 5 rgw
ceph-mds.a.log.gz:184789-   1/ 5 hadoop
ceph-mds.a.log.gz:184804-   1/ 5 javaclient
ceph-mds.a.log.gz:184823-   1/ 5 asok
ceph-mds.a.log.gz:184836-   1/ 1 throttle
ceph-mds.a.log.gz:184853-  -2/-2 (syslog threshold)
ceph-mds.a.log.gz:184880-  -1/-1 (stderr threshold)
ceph-mds.a.log.gz:184907-  max_recent     10000
ceph-mds.a.log.gz:184930-  max_new         1000
ceph-mds.a.log.gz:184953-  log_file /var/log/ceph/ceph-mds.a.log
ceph-mds.a.log.gz:184993---- end dump of recent events ---
ceph-mds.a.log.gz:185027-2015-03-11 09:14:13.320806 7f5a99dd8700 -1 *** Caught signal (Aborted) **
ceph-mds.a.log.gz:185101- in thread 7f5a99dd8700
ceph-mds.a.log.gz:185125-
ceph-mds.a.log.gz:185126: ceph version 0.61.9-11-ge146934 (e146934ea488219075209816ee96dd16b6d89da2)
ceph-mds.a.log.gz:185202- 1: ceph-mds() [0x85a781]
ceph-mds.a.log.gz:185228- 2: (()+0xf710) [0x7f5a9f334710]
ceph-mds.a.log.gz:185261- 3: (gsignal()+0x35) [0x7f5a9e1aa635]
ceph-mds.a.log.gz:185299- 4: (abort()+0x175) [0x7f5a9e1abe15]
ceph-mds.a.log.gz:185336- 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f5a9ea64a5d]
ceph-mds.a.log.gz:185406- 6: (()+0xbcbe6) [0x7f5a9ea62be6]
ceph-mds.a.log.gz:185440- 7: (()+0xbcc13) [0x7f5a9ea62c13]
ceph-mds.a.log.gz:185474- 8: (()+0xbcd0e) [0x7f5a9ea62d0e]
ceph-mds.a.log.gz:185508- 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f2) [0x76b242]
ceph-mds.a.log.gz:185600- 10: (MDS::handle_mds_beacon(MMDSBeacon*)+0x16b) [0x4b7c6b]
ceph-mds.a.log.gz:185660- 11: (MDS::handle_core_message(Message*)+0x923) [0x4cc893]
ceph-mds.a.log.gz:185719- 12: (MDS::_dispatch(Message*)+0x2f) [0x4cc97f]
ceph-mds.a.log.gz:185767- 13: (MDS::ms_dispatch(Message*)+0x19b) [0x4ce42b]
ceph-mds.a.log.gz:185818- 14: (DispatchQueue::entry()+0x421) [0x84dea1]
ceph-mds.a.log.gz:185865- 15: (DispatchQueue::DispatchThread::entry()+0xd) [0x8207bd]
ceph-mds.a.log.gz:185926- 16: (()+0x79d1) [0x7f5a9f32c9d1]
ceph-mds.a.log.gz:185960- 17: (clone()+0x6d) [0x7f5a9e26086d]
ceph-mds.a.log.gz:185997- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
ceph-mds.a.log.gz:186090-
ceph-mds.a.log.gz:186091---- begin dump of recent events ---
ceph-mds.a.log.gz:186127-     0> 2015-03-11 09:14:13.320806 7f5a99dd8700 -1 *** Caught signal (Aborted) **
ceph-mds.a.log.gz:186209- in thread 7f5a99dd8700
ceph-mds.a.log.gz:186233-
ceph-mds.a.log.gz:186234: ceph version 0.61.9-11-ge146934 (e146934ea488219075209816ee96dd16b6d89da2)
ceph-mds.a.log.gz:186310- 1: ceph-mds() [0x85a781]
ceph-mds.a.log.gz:186336- 2: (()+0xf710) [0x7f5a9f334710]
ceph-mds.a.log.gz:186369- 3: (gsignal()+0x35) [0x7f5a9e1aa635]
ceph-mds.a.log.gz:186407- 4: (abort()+0x175) [0x7f5a9e1abe15]
ceph-mds.a.log.gz:186444- 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f5a9ea64a5d]
ceph-mds.a.log.gz:186514- 6: (()+0xbcbe6) [0x7f5a9ea62be6]
ceph-mds.a.log.gz:186548- 7: (()+0xbcc13) [0x7f5a9ea62c13]
ceph-mds.a.log.gz:186582- 8: (()+0xbcd0e) [0x7f5a9ea62d0e]
ceph-mds.a.log.gz:186616- 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x7f2) [0x76b242]
ceph-mds.a.log.gz:186708- 10: (MDS::handle_mds_beacon(MMDSBeacon*)+0x16b) [0x4b7c6b]
ceph-mds.a.log.gz:186768- 11: (MDS::handle_core_message(Message*)+0x923) [0x4cc893]
ceph-mds.a.log.gz:186827- 12: (MDS::_dispatch(Message*)+0x2f) [0x4cc97f]
ceph-mds.a.log.gz:186875- 13: (MDS::ms_dispatch(Message*)+0x19b) [0x4ce42b]
ceph-mds.a.log.gz:186926- 14: (DispatchQueue::entry()+0x421) [0x84dea1]
ceph-mds.a.log.gz:186973- 15: (DispatchQueue::DispatchThread::entry()+0xd) [0x8207bd]
ceph-mds.a.log.gz:187034- 16: (()+0x79d1) [0x7f5a9f32c9d1]
ceph-mds.a.log.gz:187068- 17: (clone()+0x6d) [0x7f5a9e26086d]
ceph-mds.a.log.gz:187105- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

Related issues

Duplicates fs - Bug #11053: "FAILED assert(beacon_seq_stamp[seq] > beacon_last_acked_stamp)" in upgrade:dumpling-x-firefly-distro-basic-vps Resolved 03/06/2015

History

#1 Updated by Yuri Weinstein over 4 years ago

  • Project changed from devops to Ceph

#2 Updated by Yuri Weinstein over 4 years ago

  • Project changed from Ceph to fs

#3 Updated by Yuri Weinstein over 4 years ago

  • Status changed from New to Duplicate

Also available in: Atom PDF