Project

General

Profile

Actions

Bug #14309

closed

osd/OSD.h: 1849: FAILED assert(peering_queue.empty())

Added by Yuri Weinstein over 8 years ago. Updated about 8 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rados
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-01-07_21:00:01-rados-hammer-distro-basic-openstack/
Job: 62419
Logs: http://teuthology.ovh.sepia.ceph.com/teuthology/teuthology-2016-01-07_21:00:01-rados-hammer-distro-basic-openstack/62419/teuthology.log

2016-01-07T22:40:56.773 INFO:tasks.ceph.osd.1.target084217.stderr:--00:00:00:28.140 21350-- WARNING: unhandled syscall: 306
2016-01-07T22:40:56.774 INFO:tasks.ceph.osd.1.target084217.stderr:--00:00:00:28.140 21350-- You may be able to write your own handler.
2016-01-07T22:40:56.774 INFO:tasks.ceph.osd.1.target084217.stderr:--00:00:00:28.140 21350-- Read the file README_MISSING_SYSCALL_OR_IOCTL.
2016-01-07T22:40:56.775 INFO:tasks.ceph.osd.1.target084217.stderr:--00:00:00:28.140 21350-- Nevertheless we consider this a bug.  Please report
2016-01-07T22:40:56.776 INFO:tasks.ceph.osd.1.target084217.stderr:--00:00:00:28.140 21350-- it at http://valgrind.org/support/bug_reports.html.
2016-01-07T22:40:57.571 INFO:tasks.ceph.osd.1.target084217.stderr:osd/OSD.h: In function 'virtual void OSD::PeeringWQ::_clear()' thread 2d051700 time 2016-01-07 22:40:57.564362
2016-01-07T22:40:57.571 INFO:tasks.ceph.osd.1.target084217.stderr:osd/OSD.h: 1630: FAILED assert(peering_queue.empty())
2016-01-07T22:40:57.605 INFO:tasks.ceph.osd.1.target084217.stderr: ceph version 0.94.5-178-g9739d4d (9739d4de49f8167866eda556b2f1581c068ec8a7)
2016-01-07T22:40:57.605 INFO:tasks.ceph.osd.1.target084217.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0xbc540b]
2016-01-07T22:40:57.605 INFO:tasks.ceph.osd.1.target084217.stderr: 2: ceph-osd() [0x6cdadc]
2016-01-07T22:40:57.605 INFO:tasks.ceph.osd.1.target084217.stderr: 3: (OSD::shutdown()+0xab3) [0x688a83]
2016-01-07T22:40:57.605 INFO:tasks.ceph.osd.1.target084217.stderr: 4: (OSD::handle_signal(int)+0x60) [0x689e90]
2016-01-07T22:40:57.606 INFO:tasks.ceph.osd.1.target084217.stderr: 5: (SignalHandler::entry()+0x117) [0xacd797]
2016-01-07T22:40:57.606 INFO:tasks.ceph.osd.1.target084217.stderr: 6: (()+0x8182) [0x5d72182]
2016-01-07T22:40:57.606 INFO:tasks.ceph.osd.1.target084217.stderr: 7: (clone()+0x6d) [0x784447d]
2016-01-07T22:40:57.606 INFO:tasks.ceph.osd.1.target084217.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Actions #1

Updated by Samuel Just over 8 years ago

  • Priority changed from Normal to Urgent
Actions #2

Updated by Sage Weil about 8 years ago

  • Subject changed from "osd/OSD.h: 1630: FAILED assert(peering_queue.empty())" in rados-hammer-distro-basic-openstack to osd/OSD.h: 1849: FAILED assert(peering_queue.empty())
  • Status changed from New to 12

/a/sage-2016-03-17_05:46:34-rados-wip-sage-testing---basic-smithi/68591

Actions #3

Updated by Samuel Just about 8 years ago

  • Assignee set to Samuel Just
Actions #4

Updated by Samuel Just about 8 years ago

After we're already shutting down:

-41> 2016-03-17 20:13:54.409235 19ca6700 10 journal op_apply_start 65 open_ops 0 -> 1
-40> 2016-03-17 20:13:54.409301 19ca6700 5 filestore(/var/lib/ceph/osd/ceph-0) _do_op 0x34ac4090 seq 65 osr(meta 0xfe2c920)/0xfe2c920 start
-39> 2016-03-17 20:13:54.409377 19ca6700 10 filestore(/var/lib/ceph/osd/ceph-0) _do_transaction on 0x34ac3c90
-38> 2016-03-17 20:13:54.409512 19ca6700 15 filestore(/var/lib/ceph/osd/ceph-0) write meta/#-1:64e2fa6d:::inc_osdmap.7:0# 0~379
-37> 2016-03-17 20:13:54.409837 1aca8700 10 osd.0 6 _committed_osd_maps 7..7
-36> 2016-03-17 20:13:54.409887 1aca8700 10 osd.0 6 advance to epoch 7 (<= newest 7)
-35> 2016-03-17 20:13:54.410154 1aca8700 30 osd.0 6 get_map 7 -cached
-34> 2016-03-17 20:13:54.411146 1aca8700 7 osd.0 7 consume_map version 7
Actions #5

Updated by Samuel Just about 8 years ago

  • Status changed from 12 to 7
Actions #6

Updated by Sage Weil about 8 years ago

  • Status changed from 7 to Resolved
Actions #7

Updated by Yuri Weinstein about 8 years ago

  • Related to Bug #15392: infernalis: "osd/OSD.h: 1784: FAILED assert(peering_queue.empty())" in teuthology-2016-04-05_02:00:02-rados-infernalis-distro-basic-openstack added
Actions #8

Updated by Samuel Just about 8 years ago

  • Related to deleted (Bug #15392: infernalis: "osd/OSD.h: 1784: FAILED assert(peering_queue.empty())" in teuthology-2016-04-05_02:00:02-rados-infernalis-distro-basic-openstack)
Actions

Also available in: Atom PDF