Project

General

Profile

Actions

Bug #4271

closed

osdc/ObjectCacher.cc: 834: FAILED assert(ob->last_commit_tid < tid)

Added by Sage Weil about 11 years ago. Updated about 11 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

on latest next, including the most recent osd ooo reply fixes:

2013-02-26T05:22:29.636 INFO:teuthology.task.qemu.client.0.err:osdc/ObjectCacher.cc: In function 'void ObjectCacher::bh_write_commit(int64_t, sobject_t, loff_t, uint64_t, tid_t, int)' thread 7ff1a77fe700 time 2013-02-26 05:22:22.133385
2013-02-26T05:22:29.636 INFO:teuthology.task.qemu.client.0.err:osdc/ObjectCacher.cc: 834: FAILED assert(ob->last_commit_tid < tid)
2013-02-26T05:22:29.636 INFO:teuthology.task.qemu.client.0.err: ceph version 0.57-411-g9096d70 (9096d70642880946b0b477e33f7debabbefec9fa)
2013-02-26T05:22:29.637 INFO:teuthology.task.qemu.client.0.err: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x95) [0x7ff1c320f90d]
2013-02-26T05:22:29.637 INFO:teuthology.task.qemu.client.0.err: 2: (ObjectCacher::bh_write_commit(long, sobject_t, long, unsigned long, unsigned long, int)+0xda7) [0x7ff1c4070fa3]
2013-02-26T05:22:29.637 INFO:teuthology.task.qemu.client.0.err: 3: (ObjectCacher::C_WriteCommit::finish(int)+0x6e) [0x7ff1c407dcfa]
2013-02-26T05:22:29.637 INFO:teuthology.task.qemu.client.0.err: 4: (Context::complete(int)+0x2b) [0x7ff1c402fe3f]
2013-02-26T05:22:29.637 INFO:teuthology.task.qemu.client.0.err: 5: (librbd::C_Request::finish(int)+0x142) [0x7ff1c40687a0]
2013-02-26T05:22:29.637 INFO:teuthology.task.qemu.client.0.err: 6: (Context::complete(int)+0x2b) [0x7ff1c402fe3f]
2013-02-26T05:22:29.637 INFO:teuthology.task.qemu.client.0.err: 7: (librbd::AioRequest::complete(int)+0x6f) [0x7ff1c402fecf]
2013-02-26T05:22:29.638 INFO:teuthology.task.qemu.client.0.err: 8: (librbd::rados_req_cb(void*, void*)+0x34) [0x7ff1c405e59e]
2013-02-26T05:22:29.638 INFO:teuthology.task.qemu.client.0.err: 9: (librados::C_AioSafe::finish(int)+0x4d) [0x7ff1c31996e5]
2013-02-26T05:22:29.638 INFO:teuthology.task.qemu.client.0.err: 10: (Finisher::finisher_thread_entry()+0x342) [0x7ff1c320ea8a]
2013-02-26T05:22:29.638 INFO:teuthology.task.qemu.client.0.err: 11: (Finisher::FinisherThread::entry()+0x1c) [0x7ff1c3182690]
2013-02-26T05:22:29.638 INFO:teuthology.task.qemu.client.0.err: 12: (Thread::_entry_func(void*)+0x23) [0x7ff1c33c827d]
2013-02-26T05:22:29.638 INFO:teuthology.task.qemu.client.0.err: 13: (()+0x7e9a) [0x7ff1c0453e9a]
2013-02-26T05:22:29.638 INFO:teuthology.task.qemu.client.0.err: 14: (clone()+0x6d) [0x7ff1c01814bd]
2013-02-26T05:22:29.639 INFO:teuthology.task.qemu.client.0.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-02-26T05:22:29.639 INFO:teuthology.task.qemu.client.0.err:terminate called after throwing an instance of 'ceph::FailedAssertion'
2013-02-26T05:22:37.477 INFO:teuthology.task.qemu.client.0.err:daemon-helper: command crashed with signal 6

job was
kernel:
  kdb: true
  sha1: 49659416ba4fa8308bd29e453f54c3bcf8a0fbf1
nuke-on-error: true
overrides:
  ceph:
    conf:
      global:
        ms inject socket failures: 5000
      osd:
        osd op thread timeout: 60
    fs: btrfs
    log-whitelist:
    - slow request
    sha1: 9096d70642880946b0b477e33f7debabbefec9fa
  s3tests:
    branch: next
  workunit:
    sha1: 9096d70642880946b0b477e33f7debabbefec9fa
roles:
- - mon.a
  - mon.c
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mds.a
  - osd.3
  - osd.4
  - osd.5
- - client.0
tasks:
- chef: null
- clock: null
- ceph:
    conf:
      client:
        rbd cache: true
- qemu:
    all:
      test: https://raw.github.com/ceph/ceph/master/qa/workunits/suites/tiobench.sh


Related issues 2 (0 open2 closed)

Related to Ceph - Bug #4369: osd: msgr connection not cleanly shut downResolvedSage Weil03/07/2013

Actions
Is duplicate of Ceph - Bug #3675: osd: hang during intial peeringResolvedSage Weil12/22/2012

Actions
Actions

Also available in: Atom PDF