Project

General

Profile

Actions
Copy link

Bug #6207

closed

Found incorrect object contents

Added by Sage Weil over 10 years ago. Updated over 10 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Samuel Just
Category:
OSD
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2013-09-01T21:45:47.962 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]: Found incorrect object contents ObjNum: 148 snap: 45 seqnum: 148 prefix: plana3710235-OID: 45 snap 45
2013-09-01T21:45:47.962 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]: , expected ObjNum: 326 snap: 107 seqnum: 326 prefix: plana3710235-OID: 45 snap 107
2013-09-01T21:45:47.962 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  oid 45
2013-09-01T21:45:47.962 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]: Object 45 contents ObjNum: 148 snap: 45 seqnum: 148 prefix: plana3710235-OID: 45 snap 45
2013-09-01T21:45:47.962 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  corrupt
2013-09-01T21:45:47.962 INFO:teuthology.task.rados.rados.0.out:[10.214.131.3]: incorrect buffer at pos 4
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]: ./test/osd/RadosModel.h: In function 'virtual void ReadOp::_finish(TestOp::CallbackInfo*)' thread 7f0facd77700 time 2013-09-01 21:46:00.402859
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]: ./test/osd/RadosModel.h: 1053: FAILED assert(0)
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  ceph version 0.67.2-22-ga708c8a (a708c8ab52e5b1476405a1f817c23b8845fbaab3)
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  1: (ReadOp::_finish(TestOp::CallbackInfo*)+0x1421) [0x414ef1]
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  2: (librados::C_AioComplete::finish(int)+0x1d) [0x7f0fb2b08a4d]
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  3: (Context::complete(int)+0xa) [0x7f0fb2ae94fa]
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  4: (Finisher::finisher_thread_entry()+0x1c0) [0x7f0fb2b8cd10]
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  5: (()+0x7e9a) [0x7f0fb276ae9a]
2013-09-01T21:45:47.963 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  6: (clone()+0x6d) [0x7f0fb1f81ccd]
2013-09-01T21:45:47.964 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]:  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-09-01T21:45:47.964 INFO:teuthology.task.rados.rados.0.err:[10.214.131.3]: terminate called after throwing an instance of 'ceph::FailedAssertion'

ubuntu@teuthology:/a/teuthology-2013-09-01_20:00:14-rados-dumpling-testing-basic-plana/16572$ cat orig.config.yaml 
kernel:
  kdb: true
  sha1: 263cbbcaf605e359a46e30889595d82629f82080
machine_type: plana
nuke-on-error: true
os_type: ubuntu
overrides:
  admin_socket:
    branch: dumpling
  ceph:
    conf:
      global:
        ms inject delay max: 1
        ms inject delay probability: 0.005
        ms inject delay type: osd
        ms inject internal delays: 0.002
        ms inject socket failures: 2500
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
        mon min osdmap epochs: 2
      osd:
        osd map cache size: 1
    fs: ext4
    log-whitelist:
    - slow request
    sha1: a708c8ab52e5b1476405a1f817c23b8845fbaab3
  ceph-deploy:
    branch:
      dev: dumpling
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
  install:
    ceph:
      sha1: a708c8ab52e5b1476405a1f817c23b8845fbaab3
  s3tests:
    branch: master
  workunit:
    sha1: a708c8ab52e5b1476405a1f817c23b8845fbaab3
roles:
- - mon.a
  - mon.c
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mds.a
  - osd.3
  - osd.4
  - osd.5
  - client.0
tasks:
- chef: null
- clock.check: null
- install: null
- ceph:
    log-whitelist:
    - wrongly marked me down
    - objects unfound and apparently lost
- thrashosds:
    chance_pgnum_grow: 1
    chance_pgpnum_fix: 1
    chance_test_map_discontinuity: 0.5
    timeout: 1200
- rados:
    clients:
    - client.0
    objects: 50
    op_weights:
      delete: 50
      read: 100
      rollback: 50
      snap_create: 50
      snap_remove: 50
      write: 100
    ops: 4000
teuthology_branch: dumpling
Actions
Copy link

Also available in: Atom PDF