Project

General

Profile

Actions
Copy link

Bug #5371

closed

idempotent filestore test failure

Added by Sage Weil almost 11 years ago. Updated almost 11 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2013-06-15T02:49:30.941 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.013847 7f456d8af780 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
2013-06-15T02:49:30.941 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.013858 7f456d8af780  1 journal _open b.10/journal fd 23: 104857600 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-06-15T02:49:30.964 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.037026 7f456d8af780  1 journal _open b.10/journal fd 23: 104857600 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-06-15T02:49:30.977 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.050006 7f456d8af780  0 filestore_diff diff_objects_stat nlink mismatch (A: 1 != B: 2)
2013-06-15T02:49:30.977 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.050016 7f456d8af780  0 filestore_diff diff_objects stat mismatch on 0.0_head/cbe4f790/obj3-3/head//-1
2013-06-15T02:49:30.980 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.052875 7f456d8af780  0 filestore_diff diff_objects_stat nlink mismatch (A: 1 != B: 2)
2013-06-15T02:49:30.980 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.052884 7f456d8af780  0 filestore_diff diff_objects stat mismatch on 0.19_head/cbe4f790/obj3-3/head//-1
2013-06-15T02:49:30.980 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.053718 7f456d8af780  0 test_idempotent_sequence diff found an difference
2013-06-15T02:49:30.981 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.054254 7f456d8af780  1 journal close a.10/journal
2013-06-15T02:49:30.982 INFO:teuthology.orchestra.run.err:2013-06-15 02:50:25.055017 7f456d8af780  1 journal close b.10/journal
2013-06-15T02:49:30.983 INFO:teuthology.orchestra.run.out:FAIL
2013-06-15T02:49:30.984 INFO:teuthology.orchestra.run.out: see:
2013-06-15T02:49:30.984 INFO:teuthology.orchestra.run.out:   a.10.fail     -- leading up to failure
2013-06-15T02:49:30.984 INFO:teuthology.orchestra.run.out:   a.10.recover  -- journal replay
2013-06-15T02:49:30.984 INFO:teuthology.orchestra.run.out:   b.10.clean    -- the clean reference
2013-06-15T02:49:30.994 INFO:teuthology.orchestra.run.err:./run_seed_to_range.sh: 15: ./run_seed_to_range.sh: -d: not found
2013-06-15T02:49:30.995 INFO:teuthology.orchestra.run.out:no dir provided for evidence disposal
2013-06-15T02:49:30.996 DEBUG:teuthology.orchestra.run:Running [10.214.132.7]: 'cp -a /home/ubuntu/cephtest/36221/data/test.client.0 /home/ubuntu/cephtest/36221/archive/idempotent_failure'
2013-06-15T02:49:32.770 DEBUG:teuthology.orchestra.run:Running [10.214.132.7]: 'rm -rf -- /home/ubuntu/cephtest/36221/data/test.client.0'

job was
ubuntu@teuthology:/a/teuthology-2013-06-15_01:00:11-rados-next-testing-basic/36221$ cat orig.config.yaml 
kernel:
  kdb: true
  sha1: f28d6bf9ef4d3f8dd2e669fd21be827663f215e2
machine_type: plana
nuke-on-error: true
overrides:
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 20
        debug paxos: 20
    log-whitelist:
    - slow request
    sha1: 9253cd8174ca7690414923259b01c0a484323f19
  install:
    ceph:
      sha1: 9253cd8174ca7690414923259b01c0a484323f19
  s3tests:
    branch: next
  workunit:
    sha1: 9253cd8174ca7690414923259b01c0a484323f19
roles:
- - mon.0
  - osd.0
  - osd.1
  - mds.a
  - client.0
tasks:
- chef: null
- clock.check: null
- install: null
- ceph: null
- filestore_idempotent: null
Actions
Copy link
 #1

Updated by Samuel Just almost 11 years ago

  • Assignee deleted (Samuel Just)
Actions
Copy link
 #2

Updated by Samuel Just almost 11 years ago

  • Assignee set to David Zafman
Actions
Copy link
 #3

Updated by David Zafman almost 11 years ago

  • Status changed from New to In Progress

I ran this test twice on Mira and twice on Plana nodes against a Jul 9, 2013 master branch (00ae543b3e32f89d906a0e934792cc5309f57696) and the problem did not recur.

However, I do see the failure on the Teuthology server in /a/teuthology-2013-07-07_01:00:13-rados-master-testing-basic

Actions
Copy link
 #4

Updated by David Zafman almost 11 years ago

  • Status changed from In Progress to Fix Under Review
Actions
Copy link
 #5

Updated by Sage Weil almost 11 years ago

  • Status changed from Fix Under Review to Resolved
Actions
Copy link

Also available in: Atom PDF