Project

General

Profile

Actions

Bug #9874

closed

ceph_test_rados, out of order ops

Added by Samuel Just over 9 years ago. Updated over 9 years ago.

Status:
Duplicate
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2014-10-22T17:06:21.115 INFO:tasks.rados.rados.0.burnupi60.stderr:Error: finished tid 3 when last_acked_tid was 7
2014-10-22T17:06:21.115 INFO:tasks.rados.rados.0.burnupi60.stderr:./test/osd/RadosModel.h: In function 'virtual void WriteOp::_finish(TestOp::CallbackInfo*)' thread 7f5061ffb700 time 2014-10-22 17:06
:21.102179
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr:./test/osd/RadosModel.h: 829: FAILED assert(0)
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr: ceph version 0.86-89-gfc889ef (fc889effe832f4cf0b2e358ea07dfaa4bf2d4292)
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0x7f506fde817b]
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr: 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x2e0) [0x4170a0]
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr: 3: (write_callback(void*, void*)+0x19) [0x427019]
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr: 4: (librados::C_AioSafe::finish(int)+0x1d) [0x7f506fd4a55d]
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr: 5: (Context::complete(int)+0x9) [0x7f506fd25f79]
2014-10-22T17:06:21.116 INFO:tasks.rados.rados.0.burnupi60.stderr: 6: (Finisher::finisher_thread_entry()+0x158) [0x7f506fde7268]
2014-10-22T17:06:21.117 INFO:tasks.rados.rados.0.burnupi60.stderr: 7: (()+0x8182) [0x7f506f924182]
2014-10-22T17:06:21.117 INFO:tasks.rados.rados.0.burnupi60.stderr: 8: (clone()+0x6d) [0x7f506f136fbd]
2014-10-22T17:06:21.117 INFO:tasks.rados.rados.0.burnupi60.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

wip-sam-testing-2014-10-23, but I think no related patches.

ubuntu@teuthology:/a/samuelj-2014-10-22_14:27:22-rados-wip-sam-testing-wip-testing-vanilla-fixes-basic-multi/566439

Actions #1

Updated by Samuel Just over 9 years ago

- exec:
client.0:
- ceph osd pool create base 4
- ceph osd pool create cache 4
- ceph osd tier add base cache
- ceph osd tier cache-mode cache writeback
- ceph osd tier set-overlay base cache
- ceph osd pool set cache hit_set_type bloom
- ceph osd pool set cache hit_set_count 8
- ceph osd pool set cache hit_set_period 60
- ceph osd pool set cache target_max_objects 500
- background_exec:
mon.a:
- while true
- do sleep 30
- echo forward
- ceph osd tier cache-mode cache forward
- sleep 10
- ceph osd pool set cache cache_target_full_ratio .001
- echo cache-try-flush-evict-all
- rados p cache cache-try-flush-evict-all
- sleep 5
- echo cache-flush-evict-all
- rados -p cache cache-flush-evict-all
- sleep 5
- echo remove overlay
- ceph osd tier remove-overlay base
- sleep 20
- echo add writeback overlay
- ceph osd tier cache-mode cache writeback
- ceph osd pool set cache cache_target_full_ratio .8
- ceph osd tier set-overlay base cache
- sleep 30
- ceph osd tier cache-mode cache readforward
- done
rados:
clients:
- client.0
max_seconds: 600
objects: 10000
op_weights:
copy_from: 50
delete: 50
read: 100
write: 100
ops: 400000
pools:
- base
size: 1024

Actions #2

Updated by Sage Weil over 9 years ago

  • Priority changed from Urgent to High
Actions #3

Updated by Samuel Just over 9 years ago

  • Status changed from New to Duplicate
Actions

Also available in: Atom PDF