Project

General

Profile

Actions

Bug #15673

closed

repair_test failure on assert in get_pg_replica

Added by Samuel Just almost 8 years ago. Updated almost 8 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

sjust@teuthology:/a/samuelj-2016-04-28_23:23:57-rados-wip-sam-testing-distro-basic-smithi/155287

Actions #1

Updated by David Zafman almost 8 years ago

It looks like a pg dump immediately after a pool create happened so fast that the pg wasn't even there in "creating" state yet.

Normally the ceph pg dump would see the pg in "creating" state right after the pool is created, but maybe there is a VERY small window before that happens.

2016-04-28T23:55:56.969 INFO:teuthology.orchestra.run.smithi060:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd pool create repair_pool_1 1'
2016-04-28T23:55:57.761 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'repair_pool_1' created
2016-04-28T23:55:57.776 INFO:tasks.repair_test:starting repair test type 1
2016-04-28T23:55:57.777 INFO:tasks.repair_test:Choosing replica
2016-04-28T23:55:57.777 INFO:teuthology.orchestra.run.smithi060:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph pg dump --format=json'
2016-04-28T23:55:57.911 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all in format json
2016-04-28T23:55:57.923 INFO:teuthology.orchestra.run.smithi060:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd dump --format=json'
2016-04-28T23:55:58.132 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 66, in run_tasks
manager = run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 45, in run_one_task
return fn(**kwargs)
File "/var/lib/teuthworker/src/ceph-qa-suite_master/tasks/repair_test.py", line 304, in task
repair_test_1(ctx, dataerr, choose_replica, "deep-scrub")
File "/var/lib/teuthworker/src/ceph-qa-suite_master/tasks/repair_test.py", line 84, in repair_test_1
victim_osd = chooser(ctx, pool, 0)
File "/var/lib/teuthworker/src/ceph-qa-suite_master/tasks/repair_test.py", line 26, in choose_replica
return ctx.manager.get_pg_replica(pool, num)
File "/var/lib/teuthworker/src/ceph-qa-suite_master/tasks/ceph_manager.py", line 1004, in get_pg_replica
assert False
AssertionError

Actions #2

Updated by David Zafman almost 8 years ago

  • Status changed from New to In Progress
Actions #3

Updated by David Zafman almost 8 years ago

  • Status changed from In Progress to Resolved

8da6e97bd4e208952322d15b733b7880a4af330c

Actions

Also available in: Atom PDF