Project

General

Profile

Actions

Bug #63158

closed

"AssertionError: assert 'client' in role" in upgrade stress-split tests

Added by Laura Flores 7 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
backport_processed
Backport:
reef
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

See most failed jobs in:
https://pulpito.ceph.com/teuthology-2023-09-30_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/
https://pulpito.ceph.com/teuthology-2023-10-07_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/

2023-10-01T02:29:57.678 INFO:tasks.cephadm.ceph_manager.ceph:recovered!
2023-10-01T02:29:57.678 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/parallel.py", line 56, in task
    p.spawn(_run_spawned, ctx, confg, taskname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/parallel.py", line 64, in _run_spawned
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/sequential.py", line 47, in task
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph_fc1e90a395a6a5631142eb70fd9bf3d22740a9da/qa/tasks/workunit.py", line 119, in task
    assert 'client' in role
AssertionError

Related issues 2 (0 open2 closed)

Copied to Ceph - Backport #63167: reef: "AssertionError: assert 'client' in role" in upgrade stress-split testsDuplicateLaura FloresActions
Copied to Ceph - Backport #63168: reef: "AssertionError: assert 'client' in role" in upgrade stress-split testsResolvedLaura FloresActions
Actions #1

Updated by Laura Flores 7 months ago

  • Subject changed from AssertionError: assert 'client' in role to "AssertionError: assert 'client' in role" in upgrade stress-split tests

Specifically seems to happen in stress-split tests. Parallel tests are passing.

Actions #2

Updated by Laura Flores 7 months ago

Looks like this is just an issue with the yaml files, as introduced in https://github.com/ceph/ceph/pull/51889.

The stress-split tests have RBD_FEATURES indented under "clients", while parallel tests do not. The "clients" section thinks that "env" is a client, when it should be in its own section.

Actions #3

Updated by Laura Flores 7 months ago

  • Status changed from New to In Progress
  • Assignee set to Laura Flores
Actions #4

Updated by Laura Flores 7 months ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 53900
Actions #5

Updated by Laura Flores 7 months ago

  • Backport set to reef
Actions #6

Updated by Laura Flores 7 months ago

  • Status changed from Fix Under Review to Pending Backport
Actions #7

Updated by Backport Bot 7 months ago

  • Copied to Backport #63167: reef: "AssertionError: assert 'client' in role" in upgrade stress-split tests added
Actions #8

Updated by Backport Bot 7 months ago

  • Tags set to backport_processed
Actions #9

Updated by Laura Flores 7 months ago

  • Copied to Backport #63168: reef: "AssertionError: assert 'client' in role" in upgrade stress-split tests added
Actions #10

Updated by Ilya Dryomov 7 months ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF