Tools » teuthology

2021-08-18 23:24:36,351.351 INFO:teuthology.suite.run:raw_yaml use_shaman: True
tasks:
- cephadm:
- cephadm.shell:
    host.a:
    - ceph orch status
    - ceph orch ps
    - ceph orch ls
    - ceph orch host ls
    - ceph orch device ls
- install:
    extra_packages:
      - iscsi-initiator-utils
      - device-mapper-multipath

roles:
- - host.a
  - mon.a
  - mgr.y
  - osd.0
  - osd.1
  - client.0
  - ceph.iscsi.iscsi.a
- - host.b
  - mon.b
  - mgr.x
  - osd.2
  - client.1
- - mon.c
  - mgr.z
  - osd.3
  - osd.4
  - ceph.iscsi.iscsi.b

openstack:
  - machine:
      disk: 40 # GB
      ram: 8000 # MB
      cpus: 1
    volumes: # attached to each instance
      count: 4
      size: 30 # GB

os_type: centos
os_version: "8.3" 
overrides:
  selinux:
    whitelist:
      - scontext=system_u:system_r:logrotate_t:s0

tasks:
- workunit:
    parallel: False
    clients:
      client.0:
      - rbd/iscsi_container_test.sh gateway_create.sh
- workunit:
    parallel: False
    clients:
      client.1:
      - rbd/iscsi_initiator_cfg.sh
- cram:
    parallel: False
    clients:
      client.1:
      - src/test/cli-integration/rbd/iscsi_client.t
- workunit:
    parallel: False
    clients:
      client.0:
      - rbd/iscsi_container_test.sh gateway_delete.sh
- cram:
    sequential:
    clients:
      client.0:
      - src/test/cli-integration/rbd/rest_api_create.t
      client.1:
      - src/test/cli-integration/rbd/iscsi_client.t
      client.0:
      - src/test/cli-integration/rbd/rest_api_delete.t

2021-08-18 23:24:36,360.360 INFO:teuthology.suite.run:parsed_yaml {'use_shaman': True, 'tasks': [{'workunit': {'parallel': False, 'clients': {'client.0': ['rbd/iscsi_container_test.sh gateway_create.sh']}}}, {'workunit': {'parallel': False, 'clients': {'client.1': ['rbd/iscsi_initiator_cfg.sh']}}}, {'cram': {'parallel': False, 'clients': {'client.1': ['src/test/cli-integration/rbd/iscsi_client.t']}}}, {'workunit': {'parallel': False, 'clients': {'client.0': ['rbd/iscsi_container_test.sh gateway_delete.sh']}}}, {'cram': {'sequential': None, 'clients': {'client.0': ['src/test/cli-integration/rbd/rest_api_delete.t'], 'client.1': ['src/test/cli-integration/rbd/iscsi_client.t']}}}], 'roles': [['host.a', 'mon.a', 'mgr.y', 'osd.0', 'osd.1', 'client.0', 'ceph.iscsi.iscsi.a'], ['host.b', 'mon.b', 'mgr.x', 'osd.2', 'client.1'], ['mon.c', 'mgr.z', 'osd.3', 'osd.4', 'ceph.iscsi.iscsi.b']], 'openstack': [{'machine': {'disk': 40, 'ram': 8000, 'cpus': 1}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.3', 'overrides': {'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}}}

while in raw_yaml we do see `- src/test/cli-integration/rbd/rest_api_create.t` to same is not parsed for some reason and retains corrupt values ` {'cram': {'sequential': None, 'clients': {'client.0': ['src/test/cli-integration/rbd/rest_api_delete.t'], 'client.1': ['src/test/cli-integration/rbd/iscsi_client.t']}}}],`

code path

    def collect_jobs(self, arch, configs, newest=False, limit=0):
        jobs_to_schedule = []
        jobs_missing_packages = []
        for description, fragment_paths in configs:
            if limit > 0 and len(jobs_to_schedule) >= limit:
                log.info(
                    'Stopped after {limit} jobs due to --limit={limit}'.format(
                        limit=limit))
                break

            raw_yaml = '\n'.join([open(a, 'r').read() for a in fragment_paths])
            log.info("raw_yaml %s", raw_yaml)
            parsed_yaml = yaml.safe_load(raw_yaml)
            log.info("parsed_yaml %s", parsed_yaml)