Ceph » RADOS

Description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_python}

Failure Reason:

Command failed (workunit test rados/test_python.sh) on smithi016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=11ec2f2c963dded7e0cccf5a8c9afdde6d1c0f46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'

/a/lflores-2022-01-05_19:04:35-rados-wip-lflores-mgr-rocksdb-distro-default-smithi/6596519

2022-01-05T19:57:39.635 INFO:tasks.workunit.client.0.smithi016.stderr:test_rados.TestWatchNotify.test_aio_notify ... ERROR
2022-01-05T19:57:39.644 INFO:tasks.workunit.client.0.smithi016.stderr:test_rados.test_rados_init_error ... ok
2022-01-05T19:57:39.704 INFO:tasks.workunit.client.0.smithi016.stderr:test_rados.test_rados_init ... ok
2022-01-05T19:57:39.719 INFO:tasks.workunit.client.0.smithi016.stderr:test_rados.test_ioctx_context_manager ... ok
2022-01-05T19:57:39.729 INFO:tasks.workunit.client.0.smithi016.stderr:test_rados.test_parse_argv ... ok
2022-01-05T19:57:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:test_rados.test_parse_argv_empty_str ... ok
2022-01-05T19:57:39.735 INFO:tasks.workunit.client.0.smithi016.stderr:
2022-01-05T19:57:39.735 INFO:tasks.workunit.client.0.smithi016.stderr:======================================================================
2022-01-05T19:57:39.735 INFO:tasks.workunit.client.0.smithi016.stderr:ERROR: test_rados.TestWatchNotify.test_aio_notify
2022-01-05T19:57:39.736 INFO:tasks.workunit.client.0.smithi016.stderr:----------------------------------------------------------------------
2022-01-05T19:57:39.736 INFO:tasks.workunit.client.0.smithi016.stderr:Traceback (most recent call last):
2022-01-05T19:57:39.736 INFO:tasks.workunit.client.0.smithi016.stderr:  File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
2022-01-05T19:57:39.736 INFO:tasks.workunit.client.0.smithi016.stderr:    self.test(*self.arg)
2022-01-05T19:57:39.737 INFO:tasks.workunit.client.0.smithi016.stderr:  File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rados.py", line 1533, in test_aio_notify
2022-01-05T19:57:39.737 INFO:tasks.workunit.client.0.smithi016.stderr:    assert_raises(NotConnected, watch1.check)
2022-01-05T19:57:39.737 INFO:tasks.workunit.client.0.smithi016.stderr:  File "/usr/lib64/python3.6/unittest/case.py", line 750, in assertRaises
2022-01-05T19:57:39.737 INFO:tasks.workunit.client.0.smithi016.stderr:    return context.handle('assertRaises', args, kwargs)
2022-01-05T19:57:39.738 INFO:tasks.workunit.client.0.smithi016.stderr:  File "/usr/lib64/python3.6/unittest/case.py", line 195, in handle
2022-01-05T19:57:39.738 INFO:tasks.workunit.client.0.smithi016.stderr:    callable_obj(*args, **kwargs)
2022-01-05T19:57:39.738 INFO:tasks.workunit.client.0.smithi016.stderr:  File "rados.pyx", line 2101, in rados.Watch.check
2022-01-05T19:57:39.738 INFO:tasks.workunit.client.0.smithi016.stderr:rados.ObjectNotFound: [errno 2] RADOS object not found (check error)
2022-01-05T19:57:39.739 INFO:tasks.workunit.client.0.smithi016.stderr:
2022-01-05T19:57:39.739 INFO:tasks.workunit.client.0.smithi016.stderr:----------------------------------------------------------------------
2022-01-05T19:57:39.739 INFO:tasks.workunit.client.0.smithi016.stderr:Ran 89 tests in 317.759s
2022-01-05T19:57:39.739 INFO:tasks.workunit.client.0.smithi016.stderr:
2022-01-05T19:57:39.740 INFO:tasks.workunit.client.0.smithi016.stderr:FAILED (errors=1)
2022-01-05T19:57:39.754 DEBUG:teuthology.orchestra.run:got remote process result: 1
2022-01-05T19:57:39.755 INFO:tasks.workunit:Stopping ['rados/test_python.sh'] on client.0...
2022-01-05T19:57:39.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2022-01-05T19:57:40.032 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 91, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 70, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_ceph-c_11ec2f2c963dded7e0cccf5a8c9afdde6d1c0f46/qa/tasks/workunit.py", line 135, in task
    coverage_and_limits=not config.get('no_coverage_and_limits', None))
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_ceph-c_11ec2f2c963dded7e0cccf5a8c9afdde6d1c0f46/qa/tasks/workunit.py", line 427, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 183, in _raise_for_status
    node=self.hostname, label=self.label
teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test_python.sh) on smithi016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=11ec2f2c963dded7e0cccf5a8c9afdde6d1c0f46 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'