Project

General

Profile

Actions

Bug #58512

closed

ubuntu 22.04: s3tests bootstrap fails with AttributeError: module 'collections' has no attribute 'Callable'

Added by Casey Bodley about 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Target version:
-
% Done:

0%

Source:
Tags:
qa
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

ex: http://qa-proxy.ceph.com/teuthology/cbodley-2023-01-18_15:20:22-rgw-main-distro-default-smithi/7129634/teuthology.log

2023-01-18T15:57:29.447 DEBUG:teuthology.orchestra.run.smithi019:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests-client.0/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests-client.0 -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain,!sse-s3'
2023-01-18T15:57:29.680 INFO:teuthology.orchestra.run.smithi019.stderr:Traceback (most recent call last):
2023-01-18T15:57:29.681 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2023-01-18T15:57:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:    return _run_code(code, main_globals, None,
2023-01-18T15:57:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
2023-01-18T15:57:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:    exec(code, run_globals)
2023-01-18T15:57:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/__main__.py", line 8, in <module>
2023-01-18T15:57:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:    run_exit()
2023-01-18T15:57:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/core.py", line 118, in __init__
2023-01-18T15:57:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:    unittest.TestProgram.__init__(
2023-01-18T15:57:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3.10/unittest/main.py", line 100, in __init__
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:    self.parseArgs(argv)
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/core.py", line 179, in parseArgs
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:    self.createTests()
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/core.py", line 193, in createTests
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:    self.test = self.testLoader.loadTestsFromNames(self.testNames)
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/loader.py", line 481, in loadTestsFromNames
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:    return unittest.TestLoader.loadTestsFromNames(self, names, module)
2023-01-18T15:57:29.701 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3.10/unittest/loader.py", line 220, in loadTestsFromNames
2023-01-18T15:57:29.702 INFO:teuthology.orchestra.run.smithi019.stderr:    suites = [self.loadTestsFromName(name, module) for name in names]
2023-01-18T15:57:29.702 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3.10/unittest/loader.py", line 220, in <listcomp>
2023-01-18T15:57:29.702 INFO:teuthology.orchestra.run.smithi019.stderr:    suites = [self.loadTestsFromName(name, module) for name in names]
2023-01-18T15:57:29.702 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/loader.py", line 454, in loadTestsFromName
2023-01-18T15:57:29.702 INFO:teuthology.orchestra.run.smithi019.stderr:    return LazySuite(
2023-01-18T15:57:29.703 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/suite.py", line 53, in __init__
2023-01-18T15:57:29.703 INFO:teuthology.orchestra.run.smithi019.stderr:    super(LazySuite, self).__init__()
2023-01-18T15:57:29.703 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/usr/lib/python3.10/unittest/suite.py", line 22, in __init__
2023-01-18T15:57:29.703 INFO:teuthology.orchestra.run.smithi019.stderr:    self._tests = []
2023-01-18T15:57:29.703 INFO:teuthology.orchestra.run.smithi019.stderr:  File "/home/ubuntu/cephtest/s3-tests-client.0/virtualenv/lib/python3.10/site-packages/nose/suite.py", line 106, in _set_tests
2023-01-18T15:57:29.703 INFO:teuthology.orchestra.run.smithi019.stderr:    if isinstance(tests, collections.Callable) and not is_suite:
2023-01-18T15:57:29.703 INFO:teuthology.orchestra.run.smithi019.stderr:AttributeError: module 'collections' has no attribute 'Callable'
2023-01-18T15:57:29.725 DEBUG:teuthology.orchestra.run:got remote process result: 1

this is a known issue (https://github.com/nose-devs/nose/issues/1099) with nosetests on python versions 3.9 and above. some workarounds are suggested in that issue; otherwise we might try pinning python 3.8

Actions #1

Updated by Casey Bodley about 1 year ago

ubuntu 22.04 only provides python 3.10. we'll probably want to replace nose with pytest in both s3-tests and ragweed

Actions #2

Updated by Casey Bodley about 1 year ago

  • Status changed from New to Fix Under Review
  • Assignee set to Casey Bodley
  • Pull request ID set to 49826
Actions #3

Updated by Casey Bodley about 1 year ago

  • Status changed from Fix Under Review to Resolved
Actions

Also available in: Atom PDF