Bug #62188
closed
AttributeError: 'RemoteProcess' object has no attribute 'read'
Added by Venky Shankar 10 months ago.
Updated about 1 month ago.
Backport:
quincy,reef,squid
Labels (FS):
qa, qa-failure
Description
/a/vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7352553
2023-07-26T07:12:26.945 DEBUG:teuthology.orchestra.run.smithi121:> mktemp
2023-07-26T07:12:26.964 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.S5KnYoRutf
2023-07-26T07:12:26.965 DEBUG:teuthology.orchestra.run.smithi121:> set -ex
2023-07-26T07:12:26.965 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/tmp/tmp.S5KnYoRutf
2023-07-26T07:12:27.009 ERROR:teuthology:Uncaught exception (Hub)
Traceback (most recent call last):
File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run
File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/run.py", line 309, in copy_and_close
shutil.copyfileobj(src, fdst)
File "/usr/lib/python3.8/shutil.py", line 199, in copyfileobj
fsrc_read = fsrc.read
AttributeError: 'RemoteProcess' object has no attribute 'read'
Related issues
1 (1 open — 0 closed)
- Project changed from teuthology to CephFS
- Assignee set to Rishabh Dave
FWIW - this seems to be happening with multifs-auth tests in fs suite
/a/vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7352571
Rishabh, please RCA. I remember we talking about this but not sure if any RCA was done.
I spent a good amount of time with this ticket. The reason for this failure is unclear from logs. There's no traceback pointing to any code in test_multifs_auth.py.
I suspect the cause of failure is this line at the end of method CephFSTestCase.create_client() - return run_ceph_cmd(f'auth get {self.client_name}'). I can't be sure because there's nothing in logs to confirm this. I suspect so because same test (test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent) failed recently while I was working with "fs authorize" PR.
Running this test locally (with vstart_runner.py) fails because the method create_client() doesn't return the keyring.
Rishabh Dave wrote:
I spent a good amount of time with this ticket. The reason for this failure is unclear from logs. There's no traceback pointing to any code in test_multifs_auth.py.
I suspect the cause of failure is this line at the end of method CephFSTestCase.create_client() - return run_ceph_cmd(f'auth get {self.client_name}'). I can't be sure because there's nothing in logs to confirm this.
You could dump out the return value just before that line - if some output is expected, then the empty return value is most likely the issue.
I suspect so because same test (test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent) failed recently while I was working with "fs authorize" PR.
Running this test locally (with vstart_runner.py) fails because the method create_client() doesn't return the keyring.
That sounds like a bug to me.
Venky Shankar wrote:
Rishabh Dave wrote:
I spent a good amount of time with this ticket. The reason for this failure is unclear from logs. There's no traceback pointing to any code in test_multifs_auth.py.
I suspect the cause of failure is this line at the end of method CephFSTestCase.create_client() - return run_ceph_cmd(f'auth get {self.client_name}'). I can't be sure because there's nothing in logs to confirm this.
You could dump out the return value just before that line - if some output is expected, then the empty return value is most likely the issue.
Yes. I suspect the tracker ticket I've linked is the same issue.
I suspect so because same test (test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent) failed recently while I was working with "fs authorize" PR.
Running this test locally (with vstart_runner.py) fails because the method create_client() doesn't return the keyring.
That sounds like a bug to me.
It is. I've raised a tracker ticket for it (https://tracker.ceph.com/issues/62246) and also a commit has been written for it.
- Related to Bug #62246: qa/cephfs: test_mount_mon_and_osd_caps_present_mds_caps_absent fails added
- Priority changed from Normal to Urgent
- Target version set to v20.0.0
- Backport set to quincy,reef,squid
- Severity changed from 3 - minor to 2 - major
- Labels (FS) qa, qa-failure added
Rishabh, this is seen in reef run: /a/yuriw-2024-04-05_18:13:21-fs-wip-yuri4-testing-2024-04-04-1128-reef-distro-default-smithi/7641588
2024-04-05T21:05:00.846 ERROR:teuthology:Uncaught exception (Hub)
Traceback (most recent call last):
File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run
File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 309, in copy_and_close
shutil.copyfileobj(src, fdst)
File "/usr/lib/python3.8/shutil.py", line 202, in copyfileobj
fsrc_read = fsrc.read
AttributeError: 'RemoteProcess' object has no attribute 'read'
Please RCA this asap.
- Status changed from New to Duplicate
Also available in: Atom
PDF