Project

General

Profile

Bug #56445

Command failed on smithi162 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --"

Added by Venky Shankar 7 months ago. Updated 14 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
QA Suite
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

Haven't seen this before and started happening pretty recently. E.g.: https://pulpito.ceph.com/vshankar-2022-06-29_09:19:00-fs-wip-vshankar-testing-20220627-100931-testing-default-smithi/6904969/

Seems to erroring out when gathering syslog

```
2022-06-30T11:21:01.722 INFO:teuthology.orchestra.run.smithi162.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: Permission denied
2022-06-30T11:21:01.737 INFO:teuthology.task.internal.syslog:Compressing syslogs...
2022-06-30T11:21:01.738 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog name '*.log' -print0 | sudo xargs -0 --no-run-if-empty - gzip --
2022-06-30T11:21:01.744 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog name '*.log' -print0 | sudo xargs -0 --no-run-if-empty - gzip --
2022-06-30T11:21:01.834 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/kern.log.gz already exists; not overwritten
2022-06-30T11:21:01.856 DEBUG:teuthology.orchestra.run:got remote process result: 123
2022-06-30T11:21:01.856 ERROR:teuthology.run_tasks:Manager failed: internal.syslog
```

kern.log.gz already exists perhaps. Not sure why. I', also not sure what changes in fs suite is causing this to show up. Other instances:

- https://pulpito.ceph.com/vshankar-2022-06-29_09:19:00-fs-wip-vshankar-testing-20220627-100931-testing-default-smithi/6904976/
- https://pulpito.ceph.com/vshankar-2022-06-29_09:19:00-fs-wip-vshankar-testing-20220627-100931-testing-default-smithi/6904993/

History

#1 Updated by Venky Shankar 7 months ago

Formatting the errs:

2022-06-30T11:21:01.722 INFO:teuthology.orchestra.run.smithi162.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: Permission denied
2022-06-30T11:21:01.737 INFO:teuthology.task.internal.syslog:Compressing syslogs...
2022-06-30T11:21:01.738 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog name '*.log' -print0 | sudo xargs -0 --no-run-if-empty - gzip --
2022-06-30T11:21:01.744 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog name '*.log' -print0 | sudo xargs -0 --no-run-if-empty - gzip --
2022-06-30T11:21:01.834 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/kern.log.gz already exists; not overwritten
2022-06-30T11:21:01.856 DEBUG:teuthology.orchestra.run:got remote process result: 123
2022-06-30T11:21:01.856 ERROR:teuthology.run_tasks:Manager failed: internal.syslog

#2 Updated by Brad Hubbard 14 days ago

The 123 error is coming from xargs, presumably because xargs is returning an error.

From 'man xargs' EXIT STATUS section.

 123 if any invocation of the command exited with status 1-125

Powercycle suite seems to reproduce this nicely so I'll see what I can work out.

Also available in: Atom PDF