Project

General

Profile

Actions

Bug #61586

open

fetch_binaries_for_coredumps() attempts to run "which" in the entire command with arguments

Added by Ilya Dryomov 11 months ago.

Status:
New
Priority:
Normal
Category:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

http://qa-proxy.ceph.com/teuthology/dis-2023-06-04_22:59:23-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295992/teuthology.log

2023-06-05T00:21:31.608 INFO:teuthology.task.internal:Transferring binaries for coredumps...
2023-06-05T00:21:31.818 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dis-2023-06-04_22:59:23-krbd-main-wip-exclusive-lock-snapc-default-smithi/7295992/remote/smithi017/coredump/1685924286.30159.core.gz: gzip compressed data, was "1685924286.30159.core", last modified: Mon Jun  5 00:20:12 2023, max compression

2023-06-05T00:21:31.819 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ...
2023-06-05T00:21:36.454 INFO:teuthology.task.internal: core looks like: /tmp/tmpsbyf2am4: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'ceph-osd -f --cluster ceph -i 5', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-osd', platform: 'x86_64'

2023-06-05T00:21:36.614 INFO:teuthology.task.internal: dump_program: ceph-osd -f --cluster ceph -i 5
2023-06-05T00:21:36.615 DEBUG:teuthology.orchestra.run.smithi017:> which 'ceph-osd -f --cluster ceph -i 5'
2023-06-05T00:21:36.634 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-06-05T00:21:36.635 ERROR:teuthology.run_tasks:Manager failed: internal.archive
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/run_tasks.py", line 192, in run_tasks
    suppress = manager.__exit__(*exc_info)
  File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__
    next(self.gen)
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/task/internal/__init__.py", line 420, in archive
    fetch_binaries_for_coredumps(path, rem)
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps
    remote_path = remote.sh(['which', dump_program]).rstrip()
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/remote.py", line 96, in sh
    proc = self.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 181, in _raise_for_status
    raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 1: "which 'ceph-osd -f --cluster ceph -i 5'" 

I think it needs to be

which 'ceph-osd'
instead of
which 'ceph-osd -f --cluster ceph -i 5'


Related issues 1 (0 open1 closed)

Related to teuthology - Bug #53206: Found coredumps on ubuntu@smithi115.front.sepia.ceph.com | IndexError: list index out of rangeResolvedKamoltat (Junior) Sirivadhna

Actions
Actions #1

Updated by Ilya Dryomov 11 months ago

  • Related to Bug #53206: Found coredumps on ubuntu@smithi115.front.sepia.ceph.com | IndexError: list index out of range added
Actions

Also available in: Atom PDF