Project

General

Profile

Actions
Copy link

Bug #54516

closed

mon/config.sh: unrecognized config option 'debug asok'

Added by Kamoltat (Junior) Sirivadhna about 2 years ago. Updated about 2 years ago.

Status:
Won't Fix
Priority:
Normal
Assignee:
Nitzan Mordechai
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
45730
Crash signature (v1):
Crash signature (v2):

Description

/a/yuriw-2022-03-04_21:56:41-rados-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi/6721689

2022-03-05T04:02:05.416 INFO:tasks.workunit.client.0.smithi074.stderr:+ ceph config set client.foo 'debug asok' 44
2022-03-05T04:02:05.689 INFO:tasks.workunit.client.0.smithi074.stderr:Error EINVAL: unrecognized config option 'debug asok'
2022-03-05T04:02:05.691 DEBUG:teuthology.orchestra.run:got remote process result: 22
2022-03-05T04:02:05.692 INFO:tasks.workunit:Stopping ['mon/config.sh'] on client.0...
2022-03-05T04:02:05.692 DEBUG:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2022-03-05T04:02:05.952 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/run_tasks.py", line 91, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/run_tasks.py", line 70, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_c8f79f870e0d6a996c92d420e6256d312bac1c7c/qa/tasks/workunit.py", line 148, in task
    cleanup=cleanup)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_c8f79f870e0d6a996c92d420e6256d312bac1c7c/qa/tasks/workunit.py", line 298, in _spawn_on_all_clients
    timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_c8f79f870e0d6a996c92d420e6256d312bac1c7c/qa/tasks/workunit.py", line 427, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/run.py", line 183, in _raise_for_status
    node=self.hostname, label=self.label
teuthology.exceptions.CommandFailedError: Command failed (workunit test mon/config.sh) on smithi074 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8f79f870e0d6a996c92d420e6256d312bac1c7c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/config.sh'
2022-03-05T04:02:06.177 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8667fa4b9307459191ea18725622c87f

Actions
Copy link
 #1

Updated by Laura Flores about 2 years ago

This was the first occurrence of this test failure according to the Sentry history (March 5th 2022), and it has since failed on master.

Actions
Copy link
 #2

Updated by Nitzan Mordechai about 2 years ago

PR https://github.com/ceph/ceph/pull/44656 Added the test along with the code to support whitespace.
checking.

Actions
Copy link
 #3

Updated by Nitzan Mordechai about 2 years ago

  • Assignee set to Nitzan Mordechai
Actions
Copy link
 #4

Updated by Nitzan Mordechai about 2 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #5

Updated by Nitzan Mordechai about 2 years ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 45730
Actions
Copy link
 #6

Updated by Neha Ojha about 2 years ago

  • Status changed from Fix Under Review to Won't Fix

I don't think this a real failure. The occurrences captured in sentry are from runs, where the install sha1 and workunit sha1 don't match. This implies, the tests included in https://github.com/ceph/ceph/pull/44656/commits/674489490fdd74b84295a57a71c51c6bc0ab2cee, where tested without the src code changes https://github.com/ceph/ceph/pull/44656/commits/94cac0795f64751b9e37d4e025b0c0f41b82fd39.

Recent runs where these tests are passing

/a/yuriw-2022-03-25_18:40:53-rados-wip-yuri-testing-2022-03-25-0929-distro-default-smithi/6760818

   install:
      ceph:
        flavor: default
        sha1: 96d953de10fae4905a35ee1f5aa223cdd3275b37
    workunit:
      branch: wip-yuri-testing-2022-03-25-0929
      sha1: 96d953de10fae4905a35ee1f5aa223cdd3275b37

/a/yuriw-2022-03-29_21:35:01-rados-wip-yuri3-testing-2022-03-29-1133-distro-default-smithi/6767517

    install:
      ceph:
        flavor: default
        sha1: 36eb526591e5bf87aeed3045c8e219027174a8d1
    workunit:
      branch: wip-yuri3-testing-2022-03-29-1133
      sha1: 36eb526591e5bf87aeed3045c8e219027174a8d1

vs

The ones captured in https://sentry.ceph.com/organizations/ceph/issues/23797/events/8667fa4b9307459191ea18725622c87f/events/?project=2.

/a/yuriw-2022-03-04_21:56:41-rados-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi/6721689
    install:
      ceph:
        flavor: default
        sha1: 455fbdef60203ba134b5a8589916d6dca35cd51b
    workunit:
      branch: wip-yuri4-testing-2022-03-03-1448
      sha1: c8f79f870e0d6a996c92d420e6256d312bac1c7c

/a/rzarzynski-2022-03-07_00:23:56-rados-master-distro-basic-smithi/6724345
    install:
      ceph:
        flavor: crimson
        sha1: a0748b03ae0d400aa24e080b98680d830beb6b59
    workunit:
      branch: master
      sha1: 27bad0cf8decf43ee4c77b0b76e8f0be5095a177

/a/rzarzynski-2022-03-07_19:25:51-rados-master-distro-basic-smithi/6725106

    install:
      ceph:
        flavor: crimson
        sha1: 35d04a0ed2a9cb550d4a5c580c4c40bd7deabe5c
    workunit:
      branch: master
      sha1: 27bad0cf8decf43ee4c77b0b76e8f0be5095a177

A test on latest master also passed https://pulpito.ceph.com/nojha-2022-03-31_21:47:48-rados:singleton-master-distro-basic-smithi/

Actions
Copy link

Also available in: Atom PDF