Project

General

Profile

Actions

Bug #45615

closed

api_watch_notify_pp: LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 fails

Added by Neha Ojha almost 4 years ago. Updated 3 months ago.

Status:
Resolved
Priority:
High
Category:
-
Target version:
-
% Done:

100%

Source:
Community (dev)
Tags:
backport_processed
Backport:
pacific,quincy
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2020-05-19T03:15:09.084 INFO:tasks.workunit.client.0.smithi175.stdout:      api_watch_notify_pp: [       OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (120101 ms)
2020-05-19T03:15:09.085 INFO:tasks.workunit.client.0.smithi175.stdout:      api_watch_notify_pp: [ RUN      ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1
2020-05-19T03:15:09.085 INFO:tasks.workunit.client.0.smithi175.stdout:      api_watch_notify_pp: notify
2020-05-19T03:15:09.085 INFO:tasks.workunit.client.0.smithi175.stdout:error in api_watch_notify_pp (29689)
2020-05-19T03:15:09.085 INFO:tasks.workunit.client.0.smithi175.stderr:bash: line 1: 29691 Alarm clock             ceph_test_rados_api_watch_notify_pp 2>&1
2020-05-19T03:15:09.086 INFO:tasks.workunit.client.0.smithi175.stderr:     29692 Done                    | tee ceph_test_rados_api_watch_notify_pp.log
2020-05-19T03:15:09.086 INFO:tasks.workunit.client.0.smithi175.stderr:     29693 Done                    | sed "s/^/      api_watch_notify_pp: /" 
2020-05-19T03:15:09.086 INFO:tasks.workunit.client.0.smithi175.stderr:+ echo 'error in api_watch_notify_pp (29689)'
2020-05-19T03:15:09.086 INFO:tasks.workunit.client.0.smithi175.stderr:+ ret=1
2020-05-19T03:15:09.086 INFO:tasks.workunit.client.0.smithi175.stderr:+ for t in "${!pids[@]}" 
2020-05-19T03:15:09.087 INFO:tasks.workunit.client.0.smithi175.stderr:+ pid=29583
2020-05-19T03:15:09.087 INFO:tasks.workunit.client.0.smithi175.stderr:+ wait 29583
2020-05-19T03:15:09.087 INFO:tasks.workunit.client.0.smithi175.stderr:+ for t in "${!pids[@]}" 

and then

2020-05-19T03:15:09.101 INFO:tasks.workunit.client.0.smithi175.stderr:+ pkill -P 29367
2020-05-19T03:15:09.103 INFO:tasks.workunit.client.0.smithi175.stderr:+ true
2020-05-19T03:15:09.103 DEBUG:teuthology.orchestra.run:got remote process result: 1
2020-05-19T03:15:09.104 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0...
2020-05-19T03:15:09.104 INFO:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2020-05-19T03:15:09.291 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 88, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 67, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-revert-34894/qa/tasks/workunit.py", line 127, in task
    coverage_and_limits=not config.get('no_coverage_and_limits', None))
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 87, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 101, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 37, in resurrect_traceback
    reraise(*exc_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/six.py", line 703, in reraise
    raise value
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 24, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-revert-34894/qa/tasks/workunit.py", line 415, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 206, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 473, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 162, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 184, in _raise_for_status
    node=self.hostname, label=self.label
teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi175 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1f885b6c2fdde1f3ab249a56f7b4b763556f4373 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
2020-05-19T03:15:09.323 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=f841c344e94c4a2d96258c84877f0d7d

/a/nojha-2020-05-19_00:53:41-rados-wip-revert-34894-distro-basic-smithi/5068112


Related issues 3 (0 open3 closed)

Related to RADOS - Bug #50042: rados/test.sh: api_watch_notify failuresResolvedNitzan Mordechai

Actions
Copied to RADOS - Backport #58611: pacific: api_watch_notify_pp: LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 failsResolvedNitzan MordechaiActions
Copied to RADOS - Backport #58612: quincy: api_watch_notify_pp: LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 failsResolvedNitzan MordechaiActions
Actions #1

Updated by Brad Hubbard over 3 years ago

  • Priority changed from Normal to High
  • Backport set to octopus

/a/yuriw-2020-07-13_23:00:15-rados-wip-yuri8-testing-2020-07-13-1946-octopus-distro-basic-smithi/5223919

Actions #3

Updated by Neha Ojha over 3 years ago

/a/teuthology-2020-09-25_07:01:01-rados-master-distro-basic-smithi/5466707

Actions #4

Updated by Deepika Upadhyay over 3 years ago

/ceph/teuthology-archive/yuriw-2021-01-04_18:28:05-rados-wip-yuri2-testing-2021-01-04-0837-octopus-distro-basic-smithi/5754177/teuthology.log

2021-01-04T21:10:44.893 INFO:tasks.workunit.client.0.smithi112.stdout:error in api_watch_notify_pp (24698)
2021-01-04T21:10:44.894 INFO:tasks.workunit.client.0.smithi112.stderr:bash: line 1: 24700 Alarm clock             ceph_test_rados_api_watch_notify_pp 2>&1
2021-01-04T21:10:44.894 INFO:tasks.workunit.client.0.smithi112.stderr:     24701 Done                    | tee ceph_test_rados_api_watch_notify_pp.log
2021-01-04T21:10:44.894 INFO:tasks.workunit.client.0.smithi112.stderr:     24702 Done                    | sed "s/^/      api_watch_notify_pp: /" 
2021-01-04T21:10:44.894 INFO:tasks.workunit.client.0.smithi112.stderr:+ echo 'error in api_watch_notify_pp (24698)'

Actions #5

Updated by Nitzan Mordechai over 1 year ago

  • Related to Bug #50042: rados/test.sh: api_watch_notify failures added
Actions #6

Updated by Nitzan Mordechai over 1 year ago

  • Assignee set to Nitzan Mordechai
Actions #7

Updated by Nitzan Mordechai about 1 year ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 49109
Actions #8

Updated by Radoslaw Zarzynski about 1 year ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from octopus to pacific,quincy
Actions #9

Updated by Backport Bot about 1 year ago

  • Copied to Backport #58611: pacific: api_watch_notify_pp: LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 fails added
Actions #10

Updated by Backport Bot about 1 year ago

  • Copied to Backport #58612: quincy: api_watch_notify_pp: LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 fails added
Actions #11

Updated by Backport Bot about 1 year ago

  • Tags set to backport_processed
Actions #12

Updated by Konstantin Shalygin 3 months ago

  • Status changed from Pending Backport to Resolved
  • % Done changed from 0 to 100
  • Source set to Community (dev)
Actions

Also available in: Atom PDF