Project

General

Profile

Actions

Bug #23715

closed

"Scrubbing terminated -- not all pgs were active and clean" in fs-jewel-distro-basic-ovh

Added by Yuri Weinstein about 6 years ago. Updated almost 6 years ago.

Status:
Closed
Priority:
Urgent
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
fs
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2018-04-11_04:10:03-fs-jewel-distro-basic-ovh/
Jobs: 40 jobs
Logs: teuthology-2018-04-11_04:15:02-krbd-jewel-testing-basic-ovh/2385215/teuthology.log

2018-04-13T18:37:18.345 INFO:tasks.ceph:Waiting for all osds to be active and clean.
2018-04-13T18:37:28.346 INFO:tasks.ceph:Scrubbing terminated -- not all pgs were active and clean.
2018-04-13T18:37:28.347 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 32, in nested
    yield vars
  File "/home/teuthworker/src/git.ceph.com_ceph_jewel/qa/tasks/ceph.py", line 1535, in task
    healthy(ctx=ctx, config=dict(cluster=config['cluster']))
  File "/home/teuthworker/src/git.ceph.com_ceph_jewel/qa/tasks/ceph.py", line 1132, in healthy
    ceph_cluster=cluster_name,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 924, in wait_until_osds_up
    daemon.check_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/daemon/state.py", line 42, in check_status
    return self.proc.poll()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 205, in poll
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 177, in _raise_for_status
    node=self.hostname, label=self.label
Commandteuthology-2018-04-11_04:15:02-krbd-jewel-testing-basic-ovh/2385215/teuthology.log
FailedError: Command failed on ovh098 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1'

Actions #1

Updated by Yuri Weinstein about 6 years ago

Nathan, I am not sure if you have seen this.
Suspect also in http://pulpito.ceph.com/teuthology-2018-04-11_04:15:02-krbd-jewel-testing-basic-ovh/

Actions #2

Updated by Yuri Weinstein about 6 years ago

  • Project changed from 18 to Ceph
Actions #3

Updated by Nathan Cutler about 6 years ago

  • Project changed from Ceph to CephFS
  • Assignee deleted (Nathan Cutler)

Yuri, I have not seen this on smithi, so I assume it only happens in virtual environments.

Actions #4

Updated by Yuri Weinstein about 6 years ago

Patrick, any requirements against running k* suites on ovh ?

Actions #5

Updated by Patrick Donnelly about 6 years ago

  • Assignee set to Patrick Donnelly
Actions #6

Updated by Patrick Donnelly almost 6 years ago

  • Status changed from New to Closed

Problem seems to have gone away. Closing.

Actions

Also available in: Atom PDF