Bug #15012: "[ FAILED ] LibRadosTwoPoolsPP.Whiteout" in upgrade:hammer-x-jewel-distro-basic-vps - Ceph - Ceph

Actions

Copy link

Bug #15012

closed

"[ FAILED ] LibRadosTwoPoolsPP.Whiteout" in upgrade:hammer-x-jewel-distro-basic-vps

Added by Yuri Weinstein about 8 years ago. Updated about 8 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Yuri Weinstein

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

upgrade/hammer-x

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2016-03-08_02:10:13-upgrade:hammer-x-jewel-distro-basic-vps/
Jobs: 46407
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2016-03-08_02:10:13-upgrade:hammer-x-jewel-distro-basic-vps/46407/teuthology.log

2016-03-08T02:55:22.315 INFO:tasks.workunit.client.0.vpm019.stdout:Value of: it != cache_ioctx.nobjects_end()
2016-03-08T02:55:22.315 INFO:tasks.workunit.client.0.vpm019.stdout:  Actual: false
2016-03-08T02:55:22.316 INFO:tasks.workunit.client.0.vpm019.stdout:Expected: true
2016-03-08T02:55:25.426 INFO:tasks.workunit.client.0.vpm019.stdout:[  FAILED  ] LibRadosTwoPoolsPP.Whiteout (7901 ms)
....
2016-03-08T02:59:44.023 INFO:tasks.workunit.client.0.vpm019.stdout:test/librados/tier.cc:3192: Failure
2016-03-08T02:59:44.024 INFO:tasks.workunit.client.0.vpm019.stdout:Value of: it != cache_ioctx.nobjects_end()
2016-03-08T02:59:44.024 INFO:tasks.workunit.client.0.vpm019.stdout:  Actual: false
2016-03-08T02:59:44.024 INFO:tasks.workunit.client.0.vpm019.stdout:Expected: true
2016-03-08T02:59:47.214 INFO:tasks.workunit.client.0.vpm019.stdout:[  FAILED  ] LibRadosTwoPoolsECPP.Whiteout (7512 ms)

Actions

Copy link

Updated by Yuri Weinstein about 8 years ago

Priority changed from Normal to Urgent

Run: http://pulpito.ceph.com/teuthology-2016-03-10_02:10:02-upgrade:hammer-x-jewel-distro-basic-vps/
Job: 50505
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2016-03-10_02:10:02-upgrade:hammer-x-jewel-distro-basic-vps/50505/teuthology.log

2016-03-10T03:22:06.635 INFO:tasks.workunit.client.0.vpm111.stdout:test/librados/tier.cc:630: Failure
2016-03-10T03:22:06.635 INFO:tasks.workunit.client.0.vpm111.stdout:Value of: it != cache_ioctx.nobjects_end()
2016-03-10T03:22:06.635 INFO:tasks.workunit.client.0.vpm111.stdout:  Actual: false
2016-03-10T03:22:06.635 INFO:tasks.workunit.client.0.vpm111.stdout:Expected: true
2016-03-10T03:22:09.829 INFO:tasks.workunit.client.0.vpm111.stdout:[  FAILED  ] LibRadosTwoPoolsPP.Whiteout (7592 ms)
....
2016-03-10T03:26:31.597 INFO:tasks.workunit.client.0.vpm111.stdout:test/librados/tier.cc:3192: Failure
2016-03-10T03:26:31.598 INFO:tasks.workunit.client.0.vpm111.stdout:Value of: it != cache_ioctx.nobjects_end()
2016-03-10T03:26:31.598 INFO:tasks.workunit.client.0.vpm111.stdout:  Actual: false
2016-03-10T03:26:31.598 INFO:tasks.workunit.client.0.vpm111.stdout:Expected: true
2016-03-10T03:26:34.729 INFO:tasks.workunit.client.0.vpm111.stdout:[  FAILED  ] LibRadosTwoPoolsECPP.Whiteout (7676 ms)

Actions

Copy link

Updated by Nathan Cutler about 8 years ago

I see that #11548 fixed a similar issue by adding a workunit ( https://github.com/ceph/ceph/commit/348a3d3c9880e7d022e71a2faafe51c8f771406e ) and telling the upgrade tests to use it ( https://github.com/ceph/ceph-qa-suite/commit/c0e3f8f79c6d985a13776898f43664495920d9b0 ).

However, I see no indication that the latter commit was backported. No trace of it in infernalis or hammer.

@Josh Jones, should we backport that ceph-qa-suite commit? And would it have any effect in terms of fixing this bug?

Actions

Copy link

Updated by Nathan Cutler about 8 years ago

Hmm, looking at the failed job:

  suite: upgrade:hammer-x
  suite_branch: jewel
  suite_path: /var/lib/teuthworker/src/ceph-qa-suite_jewel
  suite_sha1: 52704d3b715acfef7ed4d086e852da2bd4f293cd
  tasks:
  - install:
      branch: firefly
  - ceph:
      log-whitelist:
      - reached quota
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rados/test.sh

I guess this is not related to #11548, after all.

Actions

Copy link