Bug #36104: TestClsRbd.parents fails with EEXIST - rbd - Ceph

Actions

Copy link

Bug #36104

closed

TestClsRbd.parents fails with EEXIST

Added by Sage Weil over 5 years ago. Updated over 4 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Target version:

% Done:

Source:

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

2018-09-20T20:36:31.867 INFO:tasks.workunit.client.2.smithi163.stdout:[ RUN      ] TestClsRbd.parents
2018-09-20T20:36:31.893 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight'
2018-09-20T20:36:31.935 INFO:tasks.ceph.osd.5.smithi025.stderr:2018-09-20 20:36:31.934 7f3bde744700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5  (PID: 14259) UID: 0
2018-09-20T20:36:32.036 INFO:tasks.ceph.osd.0.smithi097.stderr:2018-09-20 20:36:32.034 7fbfa681f700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0  (PID: 14134) UID: 0
2018-09-20T20:36:32.100 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops'
2018-09-20T20:36:32.138 INFO:tasks.ceph.osd.3.smithi097.stderr:2018-09-20 20:36:32.134 7f238522d700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3  (PID: 14141) UID: 0
2018-09-20T20:36:32.235 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops'
2018-09-20T20:36:32.238 INFO:tasks.ceph.osd.7.smithi025.stderr:2018-09-20 20:36:32.234 7f3dfb60a700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7  (PID: 14263) UID: 0
2018-09-20T20:36:32.327 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight'
2018-09-20T20:36:32.328 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset
2018-09-20T20:36:32.350 INFO:tasks.ceph.osd.2.smithi097.stderr:2018-09-20 20:36:32.346 7fc042f8d700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2  (PID: 14139) UID: 0
2018-09-20T20:36:32.439 INFO:tasks.ceph.osd.3.smithi097.stderr:2018-09-20 20:36:32.438 7f238522d700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3  (PID: 14141) UID: 0
2018-09-20T20:36:32.451 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops'
2018-09-20T20:36:32.540 INFO:tasks.ceph.osd.5.smithi025.stderr:2018-09-20 20:36:32.538 7f3bde744700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5  (PID: 14259) UID: 0
2018-09-20T20:36:32.641 INFO:tasks.ceph.osd.1.smithi097.stderr:2018-09-20 20:36:32.638 7fbee05cd700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1  (PID: 14136) UID: 0
2018-09-20T20:36:32.652 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops'
2018-09-20T20:36:32.708 INFO:teuthology.orchestra.run.smithi097:Running: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true" 
2018-09-20T20:36:32.751 INFO:tasks.ceph.osd.0.smithi097.stderr:2018-09-20 20:36:32.750 7fbfa681f700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0  (PID: 14134) UID: 0
2018-09-20T20:36:32.828 INFO:teuthology.orchestra.run.smithi097.stderr:2018-09-20 20:36:32.826 7f1e47123700 -1 WARNING: all dangerous and experimental features are enabled.
2018-09-20T20:36:32.843 INFO:tasks.ceph.osd.3.smithi097.stderr:2018-09-20 20:36:32.842 7f238522d700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3  (PID: 14141) UID: 0
2018-09-20T20:36:32.846 INFO:teuthology.orchestra.run.smithi097.stderr:2018-09-20 20:36:32.846 7f1e47123700 -1 WARNING: all dangerous and experimental features are enabled.
2018-09-20T20:36:32.874 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight'
2018-09-20T20:36:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = 'true'
2018-09-20T20:36:32.896 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = 'true'
2018-09-20T20:36:32.924 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = 'true'
2018-09-20T20:36:32.939 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = 'true'
2018-09-20T20:36:32.947 INFO:tasks.ceph.osd.4.smithi025.stderr:2018-09-20 20:36:32.946 7f74ce885700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4  (PID: 14256) UID: 0
2018-09-20T20:36:32.961 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = 'true'
2018-09-20T20:36:32.970 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops'
2018-09-20T20:36:32.992 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = 'true'
2018-09-20T20:36:33.048 INFO:tasks.ceph.osd.4.smithi025.stderr:2018-09-20 20:36:33.046 7f74ce885700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4  (PID: 14256) UID: 0
2018-09-20T20:36:33.095 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops'
2018-09-20T20:36:33.149 INFO:tasks.ceph.osd.3.smithi097.stderr:2018-09-20 20:36:33.146 7f238522d700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3  (PID: 14141) UID: 0
2018-09-20T20:36:33.216 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight'
2018-09-20T20:36:33.254 INFO:tasks.ceph.osd.1.smithi097.stderr:2018-09-20 20:36:33.254 7fbee05cd700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1  (PID: 14136) UID: 0
2018-09-20T20:36:33.352 INFO:tasks.ceph.osd.5.smithi025.stderr:2018-09-20 20:36:33.350 7f3bde744700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5  (PID: 14259) UID: 0
2018-09-20T20:36:33.436 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops'
2018-09-20T20:36:33.452 INFO:tasks.ceph.osd.5.smithi025.stderr:2018-09-20 20:36:33.450 7f3bde744700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5  (PID: 14259) UID: 0
2018-09-20T20:36:33.550 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops'
2018-09-20T20:36:33.553 INFO:tasks.ceph.osd.6.smithi025.stderr:2018-09-20 20:36:33.554 7f0a4eff2700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6  (PID: 14260) UID: 0
2018-09-20T20:36:33.654 INFO:tasks.ceph.osd.6.smithi025.stderr:2018-09-20 20:36:33.650 7f0a4eff2700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6  (PID: 14260) UID: 0
2018-09-20T20:36:33.672 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight'
2018-09-20T20:36:33.755 INFO:tasks.ceph.osd.2.smithi097.stderr:2018-09-20 20:36:33.754 7fc042f8d700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2  (PID: 14139) UID: 0
2018-09-20T20:36:33.758 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops'
2018-09-20T20:36:33.856 INFO:tasks.ceph.osd.4.smithi025.stderr:2018-09-20 20:36:33.854 7f74ce885700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4  (PID: 14256) UID: 0
2018-09-20T20:36:33.940 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops'
2018-09-20T20:36:33.957 INFO:tasks.ceph.osd.4.smithi025.stderr:2018-09-20 20:36:33.954 7f74ce885700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4  (PID: 14256) UID: 0
2018-09-20T20:36:34.055 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight'
2018-09-20T20:36:34.058 INFO:tasks.ceph.osd.1.smithi097.stderr:2018-09-20 20:36:34.058 7fbee05cd700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1  (PID: 14136) UID: 0
2018-09-20T20:36:34.159 INFO:tasks.ceph.osd.7.smithi025.stderr:2018-09-20 20:36:34.158 7f3dfb60a700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7  (PID: 14263) UID: 0
2018-09-20T20:36:34.209 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops'
2018-09-20T20:36:34.260 INFO:tasks.ceph.osd.0.smithi097.stderr:2018-09-20 20:36:34.258 7fbfa681f700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0  (PID: 14134) UID: 0
2018-09-20T20:36:34.352 INFO:teuthology.orchestra.run.smithi097:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub'
2018-09-20T20:36:34.361 INFO:tasks.ceph.osd.6.smithi025.stderr:2018-09-20 20:36:34.358 7f0a4eff2700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6  (PID: 14260) UID: 0
2018-09-20T20:36:34.411 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops'
2018-09-20T20:36:34.462 INFO:tasks.ceph.osd.7.smithi025.stderr:2018-09-20 20:36:34.458 7f3dfb60a700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7  (PID: 14263) UID: 0
2018-09-20T20:36:34.463 INFO:teuthology.orchestra.run.smithi097.stderr:2018-09-20 20:36:34.462 7fe078ff1700 -1 WARNING: all dangerous and experimental features are enabled.
2018-09-20T20:36:34.485 INFO:teuthology.orchestra.run.smithi097.stderr:2018-09-20 20:36:34.482 7fe078ff1700 -1 WARNING: all dangerous and experimental features are enabled.
2018-09-20T20:36:34.563 INFO:tasks.ceph.osd.3.smithi097.stderr:2018-09-20 20:36:34.562 7f238522d700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3  (PID: 14141) UID: 0
2018-09-20T20:36:34.596 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight'
2018-09-20T20:36:34.664 INFO:tasks.ceph.osd.4.smithi025.stderr:2018-09-20 20:36:34.662 7f74ce885700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4  (PID: 14256) UID: 0
2018-09-20T20:36:34.723 INFO:teuthology.orchestra.run.smithi025:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops'
2018-09-20T20:36:34.765 INFO:tasks.ceph.osd.6.smithi025.stderr:2018-09-20 20:36:34.762 7f0a4eff2700 -1 received  signal: Hangup from /usr/bin/python /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6  (PID: 14260) UID: 0
2018-09-20T20:36:34.815 INFO:tasks.workunit.client.2.smithi163.stdout:/build/ceph-12.2.8-199-gc20a7a9/src/test/cls_rbd/test_cls_rbd.cc:674: Failure
2018-09-20T20:36:34.815 INFO:tasks.workunit.client.2.smithi163.stdout:      Expected: 0
2018-09-20T20:36:34.815 INFO:tasks.workunit.client.2.smithi163.stdout:To be equal to: set_parent(&ioctx, oid, ParentSpec(4, "parent2", 6), 5<<20)
2018-09-20T20:36:34.815 INFO:tasks.workunit.client.2.smithi163.stdout:      Which is: -17
2018-09-20T20:36:34.815 INFO:tasks.workunit.client.2.smithi163.stdout:[  FAILED  ] TestClsRbd.parents (2948 ms)

/a/sage-2018-09-20_18:56:20-rados-wip-sage-testing-2018-09-20-0933-distro-basic-smithi/3047041

Actions

Copy link

Updated by Jason Dillaman over 5 years ago

Status changed from 12 to Need More Info
Priority changed from High to Normal

This is just an invalid test from an old release that is now being hit [1]. The real issue, however, is that it appears that test suite installs hammer of all things. Can we drop hammer and replace it w/ mimic for the sake of backporting?

[1] http://tracker.ceph.com/issues/36097

Actions

Copy link

Updated by Sage Weil over 5 years ago

Jason Dillaman wrote:

This is just an invalid test from an old release that is now being hit [1]. The real issue, however, is that it appears that test suite installs hammer of all things. Can we drop hammer and replace it w/ mimic for the sake of backporting?

[1] http://tracker.ceph.com/issues/36097

Hmm, the point of these tests is to make sure the hammer client works against the latest release.. which I think we still want. (We can add mimic though!)

Maybe the fix is to not run the cls_rbd tests at all here, or to just skip this specific test if the incompatibility is known to be a non-issue?

Actions

Copy link

Updated by Jason Dillaman over 5 years ago

Sage Weil wrote:

Hmm, the point of these tests is to make sure the hammer client works against the latest release.. which I think we still want. (We can add mimic though!)

Indeed -- but in this case, the test was testing something that wasn't valid (an image having different parents between snapshots). The only legal value is that parents can be removed at some point if the image was flattened.

Actions

Copy link