Ceph » mgr » Dashboard

test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) is failing on several PRs currently, e.g.:

http://pulpito.ceph.com/skrah-2018-10-09_08:57:22-rados:mgr-wip-skrah-testing-23230-2018-10-09-09-01-distro-basic-smithi/
http://pulpito.ceph.com/tdehler-2018-10-08_11:20:33-rados:mgr-wip-tdehler-testing-21614-distro-basic-smithi/

2018-10-09T09:29:55.371 INFO:tasks.mgr.dashboard.helper:request GET to https://smithi016.front.sepia.ceph.com:7791/api/osd/13/safe_to_destroy
2018-10-09T09:29:55.377 INFO:tasks.ceph.mgr.z.smithi016.stderr:2018-10-09 09:29:55.342 7efe59af4700 -1 mgr.server reply reply (11) Resource temporarily unavailable 3 pgs have unknown state; cannot draw any conclusions
2018-10-09T09:29:55.379 INFO:tasks.ceph.mgr.z.smithi016.stdout:::ffff:172.21.0.51 - - [09/Oct/2018:09:29:55] "GET /api/osd/13/safe_to_destroy HTTP/1.1" 200 106 "" "python-requests/2.12.5" 
2018-10-09T09:29:55.380 INFO:tasks.cephfs_test_runner:test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) ... FAIL
2018-10-09T09:29:55.381 INFO:tasks.mgr.dashboard.helper:request POST to https://smithi016.front.sepia.ceph.com:7791/api/osd/0/mark_in
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:======================================================================
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:    self.assertJsonBody({'safe-to-destroy': True})
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:    self.assertEqual(body, data)
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True}
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions',
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:-  u'safe-to-destroy': False}
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^^                   ^^^^
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True}
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^                   ^^^
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:Ran 40 tests in 489.927s
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:FAILED (failures=1)
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:======================================================================
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:    self.assertJsonBody({'safe-to-destroy': True})
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:    self.assertEqual(body, data)
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True}
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions',
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:-  u'safe-to-destroy': False}
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:? ^^                   ^^^^
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True}
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:? ^                   ^^^
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.392 ERROR:teuthology.run_tasks:Saw exception from tasks.