Project

General

Profile

Bug #36353

Updated by Patrick Seidensal over 5 years ago

test_safe_to_destroy test_safe_to_destro (tasks.mgr.dashboard.test_osd.OsdTest) is failing on several PRs currently, e.g.: 

 http://pulpito.ceph.com/skrah-2018-10-09_08:57:22-rados:mgr-wip-skrah-testing-23230-2018-10-09-09-01-distro-basic-smithi/ 
 http://pulpito.ceph.com/tdehler-2018-10-08_11:20:33-rados:mgr-wip-tdehler-testing-21614-distro-basic-smithi/ 

 <pre> 
 2018-10-09T09:29:55.371 INFO:tasks.mgr.dashboard.helper:request GET to https://smithi016.front.sepia.ceph.com:7791/api/osd/13/safe_to_destroy 
 2018-10-09T09:29:55.377 INFO:tasks.ceph.mgr.z.smithi016.stderr:2018-10-09 09:29:55.342 7efe59af4700 -1 mgr.server reply reply (11) Resource temporarily unavailable 3 pgs have unknown state; cannot draw any conclusions 
 2018-10-09T09:29:55.379 INFO:tasks.ceph.mgr.z.smithi016.stdout:::ffff:172.21.0.51 - - [09/Oct/2018:09:29:55] "GET /api/osd/13/safe_to_destroy HTTP/1.1" 200 106 "" "python-requests/2.12.5" 
 2018-10-09T09:29:55.380 INFO:tasks.cephfs_test_runner:test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) ... FAIL 
 2018-10-09T09:29:55.381 INFO:tasks.mgr.dashboard.helper:request POST to https://smithi016.front.sepia.ceph.com:7791/api/osd/0/mark_in 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:====================================================================== 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:    File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:      self.assertJsonBody({'safe-to-destroy': True}) 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:    File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:      self.assertEqual(body, data) 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True} 
 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions', 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:-    u'safe-to-destroy': False} 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^^                     ^^^^ 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True} 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^                     ^^^ 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:Ran 40 tests in 489.927s 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 
 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:====================================================================== 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:    File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:      self.assertJsonBody({'safe-to-destroy': True}) 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:    File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:      self.assertEqual(body, data) 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True} 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions', 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:-    u'safe-to-destroy': False} 
 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:? ^^                     ^^^^ 
 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True} 
 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:? ^                     ^^^ 
 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner: 
 2018-10-09T09:29:55.392 ERROR:teuthology.run_tasks:Saw exception from tasks. 
 </pre>

Back