Actions
Bug #36353
closedmgr/dashboard: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
Status:
Can't reproduce
Priority:
Normal
Assignee:
Category:
Component - OSDs
Target version:
-
% Done:
0%
Source:
Development
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) is failing on several PRs currently, e.g.:
http://pulpito.ceph.com/skrah-2018-10-09_08:57:22-rados:mgr-wip-skrah-testing-23230-2018-10-09-09-01-distro-basic-smithi/
http://pulpito.ceph.com/tdehler-2018-10-08_11:20:33-rados:mgr-wip-tdehler-testing-21614-distro-basic-smithi/
2018-10-09T09:29:55.371 INFO:tasks.mgr.dashboard.helper:request GET to https://smithi016.front.sepia.ceph.com:7791/api/osd/13/safe_to_destroy 2018-10-09T09:29:55.377 INFO:tasks.ceph.mgr.z.smithi016.stderr:2018-10-09 09:29:55.342 7efe59af4700 -1 mgr.server reply reply (11) Resource temporarily unavailable 3 pgs have unknown state; cannot draw any conclusions 2018-10-09T09:29:55.379 INFO:tasks.ceph.mgr.z.smithi016.stdout:::ffff:172.21.0.51 - - [09/Oct/2018:09:29:55] "GET /api/osd/13/safe_to_destroy HTTP/1.1" 200 106 "" "python-requests/2.12.5" 2018-10-09T09:29:55.380 INFO:tasks.cephfs_test_runner:test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) ... FAIL 2018-10-09T09:29:55.381 INFO:tasks.mgr.dashboard.helper:request POST to https://smithi016.front.sepia.ceph.com:7791/api/osd/0/mark_in 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:====================================================================== 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner: self.assertJsonBody({'safe-to-destroy': True}) 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner: self.assertEqual(body, data) 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True} 2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions', 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:- u'safe-to-destroy': False} 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^^ ^^^^ 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True} 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^ ^^^ 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:Ran 40 tests in 489.927s 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:====================================================================== 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner: self.assertJsonBody({'safe-to-destroy': True}) 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner: self.assertEqual(body, data) 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True} 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions', 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:- u'safe-to-destroy': False} 2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:? ^^ ^^^^ 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True} 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:? ^ ^^^ 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner: 2018-10-09T09:29:55.392 ERROR:teuthology.run_tasks:Saw exception from tasks.
Updated by Patrick Seidensal over 5 years ago
- Subject changed from mgr/dashboard: test_safe_to_destro (tasks.mgr.dashboard.test_osd.OsdTest) to mgr/dashboard: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
- Description updated (diff)
Updated by Patrick Seidensal over 5 years ago
- Status changed from New to In Progress
Updated by Patrick Seidensal over 5 years ago
- Status changed from In Progress to Need More Info
Updated by Tatjana Dehler over 5 years ago
- Status changed from Need More Info to 7
Updated by Tatjana Dehler over 5 years ago
- Status changed from 7 to Need More Info
- Pull request ID deleted (
25127)
Updated by Patrick Seidensal over 5 years ago
- Status changed from Need More Info to Can't reproduce
I will close this one. Feel free to reopen if the error reoccurs.
Updated by Kefu Chai about 4 years ago
- Status changed from Can't reproduce to New
2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:====================================================================== 2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) 2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-01-25-0051/qa/tasks/mgr/dashboard/test_osd.py", line 113, in test_safe_to_dest roy 2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner: 'stored_pgs': [], 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-01-25-0051/qa/tasks/mgr/dashboard/helper.py", line 343, in assertJsonBody 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner: self.assertEqual(body, data) 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:AssertionError: {u'is_safe_to_destroy': False, u'message': u'[errno -11] 2 pgs have unknown stat [truncated]... != {'active': [], 'is_safe_to_destroy': True, 'stored_pgs': [], 'safe_to_destroy': [truncated]... 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:+ {'active': [], 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:- {u'is_safe_to_destroy': False, 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:? ^^ ^^^^ 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner: 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:+ 'is_safe_to_destroy': True, 2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:? ^ ^^^ 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner: 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:- u'message': u'[errno -11] 2 pgs have unknown state; cannot draw any conclusions'} 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:+ 'missing_stats': [], 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:+ 'safe_to_destroy': [13], 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:+ 'stored_pgs': []} 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner: 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:Ran 93 tests in 1010.826s 2020-01-25T07:51:44.900 INFO:tasks.cephfs_test_runner: 2020-01-25T07:51:44.900 INFO:tasks.cephfs_test_runner:FAILED (failures=1)
/a/kchai-2020-01-25_04:55:56-rados-wip-kefu-testing-2020-01-25-0051-distro-basic-smithi/4705866
Updated by Tatjana Dehler almost 4 years ago
As the last comment was added ~5 months ago, I would assume the issues doesn't happen anymore. I'm wondering if the issue can just be closed again?
Updated by Lenz Grimmer almost 4 years ago
- Status changed from New to Can't reproduce
Resolving as "Can't reproduce" for now - please re-open if it appears again.
Updated by Ernesto Puerta about 3 years ago
- Project changed from mgr to Dashboard
- Category changed from 138 to Component - OSDs
Actions