Project

General

Profile

Actions
Copy link

Bug #36353

closed

mgr/dashboard: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)

Added by Tatjana Dehler over 5 years ago. Updated about 3 years ago.

Status:
Can't reproduce
Priority:
Normal
Assignee:
Patrick Seidensal
Category:
Component - OSDs
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) is failing on several PRs currently, e.g.:

http://pulpito.ceph.com/skrah-2018-10-09_08:57:22-rados:mgr-wip-skrah-testing-23230-2018-10-09-09-01-distro-basic-smithi/
http://pulpito.ceph.com/tdehler-2018-10-08_11:20:33-rados:mgr-wip-tdehler-testing-21614-distro-basic-smithi/

2018-10-09T09:29:55.371 INFO:tasks.mgr.dashboard.helper:request GET to https://smithi016.front.sepia.ceph.com:7791/api/osd/13/safe_to_destroy
2018-10-09T09:29:55.377 INFO:tasks.ceph.mgr.z.smithi016.stderr:2018-10-09 09:29:55.342 7efe59af4700 -1 mgr.server reply reply (11) Resource temporarily unavailable 3 pgs have unknown state; cannot draw any conclusions
2018-10-09T09:29:55.379 INFO:tasks.ceph.mgr.z.smithi016.stdout:::ffff:172.21.0.51 - - [09/Oct/2018:09:29:55] "GET /api/osd/13/safe_to_destroy HTTP/1.1" 200 106 "" "python-requests/2.12.5" 
2018-10-09T09:29:55.380 INFO:tasks.cephfs_test_runner:test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest) ... FAIL
2018-10-09T09:29:55.381 INFO:tasks.mgr.dashboard.helper:request POST to https://smithi016.front.sepia.ceph.com:7791/api/osd/0/mark_in
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:======================================================================
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:    self.assertJsonBody({'safe-to-destroy': True})
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:    self.assertEqual(body, data)
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True}
2018-10-09T09:29:55.389 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions',
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:-  u'safe-to-destroy': False}
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^^                   ^^^^
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True}
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:? ^                   ^^^
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:Ran 40 tests in 489.927s
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:FAILED (failures=1)
2018-10-09T09:29:55.390 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:======================================================================
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/test_osd.py", line 105, in test_safe_to_destroy
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:    self.assertJsonBody({'safe-to-destroy': True})
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-skrah-testing-23230-2018-10-09-09-01/qa/tasks/mgr/dashboard/helper.py", line 309, in assertJsonBody
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:    self.assertEqual(body, data)
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:AssertionError: {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions [truncated]... != {'safe-to-destroy': True}
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:- {u'message': u'[errno -11] 3 pgs have unknown state; cannot draw any conclusions',
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:-  u'safe-to-destroy': False}
2018-10-09T09:29:55.391 INFO:tasks.cephfs_test_runner:? ^^                   ^^^^
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:+ {'safe-to-destroy': True}
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:? ^                   ^^^
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.392 INFO:tasks.cephfs_test_runner:
2018-10-09T09:29:55.392 ERROR:teuthology.run_tasks:Saw exception from tasks.
Actions
Copy link
 #1

Updated by Patrick Seidensal over 5 years ago

  • Assignee set to Patrick Seidensal
Actions
Copy link
 #2

Updated by Patrick Seidensal over 5 years ago

  • Subject changed from mgr/dashboard: test_safe_to_destro (tasks.mgr.dashboard.test_osd.OsdTest) to mgr/dashboard: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
  • Description updated (diff)
Actions
Copy link
 #3

Updated by Patrick Seidensal over 5 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #4

Updated by Patrick Seidensal over 5 years ago

  • Status changed from In Progress to Need More Info
Actions
Copy link
 #5

Updated by Tatjana Dehler over 5 years ago

  • Pull request ID set to 25127
Actions
Copy link
 #6

Updated by Tatjana Dehler over 5 years ago

  • Status changed from Need More Info to 7
Actions
Copy link
 #7

Updated by Tatjana Dehler over 5 years ago

  • Status changed from 7 to Need More Info
  • Pull request ID deleted (25127)
Actions
Copy link
 #8

Updated by Patrick Seidensal over 5 years ago

  • Status changed from Need More Info to Can't reproduce

I will close this one. Feel free to reopen if the error reoccurs.

Actions
Copy link
 #9

Updated by Kefu Chai about 4 years ago

  • Status changed from Can't reproduce to New
2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:======================================================================
2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:FAIL: test_safe_to_destroy (tasks.mgr.dashboard.test_osd.OsdTest)
2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-01-25-0051/qa/tasks/mgr/dashboard/test_osd.py", line 113, in test_safe_to_dest
roy
2020-01-25T07:51:44.897 INFO:tasks.cephfs_test_runner:    'stored_pgs': [],
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-01-25-0051/qa/tasks/mgr/dashboard/helper.py", line 343, in assertJsonBody
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:    self.assertEqual(body, data)
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:AssertionError: {u'is_safe_to_destroy': False, u'message': u'[errno -11] 2 pgs have unknown stat [truncated]... != {'active': [], 'is_safe_to_destroy': True, 'stored_pgs': [], 'safe_to_destroy':  [truncated]...
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:+ {'active': [],
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:- {u'is_safe_to_destroy': False,
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:? ^^                      ^^^^
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:+  'is_safe_to_destroy': True,
2020-01-25T07:51:44.898 INFO:tasks.cephfs_test_runner:? ^                      ^^^
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:-  u'message': u'[errno -11] 2 pgs have unknown state; cannot draw any conclusions'}
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:+  'missing_stats': [],
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:+  'safe_to_destroy': [13],
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:+  'stored_pgs': []}
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2020-01-25T07:51:44.899 INFO:tasks.cephfs_test_runner:Ran 93 tests in 1010.826s
2020-01-25T07:51:44.900 INFO:tasks.cephfs_test_runner:
2020-01-25T07:51:44.900 INFO:tasks.cephfs_test_runner:FAILED (failures=1)

/a/kchai-2020-01-25_04:55:56-rados-wip-kefu-testing-2020-01-25-0051-distro-basic-smithi/4705866

Actions
Copy link
 #10

Updated by Tatjana Dehler almost 4 years ago

As the last comment was added ~5 months ago, I would assume the issues doesn't happen anymore. I'm wondering if the issue can just be closed again?

Actions
Copy link
 #11

Updated by Lenz Grimmer almost 4 years ago

  • Status changed from New to Can't reproduce

Resolving as "Can't reproduce" for now - please re-open if it appears again.

Actions
Copy link
 #12

Updated by Ernesto Puerta about 3 years ago

  • Project changed from mgr to Dashboard
  • Category changed from 138 to Component - OSDs
Actions
Copy link

Also available in: Atom PDF