Project

General

Profile

Actions

Bug #44725

closed

Bug #44706: mgr/dashboard: ceph-api-nightly-master-backend test failure

mgr/dashboard: backend test failure on tasks.mgr.dashboard.test_health.HealthTest

Added by Kiefer Chang about 4 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Testing & QA
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
octopus, nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2020-03-23 03:41:28,476.476 INFO:__main__:test_minimal_health (tasks.mgr.dashboard.test_health.HealthTest) ... FAIL
2020-03-23 03:41:28,477.477 INFO:__main__:Running ['./bin/ceph', 'log', 'Ended test tasks.mgr.dashboard.test_health.HealthTest.test_minimal_health']
2020-03-23 03:41:29,811.811 INFO:__main__:Stopped test: test_minimal_health (tasks.mgr.dashboard.test_health.HealthTest) in 3.191219s
2020-03-23 03:41:29,815.815 INFO:__main__:
2020-03-23 03:41:29,816.816 INFO:__main__:======================================================================
2020-03-23 03:41:29,816.816 INFO:__main__:FAIL: test_minimal_health (tasks.mgr.dashboard.test_health.HealthTest)
2020-03-23 03:41:29,816.816 INFO:__main__:----------------------------------------------------------------------
2020-03-23 03:41:29,817.817 INFO:__main__:Traceback (most recent call last):
2020-03-23 03:41:29,817.817 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-api-nightly-master-backend/qa/tasks/mgr/dashboard/test_health.py", line 88, in test_minimal_health
2020-03-23 03:41:29,817.817 INFO:__main__:    self.assertSchema(data, schema)
2020-03-23 03:41:29,818.818 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-api-nightly-master-backend/qa/tasks/mgr/dashboard/helper.py", line 369, in assertSchema
2020-03-23 03:41:29,818.818 INFO:__main__:    self.assertEqual(data, str(e))
2020-03-23 03:41:29,818.818 INFO:__main__:AssertionError: {u'df': {u'stats': {u'total_used_raw_bytes': 8757018624, u'total_bytes': 433791664128, u'total_avail_bytes': 425034645504}}, u'osd_map': {u'osds': [{u'up': 1, u'in': 1}, {u'up': 1, u'in': 1}, {u'up': 1, u'in': 1}, {u'up': 1, u'in': 1}]}, u'rgw': 1, u'fs_map': {u'standbys': [], u'filesystems': [{u'mdsmap': {u'session_autoclose': 300, u'balancer': u'', u'modified': u'2020-03-23T03:41:12.777084+0000', u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'failed': [], u'metadata_pool': 12, u'epoch': 27, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [13], u'info': {u'gid_9410': {u'addr': u'51.91.150.122:6835/4201322759', u'export_targets': [], u'name': u'a', u'incarnation': 26, u'state_seq': 3, u'state': u'up:active', u'gid': 9410, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 4201322759, u'type': u'v2', u'addr': u'51.91.150.122:6834'}, [...]

The failure is schema change in mdsmap.


 != "In `input['fs_map']['filesystems'][0]['mdsmap']`: unknown keys: set([u'session_autoclose', u'balancer', u'modified', u'last_failure_osd_epoch', u'in', u'last_failure', u'max_file_size', u'explicitly_allowed_features', u'damaged', u'tableserver', u'failed', u'metadata_pool', u'epoch', u'flags', u'max_mds', u'compat', u'min_compat_client', u'data_pools', u'fs_name', u'created', u'standby_count_wanted', u'enabled', u'up', u'session_timeout', u'stopped', u'ever_allowed_features', u'root'])" 

We ignore the schema check of mdsmap in full_health test, but not in the minimal.
Failing log: https://jenkins.ceph.com/job/ceph-api-nightly-master-backend/110/console


Related issues 2 (0 open2 closed)

Copied to Dashboard - Backport #44786: octopus: mgr/dashboard: backend test failure on tasks.mgr.dashboard.test_health.HealthTestResolvedNathan CutlerActions
Copied to Dashboard - Backport #45945: nautilus: mgr/dashboard: backend test failure on tasks.mgr.dashboard.test_health.HealthTestResolvedAvan ThakkarActions
Actions #1

Updated by Kiefer Chang about 4 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 34138
Actions #2

Updated by Kefu Chai about 4 years ago

  • Status changed from Fix Under Review to Resolved
Actions #3

Updated by Laura Paduano about 4 years ago

  • Status changed from Resolved to Pending Backport
  • Source set to Q/A
  • Backport set to octopus
  • Affected Versions v16.0.0 added
Actions #4

Updated by Konstantin Shalygin about 4 years ago

  • Copied to Backport #44786: octopus: mgr/dashboard: backend test failure on tasks.mgr.dashboard.test_health.HealthTest added
Actions #5

Updated by Laura Paduano about 4 years ago

  • Status changed from Pending Backport to Resolved
  • Backport deleted (octopus)
  • Affected Versions deleted (v16.0.0)
Actions #6

Updated by Nathan Cutler about 4 years ago

  • Status changed from Resolved to Pending Backport
  • Backport set to octopus
Actions #7

Updated by Lenz Grimmer about 4 years ago

  • Status changed from Pending Backport to Resolved
Actions #8

Updated by Avan Thakkar almost 4 years ago

  • Backport changed from octopus to octopus, nautilus
Actions #9

Updated by Avan Thakkar almost 4 years ago

  • Status changed from Resolved to Pending Backport
Actions #10

Updated by Avan Thakkar almost 4 years ago

  • Copied to Backport #45945: nautilus: mgr/dashboard: backend test failure on tasks.mgr.dashboard.test_health.HealthTest added
Actions #11

Updated by Nathan Cutler almost 4 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Actions #12

Updated by Ernesto Puerta about 3 years ago

  • Project changed from mgr to Dashboard
  • Category changed from 151 to Testing & QA
Actions

Also available in: Atom PDF