Project

General

Profile

Actions

Bug #58744

closed

qa: intermittent nfs test failures at nfs cluster creation

Added by Dhairya Parmar about 1 year ago. Updated 8 months ago.

Status:
Resolved
Priority:
Normal
Category:
Testing
Target version:
% Done:

100%

Source:
Development
Tags:
backport_processed
Backport:
reef,quincy,pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
qa-failure
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

While working on https://github.com/ceph/ceph/pull/49460, I found any random test would fail with "AssertionError: NFS Ganesha cluster deployment failed". In order to confirm that it's not my code doing something, i ran test_nfs against main and found this issue still coming up. Running 'nfs clustur ls' before running 'nfs cluster create test' cmd, the output would show cluster 'test' existent while the previous test does delete it and this was confirmed by running 'nfs cluster ls' after every cluster deletion cmd.

http://pulpito.front.sepia.ceph.com/dparmar-2023-02-13_15:52:09-orch:cephadm-wip-58228-distro-default-smithi/7170593/
http://pulpito.front.sepia.ceph.com/dparmar-2023-02-15_09:23:57-orch:cephadm-main-distro-default-smithi/7174810/

Running the command set(check nfs server status -> nfs cluster create test -> check status) in a loop (max three iteration) fixes the issue, i think it takes sometime to update the cluster data and because the time gap between running cluster deletion - cluster creation is too small, its sometimes a bit slow to update the cluster data and flush the old data in time.


Related issues 3 (0 open3 closed)

Copied to CephFS - Backport #59247: quincy: qa: intermittent nfs test failures at nfs cluster creationResolvedDhairya ParmarActions
Copied to CephFS - Backport #59248: reef: qa: intermittent nfs test failures at nfs cluster creationResolvedDhairya ParmarActions
Copied to CephFS - Backport #59249: pacific: qa: intermittent nfs test failures at nfs cluster creationResolvedDhairya ParmarActions
Actions #1

Updated by Venky Shankar about 1 year ago

  • Category set to Testing
  • Target version set to v18.0.0
  • Backport set to pacific,quincy
Actions #2

Updated by Dhairya Parmar about 1 year ago

  • Status changed from In Progress to Fix Under Review
Actions #3

Updated by Laura Flores about 1 year ago

  • Translation missing: en.field_tag_list set to test-failure

/a/yuriw-2023-02-18_15:53:03-rados-wip-yuri5-testing-2023-02-17-1400-quincy-distro-default-smithi/7180649

Actions #4

Updated by Venky Shankar about 1 year ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from pacific,quincy to reef,quincy,pacific
Actions #5

Updated by Backport Bot about 1 year ago

  • Copied to Backport #59247: quincy: qa: intermittent nfs test failures at nfs cluster creation added
Actions #6

Updated by Backport Bot about 1 year ago

  • Copied to Backport #59248: reef: qa: intermittent nfs test failures at nfs cluster creation added
Actions #7

Updated by Backport Bot about 1 year ago

  • Copied to Backport #59249: pacific: qa: intermittent nfs test failures at nfs cluster creation added
Actions #8

Updated by Backport Bot about 1 year ago

  • Tags set to backport_processed
Actions #9

Updated by Konstantin Shalygin 8 months ago

  • Tracker changed from Fix to Bug
  • Status changed from Pending Backport to Resolved
  • % Done changed from 0 to 100
  • Regression set to No
  • Severity set to 3 - minor
Actions

Also available in: Atom PDF