Project

General

Profile

Actions
Copy link

Bug #47292

open

cephfs-shell: test_df_for_valid_file failure

Added by Patrick Donnelly over 3 years ago. Updated 6 months ago.

Status:
In Progress
Priority:
Normal
Assignee:
Rishabh Dave
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
pacific,octopus,nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
cephfs-shell
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2020-09-03T03:19:26.939 INFO:tasks.cephfs_test_runner:======================================================================
2020-09-03T03:19:26.939 INFO:tasks.cephfs_test_runner:FAIL: test_df_for_valid_file (tasks.cephfs.test_cephfs_shell.TestDF)
2020-09-03T03:19:26.940 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2020-09-03T03:19:26.940 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2020-09-03T03:19:26.940 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200903.000442/qa/tasks/cephfs/test_cephfs_shell.py", line 746, in test_df_for_valid_file
2020-09-03T03:19:26.941 INFO:tasks.cephfs_test_runner:    self.validate_df("dumpfile")
2020-09-03T03:19:26.941 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200903.000442/qa/tasks/cephfs/test_cephfs_shell.py", line 724, in validate_df
2020-09-03T03:19:26.941 INFO:tasks.cephfs_test_runner:    (int(shell_df[0]), int(shell_df[1]) , int(shell_df[2])))
2020-09-03T03:19:26.941 INFO:tasks.cephfs_test_runner:AssertionError: Tuples differ: (358514688, 99015112, 259499576) != (358584320, 99015112, 259569208)
2020-09-03T03:19:26.942 INFO:tasks.cephfs_test_runner:
2020-09-03T03:19:26.942 INFO:tasks.cephfs_test_runner:First differing element 0:
2020-09-03T03:19:26.942 INFO:tasks.cephfs_test_runner:358514688
2020-09-03T03:19:26.943 INFO:tasks.cephfs_test_runner:358584320
2020-09-03T03:19:26.943 INFO:tasks.cephfs_test_runner:
2020-09-03T03:19:26.944 INFO:tasks.cephfs_test_runner:- (358514688, 99015112, 259499576)
2020-09-03T03:19:26.944 INFO:tasks.cephfs_test_runner:+ (358584320, 99015112, 259569208)

From: /ceph/teuthology-archive/pdonnell-2020-09-03_02:04:14-fs-wip-pdonnell-testing-20200903.000442-distro-basic-smithi/5401434/teuthology.log

Actions
Copy link
 #1

Updated by Patrick Donnelly over 3 years ago

  • Target version changed from v16.0.0 to v17.0.0
  • Backport set to pacific,octopus,nautilus
Actions
Copy link
 #2

Updated by Patrick Donnelly almost 2 years ago

  • Target version deleted (v17.0.0)
Actions
Copy link
 #4

Updated by Rishabh Dave 9 months ago

Can't reproduce this bug with vstart_runner.py.

2023-08-02 19:15:08,828.828 DEBUG:__main__:> ./bin/ceph config rm mon mon_allow_pool_delete
2023-08-02 19:15:09,020.020 DEBUG:__main__:> ./bin/ceph log 'Ended test tasks.cephfs.test_cephfs_shell.TestDF.test_df_for_valid_file'
2023-08-02 19:15:09,812.812 INFO:__main__:Stopped test: test_df_for_valid_file (tasks.cephfs.test_cephfs_shell.TestDF.test_df_for_valid_file) in 20.188983s
2023-08-02 19:15:09,813.813 INFO:__main__:test_df_for_valid_file (tasks.cephfs.test_cephfs_shell.TestDF.test_df_for_valid_file) ... ok
2023-08-02 19:15:09,813.813 INFO:__main__:
2023-08-02 19:15:09,813.813 INFO:__main__:----------------------------------------------------------------------
2023-08-02 19:15:09,813.813 INFO:__main__:Ran 1 test in 20.189s
2023-08-02 19:15:09,813.813 INFO:__main__:
2023-08-02 19:15:09,813.813 INFO:__main__:OK

I'll try with teuthology.

Actions
Copy link
 #5

Updated by Rishabh Dave 9 months ago

The bug on this ticket can't be reproducede with teuthology as well - https://pulpito.ceph.com/rishabh-2023-08-02_13:54:23-fs:shell-wip-vshankar-testing-20230727.111459-testing-default-smithi/. Following a log entry (from teuthology.log) showing that this test method run successfully -

2023-08-02T14:21:08.975 INFO:tasks.cephfs_test_runner:test_df_for_valid_file (tasks.cephfs.test_cephfs_shell.TestDF) ... ok
Actions
Copy link
 #6

Updated by Rishabh Dave 9 months ago

Inspecting methods (in test_cephfs_shell.py) test_df_for_valid_file and validate_df, this seems to be a bug not in test_cephfs_shell.py but in cephfs-shell.

Actions
Copy link
 #7

Updated by Rishabh Dave 9 months ago

  • Status changed from New to In Progress
Actions
Copy link
 #8

Updated by Rishabh Dave 9 months ago

This can be due to some sort of race (in the test I suppose). Tests for du cephfs-shell command also suffered similar issues (long ago) and adding a sleep for few seconds to tests fixed this issue. Trying the same thing for this PR - https://github.com/ceph/ceph/pull/52822.

Actions
Copy link
 #9

Updated by Venky Shankar 6 months ago

/a/vshankar-2023-10-14_01:51:22-fs-wip-vshankar-testing-20231013.093215-testing-default-smithi/7427312

Actions
Copy link

Also available in: Atom PDF