Project

General

Profile

Actions
Copy link

Feature #9466

closed

kclient: Extend CephFSTestCase tests to cover kclient

Added by John Spray over 9 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
Testing
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:
Component(FS):
Labels (FS):
Pull request ID:

Description

Currently the mds_client_recovery and mds_client_limits tasks in ceph-qa-suite only run against the fuse client, because only FuseClient has the necessary hooks.

Actions
Copy link
 #1

Updated by John Spray over 9 years ago

kclient instrumentation to enable implementing KernelClient::get_global_id (mapping local mount to the ID we see on the MDS side)

Actions
Copy link
 #2

Updated by John Spray over 9 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #3

Updated by John Spray over 9 years ago

  • Project changed from Ceph to CephFS
Actions
Copy link
 #4

Updated by John Spray over 9 years ago

  • Status changed from In Progress to 7

Got these passing at least once by hand using IPMI to work around #9477, suite scheduled:

http://pulpito.front.sepia.ceph.com/john-2014-09-16_22:15:30-kcephfs-wip-9189-wip-9466-basic-multi/

Actions
Copy link
 #5

Updated by John Spray over 9 years ago

  • Assignee set to John Spray
Actions
Copy link
 #6

Updated by Greg Farnum almost 8 years ago

  • Subject changed from Extend recovery and limits tests to cover kclient to kclient: Extend recovery and limits tests to cover kclient
  • Category set to Testing

What still needs to get done for this, John?

Actions
Copy link
 #7

Updated by John Spray almost 8 years ago

  • Status changed from 7 to 12

I think most or all of the hooks are there, should be a case of taking suites/fs/recovery/tasks/client-limits.yaml and running it with kclient (and seeing what breaks!)

Actions
Copy link
 #8

Updated by John Spray almost 8 years ago

  • Assignee deleted (John Spray)
Actions
Copy link
 #9

Updated by John Spray over 7 years ago

  • Subject changed from kclient: Extend recovery and limits tests to cover kclient to kclient: Extend CephFSTestCase tests to cover kclient

Updating title to reflect that these days we have lots of tests (in fs/recovery, which is now a bit of a silly name for such a mixed bunch).

A quick attempt to run these against the kernel client is here:
http://pulpito.ceph.com/jspray-2016-08-10_16:14:52-kcephfs:recovery-master-testing-basic-mira/

There are a load failing on umounts, there is some test code that is unmounting things that don't need it, that needs fixing.

Actions
Copy link
 #10

Updated by John Spray over 7 years ago

Updated test branch that only calls umount when really needed (https://github.com/ceph/ceph-qa-suite/pull/1156)

Looking past the sea of red... a lot of the tests are actually passing.
http://pulpito.ceph.com/jspray-2016-08-30_12:07:21-kcephfs:recovery-master-testing-basic-mira/

(virtualenv) jspray@teuthology:/a/jspray-2016-08-30_12:07:21-kcephfs:recovery-master-testing-basic-mira$ grep "\.\.\. ok" */teuthology.log
Binary file 392434/teuthology.log matches
Binary file 392435/teuthology.log matches
392436/teuthology.log:2016-08-30T12:29:55.452 INFO:tasks.cephfs_test_runner:test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) ... test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) ... test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) ... ok
392436/teuthology.log:2016-08-30T12:31:50.367 INFO:tasks.cephfs_test_runner:test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) ... ok
392438/teuthology.log:2016-08-30T12:46:47.683 INFO:tasks.cephfs_test_runner:test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) ... ok
392438/teuthology.log:2016-08-30T12:47:16.579 INFO:tasks.cephfs_test_runner:test_basic (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok
392439/teuthology.log:2016-08-30T12:28:15.868 INFO:tasks.cephfs_test_runner:test_client_config (tasks.cephfs.test_config_commands.TestConfigCommands) ... test_mds_config_asok (tasks.cephfs.test_config_commands.TestConfigCommands) ... ok
392439/teuthology.log:2016-08-30T12:28:42.204 INFO:tasks.cephfs_test_runner:test_mds_config_tell (tasks.cephfs.test_config_commands.TestConfigCommands) ... ok
392441/teuthology.log:2016-08-30T12:28:07.425 INFO:tasks.cephfs_test_runner:test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:37:49.039 INFO:tasks.cephfs_test_runner:test_parallel_execution (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:38:55.709 INFO:tasks.cephfs_test_runner:test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:40:01.307 INFO:tasks.cephfs_test_runner:test_rebuild_missing_zeroth (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:41:10.056 INFO:tasks.cephfs_test_runner:test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:42:16.337 INFO:tasks.cephfs_test_runner:test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:43:22.732 INFO:tasks.cephfs_test_runner:test_rebuild_nondefault_layout (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:44:29.604 INFO:tasks.cephfs_test_runner:test_rebuild_simple (tasks.cephfs.test_data_scan.TestDataScan) ... ok
392441/teuthology.log:2016-08-30T12:46:25.799 INFO:tasks.cephfs_test_runner:test_stashed_layout (tasks.cephfs.test_data_scan.TestDataScan) ... ok
Binary file 392442/teuthology.log matches
392443/teuthology.log:2016-08-30T12:23:01.482 INFO:tasks.cephfs_test_runner:test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok
392443/teuthology.log:2016-08-30T12:27:03.705 INFO:tasks.cephfs_test_runner:test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok
Binary file 392444/teuthology.log matches
392446/teuthology.log:2016-08-30T12:14:17.377 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ok
392446/teuthology.log:2016-08-30T12:14:47.166 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ok
392447/teuthology.log:2016-08-30T12:21:59.531 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) ... ok
392448/teuthology.log:2016-08-30T12:13:04.549 INFO:tasks.cephfs_test_runner:test_dir_deletion (tasks.cephfs.test_strays.TestStrays) ... ok
392448/teuthology.log:2016-08-30T12:13:52.265 INFO:tasks.cephfs_test_runner:test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) ... ok
392448/teuthology.log:2016-08-30T12:14:21.267 INFO:tasks.cephfs_test_runner:test_fancy_layout (tasks.cephfs.test_strays.TestStrays) ... ok
392448/teuthology.log:2016-08-30T12:15:38.966 INFO:tasks.cephfs_test_runner:test_files_throttle (tasks.cephfs.test_strays.TestStrays) ... ok
Binary file 392448/teuthology.log matches
392449/teuthology.log:2016-08-30T12:24:08.637 INFO:tasks.cephfs_test_runner:test_15303 (tasks.cephfs.test_volume_client.TestVolumeClient) ... ok
392449/teuthology.log:2016-08-30T12:24:52.450 INFO:tasks.cephfs_test_runner:test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient) ... ok
392449/teuthology.log:2016-08-30T12:25:31.699 INFO:tasks.cephfs_test_runner:test_default_prefix (tasks.cephfs.test_volume_client.TestVolumeClient) ... ok
Actions
Copy link
 #11

Updated by John Spray over 7 years ago

Latest:
http://pulpito.ceph.com/jspray-2016-09-05_12:30:10-kcephfs:recovery-master-testing-basic-mira/

Failure: Test failure: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair)
1 jobs: ['401041']

Failure: Test failure: test_simple (tasks.cephfs.test_failover.TestFailover)
1 jobs: ['401039']

Failure: global name 'ConnectionLostError' is not defined
1 jobs: ['401035']

Failure: 'module' object has no attribute 'test_readahead'
2 jobs: ['401034', '401043']

Failure: Test failure: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage)
1 jobs: ['401037']

Failure: Test failure: test_evict_client (tasks.cephfs.test_volume_client.TestVolumeClient)
1 jobs: ['401047']
Actions
Copy link
 #12

Updated by John Spray almost 7 years ago

  • Status changed from 12 to Resolved

This got done a while back.

Actions
Copy link

Also available in: Atom PDF