Bug #47488: Apparent deadlock in tasks.mgr.dashboard.test_cephfs.CephfsTest.test_snapshots - CephFS - Ceph

Actions

Copy link

Bug #47488

open

Apparent deadlock in tasks.mgr.dashboard.test_cephfs.CephfsTest.test_snapshots

Added by Brad Hubbard over 3 years ago. Updated over 3 years ago.

Status:

New

Priority:

Low

Assignee:

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

Ceph - v16.0.0

ceph-qa-suite:

rados

Component(FS):

Labels (FS):

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

/a/yuriw-2020-09-02_17:33:04-rados-wip-yuri-master-baseline-9.2.2020-distro-basic-smithi/5400010

2020-09-02T18:30:59.657 INFO:tasks.cephfs_test_runner:test_quotas_unset_both (tasks.mgr.dashboard.test_cephfs.CephfsTest) ... ok
2020-09-02T18:30:59.657 INFO:tasks.cephfs_test_runner:Starting test: test_snapshots (tasks.mgr.dashboard.test_cephfs.CephfsTest)
2020-09-02T18:30:59.812 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:30:59.783+0000 7ff96bfff700 20 mgrc handle_mgr_map mgrmap(e 76) v1
2020-09-02T18:30:59.813 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:30:59.783+0000 7ff96bfff700  4 mgrc handle_mgr_map Got map version 76
2020-09-02T18:30:59.813 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:30:59.783+0000 7ff96bfff700  4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/20389,v1:172.21.15.196:6809/20389]
2020-09-02T18:30:59.814 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:30:59.783+0000 7ff96bfff700  4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/20389,v1:172.21.15.196:6809/20389]
2020-09-02T18:31:00.648 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:31:00.646+0000 7ff97931e700 10 mgrc shutdown
2020-09-02T18:31:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:31:00.786+0000 7effd8ff9700 20 mgrc handle_mgr_map mgrmap(e 76) v1
2020-09-02T18:31:00.797 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:31:00.786+0000 7effd8ff9700  4 mgrc handle_mgr_map Got map version 76
2020-09-02T18:31:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:31:00.786+0000 7effd8ff9700  4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/20389,v1:172.21.15.196:6809/20389]
2020-09-02T18:31:00.798 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:31:00.786+0000 7effd8ff9700  4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/20389,v1:172.21.15.196:6809/20389]
2020-09-02T18:31:00.994 INFO:teuthology.orchestra.run.smithi196.stdout:
2020-09-02T18:31:00.995 INFO:teuthology.orchestra.run.smithi196.stderr:2020-09-02T18:31:00.990+0000 7effe1edd700 10 mgrc shutdown
2020-09-02T18:31:01.014 INFO:teuthology.orchestra.run.smithi196.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]}
2020-09-02T18:31:01.014 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s
2020-09-02T18:31:01.015 INFO:tasks.mgr.dashboard.helper:Request POST to https://smithi196:7789/api/cephfs/2/tree
2020-09-02T18:31:01.030 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.026+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.030 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.026+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.030 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.026+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.030 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.026+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.031 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.026+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.056 INFO:tasks.mgr.dashboard.helper:Request POST to https://smithi196:7789/api/cephfs/2/snapshot
2020-09-02T18:31:01.070 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.066+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.071 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.066+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.071 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.066+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.071 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.066+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.071 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.066+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.098 INFO:tasks.mgr.dashboard.helper:Request GET to https://smithi196:7789/api/cephfs/2/ls_dir
2020-09-02T18:31:01.110 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.106+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.111 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.106+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.111 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.106+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.111 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.106+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:01.112 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:31:01.106+0000 7fb38994b700 -1 client.0 error registering admin socket command: (17) File exists
2020-09-02T18:31:13.805 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:31:13.810 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:31:43.854 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:31:43.863 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:32:13.908 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:32:13.913 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:32:43.971 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:32:44.271 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:33:14.318 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:33:14.324 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:33:44.371 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:33:44.376 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:34:14.428 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:34:14.434 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:34:44.474 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:34:44.496 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:35:14.563 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:35:14.567 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:35:44.646 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:35:44.675 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:36:02.426 INFO:tasks.ceph.mgr.x.smithi196.stderr:2020-09-02T18:36:02.417+0000 7fb37df34700 -1 client.7348 I was blocklisted at osd epoch 67
2020-09-02T18:36:14.728 INFO:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2020-09-02T18:36:14.733 INFO:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf
...