Project

General

Profile

Actions

Bug #61775

closed

cephfs-mirror: mirror daemon does not shutdown (in mirror ha tests)

Added by Venky Shankar 11 months ago. Updated 11 months ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
Correctness/Safety
Target version:
% Done:

0%

Source:
Tags:
Backport:
reef,quincy,pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
cephfs-mirror
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

https://pulpito.ceph.com/vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7308904

cephfs mirror log: ./remote/smithi112/log/ceph-client.mirror1.46352.log.gz

2023-06-20T14:15:14.951+0000 7f9618a23640 10 cephfs::mirror::watcher:RewatchRequest unwatch
2023-06-20T14:15:14.951+0000 7f960fa11640 20 cephfs::mirror::watcher:RewatchRequest handle_unwatch: r=-2
2023-06-20T14:15:14.951+0000 7f960fa11640 -1 cephfs::mirror::watcher:RewatchRequest handle_unwatch: failed to unwatch: (2) No such file or directory
2023-06-20T14:15:14.951+0000 7f960fa11640 20 cephfs::mirror::watcher:RewatchRequest rewatch
2023-06-20T14:15:14.951+0000 7f960fa11640 20 cephfs::mirror::watcher:RewatchRequest handle_unwatch: r=-2
2023-06-20T14:15:14.951+0000 7f960fa11640 -1 cephfs::mirror::watcher:RewatchRequest handle_unwatch: failed to unwatch: (2) No such file or directory
2023-06-20T14:15:14.951+0000 7f960fa11640 20 cephfs::mirror::watcher:RewatchRequest rewatch
2023-06-20T14:15:14.951+0000 7f960f210640 20 cephfs::mirror::watcher:RewatchRequest handle_rewatch: r=-2
2023-06-20T14:15:14.951+0000 7f960f210640 -1 cephfs::mirror::watcher:RewatchRequest handle_rewatch: failed to watch object: (2) No such file or directory
2023-06-20T14:15:14.951+0000 7f960f210640 20 cephfs::mirror::watcher:RewatchRequest finish: r=-2
2023-06-20T14:15:14.951+0000 7f960f210640 20 cephfs::mirror::Watcher handle_rewatch: r=-2
2023-06-20T14:15:14.951+0000 7f960f210640  5 cephfs::mirror::Watcher handle_rewatch: object cephfs_mirror.4701 does not exist
2023-06-20T14:15:14.951+0000 7f960f210640 20 cephfs::mirror::watcher:RewatchRequest handle_rewatch: r=-2
2023-06-20T14:15:14.951+0000 7f960f210640 -1 cephfs::mirror::watcher:RewatchRequest handle_rewatch: failed to watch object: (2) No such file or directory
2023-06-20T14:15:14.951+0000 7f960f210640 20 cephfs::mirror::watcher:RewatchRequest finish: r=-2
2023-06-20T14:15:14.951+0000 7f960f210640 20 cephfs::mirror::Watcher handle_rewatch: r=-2
2023-06-20T14:15:14.951+0000 7f960f210640  5 cephfs::mirror::Watcher handle_rewatch: object cephfs_mirror does not exist
2023-06-20T14:15:14.951+0000 7f9618a23640 10 cephfs::mirror::Watcher handle_rewatch_callback: r=-2
2023-06-20T14:15:14.951+0000 7f9618a23640  5 cephfs::mirror::InstanceWatcher handle_rewatch_complete: r=-2
2023-06-20T14:15:14.951+0000 7f9618a23640 -1 cephfs::mirror::InstanceWatcher handle_rewatch_complete: mirroring object deleted
2023-06-20T14:15:14.951+0000 7f9618a23640 10 cephfs::mirror::Watcher handle_rewatch_callback: r=-2
2023-06-20T14:15:14.951+0000 7f9618a23640  5 cephfs::mirror::MirrorWatcher handle_rewatch_complete: r=-2
2023-06-20T14:15:14.951+0000 7f9618a23640 -1 cephfs::mirror::MirrorWatcher handle_rewatch_complete: mirroring object deleted
2023-06-20T14:15:47.511+0000 7f9619a25640 -1 received  signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground  (PID: 46349) UID: 1000
2023-06-20T14:15:47.511+0000 7f9619a25640 10 cephfs::mirror::Mirror handle_signal: signal=15
2023-06-20T14:23:26.411+0000 7f9608a03640  0 client.4703 ms_handle_reset on v2:172.21.15.112:3300/0

cephfs-mirror in the above case did not shutdown and hung causing the test to fail after reaching a task timeout.

Actions #2

Updated by Venky Shankar 11 months ago

  • Status changed from New to Duplicate
Actions

Also available in: Atom PDF