Actions
Bug #62648
openpybind/mgr/volumes: volume rm freeze waiting for async job on fs to complete
% Done:
0%
Source:
Q/A
Tags:
Backport:
reef,quincy
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
mgr/volumes
Labels (FS):
qa-failure
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2023-08-16T14:34:55.019+0000 7f833f0f0640 0 log_channel(audit) log [DBG] : from='client.11322 -' entity='client.admin' cmd=[{"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}]: dispatch
2023-08-16T14:34:55.019+0000 7f833f0f0640 10 mgr.server _handle_command passing through command 'fs volume rm' size 4
2023-08-16T14:34:55.019+0000 7f831d02c640 10 finisher(0x561758c58db8) finisher_thread doing [0x56175aa45c70,0]
2023-08-16T14:34:55.019+0000 7f831d02c640 10 mgr.server operator() dispatching command 'fs volume rm' size 4
2023-08-16T14:34:55.019+0000 7f831d02c640 20 mgr Gil Switched to new thread state 0x561759bc47e0
2023-08-16T14:34:55.019+0000 7f831d02c640 0 [volumes INFO volumes.module] Starting _cmd_fs_volume_rm(prefix:fs volume rm, target:['mon-mgr', ''], vol_name:cephfs, yes-i-really-mean-it:--yes-i-really-mean-it) < ""
2023-08-16T14:34:55.019+0000 7f831d02c640 1 -- 172.21.15.142:0/3632701363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config get", "key": "mon_allow_pool_delete", "who": "mon", "format": "json"} v 0) v1 -- 0x561759efd680 con 0x56175100b400
2023-08-16T14:34:55.020+0000 7f8398525640 1 -- 172.21.15.142:0/3632701363 <== mon.1 v2:172.21.15.142:3300/0 1884 ==== mon_command_ack([{"prefix": "config get", "key": "mon_allow_pool_delete", "who": "mon", "format": "json"}]=0 v32) v1 ==== 122+0+5 (secure 0 0 0) 0x561758c3d040 con 0x56175100b400
2023-08-16T14:34:55.021+0000 7f833d8ed640 10 finisher(0x561758b0aa00) finisher_thread doing [0x5617590049e0,0]
2023-08-16T14:34:55.021+0000 7f833d8ed640 1 -- 172.21.15.142:0/3632701363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=61) v1 -- 0x5617594f2f20 con 0x56175100b400
2023-08-16T14:34:55.021+0000 7f833d8ed640 10 finisher(0x561758b0aa00) finisher_thread done with [0x5617590049e0,0]
2023-08-16T14:34:55.021+0000 7f833d8ed640 10 finisher(0x561758b0aa00) finisher_thread empty
2023-08-16T14:34:55.021+0000 7f833d8ed640 10 finisher(0x561758b0aa00) finisher_thread sleeping
2023-08-16T14:34:55.021+0000 7f8398525640 1 -- 172.21.15.142:0/3632701363 <== mon.1 v2:172.21.15.142:3300/0 1885 ==== mon_get_version_reply(handle=61 version=202) v2 ==== 24+0+0 (secure 0 0 0) 0x5617594f2f20 con 0x56175100b400
2023-08-16T14:34:55.021+0000 7f8397523640 10 MonCommandCompletion::finish()
2023-08-16T14:34:55.021+0000 7f8397523640 20 mgr Gil Switched to new thread state 0x5617592bb320
2023-08-16T14:34:55.022+0000 7f8397523640 20 mgr ~Gil Destroying new thread state 0x5617592bb320
2023-08-16T14:34:55.022+0000 7f8397523640 10 mgr notify_all notify_all: notify_all command
2023-08-16T14:34:55.022+0000 7f8397523640 15 mgr notify_all queuing notify (command) to restful
2023-08-16T14:34:55.022+0000 7f832c08a640 10 finisher(0x561758c58638) finisher_thread doing [0x561759493f80,0]
2023-08-16T14:34:55.022+0000 7f831d02c640 0 [volumes DEBUG root] mon_command: 'config get' -> 0 in 0.003s
2023-08-16T14:34:55.024+0000 7f831d02c640 0 [volumes DEBUG mgr_util] locking <unlocked _thread.lock object at 0x7f832b86e480> with 5 timeout
2023-08-16T14:34:55.024+0000 7f831d02c640 0 [volumes DEBUG mgr_util] locked <locked _thread.lock object at 0x7f832b86e480>
2023-08-16T14:34:55.024+0000 7f831d02c640 0 [volumes INFO volumes.fs.async_job] cancelling jobs for volume 'cephfs'
2023-08-16T14:34:55.024+0000 7f831d02c640 0 [volumes DEBUG volumes.fs.async_job] waiting for 1 in-progress jobs for volume 'cephfs' to cancel
From: /teuthology/vshankar-2023-08-16_10:55:44-fs-wip-vshankar-testing-20230816.054905-testing-default-smithi/7369756/remote/smithi142/log/ceph-mgr.x.log.gz
Actions