Project

General

Profile

Actions
Copy link

Bug #48296

closed

[rbd_support] Attempting to background remove in-use image results in apparent stuck progress

Added by Jason Dillaman over 3 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Jason Dillaman
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
nautilus,octopus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
38196
Crash signature (v1):
Crash signature (v2):

Description

When attempting to background remove an RBD image when it's still in-use (i.e. it has a child image attached), the remove will correctly fail but (1) it leaves an apparently stuck progress notification and (2) the MGR logs shows the (expected) failure every thirty seconds while it retries.

Note that is purely a progress status and log issue. Once the image can be deleted (since the associated child images are flattened or removed), the removal will correctly proceed.

Progress:

sh-4.4# ceph -s
< .... SNIP ... >
  progress:
    Removing image ocs-storagecluster-cephblockpool/a10a894b726cc from trash
      [..............................]
    Removing image ocs-storagecluster-cephblockpool/a10a87ad46bc5 from trash
      [..............................]
    Removing image ocs-storagecluster-cephblockpool/a10a862e83ce1 from trash
      [..............................]

Logs:

debug 2020-11-17 13:02:54.211 7f44e544e700 -1 librbd::SnapshotRemoveRequest: 0x558a65235a20 should_complete: encountered error: (16) Device or resource busy
debug 2020-11-17 13:02:54.211 7f44e544e700 -1 librbd::image::PreRemoveRequest: 0x558a64e78f20 handle_remove_snapshot: failed to auto-prune snapshot 16: (16) Device or resource busy
debug 2020-11-17 13:02:54.215 7f44e32ca700  0 mgr[rbd_support] execute_task: [errno 39] error deleting image from trash

Related issues 2 (0 open — 2 closed)

Copied to rbd - Backport #48341: octopus: [rbd_support] Attempting to background remove in-use image results in apparent stuck progress ResolvedNathan CutlerActions
Copied to rbd - Backport #48342: nautilus: [rbd_support] Attempting to background remove in-use image results in apparent stuck progress ResolvedNathan CutlerActions
Actions
Copy link
 #1

Updated by Jason Dillaman over 3 years ago

  • Status changed from New to In Progress
  • Assignee set to Jason Dillaman
Actions
Copy link
 #2

Updated by Jason Dillaman over 3 years ago

Commit 6e1434eefc3dd4c815359a85d9d51a798983d9a2 includes changes to "librbd::image::PreRemoveRequest::handle_remove_snapshot" and "librbd::operation::SnapshotRemoveRequest::should_complete" to not log "-EBUSY" errors. These changes should be included in any backport to nautilus (exists on master and octopus).

Actions
Copy link
 #3

Updated by Jason Dillaman over 3 years ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 38196
Actions
Copy link
 #4

Updated by Mykola Golub over 3 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions
Copy link
 #5

Updated by Nathan Cutler over 3 years ago

  • Copied to Backport #48341: octopus: [rbd_support] Attempting to background remove in-use image results in apparent stuck progress added
Actions
Copy link
 #6

Updated by Nathan Cutler over 3 years ago

  • Copied to Backport #48342: nautilus: [rbd_support] Attempting to background remove in-use image results in apparent stuck progress added
Actions
Copy link
 #7

Updated by Nathan Cutler about 3 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Actions
Copy link

Also available in: Atom PDF