Project

General

Profile

Actions

Bug #16435

closed

COPY broke multipart files uploaded under dumpling

Added by Robin Johnson almost 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
-
% Done:

0%

Source:
other
Tags:
hammer, dumpling, rgw, multipart
Backport:
jewel, hammer
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

A user reported that some files in their bucket, uploaded ~2 years ago under dumpling, have stopped working after they were moved around recently.

All of the files under "home/fvault/Lastest/" were moved to "home/fvault/Lastest/20g/", and now they all don't work anymore.

A HEAD on the files returns the correct metadata and response code 200, but a GET operation and all other operations [that access the objects] I've tested (including rename/move) returns 404.

I have run:
- bucket check --fix
- bucket check --fix --check-head-obj-locator
But it did not fix the issue.

The rgw-admin object stat output on one of the broken objects does show the older manifest->objs structure, and the first item in that list contains the old filename, isn't in RADOS anymore.

Attached is rgw-admin object stat output, plus rados stat output for each of the parts.

I've censored the following information in the attachments.
- IPs
- Bucket name
- Actual filename

Required fix parts:
- codebase needs to correctly handle the move
- need a fixup tool to detect and fix all broken manifests for this, may be VERY hard depending what the rename was.


Files

rgw-object-stat.dho1444.txt (4.05 KB) rgw-object-stat.dho1444.txt radosgw-admin object stat Robin Johnson, 06/22/2016 10:24 PM
rados-objects.stat.dho1444.txt (365 Bytes) rados-objects.stat.dho1444.txt rados stat Robin Johnson, 06/22/2016 10:24 PM
rgw-log.dho1444.txt (2.93 KB) rgw-log.dho1444.txt RGW logs for the object (HEAD+GET) Robin Johnson, 06/22/2016 10:24 PM

Related issues 2 (0 open2 closed)

Copied to rgw - Backport #17122: jewel: COPY broke multipart files uploaded under dumplingResolvedLoïc DacharyActions
Copied to rgw - Backport #17123: hammer: COPY broke multipart files uploaded under dumplingResolvedNathan CutlerActions
Actions

Also available in: Atom PDF