Project

General

Profile

Actions

Bug #22982

closed

Objects only serving first 512K

Added by Robin Johnson about 6 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
High
Assignee:
-
Target version:
-
% Done:

0%

Source:
Community (dev)
Tags:
rgw
Backport:
luminous
Regression:
Yes
Severity:
2 - major
Reviewed:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

This has be seen in previous releases, but it's back again in Luminous! Too late for 12.2.3 tag, but I'll apply the fix to our internal build when it's available.

$ wget ...
--2018-02-11 23:44:57--  https://objects-us-west-1.dream.io/BUCKET-CENSORED/FILENAME-CENSORED?Expires=1518424203&Signature=CENSORED&AWSAccessKeyId=CENSORED
Resolving objects-us-west-1.dream.io... 2607:f298:4:143:acce:55:2:1, 64.90.32.8
Connecting to objects-us-west-1.dream.io|2607:f298:4:143:acce:55:2:1|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 11127936 (11M) [audio/x-wav]
Saving to: ‘/dev/null’

/dev/null                                         4%[===>                                                                                                 ] 512.00K  1.90MB/s    in 0.3s    

2018-02-11 23:44:58 (1.90 MB/s) - Connection closed at byte 524288. Retrying.

JSON of object stat

$ radosgw-admin --bucket BUCKET-CENSORED --object 'FILENAME-CENSORED' object stat
{
    "name": "FILENAME-CENSORED",
    "size": 11127936,
    "policy": {
        "acl": {
            "acl_user_map": [
                {
                    "user": "USER-CENSORED",
                    "acl": 15
                }
            ],
            "acl_group_map": [],
            "grant_map": [
                {
                    "id": "USER-CENSORED",
                    "grant": {
                        "type": {
                            "type": 0
                        },
                        "id": "USER-CENSORED",
                        "email": "",
                        "permission": {
                            "flags": 15
                        },
                        "name": "USER-CENSORED",
                        "group": 0,
                        "url_spec": "" 
                    }
                }
            ]
        },
        "owner": {
            "id": "USER-CENSORED",
            "display_name": "USER-CENSORED" 
        }
    },
    "etag": "722e7c40151930b38cdf285659a92d94",
    "tag": "default.52038511.39424258",
    "manifest": {
        "objs": [
            0,
            {
                "loc": {
                    "bucket": {
                        "name": "BUCKET-CENSORED",
                        "marker": "default.51695731.142363",
                        "bucket_id": "default.51695731.142363",
                        "tenant": "",
                        "explicit_placement": {
                            "data_pool": ".rgw.data.1",
                            "data_extra_pool": "",
                            "index_pool": ".rgw.data.1" 
                        }
                    },
                    "key": {
                        "name": "FILENAME-CENSORED",
                        "instance": "",
                        "ns": "" 
                    }
                },
                "loc_ofs": 0,
                "size": 524288
            },
            524288,
            {
                "loc": {
                    "bucket": {
                        "name": "BUCKET-CENSORED",
                        "marker": "default.51695731.142363",
                        "bucket_id": "default.51695731.142363",
                        "tenant": "",
                        "explicit_placement": {
                            "data_pool": ".rgw.data.1",
                            "data_extra_pool": "",
                            "index_pool": ".rgw.data.1" 
                        }
                    },
                    "key": {
                        "name": "__JbcJZZ4eXDtuKeFN8SakI46t0Erh4T5_1",
                        "instance": "",
                        "ns": "shadow" 
                    }
                },
                "loc_ofs": 0,
                "size": 4194304
            },
            4718592,
            {
                "loc": {
                    "bucket": {
                        "name": "BUCKET-CENSORED",
                        "marker": "default.51695731.142363",
                        "bucket_id": "default.51695731.142363",
                        "tenant": "",
                        "explicit_placement": {
                            "data_pool": ".rgw.data.1",
                            "data_extra_pool": "",
                            "index_pool": ".rgw.data.1" 
                        }
                    },
                    "key": {
                        "name": "__JbcJZZ4eXDtuKeFN8SakI46t0Erh4T5_2",
                        "instance": "",
                        "ns": "shadow" 
                    }
                },
                "loc_ofs": 0,
                "size": 4194304
            },
            8912896,
            {
                "loc": {
                    "bucket": {
                        "name": "BUCKET-CENSORED",
                        "marker": "default.51695731.142363",
                        "bucket_id": "default.51695731.142363",
                        "tenant": "",
                        "explicit_placement": {
                            "data_pool": ".rgw.data.1",
                            "data_extra_pool": "",
                            "index_pool": ".rgw.data.1" 
                        }
                    },
                    "key": {
                        "name": "__JbcJZZ4eXDtuKeFN8SakI46t0Erh4T5_3",
                        "instance": "",
                        "ns": "shadow" 
                    }
                },
                "loc_ofs": 0,
                "size": 2215040
            }
        ],
        "obj_size": 11127936,
        "explicit_objs": "true",
        "head_size": 524288,
        "max_head_size": 524288,
        "prefix": "",
        "rules": [],
        "tail_instance": "",
        "tail_placement": {
            "bucket": {
                "name": "",
                "marker": "",
                "bucket_id": "",
                "tenant": "",
                "explicit_placement": {
                    "data_pool": "",
                    "data_extra_pool": "",
                    "index_pool": "" 
                }
            },
            "placement_rule": "" 
        }
    },
    "attrs": {
        "user.rgw.content_type": "audio/x-wav" 
    }
}


Files

Dupont.wav-user.rgw.manifest (1.06 KB) Dupont.wav-user.rgw.manifest user.rgw.manifest of object Robin Johnson, 02/13/2018 04:24 AM

Related issues 1 (0 open1 closed)

Copied to rgw - Backport #23102: luminous: Objects only serving first 512KResolvedPrashant DActions
Actions

Also available in: Atom PDF