Bug #11851: Civetweb RGW appears to report full size of object as downloaded when only partially downloaded - rgw - Ceph

Actions

Copy link

Bug #11851

closed

Civetweb RGW appears to report full size of object as downloaded when only partially downloaded

Added by Matthew Wodrich almost 9 years ago. Updated over 8 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Orit Wasserman

Target version:

% Done:

Source:

Community (user)

Tags:

Backport:

hammer, firefly

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Looking at the radosgw-admin usage show get_obj bytes_sent output for a user with 500MB to ~1.1GB objects being streamed or partially downloaded, the Civetweb RGW appears to be recording that the entire size of an object has been sent for every single request, even where it's clear from logs that the connection was aborted mid-download. This results in usage numbers orders of magnitude over true usage. This has been observed on Firefly.

Related issues 2 (0 open — 2 closed)

Actions

Copy link

Updated by Sage Weil almost 9 years ago

Priority changed from Normal to Urgent
Source changed from other to Community (user)
Backport set to hammer, firefly

Actions

Copy link

Updated by Yehuda Sadeh almost 9 years ago

Can this be reproduced with a more concrete info? Looking at the code I don't think we report the full object size for partial upload. What might be happening is that civetweb is buffering a lot so we end up overreporting if nothing went on the wire, but this is just a guess.

Actions

Copy link