Project

General

Profile

Feature #14031

EC overwrites

Added by Samuel Just about 4 years ago. Updated over 2 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

58%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

This feature is complete when we support overwrites on EC pools. Linked tickets provide details.

https://github.com/athanatos/ceph/blob/wip-ec-overwrites/doc/dev/osd_internals/ec_overwrites.rst


Subtasks

Feature #14032: EC Overwrites: Phase 2: Peering support for ec overwritesNew

Feature #14033: Activation support for EC OverwritesFix Under ReviewSamuel Just

Feature #14034: EC Overwrites: Phase 2: PGLog support for recording participantsNew

Feature #14035: EC overwrites -- cleanup of ReplicatedPG::do_op to actually allow the new writesFix Under ReviewSamuel Just

Feature #14036: EC overwrites: PGBackend needs to be replumbed to support overwritesFix Under ReviewSamuel Just

Feature #14037: PGBackend: add a way for the Backend to notify ReplicatedPG that a version has been appliedFix Under ReviewSamuel Just

Feature #14038: ECBackend: delay writes which cause a clone to be created on an object with unapplied writes while those applies are forcedFix Under ReviewSamuel Just

Feature #14039: ECBackend cache extents with unapplied writesFix Under ReviewSamuel Just

Feature #14040: ECBackend support for RMWResolvedSamuel Just

Bug #17667: bug with last_backfill = head when snapdir exists and a write removes snapdirClosedSamuel Just

Feature #14041: EC overwrites: deep scrub and checksummingClosedTomy Cheru

Feature #15621: EC Overwrites: create temporary testing pool flag for enabling ec supporting featuresFix Under ReviewSamuel Just

Feature #15622: performance counters for ECbackend cacheNew

Feature #15623: EC Overwrites: ECBackend TPC supportFix Under ReviewSamuel Just

Feature #15657: EC Overwrites: explicit pg missingResolvedSamuel Just

Feature #17156: update ec overwrites implementation to support truncateFix Under ReviewSamuel Just

Feature #17157: update ec overwrites implementation to support zeroFix Under ReviewSamuel Just

Feature #17158: EC Overwrites: work out implications of recovery below min_size pushing the can_rollback_to line forwardNew

Bug #17442: EC Overwrites: for all scrubs, flush pending write-ahead updates on the range (see the wait_for_pushes thingy in the scrub state machine, it's somewhat similar)Resolved

Feature #17500: updated ec overwrites to support fadviseNew

Feature #17501: ec overwrites write zeroes efficientlyNew

Feature #17651: EC Overwrites: Missing Test Case: aligned writesNewSamuel Just

Feature #17652: EC Overwrites: Missing Test Case: multiple writes, single operationNewSamuel Just

Feature #17653: EC Overwrites: Missing Test Case: zeroNewSamuel Just

Feature #17668: bug with last_backfill = head when snapdir exists and a write removes snapdirResolvedSamuel Just

Feature #17690: workload which generates write errors (like ceph_test_rados) very occasionally hangs with the pg peers without the primary changingResolvedSamuel Just

RADOS - Bug #17718: EC Overwrites: update ceph-objectstore-tool export/import to handle rollforward/rollbackNewJosh Durgin

Feature #17741: Fix but with recovery read marker and get_rw_locks assumptionsResolvedSamuel Just

History

#1 Updated by Samuel Just about 4 years ago

  • Description updated (diff)

#2 Updated by Samuel Just about 4 years ago

  • Description updated (diff)

#3 Updated by Samuel Just over 3 years ago

I just grabbed the features relating to peering, activation, the log, and the PGBackend interface. I think they're going to need to be done in one PR since they all depend on the same design choices, so I'll tackle that next.

#4 Updated by huang jun over 3 years ago

hi, sam, are there PRs for these?

Also available in: Atom PDF