Actions
Tasks #51409
openD3N DataCache TODO list
% Done:
0%
Tags:
Reviewed:
Affected Versions:
Pull request ID:
Description
This tracker issue is a TODO list for the remaining tasks for the D3N DataCache following the initial commit.
- debug `s3_tests` failures when `--rgw_compression=zlib`
- debug s3_tests failures when `rgw_max_chunk_size != rgw_obj_stripe_size`
- check if `-o rgw_enable_ops_log=true` is still necesary for D3N operation
- does `D3nL1CacheRequest` need to be allocated on the heap? (https://github.com/ceph/ceph/pull/36266/#discussion_r655622746)
- does the `aiocb` ilabaio callback structure needs to allocated on the heap? (https://github.com/ceph/ceph/pull/36266/#discussion_r655617364)
- check if changing the `d3n_cache_map` from std::unordered_map to `boost::intrusive::list` improves eviction performance (https://github.com/ceph/ceph/pull/36266/#discussion_r494300389)
- add perf counters and radosgw-admin & rest facilities to check the amount of d3n cache data stored and object/byte hit ratios
- support non-yielding version of rgw::d3n_cache_op()
- optimize random eviction
- user docs (high-level feature description, setup instructions, config options)
- add cache-in algorithm selection, ex:
option to populate cache on PUT
option to populate cache only after a certain number of gets during the specified time window - Predictive Cache Analisis - While the Cache is disabled, analyze the load and captures Cache statistics to observes what the Cache hit ratios might be with the Cache enabled (Credit Or)
- Upstreaming of the L2 PR
- logs cleanup and rewording for consistency
- Cleanup refactor to minimize the number is #incude's related to D3N code to minimum and move as much as possible of the D3N code from .h files to .cpp files to reduce compile time
Updated by Mark Kogan almost 3 years ago
PRs:
- user docs (high-level feature description, setup instructions, config options)
https://github.com/ceph/ceph/pull/42340
- check if `-o rgw_enable_ops_log=true` is still necesary for D3N operation
https://github.com/ceph/ceph/pull/42397 - rgw: d3n: remove legacy requirement to enable rgw_enable_ops_log
Updated by Casey Bodley over 2 years ago
user docs (high-level feature description, setup instructions, config options)
merged in https://github.com/ceph/ceph/pull/42340
Updated by Casey Bodley 10 months ago
work in progress in https://github.com/ceph/ceph/pull/52346 to cover:
- does `D3nL1CacheRequest` need to be allocated on the heap? (https://github.com/ceph/ceph/pull/36266/#discussion_r655622746)
- support non-yielding version of rgw::d3n_cache_op()
Actions