Project

General

Profile

2I - A hook framework for Ceph FS operation » History » Version 1

Jessica Mack, 06/22/2015 05:08 AM

1 1 Jessica Mack
h1. 2I - A hook framework for Ceph FS operation
2 1 Jessica Mack
3 1 Jessica Mack
h3. Live Pad
4 1 Jessica Mack
5 1 Jessica Mack
The live pad can be found here: "[pad]":http://pad.ceph.com/p/A_hook_framework_for_Ceph_FS_operation
6 1 Jessica Mack
7 1 Jessica Mack
h3. Summit Snapshot
8 1 Jessica Mack
9 1 Jessica Mack
# Use cases:
10 1 Jessica Mack
# file search for hpc
11 1 Jessica Mack
# data provenance?
12 1 Jessica Mack
# file contents indexing
13 1 Jessica Mack
# tagging, metadata indexing
14 1 Jessica Mack
15 1 Jessica Mack
Read/write notification:
16 1 Jessica Mack
# avoid osd -> mds messages
17 1 Jessica Mack
# publish events on an message queue or unix domain socket or something cheapre than fork()+execve()
18 1 Jessica Mack
# can infer post-write event from filelock states
19 1 Jessica Mack
## tricky; we can help via ceph-devel etc.
20 1 Jessica Mack
# read notification can piggyback on client->mds atime update
21 1 Jessica Mack
## implement atime first :)
22 1 Jessica Mack
23 1 Jessica Mack
Coding tasks
24 1 Jessica Mack
25 1 Jessica Mack
# Debugging of the MDS dying.
26 1 Jessica Mack
# the support of other OSD operations.
27 1 Jessica Mack
# the support of extended attribute check (for hook configuration) not to notify of unnecessary events.
28 1 Jessica Mack
# the support of multiple MDS; load-balancing of hook executions.
29 1 Jessica Mack
30 1 Jessica Mack
Build / release tasks
31 1 Jessica Mack
32 1 Jessica Mack
# Just put the code on a web page and see what will happen (I mean, I have no idea on release engineering). 
33 1 Jessica Mack
34 1 Jessica Mack
Documentation tasks
35 1 Jessica Mack
36 1 Jessica Mack
# All documentation for everything is not yet done.
37 1 Jessica Mack
38 1 Jessica Mack
Deprecation tasks
39 1 Jessica Mack
40 1 Jessica Mack
# What does the deprecation tasks mean ?