Project

General

Profile

Chat Log - Sessions 17-29

*** Vjarjadian has quit IRC    00:07
*** saabylaptop has joined #ceph-summit    00:07
*** saabylaptop has left #ceph-summit    00:08
*** dalgaaf has joined #ceph-summit    00:44
*** Vincent_Valentine has joined #ceph-summit    00:46
*** dalgaaf has quit IRC    01:08
*** dalgaaf-tmp has joined #ceph-summit    01:08
*** jaydee has joined #ceph-summit    01:38
*** silversurfer has quit IRC    01:43
*** Vincent_Valentine has quit IRC    02:19
*** nwat has quit IRC    02:24
*** silversurfer has joined #ceph-summit    02:33
*** jaydee has quit IRC    02:37
*** mozg has quit IRC    02:41
*** nwat has joined #ceph-summit    02:46
*** dalgaaf has joined #ceph-summit    02:55
*** dalgaaf-tmp has quit IRC    02:57
*** nwat has quit IRC    02:58
*** fireD has joined #ceph-summit    03:08
* loicd listening to playback of tonight feed    03:30
loicd    ccourtaut: I'm breaking up sometimes ( not hearing what people say ) around 0:38 inhttp://www.youtube.com/watch?v=j0JQvE5uGgs&feature=youtu.be . Do you experience the same problem ? If you listen from 0:38 to 0:39 without breaking up you don't have the same problem and it's just on my side ;-)    03:47
ccourtaut    loicd, oh you mean you don't hear sage but his lips are moving?    03:50
ccourtaut    he told yesterday he was sorry about that, we he types, it mutes, and it happens that he types while talking    03:51
ccourtaut    loicd, iirc    03:51
joelio    yea    03:51
loicd    ccourtaut: yes    03:51
loicd    oh, ok    03:51
loicd    ccourtaut: thanks    03:52
loicd    it's better now    03:52
*** nhm has quit IRC    04:05
*** dalgaaf has quit IRC    04:33
*** dalgaaf has joined #ceph-summit    04:35
loicd    ccourtaut: I prepared this http://pad.ceph.com/p/osd-erasure-coding    04:39
loicd    does it make sense to you ?    04:40
* ccourtaut looking    05:00
loicd    I've added a few lines at the beginning of http://wiki.ceph.com/01Planning/02Blueprints/Emperor/Create_and_Maintain_S3_feature_list_for_compatibility_tracking feel free to edit if you don't like how it's done    05:03
loicd    leseb: \o    05:03
leseb    loicd: o/    05:03
loicd    leseb: did you attend yestereday ?    05:06
leseb    loicd: barely and you? it was too late    05:07
leseb    loicd: and you?    05:07
loicd    same :-)    05:07
leseb    just read some BPs and pads today    05:07
loicd    which ones ?    05:07
* loicd starting with http://pad.ceph.com/p/continuous-integration    05:08
leseb    loicd: rbd: shared read cache and rbd: namespace support    05:09
leseb    loicd: bbl    05:11
*** zhu has quit IRC    05:58
*** zhu has joined #ceph-summit    05:58
*** Vincent_Valentine has joined #ceph-summit    06:04
*** zhu_ has joined #ceph-summit    06:05
*** zhu has quit IRC    06:07
*** yanzheng has joined #ceph-summit    06:09
loicd    ccourtaut: http://pad.ceph.com/p/continuous-integration if you have a few minutes, it would be great if you could review / patch this :-)    06:11
loicd    yehudasa: http://pad.ceph.com/p/continuous-integration I suggest that teuthology is made more friendly for non-inktank users as part of a better continuous integration    06:13
*** nwat has joined #ceph-summit    06:14
joelio    should the tenants be driven by a standard API (EC2, OCCI etc.?)    06:15
loicd    joelio: good idea :-) using euca2ools would make teuthology somewhat agnostic    06:21
joelio    :)    06:22
joelio    I use OpenNebula here, so anything that is cross-platform is win for me    06:22
ccourtaut    loicd, looks good to me    06:24
loicd    :-)    06:25
* loicd takes a break before the summit starts    06:25
joelio    loicd: added that to pad btw    06:25
*** scuttlemonkey has joined #ceph-summit    06:31
*** yanzheng has quit IRC    06:31
sagewk    good morning!    06:46
joelio    sagewk: morning    06:49
joelio    (afternoon!)    06:49
*** rturk-away is now known as rturk    06:51
sagewk    good afternoon, EMEA!  :)    06:52
rturk    Hello all!    06:52
*** erice_ has joined #ceph-summit    06:52
*** mikedawson has joined #ceph-summit    06:52
*** rturk changes topic to "summit schedule: http://ceph.com/cds || live video stream: http://youtu.be/-K8bSHx7zJ0 || ping rturk to join the hangout"    06:54
rturk    ** Session "Welcome, Introduction, and Summit Process" starting in 5 minutes! || pad: http://bit.ly/1b936Xb    06:55
*** topro has joined #ceph-summit    06:56
*** wido has joined #ceph-summit    06:57
rturk    ** Session "Welcome, Introduction, and Summit Process" starting now! || pad: http://bit.ly/1b936Xb    07:00
rturk    live video stream: http://youtu.be/-K8bSHx7zJ0    07:00
*** davidzlap has joined #ceph-summit    07:02
*** ircolle has joined #ceph-summit    07:03
loicd    joelio: cool :-)    07:05
loicd    ccourtaut: would you agree to take notes during the erasure coding session ?    07:06
*** sjustlaptop has joined #ceph-summit    07:08
*** joao has joined #ceph-summit    07:09
loicd    http://pad.ceph.com/p/osd-erasure-coding sjust would you agree to walkthru your erasure code design document  ? I outlined the agenda at http://pad.ceph.com/p/osd-erasure-coding    07:11
sjustlaptop    sure    07:13
ccourtaut    loicd, sure    07:13
loicd    ccourtaut: sjustlaptop cool ;-)    07:16
*** alfredodeza has joined #ceph-summit    07:17
*** ircolle1 has joined #ceph-summit    07:18
*** Vincent_Valentine has quit IRC    07:22
*** Vincent_Valentine has joined #ceph-summit    07:22
*** jyluke has joined #ceph-summit    07:22
*** ircolle has quit IRC    07:24
rturk    ** Session "osd: Erasure coded storage backend" starting in 5 minutes! || blueprint: http://bit.ly/1epNHS5 || pad: http://bit.ly/1b936Xb    07:25
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    07:25
rturk    I know sjustlaptop and loicd were listed as interested parties for the erasure coded storage backend session    07:26
rturk    anyone else?    07:26
scuttlemonkey    ccourtaut was going to take notes, so he should probably get an invite    07:27
rturk    ok    07:27
scuttlemonkey    so he's live and not delayed    07:27
rturk    ok - ccourtaut, invite sent via pm    07:28
rturk    ** Session "osd: Erasure coded storage backend" starting now! || blueprint: http://bit.ly/1epNHS5 || pad: http://bit.ly/1b936Xb    07:31
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    07:31
rturk    hey just kidding about that pad link.  It's actually here: http://pad.ceph.com/p/osd-erasure-coding    07:34
mikedawson    loicd: My team will be able to be an alpha tester    07:40
loicd    mikedawson: excellent news :-)    07:40
sagewk    awesome!    07:40
joelio    loicd: me too, inherited a few more test nodes today    07:42
scuttlemonkey    joelio: hey, did you ever do that internal technote?    07:42
loicd    coool added to http://pad.ceph.com/p/osd-erasure-coding    07:42
joelio    scuttlemonkey: oh, much more than that - built the full platform :)    07:43
joelio    I guess the asnwer is yes, I can do a community post :)    07:43
scuttlemonkey    haha    07:43
scuttlemonkey    only if you have time/interest    07:43
rturk    :)    07:43
scuttlemonkey    I just remember you saying the technote would be an easy drop-in post    07:43
scuttlemonkey    but anything works :)    07:44
joelio    scuttlemonkey: sure have, talking about it at OpenNebulaConf in September, along with out use cases    07:44
scuttlemonkey    yeah, that's what made me think of it actually    07:44
scuttlemonkey    Jaime mentioned you were speaking    07:44
joelio    s/out/our    07:44
joelio    yea, wanted to drive some actual usage by users.. otherwise we'd be talking about a fairly sparse system. They are coming thick and fast now, users love it    07:45
scuttlemonkey    also didn't realize you were doing OpenNebula until recently    07:45
scuttlemonkey    I'll need to stand that up and become more familiar with it now that there are real live people using ceph+opennebula together    07:46
joelio    yea, I had to wait for about a month to get approval.. BBC beaurocracy.. <rolls eyes?    07:46
scuttlemonkey    haha    07:46
Vincent_Valentine    why are we writing multiple OSDs for a single write?    07:46
scuttlemonkey    big orgs same the world over    07:46
joelio    yup"    07:46
jyluke    I will be interested in opennebula+ceph as well, will be starting to do within the a few weeks time    07:46
Vincent_Valentine    If we write single OSD, the problem of logs factored over multiple OSDs will not be there.    07:46
joshd    Vincent_Valentine: replication is synchronous, writes go to the primary osd, which forwards them to other osds in the acting set and waits for all of them to apply the write before telling the client it's complete    07:47
Vincent_Valentine    Who is going to do erasure coding? Client or Another OSD?    07:49
Vincent_Valentine    If its another OSD, I can think of just replicating logs over 2/3 OSDs    07:52
rturk    ** Session "osd: cache pool overlay" starting in 5 minutes! || blueprint: http://bit.ly/154Op1e || pad: http://bit.ly/1cGbUW4    07:55
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    07:55
Vincent_Valentine    but it would simplify recovery ... am i wrong ?    07:55
rturk    sjust: ^    07:56
sjustlaptop    I'm not sure, can you expand on that?    07:56
*** jyluke has quit IRC    07:58
Vincent_Valentine    Im thinking on rolling forward for erasure coded tier. If logs are replicated, instead of fragmented by coding, recovery would be similar to replication PG    07:58
scuttlemonkey    sjustlaptop: ^^    07:59
Vincent_Valentine    1 more question ... How efficient would erasure coding would be for small object? And how does this translate to erasure coded RDB?    07:59
sjustlaptop    oh, logs will be replicated    08:00
sjustlaptop    rather than coded    08:00
sjustlaptop    the trouble is rolling forward the actual objects    08:00
sjustlaptop    the pg logs do not contain the full append data, for example    08:00
sagewk    Vincent_Valentine: can only roll forward if you have the M/N shards    08:00
sjustlaptop    (though perhaps they could)    08:00
sagewk    for replication, any 1 replica is enough    08:00
Vincent_Valentine    Understand that .. trying to simplify log consistency problem by detaching logs from erasure coding.    08:02
*** rongze_ has quit IRC    08:02
Vincent_Valentine    [Repost] 1 more question ... How efficient would erasure coding would be for small object? And how does this translate to erasure coded RDB?    08:02
*** fooz has joined #ceph-summit    08:03
sagewk    Vincent_Valentine: see bottom of pad    08:04
Vincent_Valentine    sagewk .. what abt erasure coded RDB    08:05
*** ksp has joined #ceph-summit    08:05
Vincent_Valentine    so would there be tiers .. ? Is it planned in this release?    08:06
sjustlaptop    stay tuned!    08:06
rturk    ** Session "osd: cache pool overlay" starting now! || blueprint: http://bit.ly/154Op1e || pad: http://bit.ly/1cGbUW4    08:06
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    08:06
Vincent_Valentine    :) .. i think its not same as caching ...    08:07
rturk    Vincent_Valentine: would you like to join the hangout?    08:07
*** dragonfly has quit IRC    08:07
rturk    might be easier than dealing with the live video feed delay    08:07
sjustlaptop    there are discusions for both tiering and caching    08:07
Vincent_Valentine    Heh ... m fine ... would like to participate in this though .. whom to contact ?    08:08
scuttlemonkey    loicd is the one driving erasure coding    08:08
scuttlemonkey    but for anything I would add yourself to the blueprint and start chatting with folks in irc and on the lists    08:09
*** davidzlap has quit IRC    08:09
Vincent_Valentine    Sure .. will do.. thanks    08:10
*** mikedawson_ has joined #ceph-summit    08:12
rturk    ** Session "osd: object redirects" starting soon! || blueprint: http://bit.ly/1b9dy0H || pad: http://bit.ly/12XE2Cf    08:13
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    08:13
Vincent_Valentine    Is cache pool replicated?    08:13
*** davidzlap has joined #ceph-summit    08:13
*** ksp has quit IRC    08:14
Vincent_Valentine    isnt that expensive for NAND ?    08:14
sjustlaptop    Vincent_Valentine: well, you could set replication to 1 (no replication)    08:15
sjustlaptop    but that would have an effect on durability    08:15
Vincent_Valentine    But then I loose all durability requirement ... cause we are modifying in cache pool    08:15
sjustlaptop    yes    08:16
sjustlaptop    could do write-through, I suppose    08:16
Vincent_Valentine    I was assuming write-through and no replication    08:16
sjustlaptop    would only accelerate reads    08:16
sjustlaptop    might be worthwhile though    08:16
Vincent_Valentine    To simplify this .. I would suggest two types of pools ... replicated for write-backs and unreplicated for unmodified data ...Question is who is managing write-back flushing? What policies? Who maintain write ordering?    08:18
sjustlaptop    Vincent_Valentine: as I understand it, the cache pool primary manages write ordering    08:19
*** mikedawson has quit IRC    08:19
joshd    there are no ordering guarantees with operations on different objects    08:19
Vincent_Valentine    aah ... then how does this work on RBD? 4MB objects with no ordering garuntee?    08:20
sjustlaptop    Vincent_Valentine: most disks don't give much in the way of ordering guarrantees either    08:20
joshd    all you can tell with most disks is 1 sector will be atomic (with rbd it's anything to a single object, and object boundaries will align with sectors in the virtual disk)    08:21
Vincent_Valentine    It was regarding eviction ordering for write-back cache. (especially RBD)    08:22
rturk    ** Session "osd: object redirects" starting now! || blueprint: http://bit.ly/1b9dy0H || pad: http://bit.ly/12XE2Cf    08:29
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    08:29
Vincent_Valentine    Just to be sure, we will promote whole object on caching pool? .... There would be case for doing small block(4KB) caching than object caching ...    08:29
*** sjustlaptop has quit IRC    08:34
scuttlemonkey    sagewk: just fyi, about 10m until objecter is slated, although we can probably eat into the break a bit    08:36
rturk    ** Session "librados/objecter: smarter localized reads" starting soon! || blueprint: http://bit.ly/12XHlJI || pad: http://bit.ly/1b9h4bi    08:40
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    08:40
davidzlap    Need new code for a "delete foo, create foo" seeing with DELETING state?    08:42
*** sjustlaptop has joined #ceph-summit    08:46
rturk    ** Session "librados/objecter: smarter localized reads" starting now! || blueprint: http://bit.ly/12XHlJI || pad: http://bit.ly/1b9h4bi    08:49
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    08:49
*** jyluke has joined #ceph-summit    08:53
loicd    what parts of ceph use Objecter ?    08:56
sjustlaptop    loicd: clients    08:57
sjustlaptop    it's the ball of logic responsible for determining where to send client io    08:57
loicd    ohhhh    08:57
joshd    mainly librados, ceph-fuse, and the mds use it directly - other clients use librados    08:57
loicd    :-D    08:57
loicd    now I get it !    08:57
* loicd relieved    08:58
*** nwat has quit IRC    08:58
sagewk    :)    09:00
sagewk    the goofy Objecter name strikes again    09:00
*** Vincent_Valentine has quit IRC    09:02
*** Vincent_Valentine has joined #ceph-summit    09:02
*** sjustlaptop has quit IRC    09:07
*** rturk changes topic to "summit schedule: http://ceph.com/cds || live video stream: http://youtu.be/cGosx5zD4FM || ping rturk to join the hangout"    09:09
*** mikedawson_ has quit IRC    09:10
rturk    ** Session "rgw: Multi-region / Disaster Recovery" starting in 5 minutes || blueprint: http://bit.ly/1eq1J5X || pad: http://bit.ly/12XJWmU    09:10
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    09:10
*** hskinner has joined #ceph-summit    09:11
*** fireD has left #ceph-summit    09:11
loicd    I'd like to join in ~1h :-)    09:12
loicd    rturk: ^    09:12
rturk    We are about to relaunch our live stream: http://youtu.be/cGosx5zD4FM    09:12
rturk    loic: ok    09:12
*** mikedawson has joined #ceph-summit    09:15
sagewk    ccourtaut: are you joining as well?    09:16
rturk    sagewk: he's already in the hangout    09:16
ccourtaut    sagewk, already in    09:16
ccourtaut    :)    09:16
rturk    ** Session "rgw: Multi-region / Disaster Recovery" starting now! || blueprint: http://bit.ly/1eq1J5X || pad: http://bit.ly/12XJWmU    09:17
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    09:17
*** mikedawson_ has joined #ceph-summit    09:20
*** [1]jyluke has joined #ceph-summit    09:21
*** jyluke has quit IRC    09:21
*** [1]jyluke is now known as jyluke    09:21
*** mikedawson has quit IRC    09:26
*** mikedawson_ is now known as mikedawson    09:26
sagewk    we lost yehudasa!    09:29
joelio    heading home, will be about for the rbd: cloud management platform features    09:35
joelio    rturk: could I register my interest in hangouts now please pal?    09:36
rturk    Yep, I'll write you down for that session    09:36
joelio    ace, thanks    09:37
*** erice has quit IRC    09:41
rturk    ** Session "rgw: bucket level quota" scheduled to start in 5 minutes || blueprint: http://bit.ly/16s1rsC || pad: http://bit.ly/11K0Vq2    09:42
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    09:42
rturk    ** Session "rgw: bucket level quota" starting now! || blueprint: blueprint: http://bit.ly/16s1rsC || pad: http://bit.ly/11K0Vq2    09:47
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    09:47
*** erice_ has quit IRC    09:54
*** VincentValentine has joined #ceph-summit    09:59
wido    so I missed the question :)    10:01
wido    sagewk: ^^    10:02
*** Vincent_Valentine has quit IRC    10:02
*** nwl has joined #ceph-summit    10:04
*** VincentValentine has quit IRC    10:04
*** Vincent_Valentine has joined #ceph-summit    10:04
scuttlemonkey    hey wido    10:05
wido    hey    10:05
nwl    hi    10:05
scuttlemonkey    trying to figure out the use case for bucket-level quotas    10:05
* wido was already listening in    10:05
wido    just missed the questions about the quota enforcement    10:05
wido    there is some serious lag in the video I think :)    10:06
scuttlemonkey    yes, the youtube link is maybe 2-3 mins behind the hangout    10:07
nwl    so it can be censored for bad language    10:07
scuttlemonkey    or wardrobe malfunctions :P    10:07
wido    Anyway, I don't think quota restriction has to be very tight    10:08
wido    a near perfect quota is fine for 99% of the situations    10:08
wido    maybe even 99.99%    10:08
*** lyncos has joined #ceph-summit    10:08
rturk    ** Session "rgw: Create and Maintain S3 feature list" scheduled to start in 5 minutes || blueprint: http://bit.ly/16s4bWV || pad: http://bit.ly/11K2Gnl    10:10
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    10:10
rturk    ** Session "rgw: Create and Maintain S3 feature list" starting now! || blueprint: http://bit.ly/16s4bWV || pad: http://bit.ly/11K2Gnl    10:13
loicd    https://github.com/kri5/ceph/blob/wip-s3-compliance-doc/doc/radosgw/s3_compliance.rst    10:17
loicd    that's what christophe is describing currently    10:17
yehudasa    http://aws.amazon.com/releasenotes/Amazon-S3    10:25
yehudasa    copy pasted into my hangout window and the window is stuck now    10:25
rturk    ** Session “Continuous Integration” scheduled to start in 5 minutes || pad: http://bit.ly/13Kk34N    10:26
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    10:26
*** cjh_ has left #ceph-summit    10:27
rturk    I wonder whether this list should live on the wiki?    10:27
rturk    if it's important that the barrier to editing is low, anyway    10:27
*** Andi has joined #ceph-summit    10:28
*** Andi is now known as Guest2516    10:28
*** Guest2516 has left #ceph-summit    10:29
*** abluemle has joined #ceph-summit    10:29
*** abluemle has left #ceph-summit    10:32
rturk    ** Session "Continuous Integration" starting now! || pad: http://bit.ly/13Kk34N    10:33
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    10:33
*** buck has joined #ceph-summit    10:37
sagewk    question for the room: who loves/hates gerrit?    10:38
scuttlemonkey    sagewk: having used it in the past, I really liked it    10:40
scuttlemonkey    was very approachable and (if done right) quite scalable    10:40
joshd    I strongly dislike gerrit - it only handles one commit at a time (encouraging unreviewable and too-large patches)    10:41
ircolle1    joshd - you can create a tree of patches    10:41
paravoid    wikimedia uses gerrit for pretty much everything    10:42
joshd    yes, but they're not reviewed or committed atomically    10:42
ircolle1    joshd - right    10:42
paravoid    I can provide some insight if you want    10:42
ircolle1    paravoid - want to join the hangout?    10:42
scuttlemonkey    paravoid: that would be great    10:42
*** sjustlaptop has joined #ceph-summit    10:42
joshd    and you're building and testing and reviewing every singe commit instead of a branch (i.e. a pull request)    10:42
rturk    sent link to you, paravoid    10:42
rturk    although the hangout is nearly full    10:43
paravoid    yeah, full    10:43
rturk    and now it's totally full - anyone wanna drop back to the video stream to let paravoid in?    10:44
ircolle1    I'll drop    10:44
nwl    "Pull out! You're not doing any good back there!"    10:45
* ircolle1 stuffs nwl back in his cage    10:46
nwl    "Good shot, Janson!"    10:47
nwl    i am just quoting random shit now    10:47
paravoid    http://www.mediawiki.org/wiki/Git/Gerrit_evaluation    10:47
*** nhm has joined #ceph-summit    10:48
*** abluemle has joined #ceph-summit    10:49
rturk    I seem to hear "we use garrit but have put some work into it" a lot    10:49
*** lyncos has quit IRC    10:50
*** ksp has joined #ceph-summit    10:53
paravoid    wikimedia's CI central stuff is https://integration.wikimedia.org/    10:54
paravoid    central page even    10:54
paravoid    all in all, I don't think you can easily use both gerrit & github at the same time    10:55
paravoid    and to be frank, I wouldn't switch to gerrit at this point if I were you    10:55
scuttlemonkey    ahh    10:56
zackc    i'm on IRC at least :)    10:56
paravoid    okay, dropping from the hangout to open up a slot    10:56
scuttlemonkey    paravoid: thanks for the overview though...that insight is invaluable    10:57
*** sjustlaptop has quit IRC    10:59
*** sjustlaptop has joined #ceph-summit    10:59
*** nhm has quit IRC    11:02
joelio    rturk: will just be on IRC later, got people visiting at home - can just about get away with typing.. full conference might be a little rude :)    11:05
rturk    ok :)    11:06
joelio    hopefully be able to add some ONE insight anyway    11:06
rturk    lmk if that changes    11:06
joelio    np    11:06
*** alram has joined #ceph-summit    11:07
wido    scuttlemonkey: I'm here for the librgw session    11:11
*** nwat has joined #ceph-summit    11:11
*** rturk changes topic to "summit schedule: http://ceph.com/cds || live video stream: http://youtu.be/hrQuYzyXvVg || ping rturk to join the hangout"    11:11
wido    rturk: ^^    11:11
rturk    wido, sending hangout link via pm    11:12
*** dpippenger has joined #ceph-summit    11:12
rturk    ** Session “librgw” starting now! || blueprint: http://bit.ly/15GefyV || pad: http://bit.ly/13Knzfy    11:16
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    11:16
rturk    If you're looking for the live video stream, it's here: http://youtu.be/hrQuYzyXvVg    11:21
*** nwat has quit IRC    11:22
*** sjustlaptop has quit IRC    11:23
*** troug has joined #ceph-summit    11:27
*** sjustlaptop has joined #ceph-summit    11:27
*** nhm has joined #ceph-summit    11:28
*** hskinner has quit IRC    11:29
*** nhm has quit IRC    11:29
*** sjustlaptop has quit IRC    11:29
*** sjustlaptop has joined #ceph-summit    11:30
joelio    rturk: yea, I should be in after all.. can escape for 1/2 hour    11:30
rturk    joelio: ok - link sent via pm    11:31
*** nhm has joined #ceph-summit    11:31
scuttlemonkey    joelio: fwiw, that link will work until the end of the summit    11:31
scuttlemonkey    so feel free to drop in/out as you need ot    11:31
scuttlemonkey    to*    11:31
joelio    cheers guys    11:32
ksp    I'm new to the chat. Which questions should go to IRC and which  ones to the PAD ?    11:38
ircolle1    ksp - either is fine    11:38
scuttlemonkey    ksp: feel free to drop them either place    11:38
joelio    you'll have to excuse my crappy webcam mic btw, not got my headset with me today    11:40
scuttlemonkey    no worries    11:40
rturk    ** Session “msgr: infiniband support via rsockets” scheduled to start in 5 minutes || blueprint: http://bit.ly/11Ke7eH || pad: http://bit.ly/191fQyk    11:40
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    11:40
scuttlemonkey    I keep putting myself on mute so I don't pick up ambient noise    11:40
joelio    yep, right next to a road here too so will have to do that    11:41
*** dstroppa has joined #ceph-summit    11:42
rturk    ** Session “msgr: infiniband support via rsockets” starting now! || blueprint: http://bit.ly/11Ke7eH || pad: http://bit.ly/191fQyk    11:46
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    11:46
ircolle1    I dropped to  make room    11:46
ccourtaut    same for me    11:46
sagewk    abluemle: care to join?    11:47
abluemle    andreas is here    11:47
ksp    Andreas and I are connected    11:47
abluemle    but only via chat    11:47
scuttlemonkey    no mic? Would love to have you on the broadcast, instead of just the youtube link && irc    11:48
dalgaaf    hi dieter and andreas    11:48
ksp    Hi danny    11:49
abluemle    sorry:Ö no mic, no webcam    11:49
dmick    that makes it more difficult :)    11:49
*** sjustlaptop has quit IRC    11:49
*** sjustlaptop has joined #ceph-summit    11:50
abluemle    Agree on the internal implementation via r*()    11:50
abluemle    IP is only relevant for connection establishment    11:51
sagewk    but do you need to know whether the peer is rsockets or does it fallb ack?    11:51
sagewk    i.e. can you use r* calls unconditionally and let magic happen?    11:51
abluemle    It does not fall back afaik    11:51
ksp    libSDP does use the fallback logic, and this fallback behavior can be added to rsockets as well    11:52
abluemle    libsdp is different concerning fall back: it does fall back to regular TCP sockets    11:52
abluemle    The IP address does not tell you about the rsocket character of the connection    11:54
abluemle    sth. like cluster network on rsockets and public network on regular sockets    11:56
ksp    The use case would be to run the cluster network with IB + rsockets and the client network still with Eth + IP-socket    11:56
rturk    ** Session “rbd: cloud management platform features” scheduled to start soon || blueprint: http://bit.ly/11Kfxpk || pad: http://bit.ly/191hsbd    11:57
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    11:57
abluemle    no kernel so far    11:57
ksp    we are considering to port rsocket to the kernel, but not decided yet    11:58
ksp    Sean Hefty    11:58
ksp    Sean Hefty from Intel own rsockets    11:58
sagewk    libdsp is EOL right?    11:58
dstroppa    rturk: can I have the link for the hangout for the cloud mgt platform?    11:58
ksp    yes, SDP is EOL    11:58
rturk    dstroppa: sent via pm, thanks :)    11:59
abluemle    For SDP there were userland and kernel parts    11:59
abluemle    option support is avaiable in rsocket    12:00
ksp    SDP has some license / legal risks ... this might be the reason for EOL    12:00
sagewk    what is option support?    12:00
ksp    sorry, didn't get the question    12:01
abluemle    setsockopt()    12:01
dmick    Did Matthew Anderson ever get anywhere, I wonder?  http://lists.ceph.com/pipermail/ceph-users-ceph.com/2013-June/002352.html    12:01
dalgaaf    Dieter: it's about "option support is avaiable in rsocket"    12:02
abluemle    blocking vs. non-blocking: I am not sure about the current support in rsockets.    12:02
rturk    ** Session “rbd: cloud management platform features” starting now! || blueprint: http://bit.ly/11Kfxpk || pad: http://bit.ly/191hsbd    12:04
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    12:04
*** dosaboy_ has joined #ceph-summit    12:05
sagewk    abluemle: ksp: thanks!    12:06
ksp    you are welcome    12:06
loicd    leseb: could you please link the blueprint ?    12:13
leseb    loicd: which one?    12:14
loicd    the one you're pushing    12:15
leseb    loicd: https://review.openstack.org/#/c/36042/    12:15
loicd    leseb: you can ignore me for the next 30 minutes and answer later ;-)    12:15
sagewk    zackc: what to look at http://pad.ceph.com/p/cds-teuthology ?    12:16
sagewk    add any notes for things we should discuss?    12:16
*** sjustlaptop has quit IRC    12:16
*** sjustlaptop has joined #ceph-summit    12:18
*** abluemle has left #ceph-summit    12:19
*** ksp has left #ceph-summit    12:20
zackc    sagewk: looking now    12:22
rturk    ** Session “Teuthology” scheduled to start soon || pad: http://bit.ly/191jGYa    12:25
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    12:25
zackc    rturk: i'd like to join    12:26
joelio    I'm out    12:26
scuttlemonkey    joelio: thanks for joining :)    12:26
joelio    n/p :)    12:26
rturk    zackc: link sent via pm    12:26
jyluke    just wondering, how's ceph with opennebula? would there be a lot of effort to get them work together?    12:26
rturk    thanks, joelio!    12:26
rturk    jyluke: someone actually just presented about that at Ceph Day    12:26
scuttlemonkey    Jaime has done a pretty decent job of blogging and documenting OpenNebula && Ceph    12:27
scuttlemonkey    http://opennebula.org/documentation:archives:rel4.0:ceph_ds    12:27
joelio    yea, I'm liking it    12:27
scuttlemonkey    http://blog.opennebula.org/?p=4441    12:28
joelio    it sounds like the other management stacks have similar challenges, like lack of abstractions to handle types other than file, dev etc..    12:28
Tamil    rturk: pull me in too for teuthology    12:28
jyluke    ah.. thanks. will try it out after our holidays here in malaysia. any catchas that i should be aware of?    12:28
joelio    jyluke: If you need any help getting it going, ping me on #opennebula    12:29
rturk    Tamil: Okay - we're running at capacity now but you should be there    12:29
jyluke    thanks joelio    12:29
Tamil    rturk: oh ok thanks    12:30
joelio    not really, but there are subtle differences depending on your implementation. Most of the gotchas have been cought, the difficult ones to capture are distro and version nuances    12:30
joelio    (in terms of gotas I mean!)    12:30
scuttlemonkey    Tamil: when we start I'm guessing a couple of these guys will switch to consume rather than be on the broadcast    12:30
*** houkouonchi_work has joined #ceph-summit    12:31
*** fooz has left #ceph-summit    12:31
joelio    there's definitely room for improvement in the model, currently just supports one pool. I've not tested multiple datastores of ceph type yet though, but I seem to recall there being some niggles    12:32
jyluke    joelio: thanks for the advice, we will try some of the ideas out and let you know, our team is definately interested in different pools, sort of having a premium pool with premium disks for premium users and so on    12:35
loicd    leseb: the discussion i refer to http://www.mail-archive.com/ceph-devel@vger.kernel.org/msg15479.html    12:35
loicd    regarding LFS & rgw    12:35
leseb    loicd: thanks :)    12:35
wido    https://wiki.ubuntu.com/ServerTeam/CloudArchive    12:36
ircolle1    wido - how's your Japanese? Ceph on Cloudstack getting a lot of buzz in Japan lately.    12:36
mikedawson    wido: I am using qemu 1.52 and libvirt 1.0.6    12:37
rturk    ** Session “Teuthology” starting now! || pad: http://bit.ly/191jGYa    12:37
rturk    ** Please tell rturk or scuttlemonkey if you want to join the hangout    12:37
*** dpippenger has quit IRC    12:37
wido    ircolle1: pretty bad, as in: none    12:38
wido    mikedawson: Ah, cool. From the Ubuntu archive?    12:38
joshd    joelio: jyluke: since grizzly you can have multiple volume backends and different volume types, which could use different rbd pools    12:39
mikedawson    wido: no, we're on Raring, so we installed via ppa:jacob/virtualisation    12:39
sjustlaptop    I can drop if we need another slot    12:39
wido    mikedawson: Ah, ok. I try to stick with Precise    12:39
wido    backport the raring kernel and use the Cloud Archive repo    12:39
jyluke    joshd: can i assume to use havana now?    12:40
jyluke    joshd: i am on stock precise    12:40
*** sjustlaptop has quit IRC    12:41
joshd    jyluke: yes, it'll work in havana too. basically each backend has its own section in cinder.conf - leseb has a nice blog about it http://www.sebastien-han.fr/blog/2013/04/25/ceph-and-cinder-multi-backend/    12:41
*** sjustlaptop has joined #ceph-summit    12:42
*** dpippenger has joined #ceph-summit    12:42
jyluke    joshd: thanks.    12:46
nhm    I came into the teuthology conversation late... SLURM!    12:46
* nhm runs    12:46
scuttlemonkey    nhm: http://goo.gl/l8n5EW    12:48
yehudasa    sagewk: you'll still want to have priorities, even as a single user, e.g., if you have tests running continuously and you want to get a single test running immediately    12:48
nhm    scuttlemonkey: close! https://computing.llnl.gov/linux/slurm/    12:48
scuttlemonkey    hah    12:49
scuttlemonkey    I like mine better :P    12:49
nhm    scuttlemonkey: indeed    12:49
nhm    Whatever we do with teuthology, the simpler the better.  I spend too much time right now trying to debug why something is broken. :(    12:51
alfredodeza    I would really like it to be a web service    12:52
alfredodeza    with an optional CLI that can talk to the HTTP API    12:52
alfredodeza    best of both worlds    12:53
alfredodeza    but, no ssh-keys, no '~/.teuthology' etc...    12:53
nhm    alfredodeza: So long as it's not SOAP I might be willing to get on board. ;)    12:53
alfredodeza    SOAP!    12:53
* alfredodeza runs    12:53
nhm    alfredodeza: I actually really like pdsh for this kind of thing    12:53
nhm    alfredodeza: I had a really really bad experience with folks that were very into semantic web interfaces and soured on the whole thing.    12:54
alfredodeza    better visibility, history of previous runs, see what machines are available/unavailable, etc...    12:54
*** leseb has quit IRC    12:54
*** leseb has joined #ceph-summit    12:55
alfredodeza    nhm: I see it as a couple of things: one is an API where you can interact with it (for tools like a CLI) and as a UI to interact with it through the web    12:55
alfredodeza    nhm: we should chat :)    12:56
nhm    alfredodeza: definitely has some advantages, especially if it can be done right.    12:56
alfredodeza    getting it right sounds to me like an iterative process :D    12:57
nhm    alfredodeza: That's usually the better way to go!    12:57
*** sjustlaptop has quit IRC    12:57
alfredodeza    e.g. "here is v0.0.1, try it out and give me some feedback to get 0.0.2 out immediately"    12:57
dmick    date quickly, marry slow :)    12:57
alfredodeza    lol    12:58
*** jyluke has quit IRC    12:58
*** sjustlaptop has joined #ceph-summit    12:58
nhm    alfredodeza: here's what I use for a lot of my testing now.  It's not really designed great (I tend to way overuse singletons), but it's easy and mostly doesn't break. :) https://computing.llnl.gov/linux/slurm/    12:58
nhm    doh, wrong url    12:58
nhm    https://github.com/ceph/ceph-tools/tree/master/cbt    12:58
nhm    alfredodeza: heart of it is the pdsh wrapper in common.py    12:59
* alfredodeza looks    12:59
loicd    :-)    12:59
alfredodeza    very nice    13:00
nhm    alfredodeza: was very much geared for low external dependencies and easy cluster creation.  With ceph-deploy a lot of this is probably obsolete or becoming obsolete.    13:00
alfredodeza    sure    13:00
alfredodeza    but the fact that this exists asserts we could totally leverage an HTTP service    13:00
*** dstroppa has left #ceph-summit    13:00
nhm    alfredodeza: so part of my job at some point will be to move some of this into teuthology in a sane way.    13:01
rturk    Great summit, everyone!!!    13:02
ircolle1    some point…soon    13:02
loicd    thanks everyone, great summit :-)    13:03
rturk    Let    13:03
loicd    's    13:03
rturk    Let's do this again in three months, k?    13:03
nhm    ircolle1: :)    13:03
loicd    :-D    13:03
loicd    +1    13:03
scuttlemonkey    second verse, same as the first!    13:03
rturk    did the two-day format work?    13:03
loicd    yes    13:03
scuttlemonkey    rturk: might be useful to send out a survey link    13:03
rturk    scuttlemonkey: yeah    13:03
scuttlemonkey    complete with cheese at the end    13:04
rturk    my thoughts exactly    13:04
dmick    \o/    13:04
rturk    survey form -> t-shirt    13:04
scuttlemonkey    ok, time to grab some food    13:04
rturk    enjoy    13:04
scuttlemonkey    thanks again everyone, another wicked-product summit    13:04
rturk    I'm going to go lie down    13:04
rturk    <- still sick    13:04
* loicd likes t-shirts, still wearing oscon t-shirts ;-)    13:04
*** sjustlaptop has quit IRC    13:06
*** rturk is now known as rturk-away    13:06
*** dmick has left #ceph-summit    13:14
*** joshd has left #ceph-summit    13:19
*** dosaboy has joined #ceph-summit    13:21
*** dalgaaf has quit IRC    13:26
*** dosaboy_ has quit IRC    13:27
*** buck has left #ceph-summit    13:30
*** davidzlap has left #ceph-summit    13:37
*** davidzlap has quit IRC    13:37
*** Vincent_Valentine has quit IRC    13:38
*** nhm has left #ceph-summit    13:51
*** ircolle1 has quit IRC    14:02
*** mikedawson has left #ceph-summit    14:06
*** dpippenger has quit IRC    14:19
*** ircolle has joined #ceph-summit    14:24
*** dosaboy_ has joined #ceph-summit    14:27
*** dosaboy has quit IRC    14:32
*** loicd has quit IRC    14:42
*** loicd has joined #ceph-summit    14:43
*** dpippenger has joined #ceph-summit    14:52
*** sjust has left #ceph-summit    14:54
*** dosaboy_ has quit IRC    14:56
*** dosaboy has joined #ceph-summit    15:04
*** ircolle has left #ceph-summit    15:09
*** nwl has left #ceph-summit    15:36
*** nwat has joined #ceph-summit    15:56
*** scuttlemonkey has quit IRC    16:26
*** nwat has quit IRC    16:33
*** zhu_ has quit IRC    16:48
*** haomaiwa_ has quit IRC    16:48
*** Tamil has left #ceph-summit    16:53
*** houkouonchi_work has quit IRC    17:04
*** dosaboy_ has joined #ceph-summit    17:22
*** dosaboy has quit IRC    17:23
*** alfredodeza has quit IRC    18:06
*** alram has quit IRC    18:09
*** joao has quit IRC    18:50
*** dpippenger has quit IRC    19:25
*** dosaboy has joined #ceph-summit    20:43
*** dosaboy_ has quit IRC    20:50
*** haomaiwang has joined #ceph-summit    21:42
*** rongze has joined #ceph-summit    23:40