-1F - Enforced bucket-level quotas in RGW¶
*** mtk has left #ceph-summit1 11:16
scuttlemonkey wido/gregaf: one of you guys want to take over sage's notetaking duties for this session? 11:16
wido I have to go afk in a moment 11:16
scuttlemonkey k 11:17
liwang hi 11:17
wido sorry 11:17
scuttlemonkey li! 11:17
paravoid wido: don't get me wrong on the varnish-specific stuff 11:17
scuttlemonkey so great you could make it 11:17
paravoid wido: I love Varnish and we heavily use it 11:17
wido paravoid: No problem :) 11:17
paravoid wido: I just don't think the two layers should be intermixed 11:17
liwang yes 11:17
wido No, they shouldn't indeed. I just wanted to point out the caching issues 11:17
liwang does the invitation sent 11:18
wido I want to have a "hook" to tell the cache to purge object X 11:18
scuttlemonkey liwang: in approximately 42 minutes we'll have a break and I'll make sure you get added to the speakers 11:18
wido And don't do the caching in RGW, since Varnish is much better in HTTP caching 11:18
paravoid sure, that's not a bad idea 11:18
paravoid you could invalidate with VCL too 11:18
paravoid catch PUT/POST and call out to purge (what was previously set obj.ttl=0s) 11:19
liwang i mean for the bucket-level quota session 11:19
paravoid thinking Swift here, not sure about S3 11:19
wido paravoid: True, but if you have multiple Varnish caches, you still get cache inconsistency 11:19
scuttlemonkey liwang: you want to join as a speaker? Or just as an observer? 11:19
wido It will only purge locally 11:19
paravoid indeed 11:20
scuttlemonkey youtube stream is at: http://youtu.be/rbVFozB9qls 11:20
wido I'm thinking about having 10 Varnish caches 11:20
liwang I registered as interested party for this session 11:20
paravoid we have layered varnishes with consistent hashing among them 11:20
scuttlemonkey ahhh! 11:20
paravoid if you don't do that, then you cache the same URLs multiple times 11:20
wido paravoid: True, you can do very cool stuff with Varnish that way 11:20
paravoid it's better to shard your cache 11:20
wido So you have multiple layers of Varnish servers? 11:21
scuttlemonkey liwang: url sent via private message in irc 11:21
*** paravoid_ has joined #ceph-summit1 11:26
*** paravoid is now known as Guest4609 11:27
*** paravoid_ is now known as paravoid 11:27
paravoid damn 11:27
paravoid what did I miss? 11:27
paravoid 21:21 < wido> So you have multiple layers of Varnish servers? 11:27
paravoid wido: yes 11:27
Guest4609 yes 11:27
*** Guest4609 has quit IRC 11:27
wido paravoid: Ah, ok. I just tried to avoid that 11:28
wido So you have them all as each others backend 11:28
wido Would love to see that VCL :) 11:28
paravoid not a VCL 11:28
wido Inline C? 11:28
paravoid it's a custom director, for consistent hashing 11:28
wido Ah, that's cool 11:28
paravoid https://gerrit.wikimedia.org/r/gitweb?p=operations/debs/varnish.git;a=commit;h=885b7d65fb7d93d0b3caa3fbf59a90fc2fffbaff 11:30
paravoid anyway, this is getting offtopic 11:31
*** Elbandi_ has joined #ceph-summit1 11:32
sergey I think Google App Engine can do a "503 Over Quota" 11:36
*** ksp has left #ceph-summit1 11:36
wido paravoid: Aha! Indeed offtopic, but I met one of the Wikimedia people at a VUG in Amsterdam. Got inspired :) 11:39
*** Ryan_Lane has joined #ceph-summit1 11:39
paravoid that was Mark, the commiter of the above 11:39
mikedawson sagewk: what is considered a large size Teuthology ceph cluster? What is a long-running test? 11:40
sagewk mikedawson: other channel :) 11:40
scuttlemonkey ^^ (#ceph-summit2) 11:41
mikedawson what is considered a large size Teuthology ceph cluster? What is a long-running test? 11:41
mikedawson sorry 11:41
*** ccourtaut has quit IRC 11:49
scuttlemonkey new Track 1 video is live on the event page and can also be accessed here: http://youtu.be/OUxEk87RcnI 12:03