Ceph

04/20/2017

03:13 AM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

Complete output from a ~2 hours massif run attached.
The top allocation groups are all the same, with similar rati... Gabriel Wicke

12:51 AM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

Same with hopefully better formatting:... Gabriel Wicke

12:50 AM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

I did a bit more testing with valgrind. While memcheck didn't yield anything consistent, a massif run over ~30 minute... Gabriel Wicke

04/17/2017

09:52 PM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

It looks like the dynamic log level change didn't work the previous time, so here are actual level 20 log snippets. Gabriel Wicke

09:17 PM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

Some more detail on the test:
swift-bench.conf:
[bench]
auth = http://ceph2-1/auth/v1.0
user = benchmark:swift
k... Gabriel Wicke

07:36 PM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

To rule out libcurl issues I upgraded to 7.52.1-4 from Debian sid. This did not resolve the issue.
The vast majori... Gabriel Wicke

04/15/2017

05:42 PM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

Here are the last 10k ERROR|WARN lines of the rgw log on one of the nodes. Gabriel Wicke

05:35 PM rgw Bug #19446: rgw: heavy memory leak when multisite sync fail on 10.2.6

I am seeing a leak with active-active multi site operation on 10.2.7 as well, and some of the log entries match the o... Gabriel Wicke

03/24/2017

06:10 PM rgw Bug #19375 (New): Let user control precedence in eventually consistent master-master setup

Conflicting updates in an asynchronously replicated master-master setup are currently resolved using the internal mti... Gabriel Wicke