General

Profile

Yehuda Sadeh's activity

From 05/25/2017 to 06/23/2017

06/23/2017

05:20 PM Ceph Revision 90b5efa1 (ceph): Merge pull request #15665 from oritwas/wip-rgw-reshard-old-bucket
rgw: auto reshard old buckets
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh

06/22/2017

06:36 PM rgw Bug #20339: rgw stops serving requests after receiving SIGHUP
I vaguely remember seeing something similar, maybe this:
http://tracker.ceph.com/issues/19834
Yehuda Sadeh

06/20/2017

07:45 PM rgw Bug #19604 (Pending Backport): rgw: Part's index is not removed when versioning enabled
Yehuda Sadeh
07:44 PM Ceph Revision 8c85f846 (ceph): Merge pull request #14500 from zhangsw/fix-rgw-multipart-index-bug
rgw: fix the bug that part's index can't be removed after completing multipart upload
Reviewed-by: Yehuda Sadeh <yeh...
Yehuda Sadeh
06:02 PM Ceph Revision 9fe46d04 (ceph): Merge pull request #15782 from cbodley/wip-rgw-vstart-s3tests
vstart: add rgw configuration needed to pass all s3tests
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh

06/19/2017

09:41 PM Ceph Revision ab78cd04 (ceph): rgw: fix crash when listing objects via swift
Fixes: http://tracker.ceph.com/issues/19249
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from comm...
Yehuda Sadeh
05:17 PM Ceph Revision 8c67dd10 (ceph): rgw: change default chunk size to 4MB
Fixes: http://tracker.ceph.com/issues/18621
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from comm...
Yehuda Sadeh
05:17 PM Ceph Revision f2e39fec (ceph): rgw: configurable write obj window size
Fixes: http://tracker.ceph.com/issues/18623
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from comm...
Yehuda Sadeh
05:17 PM Ceph Revision 96c8161a (ceph): rgw: assume obj write is a first write
if fails and object already exists then retry. This improves first obj
write performance on the expense of overwrites...
Yehuda Sadeh
05:17 PM Ceph Revision 5f4c38fa (ceph): rgw: don't update bucket index multiple times in overwrite
Instead of this for overwrites:
prepare (index),
write (head) [-EEXIST]
cancel (index)
read (head)
prepare (in...
Yehuda Sadeh

06/16/2017

07:03 PM Ceph Revision aa973688 (ceph): Merge pull request #15711 from cbodley/wip-rgw-swift-default-auth-error
rgw: fix swift default auth error after auth strategy refactoring
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
06:07 PM rgw Bug #20234: rgw: shadow objects are sometimes not removed
I think the way to go would be to add a new attr that would not change, and hold the 'tail tag'. We can either always... Yehuda Sadeh

06/13/2017

06:23 PM Ceph Revision 2c4fb020 (ceph): cls/refcount: store and use list of retired tags
Fixes: http://tracker.ceph.com/issues/20107
Keep around the list of retired tags, make sure we don't
drop a refcount...
Yehuda Sadeh
06:22 PM rgw Bug #20107: rgw: Truncated objects
See a potential fix here:
https://github.com/ceph/ceph/pull/15673
Yehuda Sadeh
05:47 PM rgw Bug #20107: rgw: Truncated objects
actually, I take this backward compatibility claim back a bit. Looking at the code again, I think this is how it was ... Yehuda Sadeh
05:27 PM rgw Bug #20107: rgw: Truncated objects
Yeah, your analysis seems right. I think the big issue here is that we don't set a tag on the first write, but rather... Yehuda Sadeh

06/12/2017

08:07 PM Ceph Revision 7ad2ae27 (ceph): Merge pull request #15426 from zhangsw/fix-rgw-gc-loglevel
rgw: lower some log's level in gc process.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yehuda Sadeh
06:53 PM rgw Backport #19786 (Resolved): jewel: ceph jewel failed create s3 tpye subuser from admin rest api
Yehuda Sadeh
06:52 PM rgw Bug #11239 (Resolved): civetweb defaults to libssl.so and libcrypto.so when versions not passed
Yehuda Sadeh
05:17 PM rgw Bug #17888 (Resolved): rgw:fix for deleting objects name beginning and ending with underscores of...
Yehuda Sadeh

06/09/2017

10:16 PM Ceph Revision 10a22815 (ceph): Merge pull request #12851 from zhangsw/fix-rgw-bucketcheck-bug
rgw: bucket index check in radosgw-admin removes valid index.
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh

06/08/2017

06:38 PM rgw Bug #18437: error log's error code is not right in data sync
The error code there should probably be changed to signed int. Should be trivial to fix. Yehuda Sadeh
06:34 PM rgw Bug #20128 (Resolved): rgw: teuthology failure in the rgw task (configured via rgw_snaps.yaml)
Yehuda Sadeh
06:33 PM rgw Bug #20166: RGW: Bad error handling when tail object is missing
Do you have any proposed change? Yehuda Sadeh
06:27 PM rgw Bug #20190 (Pending Backport): "datalog trim" can't work as expected
Yehuda Sadeh
06:26 PM Ceph Revision 2076175e (ceph): Merge pull request #15507 from zhangsw/fix-rgw-logtrim-bug
rgw: datalog trim and mdlog trim handles the result returned by osd incorrectly.
Reviewed-by: Casey Bodley <cbodley@...
Yehuda Sadeh
06:23 PM rgw Bug #20205: rgw: s3 api, need to return error NoSuchVersion when object does not exist and versio...
https://github.com/ceph/ceph/pull/15528 Yehuda Sadeh
06:23 PM rgw Bug #20206: rgw: delete null versioned object doesn't return x-amz-version-id http header
https://github.com/ceph/ceph/pull/15528 Yehuda Sadeh
06:21 PM rgw Bug #20107: rgw: Truncated objects
The bug I mentioned was dealing with copying objects that resided on different pools. Do you have a scenario where th... Yehuda Sadeh
06:15 PM rgw Bug #20107: rgw: Truncated objects
A copy operation should increase the tail's refcount. The garbage collection will try to remove it by dropping the re... Yehuda Sadeh
06:06 PM rgw Bug #20210: rgw: fix input/output err when using radosgw-admin bi list
Does that still happen, even after: https://github.com/ceph/ceph/pull/14981 ? Yehuda Sadeh
06:03 PM rgw Bug #20211: rgw: bucket index not syncing when rados cluster abnormally
I don't understand what step (4) is. What do you mean fail bucket index add op. Yehuda Sadeh
05:56 PM rgw Bug #18596: rgw: object owner should not be able to download the obj without container permission...
Not quite. There are a set of permissions that will do that, however, if these permissions are not set then users wil... Yehuda Sadeh

06/07/2017

12:18 AM Ceph Revision 7bd8773f (ceph): Merge pull request #14117 from zhangsw/fix-rgw-getobjectmetadata-bug
rgw: return the version id in get object and object metadata request.
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh

06/06/2017

10:29 PM rgw Bug #20206 (New): rgw: delete null versioned object doesn't return x-amz-version-id http header
Yehuda Sadeh
09:27 PM rgw Bug #20205 (New): rgw: s3 api, need to return error NoSuchVersion when object does not exist and ...
Yehuda Sadeh
08:27 PM Ceph Revision 6b30d660 (ceph): rgw: verify md5 in post obj
Fixes: http://tracker.ceph.com/issues/19739
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
06:36 PM rgw Bug #17964: rgw: multipart parts on versioned bucket create versioned bucket index entries
https://github.com/ceph/ceph/pull/14500 Yehuda Sadeh
06:34 PM rgw Bug #16355 (In Progress): radosgw-admin command, adding the tenants can not view the user usage
Yehuda Sadeh
06:28 PM rgw Bug #19219 (Resolved): Data sync problem in multisite
Yehuda Sadeh
06:24 PM rgw Bug #19285: rgw: user quota did not work well on multipart upload
Yehuda Sadeh
05:57 PM rgw Bug #19870: rgw: bytes_send and bytes_recv in the msg of usage show returning is 0 in master branch
while we're at it, we need to make sure that there's sufficient teuthology coverage for this issue. I think we do tes... Yehuda Sadeh
12:10 AM Ceph Revision ef65defe (ceph): Merge pull request #15493 from yehudasa/wip-rgw-dynamic-sharding
rgw: dynamic resharding
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Yehuda Sadeh

06/05/2017

10:01 PM Ceph Revision 014a4d07 (ceph): cls/rgw: add missing members initialization
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:18 PM Ceph Revision 13f2f36e (ceph): test/cli/radosgw-admin: update reference help.t
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:18 PM Ceph Revision 93b8e834 (ceph): rgw: fix a race
We referred to complete_op_data after aio call that could have released
it.
Signed-off-by: Yehuda Sadeh <yehuda@redh...
Yehuda Sadeh
08:18 PM Ceph Revision ba1138d7 (ceph): rgw: new num shards proportional to number of objects per shard
and also limit number of shards to not exceed the max.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:18 PM Ceph Revision 93106dac (ceph): rgw: increase max shard prime, consolidate logic
Handle larger num of shards (max ~64k now). Use the same hash logic for shard ids
everywhere.
Signed-off-by: Yehuda ...
Yehuda Sadeh
08:18 PM Ceph Revision b2a6f0e3 (ceph): rgw: fix index completion
Was missing bucket complete op, only had the guard (bad merge?).
Pass zones_trace as pointer and treat it as optional...
Yehuda Sadeh
08:18 PM Ceph Revision 2417c2c0 (ceph): rgw: ignore -ENOENT on bi_list()
just treat it as success with empty result
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:18 PM Ceph Revision ef48cc41 (ceph): rgw: remove debug helper code
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:18 PM Ceph Revision 3b7fd0ff (ceph): rgw: handle zones_trace in bi async completion handler
needed following a rebase
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:18 PM Ceph Revision f2b0eb08 (ceph): rgw: replace reshard blocking sleep with interruptible condition wait
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 40faa8d9 (ceph): radosgw-admin: reshard execute output adjustments
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 07b21866 (ceph): rgw: update bucket instance with resharding details
can be useful info for later in a cross zone sync
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision c6dc81cf (ceph): rgw-admin: radosgw-admin reshard execute -> reshard process
to be in line with other radosgw-admin commands.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision 7054308e (ceph): cls/rgw: fix reshard_list truncation identification
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 1da369e1 (ceph): rgw: reshard: renew lease and handle marker when listing reshard repo
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision aa3f71d6 (ceph): cls/rgw: remove unused field in reshard entry
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 81693efd (ceph): rgw: remove unneeded and duplicate code
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 6cb30f9c (ceph): cls/rgw: expose api to generate reshard indexing key
So that we could use it as a marker when doing reshard_list.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision 485a11fe (ceph): rgw-admin: revive reshard execute command
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 6c540bd5 (ceph): rgw: initialize bucket structure
after reading bucket info
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision ed72675b (ceph): rgw: bucket_id does not include bucket name
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 436f151e (ceph): cls/rgw: reshard add command doesn't read existing status
No need to read existing status.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision 999cca4e (ceph): rgw: internal api cleanup
rename method, minor change
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision b516c92a (ceph): rgw: bi_list() initialize is_truncated if -ENOENT
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 8e1bf1b9 (ceph): rgw: multiple fixes and adjustments related to resharding scheduler
still wip, but:
- get rid of some unneeded rados locking
- rename shards to logshards where relevant to avoid confu...
Yehuda Sadeh
08:17 PM Ceph Revision f677d0e9 (ceph): cls/rgw: modify logshard key
The logshard key shouldn't include bucket id.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision 2da8dc5d (ceph): cls/rgw: fix remove_reshard objclass op
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision cac047a8 (ceph): rgw: replace reshard blocking sleep with interruptible condition wait
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision b757e7e1 (ceph): rgw: fix compilation following rebase
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 42b3ee12 (ceph): rgw: fix deletion of index completion object
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 806d4732 (ceph): rgw: store new num shards in bucket index reshard entry
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 60778b02 (ceph): rgw: update data log after index completion reshard handling
Also rearrange code a bit.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision da1f5bc9 (ceph): rgw: clean up index completions on shutdown
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 94e3c380 (ceph): rgw: reshard complete handling, use multiple locks
to reduce contention. Also, fix completions cleanup.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision 9677f7d3 (ceph): cls/rgw: changes to support reshard guard on olh bi ops
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision e18e2714 (ceph): rgw: reshard guard for versioned operations
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 245cd0f9 (ceph): rgw: guard resharding in async completions
Catch return value from async index completions, resend operations
synchronously on a separate worker thread if neede...
Yehuda Sadeh
08:17 PM Ceph Revision d250fab2 (ceph): rgw: fix update_bucket_id, reshard blocking logic
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 8fd589d1 (ceph): rgw: handle reshard wait logic in cancel() too
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision e4d4aa8b (ceph): rgw: a few fixes
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 09ccfebf (ceph): rgw: more detailed resharding status kept in bucket header
So that we can differentiate between in-progress and complete status.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision 9766f5b9 (ceph): rgw_admin: add rgw-admin reshard status command and initial blocking logic
A command that returns the reshard status field on the bucket index objects (all
shards).
Also, initial implementatio...
Yehuda Sadeh
08:17 PM Ceph Revision 7a34a049 (ceph): rgw: split per-bucket resharding logic out from general resharding
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision bb0cb4d7 (ceph): rgw: move resharding code to BucketReshard class
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 660a5126 (ceph): rgw: mark source bucket shards when starting reshard
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 7d44601e (ceph): cls/rgw: create an objclass method to guard in-progress resharding
This method will be called on the bucket index shard.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:17 PM Ceph Revision 0bc15671 (ceph): rgw: revert some reshard blocking logic
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 04cf0ca0 (ceph): cls/rgw: minor changes
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision a07e8eb6 (ceph): cls/rgw: adjust types and ops
- don't keep data bufferlist in struct cls_rgw_bucket_instance_entry
- remove rgw_get_bucket_instance
We need to ke...
Yehuda Sadeh
08:17 PM Ceph Revision f446b80e (ceph): cls/rgw: return default header if not initialized
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 44e46b35 (ceph): cls/rgw: generate_reshard_key, change output param
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh

06/02/2017

04:16 PM Ceph Revision ea911b7f (ceph): Merge pull request #14351 from yehudasa/wip-rgw-mdsearch
rgw: metadata search part 2
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishe...
Yehuda Sadeh

06/01/2017

08:32 PM Ceph Revision 6594d972 (ceph): qa/tasks/rgw_multisite.py: adjust zone init
zone is now a ZoneConn object. Also, change import to make it relative
so that qa task can locate it.
Signed-off-by:...
Yehuda Sadeh
12:14 AM Ceph Revision 1cb7f4aa (ceph): qa/rgw_snaps: move default_idle_timeout config under the client
Fixes: http://tracker.ceph.com/issues/20128
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
12:12 AM rgw Bug #20128: rgw: teuthology failure in the rgw task (configured via rgw_snaps.yaml)
this might solve it:
https://github.com/ceph/ceph/pull/15400
Yehuda Sadeh
12:08 AM rgw Bug #20128 (Resolved): rgw: teuthology failure in the rgw task (configured via rgw_snaps.yaml)
See the failure here: http://pulpito.ceph.com/sage-2017-05-31_18:45:30-rados-wip-sage-testing---basic-smithi/1248627
...
Yehuda Sadeh

05/31/2017

10:01 PM Ceph Revision 4aea15fe (ceph): rgw: fix import
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh

05/30/2017

08:27 PM Ceph Revision 8519dc46 (ceph): test/rgw: drop use of urllib
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:27 PM Ceph Revision dd836161 (ceph): rgw: es: fix system user check
check was inverted
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:27 PM Ceph Revision c3422bd2 (ceph): rgw: minor fixes following review
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:27 PM Ceph Revision 0a836bab (ceph): rgw: check init_sync return code
fix following review
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:27 PM Ceph Revision 8f020cc5 (ceph): rgw: get_rest_filter() delete original rest manager
When overriding rest manager, delete original.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:26 PM Ceph Revision 0b203537 (ceph): test/rgw/test_multi: cleanup
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 49f92f7d (ceph): test_multi: don't pass array as default param to constructor
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 16e07f04 (ceph): rgw: system users override elasticsearch permission filter
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision ea902d18 (ceph): rgw: package radosgw-es
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision c9e2aff8 (ceph): test_multi: realm checkpoint after init
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 7e4e7432 (ceph): rgw: use RGW_AMZ_META_PREFIX
instead of defining X_AMZ_META_PREFIX
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:26 PM Ceph Revision 3a81d095 (ceph): rgw: adjust log levels
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision a42aad05 (ceph): rgw: minor cleanup
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 131f6a3c (ceph): rgw/test_multi: add tests for different key types
add int and date tests
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:26 PM Ceph Revision c13ec1c4 (ceph): rgw: don't send raw date header to elasticsearch
parse the header, and encode it in the json doc using
a format that ES can understand. Skip header if fails to
parse....
Yehuda Sadeh
08:26 PM Ceph Revision d2309153 (ceph): rgw/test-multi: test more complicated queries
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision cd3fb793 (ceph): rgw/test_multi: add test_es_bucket_conf test
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 366ffd58 (ceph): test/rgw/test_multi: differentiate between zone and zone connection
Instead of having a Zone type used for the connection, create a new
ZoneConn type that represents the connection. Thi...
Yehuda Sadeh
08:26 PM Ceph Revision bbc5d486 (ceph): test/rgw/test_multi: initial es functional tests
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 7d3be066 (ceph): rgw/test_multi/es: extend test
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision f5037624 (ceph): rgw/test_multi: zone_conn can hold more than one bucket per zone
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 024d98cf (ceph): rgw: es: index and return versioned epoch
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision ba0626f2 (ceph): rgw/test_multi: add support for elasticsearch testing
Add support for different zone types, and create an elasticsearch
zone type that deals with es testing.
Signed-off-b...
Yehuda Sadeh
08:26 PM Ceph Revision a680aa11 (ceph): rgw: es: use "null" as instance in case key.instance is empty
when indexing objects. We can get either.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:26 PM Ceph Revision de9d2cb4 (ceph): rgw-admin: zone create handles --tier-config
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 1ca77abe (ceph): rgw: don't pass sync module to rest filter in creation
sync module instance might change due to reconfiguration. Pass it into the
handler when executing op.
Signed-off-by:...
Yehuda Sadeh
08:26 PM Ceph Revision 6d3cc4b1 (ceph): rgw: move data sync instance_id initialization to caller
so that caller can easily know the instance id.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:26 PM Ceph Revision 8bfe1379 (ceph): rgw: es: configurable number of replicas and shards
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 3f409381 (ceph): rgw: add missing custom meta map initialization
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 4a91a542 (ceph): rgw: fix time format that is sent to elasticsearch
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 2c9a7bc9 (ceph): rgw: es: generic keys are not case sensitive
make map case insensitive, and explicitly define all generic keys
so that they can be forced to be lower case.
Signe...
Yehuda Sadeh
08:26 PM Ceph Revision 151a6eba (ceph): rgw: es: configurable list of buckets and owners to index
and a tier configuration that allows to select both list of buckets
and list of bucket owners (if both configured the...
Yehuda Sadeh
08:26 PM Ceph Revision f5b158fc (ceph): rgw: es: elasticsearch index path unique per sync instance
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision fbae80ba (ceph): rgw: es: add a configurable to override index path
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:26 PM Ceph Revision 85310f0e (ceph): rgw: add "explicit_custom_meta" configurable to es sync module
Modify all the map<string, string> that is used to pass in module config
to map<string, string, ltstr> so that it can...
Yehuda Sadeh
08:26 PM Ceph Revision b02d6162 (ceph): rgw: create helper for configurable item selection
with optional prefix and suffix.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 874223b2 (ceph): rgw: es: handle get config api in es zone
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision f1e681bf (ceph): common/ceph_json: map type can handle 2 or 3 template arguments
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 6d5555ac (ceph): rgw: expose conf_get(), conf_get_int(), conf_get_bool()
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision e4e6e1e5 (ceph): rgw: es: limit indexing to only configured user meta
only metadata keys that are configured on user's bucket are allowed
to be indexed. Also, use the type of meta that wa...
Yehuda Sadeh
08:24 PM Ceph Revision 7b61c992 (ceph): rgw: es: also return custom int and date results
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision acba9161 (ceph): rgw: es: api to retrieve bucket mdsearch config
GET /bucket?mdsearch
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 603863a4 (ceph): rgw: es: api to delete bucket mdsearch config
DELETE /bucket?mdsearch
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 484fd2b8 (ceph): rgw: support field aliases in es compiler
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision de5bd34e (ceph): rgw: add dout defs
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 3f62f17f (ceph): rgw: guard restricted fields in es query
don't allow users to use the 'permissions' field.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 8249f76b (ceph): rgw: new api to configure bucket's custom keys for mdsearch
POST /bucket?mdsearch
x-rgw-meta-search: <x-amz-meta-key>[;<str|int|date>][,...]
note that x-amz-meta-search header ...
Yehuda Sadeh
08:24 PM Ceph Revision 1e886475 (ceph): rgw: metadata search pagination
Leveraging elasticsearch "size" and "from" for doing pagination. This
is not optimal, but sadly it's currently the wa...
Yehuda Sadeh
08:24 PM Ceph Revision d026a23d (ceph): rgw: initial support for multiple types in es requests
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 42746ac9 (ceph): rgw: support for generic entities types in es
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 21ee7c11 (ceph): rgw: support more meaningful compilation error string
in es module
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 698763fb (ceph): rgw: extend interfaces to allow sending data
when retrieving REST resource
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 86fe1223 (ceph): rgw: send request to elasticsearch and parse response
and send back response to user
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 0180650d (ceph): rgw: also dump custom meta entries
when doing metadata search
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 99b49acc (ceph): rgw: add permissions and bucket to es query
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision c9d68822 (ceph): rgw: rename a few methods
just rename calls
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 9f494ff4 (ceph): rgw: make key param in RGWRESTStreamRWRequest::send_request() optional
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 952e72d9 (ceph): rgw: can send data in RGWRESTStreamRWRequest::send_request()
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision b6fe05d9 (ceph): rgw: move code around
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision bb46f19e (ceph): rgw: work on REST handler for es module
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision e515bf3b (ceph): rgw: meta search rest handler can access es module
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 6de586ca (ceph): rgw: handle nested fields in es queries
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 86ea4243 (ceph): rgw: move code into class
just cleaning up
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh
08:24 PM Ceph Revision 0fdd24ff (ceph): rgw: simplify es compile interface
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 42130df3 (ceph): rgw: rename rgw_rest_es.cc to rgw_es_query.cc
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:24 PM Ceph Revision 67bfdb45 (ceph): rgw: implement init_sync() callback in es module
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:18 PM Ceph Revision 6d4733c5 (ceph): rgw: add init callback to sync modules
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:18 PM Ceph Revision 49b27f4f (ceph): rgw: define es index mapping
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> Yehuda Sadeh
08:17 PM Ceph Revision 8fd55cc2 (ceph): rgw: initial implementation of mdsearch query compiler
convert infix queries that look as follows:
[(]<name> <operator> <value> [)] [<and|or> ...]
into a prefix structure...
Yehuda Sadeh
08:09 PM Ceph Revision 760c5e4f (ceph): Merge pull request #15184 from cbodley/wip-qa-rgw-cleanup
qa/rgw: remove apache/fastcgi and radosgw-agent tests
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh

05/26/2017

01:44 PM Ceph Revision aa995589 (ceph): rgw: rest conn functions cleanup, only append zonegroup if not empty
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 4e41af19846db75081cb0ddb7b33dc2bb9321ace)
Yehuda Sadeh
 

Also available in: Atom