Yehuda Sadeh's activity
From 05/25/2017 to 06/23/2017
06/23/2017
- 05:20 PM Ceph Revision 90b5efa1 (ceph): Merge pull request #15665 from oritwas/wip-rgw-reshard-old-bucket
- rgw: auto reshard old buckets
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
06/22/2017
- 06:36 PM rgw Bug #20339: rgw stops serving requests after receiving SIGHUP
- I vaguely remember seeing something similar, maybe this:
http://tracker.ceph.com/issues/19834
06/20/2017
- 07:45 PM rgw Bug #19604 (Pending Backport): rgw: Part's index is not removed when versioning enabled
- 07:44 PM Ceph Revision 8c85f846 (ceph): Merge pull request #14500 from zhangsw/fix-rgw-multipart-index-bug
- rgw: fix the bug that part's index can't be removed after completing multipart upload
Reviewed-by: Yehuda Sadeh <yeh... - 06:02 PM Ceph Revision 9fe46d04 (ceph): Merge pull request #15782 from cbodley/wip-rgw-vstart-s3tests
- vstart: add rgw configuration needed to pass all s3tests
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
06/19/2017
- 09:41 PM Ceph Revision ab78cd04 (ceph): rgw: fix crash when listing objects via swift
- Fixes: http://tracker.ceph.com/issues/19249
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from comm... - 05:17 PM Ceph Revision 8c67dd10 (ceph): rgw: change default chunk size to 4MB
- Fixes: http://tracker.ceph.com/issues/18621
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from comm... - 05:17 PM Ceph Revision f2e39fec (ceph): rgw: configurable write obj window size
- Fixes: http://tracker.ceph.com/issues/18623
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from comm... - 05:17 PM Ceph Revision 96c8161a (ceph): rgw: assume obj write is a first write
- if fails and object already exists then retry. This improves first obj
write performance on the expense of overwrites... - 05:17 PM Ceph Revision 5f4c38fa (ceph): rgw: don't update bucket index multiple times in overwrite
- Instead of this for overwrites:
prepare (index),
write (head) [-EEXIST]
cancel (index)
read (head)
prepare (in...
06/16/2017
- 07:03 PM Ceph Revision aa973688 (ceph): Merge pull request #15711 from cbodley/wip-rgw-swift-default-auth-error
- rgw: fix swift default auth error after auth strategy refactoring
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com> - 06:07 PM rgw Bug #20234: rgw: shadow objects are sometimes not removed
- I think the way to go would be to add a new attr that would not change, and hold the 'tail tag'. We can either always...
06/13/2017
- 06:23 PM Ceph Revision 2c4fb020 (ceph): cls/refcount: store and use list of retired tags
- Fixes: http://tracker.ceph.com/issues/20107
Keep around the list of retired tags, make sure we don't
drop a refcount... - 06:22 PM rgw Bug #20107: rgw: Truncated objects
- See a potential fix here:
https://github.com/ceph/ceph/pull/15673 - 05:47 PM rgw Bug #20107: rgw: Truncated objects
- actually, I take this backward compatibility claim back a bit. Looking at the code again, I think this is how it was ...
- 05:27 PM rgw Bug #20107: rgw: Truncated objects
- Yeah, your analysis seems right. I think the big issue here is that we don't set a tag on the first write, but rather...
06/12/2017
- 08:07 PM Ceph Revision 7ad2ae27 (ceph): Merge pull request #15426 from zhangsw/fix-rgw-gc-loglevel
- rgw: lower some log's level in gc process.
Reviewed-by: Casey Bodley <cbodley@redhat.com> - 06:53 PM rgw Backport #19786 (Resolved): jewel: ceph jewel failed create s3 tpye subuser from admin rest api
- 06:52 PM rgw Bug #11239 (Resolved): civetweb defaults to libssl.so and libcrypto.so when versions not passed
- 05:17 PM rgw Bug #17888 (Resolved): rgw:fix for deleting objects name beginning and ending with underscores of...
06/09/2017
- 10:16 PM Ceph Revision 10a22815 (ceph): Merge pull request #12851 from zhangsw/fix-rgw-bucketcheck-bug
- rgw: bucket index check in radosgw-admin removes valid index.
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
06/08/2017
- 06:38 PM rgw Bug #18437: error log's error code is not right in data sync
- The error code there should probably be changed to signed int. Should be trivial to fix.
- 06:34 PM rgw Bug #20128 (Resolved): rgw: teuthology failure in the rgw task (configured via rgw_snaps.yaml)
- 06:33 PM rgw Bug #20166: RGW: Bad error handling when tail object is missing
- Do you have any proposed change?
- 06:27 PM rgw Bug #20190 (Pending Backport): "datalog trim" can't work as expected
- 06:26 PM Ceph Revision 2076175e (ceph): Merge pull request #15507 from zhangsw/fix-rgw-logtrim-bug
- rgw: datalog trim and mdlog trim handles the result returned by osd incorrectly.
Reviewed-by: Casey Bodley <cbodley@... - 06:23 PM rgw Bug #20205: rgw: s3 api, need to return error NoSuchVersion when object does not exist and versio...
- https://github.com/ceph/ceph/pull/15528
- 06:23 PM rgw Bug #20206: rgw: delete null versioned object doesn't return x-amz-version-id http header
- https://github.com/ceph/ceph/pull/15528
- 06:21 PM rgw Bug #20107: rgw: Truncated objects
- The bug I mentioned was dealing with copying objects that resided on different pools. Do you have a scenario where th...
- 06:15 PM rgw Bug #20107: rgw: Truncated objects
- A copy operation should increase the tail's refcount. The garbage collection will try to remove it by dropping the re...
- 06:06 PM rgw Bug #20210: rgw: fix input/output err when using radosgw-admin bi list
- Does that still happen, even after: https://github.com/ceph/ceph/pull/14981 ?
- 06:03 PM rgw Bug #20211: rgw: bucket index not syncing when rados cluster abnormally
- I don't understand what step (4) is. What do you mean fail bucket index add op.
- 05:56 PM rgw Bug #18596: rgw: object owner should not be able to download the obj without container permission...
- Not quite. There are a set of permissions that will do that, however, if these permissions are not set then users wil...
06/07/2017
- 12:18 AM Ceph Revision 7bd8773f (ceph): Merge pull request #14117 from zhangsw/fix-rgw-getobjectmetadata-bug
- rgw: return the version id in get object and object metadata request.
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
06/06/2017
- 10:29 PM rgw Bug #20206 (New): rgw: delete null versioned object doesn't return x-amz-version-id http header
- 09:27 PM rgw Bug #20205 (New): rgw: s3 api, need to return error NoSuchVersion when object does not exist and ...
- 08:27 PM Ceph Revision 6b30d660 (ceph): rgw: verify md5 in post obj
- Fixes: http://tracker.ceph.com/issues/19739
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 06:36 PM rgw Bug #17964: rgw: multipart parts on versioned bucket create versioned bucket index entries
- https://github.com/ceph/ceph/pull/14500
- 06:34 PM rgw Bug #16355 (In Progress): radosgw-admin command, adding the tenants can not view the user usage
- 06:28 PM rgw Bug #19219 (Resolved): Data sync problem in multisite
- 06:24 PM rgw Bug #19285: rgw: user quota did not work well on multipart upload
- 05:57 PM rgw Bug #19870: rgw: bytes_send and bytes_recv in the msg of usage show returning is 0 in master branch
- while we're at it, we need to make sure that there's sufficient teuthology coverage for this issue. I think we do tes...
- 12:10 AM Ceph Revision ef65defe (ceph): Merge pull request #15493 from yehudasa/wip-rgw-dynamic-sharding
- rgw: dynamic resharding
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
06/05/2017
- 10:01 PM Ceph Revision 014a4d07 (ceph): cls/rgw: add missing members initialization
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:18 PM Ceph Revision 13f2f36e (ceph): test/cli/radosgw-admin: update reference help.t
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:18 PM Ceph Revision 93b8e834 (ceph): rgw: fix a race
- We referred to complete_op_data after aio call that could have released
it.
Signed-off-by: Yehuda Sadeh <yehuda@redh... - 08:18 PM Ceph Revision ba1138d7 (ceph): rgw: new num shards proportional to number of objects per shard
- and also limit number of shards to not exceed the max.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:18 PM Ceph Revision 93106dac (ceph): rgw: increase max shard prime, consolidate logic
- Handle larger num of shards (max ~64k now). Use the same hash logic for shard ids
everywhere.
Signed-off-by: Yehuda ... - 08:18 PM Ceph Revision b2a6f0e3 (ceph): rgw: fix index completion
- Was missing bucket complete op, only had the guard (bad merge?).
Pass zones_trace as pointer and treat it as optional... - 08:18 PM Ceph Revision 2417c2c0 (ceph): rgw: ignore -ENOENT on bi_list()
- just treat it as success with empty result
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:18 PM Ceph Revision ef48cc41 (ceph): rgw: remove debug helper code
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:18 PM Ceph Revision 3b7fd0ff (ceph): rgw: handle zones_trace in bi async completion handler
- needed following a rebase
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:18 PM Ceph Revision f2b0eb08 (ceph): rgw: replace reshard blocking sleep with interruptible condition wait
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 40faa8d9 (ceph): radosgw-admin: reshard execute output adjustments
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 07b21866 (ceph): rgw: update bucket instance with resharding details
- can be useful info for later in a cross zone sync
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision c6dc81cf (ceph): rgw-admin: radosgw-admin reshard execute -> reshard process
- to be in line with other radosgw-admin commands.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision 7054308e (ceph): cls/rgw: fix reshard_list truncation identification
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 1da369e1 (ceph): rgw: reshard: renew lease and handle marker when listing reshard repo
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision aa3f71d6 (ceph): cls/rgw: remove unused field in reshard entry
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 81693efd (ceph): rgw: remove unneeded and duplicate code
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 6cb30f9c (ceph): cls/rgw: expose api to generate reshard indexing key
- So that we could use it as a marker when doing reshard_list.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision 485a11fe (ceph): rgw-admin: revive reshard execute command
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 6c540bd5 (ceph): rgw: initialize bucket structure
- after reading bucket info
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision ed72675b (ceph): rgw: bucket_id does not include bucket name
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 436f151e (ceph): cls/rgw: reshard add command doesn't read existing status
- No need to read existing status.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision 999cca4e (ceph): rgw: internal api cleanup
- rename method, minor change
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision b516c92a (ceph): rgw: bi_list() initialize is_truncated if -ENOENT
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 8e1bf1b9 (ceph): rgw: multiple fixes and adjustments related to resharding scheduler
- still wip, but:
- get rid of some unneeded rados locking
- rename shards to logshards where relevant to avoid confu... - 08:17 PM Ceph Revision f677d0e9 (ceph): cls/rgw: modify logshard key
- The logshard key shouldn't include bucket id.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision 2da8dc5d (ceph): cls/rgw: fix remove_reshard objclass op
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision cac047a8 (ceph): rgw: replace reshard blocking sleep with interruptible condition wait
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision b757e7e1 (ceph): rgw: fix compilation following rebase
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 42b3ee12 (ceph): rgw: fix deletion of index completion object
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 806d4732 (ceph): rgw: store new num shards in bucket index reshard entry
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 60778b02 (ceph): rgw: update data log after index completion reshard handling
- Also rearrange code a bit.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision da1f5bc9 (ceph): rgw: clean up index completions on shutdown
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 94e3c380 (ceph): rgw: reshard complete handling, use multiple locks
- to reduce contention. Also, fix completions cleanup.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision 9677f7d3 (ceph): cls/rgw: changes to support reshard guard on olh bi ops
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision e18e2714 (ceph): rgw: reshard guard for versioned operations
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 245cd0f9 (ceph): rgw: guard resharding in async completions
- Catch return value from async index completions, resend operations
synchronously on a separate worker thread if neede... - 08:17 PM Ceph Revision d250fab2 (ceph): rgw: fix update_bucket_id, reshard blocking logic
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 8fd589d1 (ceph): rgw: handle reshard wait logic in cancel() too
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision e4d4aa8b (ceph): rgw: a few fixes
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 09ccfebf (ceph): rgw: more detailed resharding status kept in bucket header
- So that we can differentiate between in-progress and complete status.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision 9766f5b9 (ceph): rgw_admin: add rgw-admin reshard status command and initial blocking logic
- A command that returns the reshard status field on the bucket index objects (all
shards).
Also, initial implementatio... - 08:17 PM Ceph Revision 7a34a049 (ceph): rgw: split per-bucket resharding logic out from general resharding
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision bb0cb4d7 (ceph): rgw: move resharding code to BucketReshard class
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 660a5126 (ceph): rgw: mark source bucket shards when starting reshard
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 7d44601e (ceph): cls/rgw: create an objclass method to guard in-progress resharding
- This method will be called on the bucket index shard.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:17 PM Ceph Revision 0bc15671 (ceph): rgw: revert some reshard blocking logic
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 04cf0ca0 (ceph): cls/rgw: minor changes
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision a07e8eb6 (ceph): cls/rgw: adjust types and ops
- - don't keep data bufferlist in struct cls_rgw_bucket_instance_entry
- remove rgw_get_bucket_instance
We need to ke... - 08:17 PM Ceph Revision f446b80e (ceph): cls/rgw: return default header if not initialized
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 44e46b35 (ceph): cls/rgw: generate_reshard_key, change output param
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
06/02/2017
- 04:16 PM Ceph Revision ea911b7f (ceph): Merge pull request #14351 from yehudasa/wip-rgw-mdsearch
- rgw: metadata search part 2
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishe...
06/01/2017
- 08:32 PM Ceph Revision 6594d972 (ceph): qa/tasks/rgw_multisite.py: adjust zone init
- zone is now a ZoneConn object. Also, change import to make it relative
so that qa task can locate it.
Signed-off-by:... - 12:14 AM Ceph Revision 1cb7f4aa (ceph): qa/rgw_snaps: move default_idle_timeout config under the client
- Fixes: http://tracker.ceph.com/issues/20128
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 12:12 AM rgw Bug #20128: rgw: teuthology failure in the rgw task (configured via rgw_snaps.yaml)
- this might solve it:
https://github.com/ceph/ceph/pull/15400
- 12:08 AM rgw Bug #20128 (Resolved): rgw: teuthology failure in the rgw task (configured via rgw_snaps.yaml)
- See the failure here: http://pulpito.ceph.com/sage-2017-05-31_18:45:30-rados-wip-sage-testing---basic-smithi/1248627
...
05/31/2017
- 10:01 PM Ceph Revision 4aea15fe (ceph): rgw: fix import
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
05/30/2017
- 08:27 PM Ceph Revision 8519dc46 (ceph): test/rgw: drop use of urllib
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:27 PM Ceph Revision dd836161 (ceph): rgw: es: fix system user check
- check was inverted
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:27 PM Ceph Revision c3422bd2 (ceph): rgw: minor fixes following review
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:27 PM Ceph Revision 0a836bab (ceph): rgw: check init_sync return code
- fix following review
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:27 PM Ceph Revision 8f020cc5 (ceph): rgw: get_rest_filter() delete original rest manager
- When overriding rest manager, delete original.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:26 PM Ceph Revision 0b203537 (ceph): test/rgw/test_multi: cleanup
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 49f92f7d (ceph): test_multi: don't pass array as default param to constructor
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 16e07f04 (ceph): rgw: system users override elasticsearch permission filter
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision ea902d18 (ceph): rgw: package radosgw-es
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision c9e2aff8 (ceph): test_multi: realm checkpoint after init
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 7e4e7432 (ceph): rgw: use RGW_AMZ_META_PREFIX
- instead of defining X_AMZ_META_PREFIX
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:26 PM Ceph Revision 3a81d095 (ceph): rgw: adjust log levels
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision a42aad05 (ceph): rgw: minor cleanup
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 131f6a3c (ceph): rgw/test_multi: add tests for different key types
- add int and date tests
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:26 PM Ceph Revision c13ec1c4 (ceph): rgw: don't send raw date header to elasticsearch
- parse the header, and encode it in the json doc using
a format that ES can understand. Skip header if fails to
parse.... - 08:26 PM Ceph Revision d2309153 (ceph): rgw/test-multi: test more complicated queries
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision cd3fb793 (ceph): rgw/test_multi: add test_es_bucket_conf test
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 366ffd58 (ceph): test/rgw/test_multi: differentiate between zone and zone connection
- Instead of having a Zone type used for the connection, create a new
ZoneConn type that represents the connection. Thi... - 08:26 PM Ceph Revision bbc5d486 (ceph): test/rgw/test_multi: initial es functional tests
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 7d3be066 (ceph): rgw/test_multi/es: extend test
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision f5037624 (ceph): rgw/test_multi: zone_conn can hold more than one bucket per zone
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 024d98cf (ceph): rgw: es: index and return versioned epoch
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision ba0626f2 (ceph): rgw/test_multi: add support for elasticsearch testing
- Add support for different zone types, and create an elasticsearch
zone type that deals with es testing.
Signed-off-b... - 08:26 PM Ceph Revision a680aa11 (ceph): rgw: es: use "null" as instance in case key.instance is empty
- when indexing objects. We can get either.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:26 PM Ceph Revision de9d2cb4 (ceph): rgw-admin: zone create handles --tier-config
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 1ca77abe (ceph): rgw: don't pass sync module to rest filter in creation
- sync module instance might change due to reconfiguration. Pass it into the
handler when executing op.
Signed-off-by:... - 08:26 PM Ceph Revision 6d3cc4b1 (ceph): rgw: move data sync instance_id initialization to caller
- so that caller can easily know the instance id.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:26 PM Ceph Revision 8bfe1379 (ceph): rgw: es: configurable number of replicas and shards
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 3f409381 (ceph): rgw: add missing custom meta map initialization
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 4a91a542 (ceph): rgw: fix time format that is sent to elasticsearch
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 2c9a7bc9 (ceph): rgw: es: generic keys are not case sensitive
- make map case insensitive, and explicitly define all generic keys
so that they can be forced to be lower case.
Signe... - 08:26 PM Ceph Revision 151a6eba (ceph): rgw: es: configurable list of buckets and owners to index
- and a tier configuration that allows to select both list of buckets
and list of bucket owners (if both configured the... - 08:26 PM Ceph Revision f5b158fc (ceph): rgw: es: elasticsearch index path unique per sync instance
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision fbae80ba (ceph): rgw: es: add a configurable to override index path
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:26 PM Ceph Revision 85310f0e (ceph): rgw: add "explicit_custom_meta" configurable to es sync module
- Modify all the map<string, string> that is used to pass in module config
to map<string, string, ltstr> so that it can... - 08:26 PM Ceph Revision b02d6162 (ceph): rgw: create helper for configurable item selection
- with optional prefix and suffix.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 874223b2 (ceph): rgw: es: handle get config api in es zone
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision f1e681bf (ceph): common/ceph_json: map type can handle 2 or 3 template arguments
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 6d5555ac (ceph): rgw: expose conf_get(), conf_get_int(), conf_get_bool()
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision e4e6e1e5 (ceph): rgw: es: limit indexing to only configured user meta
- only metadata keys that are configured on user's bucket are allowed
to be indexed. Also, use the type of meta that wa... - 08:24 PM Ceph Revision 7b61c992 (ceph): rgw: es: also return custom int and date results
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision acba9161 (ceph): rgw: es: api to retrieve bucket mdsearch config
- GET /bucket?mdsearch
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 603863a4 (ceph): rgw: es: api to delete bucket mdsearch config
- DELETE /bucket?mdsearch
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 484fd2b8 (ceph): rgw: support field aliases in es compiler
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision de5bd34e (ceph): rgw: add dout defs
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 3f62f17f (ceph): rgw: guard restricted fields in es query
- don't allow users to use the 'permissions' field.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 8249f76b (ceph): rgw: new api to configure bucket's custom keys for mdsearch
- POST /bucket?mdsearch
x-rgw-meta-search: <x-amz-meta-key>[;<str|int|date>][,...]
note that x-amz-meta-search header ... - 08:24 PM Ceph Revision 1e886475 (ceph): rgw: metadata search pagination
- Leveraging elasticsearch "size" and "from" for doing pagination. This
is not optimal, but sadly it's currently the wa... - 08:24 PM Ceph Revision d026a23d (ceph): rgw: initial support for multiple types in es requests
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 42746ac9 (ceph): rgw: support for generic entities types in es
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 21ee7c11 (ceph): rgw: support more meaningful compilation error string
- in es module
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 698763fb (ceph): rgw: extend interfaces to allow sending data
- when retrieving REST resource
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 86fe1223 (ceph): rgw: send request to elasticsearch and parse response
- and send back response to user
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 0180650d (ceph): rgw: also dump custom meta entries
- when doing metadata search
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 99b49acc (ceph): rgw: add permissions and bucket to es query
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision c9d68822 (ceph): rgw: rename a few methods
- just rename calls
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 9f494ff4 (ceph): rgw: make key param in RGWRESTStreamRWRequest::send_request() optional
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 952e72d9 (ceph): rgw: can send data in RGWRESTStreamRWRequest::send_request()
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision b6fe05d9 (ceph): rgw: move code around
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision bb46f19e (ceph): rgw: work on REST handler for es module
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision e515bf3b (ceph): rgw: meta search rest handler can access es module
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 6de586ca (ceph): rgw: handle nested fields in es queries
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 86ea4243 (ceph): rgw: move code into class
- just cleaning up
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com> - 08:24 PM Ceph Revision 0fdd24ff (ceph): rgw: simplify es compile interface
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 42130df3 (ceph): rgw: rename rgw_rest_es.cc to rgw_es_query.cc
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:24 PM Ceph Revision 67bfdb45 (ceph): rgw: implement init_sync() callback in es module
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:18 PM Ceph Revision 6d4733c5 (ceph): rgw: add init callback to sync modules
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:18 PM Ceph Revision 49b27f4f (ceph): rgw: define es index mapping
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
- 08:17 PM Ceph Revision 8fd55cc2 (ceph): rgw: initial implementation of mdsearch query compiler
- convert infix queries that look as follows:
[(]<name> <operator> <value> [)] [<and|or> ...]
into a prefix structure... - 08:09 PM Ceph Revision 760c5e4f (ceph): Merge pull request #15184 from cbodley/wip-qa-rgw-cleanup
- qa/rgw: remove apache/fastcgi and radosgw-agent tests
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
05/26/2017
- 01:44 PM Ceph Revision aa995589 (ceph): rgw: rest conn functions cleanup, only append zonegroup if not empty
- Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 4e41af19846db75081cb0ddb7b33dc2bb9321ace)
Also available in: Atom