Casey Bodley's activity
From 07/22/2019 to 08/20/2019
08/20/2019
- 06:29 PM rgw Bug #41212 (Fix Under Review): Failure in test_encryption_sse_c_post_object_authenticated_request...
- 06:20 PM Ceph Revision 99a329e9 (ceph): vstart: move [client.rgw] config into [client]
- common rgw config was moved into [client.rgw] with the intent to
cover radosgw in multisite tests too, but this broke... - 05:03 PM Dashboard Bug #41306: mgr/dashboard: Teuthology test failure "test_create_get_update_delete_w_tenant (tasks...
- thanks to Alfonso for capturing some radosgw debug logs. they show that the bucket_link request isn't renaming the bu...
- 05:02 PM rgw Bug #41355 (New): RGWOp_Bucket_Info responds with an empty body instead of reporting errors
- if RGWBucketAdminOp::info() gets an error from bucket_stats() (ENOENT, for example), that error does not get reported...
- 02:19 PM rgw Bug #40806 (Pending Backport): multisite: radosgw-admin bucket sync status incorrectly reports "c...
08/16/2019
- 08:55 PM Ceph Revision c13fc35c (ceph): radosgw-admin: 'mdlog trim' loops until done
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 91eef6712ad29d6c15907f1663e6143fc4144dec)... - 08:54 PM Ceph Revision 1d544a0a (ceph): radosgw-admin: 'datalog trim' takes shard-id and loops until done
- Fixes: https://tracker.ceph.com/issues/41045
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from co... - 08:28 PM rgw Backport #41322 (In Progress): luminous: multisite: datalog/mdlog trim don't loop until done
- https://github.com/ceph/ceph/pull/29713
- 08:20 PM rgw Backport #41322 (Resolved): luminous: multisite: datalog/mdlog trim don't loop until done
- https://github.com/ceph/ceph/pull/29713
- 08:20 PM rgw Backport #41324 (Resolved): mimic: multisite: datalog/mdlog trim don't loop until done
- https://github.com/ceph/ceph/pull/30868
- 08:20 PM rgw Backport #41323 (Resolved): nautilus: multisite: datalog/mdlog trim don't loop until done
- https://github.com/ceph/ceph/pull/30869
- 07:52 PM rgw Bug #41045 (Pending Backport): multisite: datalog/mdlog trim don't loop until done
- 03:40 PM rgw Bug #40806 (Fix Under Review): multisite: radosgw-admin bucket sync status incorrectly reports "c...
- 03:39 PM rgw Bug #40806: multisite: radosgw-admin bucket sync status incorrectly reports "caught up" during fu...
- 03:39 PM rgw Bug #40806 (Pending Backport): multisite: radosgw-admin bucket sync status incorrectly reports "c...
- 03:28 PM Ceph Revision b9af497b (ceph): radosgw-admin: 'datalog trim' takes shard-id and loops until done
- Fixes: https://tracker.ceph.com/issues/41045
Signed-off-by: Casey Bodley <cbodley@redhat.com> - 03:28 PM Ceph Revision 91eef671 (ceph): radosgw-admin: 'mdlog trim' loops until done
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 03:21 PM rgw Bug #41300 (Resolved): AssertionError in radosgw-admin-rest task
- 03:17 PM rgw Bug #36293 (Resolved): InvalidBucketName expected in more cases: uppercase, adjacent chars, under...
- this is an intrusive policy change and, given the number of issues it uncovered in our test infrastructure, feels too...
- 02:26 PM rgw Feature #41143 (Pending Backport): rgw: housekeeping of reset stats operation in radosgw-admin an...
- 02:26 PM rgw Bug #40678 (Pending Backport): RGW S3Website didn't do the necessary checking to the website conf...
- 02:22 PM rgw Bug #40991 (Pending Backport): rgw: potential realm watch lost
- 02:21 PM rgw Bug #40995 (Pending Backport): rgw dns name is not case sensitive
08/15/2019
- 06:02 PM rgw Bug #41189 (Pending Backport): rgw: Put User Policy is sensitive to whitespace
- 05:56 PM rgw Bug #40818: multisite: versioned bucket deletion sometimes fails with BucketNotEmpty
- 05:42 PM rgw Bug #41297 (Fix Under Review): in cls_bucket_list_unordered() listing of entries following an ent...
- 05:17 PM rgw Bug #41300 (Fix Under Review): AssertionError in radosgw-admin-rest task
- 03:42 PM rgw Bug #41300: AssertionError in radosgw-admin-rest task
- the user service appears to no longer filter the .buckets objects out of its listings
- 02:33 PM rgw Bug #41300 (Resolved): AssertionError in radosgw-admin-rest task
- There's a failure in the radosgw-admin-rest when listing users:...
- 05:13 PM Ceph Revision 2af27be0 (ceph): rgw: RGWSI_User_Module filters '.buckets' objects out of user listing
- Fixes: https://tracker.ceph.com/issues/41300
Signed-off-by: Casey Bodley <cbodley@redhat.com>
08/14/2019
- 02:23 PM rgw Bug #40935: nautilus: RGW compression does not take effect, using command “radosgw-admin zone pla...
08/13/2019
- 08:33 PM rgw Bug #41042 (Fix Under Review): object can be copied to bucket from other user without writing per...
- 03:58 PM rgw Bug #41169 (Pending Backport): beast frontend throws an exception when running out of FDs
- 02:43 PM rgw Bug #41230 (Pending Backport): multisite: better spread multisite sync load over cooperating gate...
- each radosgw tries to lock every shard of each multisite log for processing, and can hold the locks for a long time. ...
- 02:24 PM Ceph Revision 75e1ec8a (ceph): Merge branch 'wip-rgw-metadata-servicification'
- Conflicts:
src/rgw/rgw_auth.cc
src/rgw/rgw_auth_registry.h
src/rgw/rgw_auth_s3.h
src/rgw/rgw_bucket.cc
src/rgw/r... - 12:16 PM rgw Bug #41146 (Pending Backport): rgw: rgw-log issues the wrong message when decompression fails
08/12/2019
- 06:10 PM Ceph Revision 2bf10310 (ceph): rgw: RGWUserCtl::PutParams::attrs defaults to nullptr
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 01:23 PM rgw Bug #41169: beast frontend throws an exception when running out of FDs
08/09/2019
- 04:39 PM rgw Bug #41189 (Fix Under Review): rgw: Put User Policy is sensitive to whitespace
- 02:38 PM rgw Bug #41184: rgw:report error "unrecognized arg rm" when using "radosgw-admin zone rm"
08/08/2019
- 05:52 PM rgw Bug #40924 (Closed): Ceph-dencoder Cannot Decode Correctly
- 05:48 PM rgw Bug #40991: rgw: potential realm watch lost
- 05:45 PM rgw Feature #41062 (In Progress): Extend SSE-KMS in Rados Gateway to support HashiCorp Vault
- 05:43 PM rgw Bug #23454 (Won't Fix): rgw/s3atests failure: fs contract testBlockReadZeroByteFile/testSeekZeroB...
- 05:43 PM rgw Bug #23531 (Won't Fix): s3a/2.8.0 fs.contract failure Seek/Rename/ComplexDirActions/RecursiveRoot...
- 05:42 PM rgw Bug #37350: segfault in rgw::putobj::RadosWriter::process()
- 02:06 PM Ceph Revision 57887f6a (ceph): rgw: http client drops mutex before suspending coroutine
- the lock can't be held over async_wait(), because the call to finish()
won't be able to reacquire the lock in order t... - 02:04 PM Ceph Revision fef63ad3 (ceph): rgw: http client doesn't need lock to access atomic 'done'
- Reported-by: Yuval Lifshitz <yuvalif@yahoo.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
08/07/2019
- 08:25 PM Ceph Revision 4375204a (ceph): rgw: simplify bucket chown
- removes unused 'attrs' argument, and takes uid + display name instead
of RGWUserInfo
Signed-off-by: Casey Bodley <cb... - 08:25 PM Ceph Revision b8a60eb0 (ceph): rgw: add rgw_remove_user_buckets_index
- helper function to remove the user:buckets object.
rgw_remove_uid_index() now omits the object version tracker argume... - 08:25 PM Ceph Revision ff707aa3 (ceph): rgw: user rename operates on 'stub' user
- user rename creates a 'stub' user and links all buckets to that before
modifying the existing user. once everything s... - 08:25 PM Ceph Revision c7ea6dc6 (ceph): rgw: user rename overwrites new user with --yes-i-really-mean-it
- if a previous rename attempt fails to complete, it can be restarted with
--yes-i-really-mean-it to overwrite the 'stu... - 08:25 PM Ceph Revision cfabb2f0 (ceph): rgw: user rename calls update() to write final user
- this calls remove_old_indexes() to clean up the uid and buckets index
objects, and also sets 'old_info = user_info' s... - 08:25 PM Ceph Revision 8c4338cb (ceph): rgw: consolidate RGWUser::execute_rename
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 08:25 PM Ceph Revision d02c1cab (ceph): rgw: add rename_swift_keys for user rename
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 06:02 PM Ceph Revision 553d97ca (ceph): rgw: fix unlock of shared lock in RGWDataChangesLog
- std::shared_mutex expects a call to unlock_shared() after lock_shared().
use the std::shared_lock guard to make it mo...
08/06/2019
- 08:48 PM Ceph Revision 49672ad5 (ceph): kv/rocksdb: support rmrange unconditionally
- removes the config options rocksdb_enable_rmrange and
rocksdb_max_items_rmrange that avoid calls to DeleteRange()
Si... - 08:38 PM Ceph Revision 8eb57ab5 (ceph): test/cls: add cls_rgw.bi_log_trim test
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 08:38 PM Ceph Revision ae8c31d5 (ceph): test/cls: test_cls_log uses fixture for temporary pool
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 08:38 PM Ceph Revision 4c4f71c3 (ceph): test/cls: test_cls_log doesn't allocate ObjectOperations
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 08:38 PM Ceph Revision cece372e (ceph): test/cls: add cls_log.trim_by_marker test
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 08:38 PM Ceph Revision 3897af4a (ceph): cls/log: cls_log_trim() uses cls_cxx_map_remove_range()
- uses cls_cxx_map_get_keys() instead of cls_cxx_map_get_vals() to limit
the number of keys removed
Signed-off-by: Cas... - 08:38 PM Ceph Revision a807f89c (ceph): cls/rgw: rgw_bi_log_trim() uses cls_cxx_map_remove_range()
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 08:33 PM Ceph Revision a8f4ae48 (ceph): cls/rgw: expose cls_rgw_bilog_list/trim() for single shard
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision ae9d0faa (ceph): rados: add CEPH_OSD_OP_OMAPRMKEYRANGE
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision 8da8f357 (ceph): tracing: add do_osd_op_pre_omaprmkeyrange
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision 2bdb298e (ceph): os: add bufferlist overload for omap_rmkeyrange()
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision ed505e9e (ceph): osd: add omap_rmkeyrange() to PGTransaction
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision 102435e7 (ceph): osd: add CEPH_OSD_OP_OMAPRMKEYRANGE to do_osd_ops()
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision 0a31f54e (ceph): osdc: add Objecter omap_rm_range()
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision e8c320f5 (ceph): librados: add rados_write_op_omap_rm_range2()
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision d2fcef9b (ceph): objclass: add cls_cxx_map_remove_range()
- Fixes: http://tracker.ceph.com/issues/19975
Signed-off-by: Casey Bodley <cbodley@redhat.com> - 07:21 PM Ceph Revision 0e7cd428 (ceph): test/cls: test_cls_rgw uses fixture for temporary pool
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision 5f76601e (ceph): test/cls: test_cls_rgw doesn't allocate ObjectOperations
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:21 PM Ceph Revision 78b628e5 (ceph): test/cls: test_cls_rgw uses cls_rgw_obj_key
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
08/05/2019
- 03:24 PM rgw Feature #37763 (Resolved): support S3 Object Lock
- 02:22 AM Ceph Revision eca9c0f2 (ceph): doc/rgw: document use of 'realm pull' instead of 'period pull'
- 'radosgw-admin period pull' fetches a period configuration, but does not
update the realm's current_period to use it....
08/02/2019
08/01/2019
- 02:28 PM rgw Bug #41045 (Fix Under Review): multisite: datalog/mdlog trim don't loop until done
- 01:56 PM rgw Bug #41045 (Resolved): multisite: datalog/mdlog trim don't loop until done
- these commands will only send a single osd request and trim at max 1000 entries, and not all the way to the given --e...
- 02:20 PM Ceph Revision c5ec95d7 (ceph): vstart: move common rgw config to [client.rgw]
- multisite tests in src/test/rgw/test_multi.py run vstart.sh with RGW=0
because it does some extra configuration befor...
07/31/2019
- 05:03 PM Ceph Revision dd0e60d8 (ceph): rgw: RGWBucket::link clears acl buffer before re-encoding
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
07/29/2019
- 07:20 PM Ceph Revision db8e77ca (ceph): rgw: make optional_yield explicit in RGWUserCtl interfaces
- the purpose of null_yield is to highlight synchronous function calls so
they can be found with grep. having optional_... - 07:20 PM Ceph Revision bdef2b70 (ceph): rgw: simplify RGWUserCtl params with default arguments
- Params types needed to define a non-default constructor as a workaround
for https://gcc.gnu.org/bugzilla/show_bug.cgi... - 07:20 PM Ceph Revision ee507988 (ceph): rgw: simplify RGWBucketCtl params with default arguments
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:20 PM Ceph Revision 5623d84e (ceph): rgw: simplify RGWOTPCtl params with default arguments
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:20 PM Ceph Revision 2e5c15be (ceph): rgw: simplify RGWSI_RADOS params with default arguments
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:20 PM Ceph Revision 2ff86685 (ceph): common: remove ceph::optional_ref_default
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:20 PM Ceph Revision 89a06ec7 (ceph): rgw: user service removes old access keys in remove_old_indexes
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
- 07:20 PM Ceph Revision eba7324b (ceph): rgw: fix leak of metadata backend context
- Op had no virtual destructor, so the derived Op_ManagedCtx destructor
wasn't being called to free its context. just u...
07/25/2019
- 06:03 PM rgw Bug #40815: s3cmd modify fails with ceph
- 05:59 PM rgw Feature #40826: radosgw cloud sync fail when use v4 auth s3 node.
- 05:59 PM rgw Bug #40859: multisite: delete object not sync from master when recovery
- duc pham wrote:
> version: 13.2.6
>
> 2 sites: A (master) and B (salve)
>
> 1. Create a bucket and put one obj... - 05:51 PM rgw Bug #40872: rgw: when usring radosgw-admin to list bucket, can set --max-entries excessively high
- 05:50 PM rgw Bug #40903 (Fix Under Review): rgw: gc remove tag issue
- 05:47 PM rgw Bug #40935 (Need More Info): nautilus: RGW compression does not take effect, using command “rados...
- according to the usage.png, there is a slight difference between size_actual and size_utilized that indicates a small...
- 05:39 PM rgw Bug #38055 (Pending Backport): rgw: GET/HEAD and PUT operations on buckets w/lifecycle expiration...
- @Matt, do all 3 backports sound appropriate to you?
- 05:37 PM rgw Bug #39657: multisite: metadata sync does not keep retrying failed entries
- fang yuxiang wrote:
> how about the progress now?
no progress yet, only thinking about design - 04:13 PM Ceph Revision 4c4def2f (ceph): cls/rgw: keep issuing bilog trim ops after reset
- The CLSRGWIssueBILogTrim class is intended to keep submitting
cls_log_trim operations on each bucket index shard unti... - 04:09 PM Ceph Revision 33b23b50 (ceph): qa/rgw: extra s3tests tasks use rgw endpoint configuration
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 09e992ff01b4ce286540e1230a30df67103f5968) - 04:09 PM Ceph Revision de16cf2a (ceph): qa/rgw: update default port in perl workunits
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1643879218638915073d5310b859a94d10ffeac6)
07/24/2019
- 05:19 PM Ceph Revision 073fa917 (ceph): test/rgw: test truncated reads in RGWHTTPManager
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit c669cf293f02b3c68a4c539d7accf7ddf35cb1ee)... - 02:29 PM Ceph Revision e7f5a3fb (ceph): rgw: fetch_remote_obj() compares expected object size
- if the size of object data received doesn't match the value returned in
the Rgwx-Object-Size header, fail with -EIO
... - 02:03 PM Ceph Revision 863b1bb5 (ceph): radosgw-admin: fix syncs_from in 'bucket sync status'
- If a zone is set up with sync_from_all=false, the bucket sync status
command will incorrectly report "not in sync_fro... - 02:01 PM Ceph Revision fb1d105b (ceph): radosgw-admin: fix syncs_from in 'bucket sync status'
- If a zone is set up with sync_from_all=false, the bucket sync status
command will incorrectly report "not in sync_fro... - 01:46 PM Ceph Revision ea979b91 (ceph): rgw: parse_copy_location defers url-decode
- don't url-decode until after we search for the ?, or we'll truncate
object names that contain a url-encoded ?
Fixes:... - 01:29 PM Ceph Revision a525832d (ceph): qa/rgw: add dnsmasq back to s3a-hadoop
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 8c8a706b6f4cb3b2a5b89aa1eb06b7e47909852d) - 01:29 PM Ceph Revision 74ac48eb (ceph): qa/rgw: remove ceph-ansible from s3a-hadoop suite
- Fixes: http://tracker.ceph.com/issues/39706
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from com... - 01:29 PM Ceph Revision 094fb88e (ceph): qa/rgw: use default ports (80 or 443) unless overridden
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 3ff5f0c2406e40d1024d8152e0ac9400302a757a) - 01:29 PM Ceph Revision d26f5e70 (ceph): qa/rgw: rgw task can override --rgw-dns-name on the command line
- the value for rgw_dns_name isn't known until a machine is assigned, so
it can't be set via 'override: conf:'. add a p... - 01:28 PM Ceph Revision 71d264d6 (ceph): qa/rgw: allow rgw client config to override port
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 921faebb723c11686bf790ca424c952a786f358a) - 01:11 PM rgw Bug #40818 (Fix Under Review): multisite: versioned bucket deletion sometimes fails with BucketNo...
- 12:47 PM Ceph Revision 07004d31 (ceph): rgw: delete_obj_index() takes mtime for bilog
- writing an empty timestamp to the bilog prevents other zones from
applying the delete. this means that the --bypass-g... - 11:21 AM Ceph Revision 6367eb28 (ceph): doc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api
- Fixes: http://tracker.ceph.com/issues/39597
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from com... - 11:19 AM Ceph Revision 86f2a4d5 (ceph): rgw: RGWPeriodPusher uses zone system key for inter-zonegroup messages
- RGWPeriodPusher was using an empty RGWAccessKey for inter-zonegroup
messages, which were rejected as an anonymous use...
07/23/2019
- 01:01 PM Ceph Revision 8fc9073e (ceph): common: OutputDataSocket retakes mutex on error path
- the list of buffers is protected by mutex m_lock. when dump_data() fails
and puts unwritten buffers back into the lis... - 12:59 PM Ceph Revision d227ebcf (ceph): common: OutputDataSocket retakes mutex on error path
- the list of buffers is protected by mutex m_lock. when dump_data() fails
and puts unwritten buffers back into the lis...
07/22/2019
- 03:18 PM Ceph Revision 68855678 (ceph): qa/rgw: remove incomplete rgw/tempest suite from luminous
- the rgw/tempest suite was added in mimic, and only small pieces of yaml
were accidentally backported to luminous
Sig... - 12:40 PM Ceph Revision dea4c1e0 (ceph): rgw: add RGWRados::repair_olh() to reconstruct olh attrs
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1309e2d50ee8118afe1138cd6677d84438edb55a)... - 12:40 PM Ceph Revision ce0e512b (ceph): rgw: add RGWRados::bi_get_olh() to read/decode olh entry
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit b8d7f0ad1f882b999e0fd7f3e45f8579599714cf)... - 10:17 AM Ceph Revision eede421e (ceph): rgw: fetch_remote_obj filters out olh attrs
- each zone manages its own olh log, so we don't want any of the source
zone's olh attributes. in one case (sync of an ... - 10:17 AM Ceph Revision fb07290f (ceph): test/rgw: add multisite test_version_suspended_incremental_sync
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 81fa354c1dadf4f957592f20fe9e02acd70671e0)... - 10:17 AM Ceph Revision e44025c7 (ceph): rgw: add BucketShard::init overload for bucket_info,obj
- Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit c6c445f6074df113a28adcae89248b909d031f8e) - 10:17 AM Ceph Revision 776f6341 (ceph): rgw: bi_get() takes bucket_info
- and calls the bucket_info overload of BucketShard::init() to avoid
reading the bucket info again
Signed-off-by: Case...
Also available in: Atom