Activity
From 01/13/2023 to 02/11/2023
02/11/2023
- 10:10 PM Documentation #58632: RGW Multisite documentation improvement project
- https://github.com/ceph/ceph/pull/50077 - edit "Failover and Disaster Recovery"
02/10/2023
- 04:49 AM Bug #58692 (Resolved): Consider setting "bulk" autoscale pool flag when automatically creating a ...
- When a new Ceph cluster has been deployed and RGW is used on it for the first time it seems pools necessary for RGW a...
- 02:49 AM Documentation #58632: RGW Multisite documentation improvement project
- https://github.com/ceph/ceph/pull/50066 - edit "Configuring Secondary Zones"
02/09/2023
- 10:28 PM Documentation #58687 (Need More Info): check accuracy of diagram in rados/configuration/network-c...
- https://docs.ceph.com/en/pacific/rados/configuration/network-config-ref/#network-configuration-reference
Dan van d... - 06:51 PM Bug #58673 (Fix Under Review): When bucket index ops are cancelled it can leave behind zombie ind...
- 03:36 PM Bug #58365 (Resolved): test_user_policy fails when running locally
- 03:28 PM Bug #57706: When creating a new user, if the 'uid' is not provided, error reported as 'Permission...
- bump ^
- 03:16 PM Bug #58552 (Fix Under Review): test_rgw_datacache.py test if failing with Permission denied
02/08/2023
- 07:58 PM Bug #58673 (Resolved): When bucket index ops are cancelled it can leave behind zombie index entries
- We discovered that there were a significant number of extra bucket index entries for some of our buckets and found th...
- 07:42 PM Bug #58671: Frontend socket leak that leads to OOM when connections are reset
- It is a lot easier to reproduce if HTTPS traffic is slowed by tc qdisc and S3 client, like s3cmd, is managed by a tim...
- 05:17 PM Bug #58671 (Resolved): Frontend socket leak that leads to OOM when connections are reset
- This issue is related to the following type of traffic:
# Client uses non-persistent connection (Connection: close).... - 05:24 PM Bug #58643: ragweed fails with ModuleNotFoundError (No module named 'rados')
- i'm seeing the failures under rgw/verify (which only runs against centos8) and rgw/multifs (which only runs against u...
- 05:09 PM Bug #58670: segfault due to race condition between timeout handler calling close() and the call o...
- I found out that by replacing the socket close() call in the timeout handler with socket cancel() followed by socket ...
- 05:04 PM Bug #58670 (Resolved): segfault due to race condition between timeout handler calling close() and...
- We experienced segfault crashes with radosgw with the following crash report that contains the backtrace:
> # ceph... - 02:43 PM Bug #58669 (New): ceph_test_cls_rgw_stats: add test coverage for versioned objects
- 02:36 PM Documentation #58632: RGW Multisite documentation improvement project
- https://github.com/ceph/ceph/pull/50030 - refine multisite.rst up to "Configure Secondary Zones"
- 12:14 AM Documentation #58632: RGW Multisite documentation improvement project
- https://github.com/ceph/ceph/pull/50022 - Refine "Maintenance" in multisite.rst.
- 08:24 AM Bug #58547: ?Action=ListRoles endpoint json response incorrectly formatted
- Which tool are you using to list the roles? I tried aws iam cli command, boto3, but neither of them gave output in th...
02/07/2023
- 07:50 PM Bug #58643: ragweed fails with ModuleNotFoundError (No module named 'rados')
- @Casey I have not seen this in the rados suite yet, but I will keep an eye out.
- 03:53 PM Bug #58643: ragweed fails with ModuleNotFoundError (No module named 'rados')
- also failing on quincy:
https://pulpito.ceph.com/yuriw-2023-02-03_21:59:32-rgw-wip-yuri7-testing-2023-01-30-1510-q... - 06:21 PM Bug #54802 (Fix Under Review): crash: librados::IoCtx::nobjects_begin(librados::ObjectCursor cons...
02/06/2023
- 07:07 PM Documentation #58649 (In Progress): line-edit all of doc/radosgw/multisite.rst
- The first step in the project of refining doc/radosgw/multisite.rst is a line-edit of all ~1500 lines of multisite.rst.
- 07:02 PM Documentation #58632: RGW Multisite documentation improvement project
- https://tracker.ceph.com/issues/58632 - edit lines ~50 - ~140 of multisite.rst.
- 02:28 PM Bug #58547: ?Action=ListRoles endpoint json response incorrectly formatted
- If you look closely at the first list you can see the first instance of a role starts with *{"member": {"RoleId* .The...
- 10:32 AM Backport #57702 (In Progress): quincy: rgw/crypt/barbican: Cannot create secret
- Pull Request https://github.com/ceph/ceph/pull/50002
- 08:36 AM Backport #57701 (In Progress): pacific: rgw/crypt/barbican: Cannot create secret
- Pull Request https://github.com/ceph/ceph/pull/50000
02/05/2023
- 03:50 PM Bug #58643 (Resolved): ragweed fails with ModuleNotFoundError (No module named 'rados')
- ...
02/04/2023
- 07:58 AM Documentation #58632: RGW Multisite documentation improvement project
- https://github.com/ceph/ceph/pull/49993 - refine lines 1-50 of multisite.rst
- 12:26 AM Bug #58641 (Fix Under Review): rgw: s3 notifications not generated on object transition
02/03/2023
- 09:45 PM Bug #58641 (Pending Backport): rgw: s3 notifications not generated on object transition
- The logic to generate the notifications was missed.
- 07:40 AM Documentation #58632: RGW Multisite documentation improvement project
- https://github.com/ceph/ceph/pull/49981 - Refine "Zones" section
- 07:23 AM Documentation #58632 (In Progress): RGW Multisite documentation improvement project
- https://docs.ceph.com/en/latest/radosgw/multisite/ starts with the description of new setups possible since Kraken. H...
02/02/2023
- 07:22 PM Bug #46563: Metadata synchronization failed,"metadata is behind on 1 shards" appear
- Is there a plan to backport this fix (https://github.com/ceph/ceph/pull/46148/files) to Quincy? I see that it was mer...
- 03:20 PM Bug #58547 (Need More Info): ?Action=ListRoles endpoint json response incorrectly formatted
- 03:06 PM Bug #58628 (Fix Under Review): Renaming large files fails with 403 when using temporary creds ret...
- 09:40 AM Bug #58628 (In Progress): Renaming large files fails with 403 when using temporary creds returned...
- 04:20 AM Bug #58628 (Pending Backport): Renaming large files fails with 403 when using temporary creds ret...
- Renaming large files fails with 403 when using temporary creds returned by STS. These files are uploaded using Multip...
02/01/2023
- 08:43 PM Bug #58627: PostObj may incorrectly return 400 EntityTooSmall
- https://github.com/ceph/s3-tests/pull/487
- 08:21 PM Bug #58627 (Pending Backport): PostObj may incorrectly return 400 EntityTooSmall
01/31/2023
- 06:29 PM Bug #56992 (Fix Under Review): rgw_op.cc:Deleting a non-existent object also generates a delete m...
- 01:42 PM Bug #58510 (Resolved): ubuntu 22.04: ragweed bootstrap fails with "./virtualenv/bin/pip: not found"
- 01:42 PM Bug #58549 (Resolved): ragweed bootstrap fails with "Invalid version: '0.23ubuntu1' (package: dis...
01/30/2023
- 09:10 PM Backport #54493: quincy: segmentation fault in UserAsyncRefreshHandler::init_fetch
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/49083
merged - 07:03 PM Bug #58549 (In Progress): ragweed bootstrap fails with "Invalid version: '0.23ubuntu1' (package: ...
- for testing: https://github.com/ceph/ragweed/pull/24
01/29/2023
- 05:04 PM Bug #58552: test_rgw_datacache.py test if failing with Permission denied
- The D3N cache test has failed inadvertently two cache object part files were found on the cache directory instead of ...
01/28/2023
- 07:41 AM Bug #56209: crash: ceph::common::RefCountedObject::put() const
- I just observed this on a cluster running pacific in latest version 16.2.11 .
01/27/2023
- 02:50 PM Backport #58579 (In Progress): pacific: Large RGW GC queue might prevent OSD from starting
- https://github.com/ceph/ceph/pull/49903
- 02:46 PM Backport #58580 (In Progress): quincy: Large RGW GC queue might prevent OSD from starting
- https://github.com/ceph/ceph/pull/49902
merged - 12:37 PM Bug #58594 (Pending Backport): MultiPart Upload with Bucket Policy Fails
- When configuring a bucket with the following policy, any multi-part uploads are rejected:...
- 03:43 AM Bug #58547: ?Action=ListRoles endpoint json response incorrectly formatted
- can you please be specific? which second member are you referring to here?
01/26/2023
- 04:25 PM Bug #58365: test_user_policy fails when running locally
- removed from s3tests in https://github.com/ceph/s3-tests/pull/486
- 03:48 PM Backport #57752: quincy: Log status of individual object deletions for multi-object delete reques...
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/49084
merged - 03:29 PM Bug #19364 (Closed): Provide `rgw_disable_verify_permission` option in RGW
- 03:29 PM Bug #16581 (Closed): rgw: error is logged when binding civetweb to an ip
- 03:28 PM Bug #16752 (Closed): Cannot start radosgw when there is a default zonegroup but no default zone w...
- 03:26 PM Bug #57093 (Fix Under Review): garbage in log line upon authentication failure w/ rgw_s3_auth_use...
- 03:22 PM Backport #58593 (Rejected): pacific: rgw-gap-list has insufficient error checking
- 03:22 PM Backport #58592 (New): quincy: rgw-gap-list has insufficient error checking
- 03:17 PM Backport #58470: pacific: It is not possible to set empty tags on buckets and objects.
- https://github.com/ceph/ceph/pull/49809
- 03:15 PM Bug #58453 (Pending Backport): rgw-gap-list has insufficient error checking
- 03:14 PM Bug #58473 (Need More Info): PutBucketEncryption default policy does not apply to multipart uploads
- @Adam, can you share a reproducer for this one?
- 03:11 PM Bug #58546 (Duplicate): ?Action=ListRoles endpoint json response incorrectly formatted
- 03:09 PM Bug #58552 (Triaged): test_rgw_datacache.py test if failing with Permission denied
- 03:02 PM Bug #58512 (Resolved): ubuntu 22.04: s3tests bootstrap fails with AttributeError: module 'collect...
01/25/2023
- 08:51 PM Backport #58584 (Resolved): pacific: Keys returned by Admin API during user creation on secondary...
- https://github.com/ceph/ceph/pull/51602
- 08:51 PM Backport #58583 (Resolved): quincy: Keys returned by Admin API during user creation on secondary ...
- https://github.com/ceph/ceph/pull/51601
- 08:48 PM Bug #57724 (Pending Backport): Keys returned by Admin API during user creation on secondary zone ...
- 05:40 PM Bug #58473: PutBucketEncryption default policy does not apply to multipart uploads
- the s3tests case test_sse_s3_default_multipart_upload seems to cover this, and has been passing consistently:
http... - 04:48 PM Bug #57979: rgw/cloud-tranistion: Issues with MCG cloud endpoint
- https://github.com/ceph/ceph/pull/49061 merged
- 04:47 PM Backport #57648: quincy: rgw: fix bool/int logic error when calling get_obj_head_ioctx
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/48231
merged - 03:02 PM Bug #58513 (Resolved): ubuntu 22.04: kmip task fails with cannot remove '/home/ubuntu/cephtest/ca...
- 01:50 PM Backport #58580 (Resolved): quincy: Large RGW GC queue might prevent OSD from starting
- 01:50 PM Backport #58579 (Resolved): pacific: Large RGW GC queue might prevent OSD from starting
- 01:48 PM Bug #58190 (Pending Backport): Large RGW GC queue might prevent OSD from starting
01/24/2023
- 03:55 PM cleanup Tasks #57647: prototype metadata sync with c++20 coroutines and neorados
- more work in progress:
* cls_version client for neorados: https://github.com/ceph/ceph/pull/48234
we'll also need... - 03:28 AM Backport #58553 (In Progress): pacific: Subsequent request fails after PutObject to non-existing ...
- 03:25 AM Backport #58554 (In Progress): quincy: Subsequent request fails after PutObject to non-existing b...
01/23/2023
- 08:16 PM Bug #58127 (Resolved): multisite: test_zg_master_zone_delete fails
- 03:44 PM Backport #58554 (Resolved): quincy: Subsequent request fails after PutObject to non-existing bucket
- https://github.com/ceph/ceph/pull/49840
- 03:43 PM Backport #58553 (Resolved): pacific: Subsequent request fails after PutObject to non-existing bucket
- https://github.com/ceph/ceph/pull/49841
- 03:41 PM Bug #58551: failures in lifecycle tests
- similar failure from another test. see log: http://qa-proxy.ceph.com/teuthology/yuvalif-2023-01-20_20:25:04-rgw-wip-y...
- 03:26 PM Bug #58551 (Resolved): failures in lifecycle tests
- from: http://qa-proxy.ceph.com/teuthology/yuvalif-2023-01-21_18:18:43-rgw-wip-yuval-signed-comparisson-distro-default...
- 03:38 PM Bug #58512 (Fix Under Review): ubuntu 22.04: s3tests bootstrap fails with AttributeError: module ...
- s3tests pr https://github.com/ceph/s3-tests/pull/482
- 03:36 PM Bug #58286 (Pending Backport): Subsequent request fails after PutObject to non-existing bucket
- 03:35 PM Bug #58552 (Resolved): test_rgw_datacache.py test if failing with Permission denied
- see log at: http://qa-proxy.ceph.com/teuthology/yuvalif-2023-01-21_18:18:43-rgw-wip-yuval-signed-comparisson-distro-d...
- 02:39 PM Bug #58549 (Resolved): ragweed bootstrap fails with "Invalid version: '0.23ubuntu1' (package: dis...
- on ubuntu 20.04 with python3.8
ex. http://qa-proxy.ceph.com/teuthology/ivancich-2023-01-21_22:21:55-rgw-wip-eric-t... - 01:37 PM Bug #44660: Multipart re-uploads cause orphan data
- Hi Ulrich,
The plan is to merge https://github.com/ceph/ceph/pull/49709. Apparently this tracker duplicates https... - 01:21 PM Bug #44660: Multipart re-uploads cause orphan data
- Will this ever get fixed? Or remain in the state that solutions are discussed and discarded?
- 09:54 AM Bug #58547 (Need More Info): ?Action=ListRoles endpoint json response incorrectly formatted
- After creating 2 dummy roles and trying to retrieve the list of roles through the S3 api, the list of roles was inade...
- 09:54 AM Bug #58546 (Duplicate): ?Action=ListRoles endpoint json response incorrectly formatted
- After creating 2 dummy roles and trying to retrieve the list of roles through the S3 api, the list of roles was inade...
- 07:37 AM Bug #58365: test_user_policy fails when running locally
- Yes, I think its ok to remove this test.
01/22/2023
- 09:23 PM Backport #58542 (In Progress): pacific: When multiple versions are enabled, the number of bi is g...
- 09:17 PM Backport #58542 (Resolved): pacific: When multiple versions are enabled, the number of bi is grea...
- https://github.com/ceph/ceph/pull/49829
- 09:19 PM Backport #58543 (In Progress): quincy: When multiple versions are enabled, the number of bi is gr...
- 09:17 PM Backport #58543 (Resolved): quincy: When multiple versions are enabled, the number of bi is great...
- https://github.com/ceph/ceph/pull/49828
- 09:12 PM Bug #58213 (Pending Backport): When multiple versions are enabled, the number of bi is greater th...
- 06:13 PM Bug #55026: multisite: expose config option for data sync's polling interval
- This looks like an important fix for the situation where the multi-site replication is going over a high-latency link...
- 01:13 AM Bug #58365: test_user_policy fails when running locally
- even when caps are added, the request still fails with ERR_NO_SUCH_ENTITY, because it specifies a 'UserName=987654321...
- 12:46 AM Bug #58365 (Fix Under Review): test_user_policy fails when running locally
- in teuthology, the qa/tasks/s3tests.py task adds '--caps user-policy=*' to all users it creates
vstart.sh only add...
01/20/2023
- 05:27 PM Bug #58512: ubuntu 22.04: s3tests bootstrap fails with AttributeError: module 'collections' has n...
- ubuntu 22.04 only provides python 3.10. we'll probably want to replace nose with pytest in both s3-tests and ragweed
- 04:30 PM Bug #58523 (Fix Under Review): ubuntu 22.04: kmip task fails with "Package 'python-dev' has no in...
- 02:42 PM Bug #58523 (Fix Under Review): ubuntu 22.04: kmip task fails with "Package 'python-dev' has no in...
- after fixing https://tracker.ceph.com/issues/58513, the pykmip task fails shortly afterward:...
- 04:16 PM Backport #58470 (Fix Under Review): pacific: It is not possible to set empty tags on buckets and ...
- 03:47 PM Backport #58285 (In Progress): quincy: notifications: metadata does not work for COPY events
- 11:19 AM Bug #58518 (Fix Under Review): rgw: Support disabling bucket replication using sync-policy
- 10:55 AM Bug #58518 (Pending Backport): rgw: Support disabling bucket replication using sync-policy
- Disabling bucket replication should be allowed if zones replicate by default using multisite sync policy.
01/19/2023
- 08:54 PM Bug #58510 (In Progress): ubuntu 22.04: ragweed bootstrap fails with "./virtualenv/bin/pip: not f...
- testing https://github.com/ceph/ragweed/pull/23
- 03:39 PM Bug #58510 (Resolved): ubuntu 22.04: ragweed bootstrap fails with "./virtualenv/bin/pip: not found"
- ex: http://qa-proxy.ceph.com/teuthology/cbodley-2023-01-18_15:20:22-rgw-main-distro-default-smithi/7129639/teuthology...
- 07:54 PM Bug #58513 (Fix Under Review): ubuntu 22.04: kmip task fails with cannot remove '/home/ubuntu/cep...
- 03:47 PM Bug #58513 (Resolved): ubuntu 22.04: kmip task fails with cannot remove '/home/ubuntu/cephtest/ca...
- ex: http://qa-proxy.ceph.com/teuthology/cbodley-2023-01-18_15:20:22-rgw-main-distro-default-smithi/7129638/teuthology...
- 05:53 PM Backport #58171: quincy: RGW misplaces index entries after dynamically resharding bucket
- I've done the backport, Satoru. Please feel free to review.
- 05:52 PM Backport #58171 (In Progress): quincy: RGW misplaces index entries after dynamically resharding b...
- PR: https://github.com/ceph/ceph/pull/49795
- 05:49 PM Backport #58509 (In Progress): quincy: 'radosgw-admin bucket chown' doesn't set bucket instance o...
- 03:28 PM Backport #58509 (In Progress): quincy: 'radosgw-admin bucket chown' doesn't set bucket instance o...
- https://github.com/ceph/ceph/pull/49794
- 05:48 PM Bug #57905: multisite: terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end...
- oops, this wasn't a crash in the radosgw-admin process, it was in radosgw
- 04:43 PM Bug #57770 (Resolved): RGW (pacific) misplaces index entries after dynamically resharding bucket
- 03:45 PM Bug #58512 (Resolved): ubuntu 22.04: s3tests bootstrap fails with AttributeError: module 'collect...
- ex: http://qa-proxy.ceph.com/teuthology/cbodley-2023-01-18_15:20:22-rgw-main-distro-default-smithi/7129634/teuthology...
- 03:42 PM Fix #58511: Concurrent multi-object-delete calls referencing the same objects return errors (AWS ...
- cbodley, could you transition this to needs-backport when you get a chance, so that the backport trackers get created...
- 03:40 PM Fix #58511 (New): Concurrent multi-object-delete calls referencing the same objects return errors...
- ECANCELED errors bubble up as "UnknownError" within the multi-object-delete response, for individual object statuses....
- 03:29 PM Backport #58170 (Duplicate): pacific: RGW misplaces index entries after dynamically resharding bu...
- Duplicate of https://tracker.ceph.com/issues/57770
Fixed in https://github.com/ceph/ceph/pull/48663 - 03:23 PM Bug #57936 (Pending Backport): 'radosgw-admin bucket chown' doesn't set bucket instance owner or ...
- 03:22 PM Bug #57936 (Resolved): 'radosgw-admin bucket chown' doesn't set bucket instance owner or unlink f...
- 03:14 PM Bug #58373 (Triaged): object tags allow non unique keys
- 03:13 PM Bug #58453 (Fix Under Review): rgw-gap-list has insufficient error checking
- 03:06 PM Backport #58508 (Rejected): pacific: rgw-orphan-list tool can list all rados objects as orphans
- 03:05 PM Backport #58507 (New): quincy: rgw-orphan-list tool can list all rados objects as orphans
- 03:04 PM Bug #58442 (Pending Backport): rgw-orphan-list tool can list all rados objects as orphans
- 02:49 PM Bug #23264: Server side encryption support for s3 COPY operation
- Does this apply to other SSE modes as well, if it is still a problem? I've run into the same error with SSE-S3 and wa...
01/18/2023
- 05:22 PM Backport #58495 (Rejected): pacific: rgw: remove guard_reshard in bucket_index_read_olh_log
- https://github.com/ceph/ceph/pull/52934
- 05:22 PM Backport #58494 (Resolved): quincy: rgw: remove guard_reshard in bucket_index_read_olh_log
- https://github.com/ceph/ceph/pull/49775
- 05:17 PM Backport #58480 (Duplicate): rgw: remove guard_reshard in bucket_index_read_olh_log
- 01:53 AM Backport #58480 (Duplicate): rgw: remove guard_reshard in bucket_index_read_olh_log
- bucket_index_read_olh_log just read the bucket index obj, so it is no need to be executed in guard_reshard.
- 05:17 PM Bug #58481 (Pending Backport): rgw: remove guard_reshard in bucket_index_read_olh_log
- 02:15 AM Bug #58481 (Resolved): rgw: remove guard_reshard in bucket_index_read_olh_log
- bucket_index_read_olh_log just read the bucket index obj, so it is no need to be executed in guard_reshard.
- 03:45 PM Bug #57562 (Pending Backport): multisite replication issue on Quincy
01/17/2023
- 10:58 PM Backport #58479 (Resolved): quincy: RGW service crashes regularly with floating point exception
- https://github.com/ceph/ceph/pull/53592
- 10:58 PM Backport #58478 (Resolved): pacific: RGW service crashes regularly with floating point exception
- https://github.com/ceph/ceph/pull/53593
- 10:57 PM Bug #57881 (Pending Backport): LDAP invalid password resource leak fix
- 10:51 PM Bug #58330 (Pending Backport): RGW service crashes regularly with floating point exception
- 03:03 PM Bug #58473 (Duplicate): PutBucketEncryption default policy does not apply to multipart uploads
- When applying a default encryption policy through PutBucketEncryption, it appears to only affect simple PutObject upl...
- 01:22 PM Backport #58472 (In Progress): quincy: On version 17.2.5-8.el9cp, "Segmentation fault" while uplo...
- 01:13 PM Bug #58332 (Pending Backport): On version 17.2.5-8.el9cp, "Segmentation fault" while uploading ob...
01/16/2023
- 04:30 PM Bug #58330: RGW service crashes regularly with floating point exception
- Hi Eric,
It was indeed, and when checking the rest of the buckets on the system we don't have any with zero shards... - 12:40 PM Backport #58470: pacific: It is not possible to set empty tags on buckets and objects.
- Using "deleteBucketTagging" seems to work to get rid of the tags on a bucket, but "deleteObjectTagging" does not have...
- 12:13 PM Backport #58470 (Fix Under Review): pacific: It is not possible to set empty tags on buckets and ...
- It is not possible to reset bucket/object tags by sending an empty list via the AWS SDK functions `putBucketTagging` ...
01/13/2023
- 07:25 PM Bug #58330: RGW service crashes regularly with floating point exception
- Hey Jonathan,
Was that command issued in the zone (using the same RGW) as where the crashes occur? The reason I as... - 07:00 PM Bug #58453 (Pending Backport): rgw-gap-list has insufficient error checking
- Insufficient error checking can lead to empty intermediate file(s) that could result in incorrect output listing all ...
- 02:52 PM Bug #58442 (Pending Backport): rgw-orphan-list tool can list all rados objects as orphans
- When ran on a node with limited /tmp space, the 'sort' commands used in the 'rgw-orphan-list' tool will error out whe...
- 04:05 AM Bug #58375: rgw bucket notification failed to reserve notification on queue: . error: -28 when pu...
- Add some notification configuration info, we used dev/stg/prod kafka topic. We find dev-kafka disconnected from log. ...
Also available in: Atom