Project

General

Profile

Activity

From 02/19/2024 to 03/19/2024

03/18/2024

06:39 PM Bug #64971 (New): Rgw lifecycle skip
Running ceph ver. 18.2.0
We observe that bucket lifecycle cleanup, are being dropped on a random day each week.
Sh...
Erik Skytthe
04:58 PM Bug #59380: rados/singleton-nomsgr: test failing from "Health check failed: 1 full osd(s) (OSD_FU...
/a/yuriw-2024-03-15_19:59:43-rados-wip-yuri6-testing-2024-03-15-0709-distro-default-smithi/7603379/
/a/yuriw-2024-03...
Aishwarya Mathuria

03/17/2024

02:35 PM Backport #64834 (Resolved): squid: RGW segmentation fault when reading object permissions via the...
Casey Bodley
02:35 PM Backport #64876 (Resolved): squid: x-amz-expiration HTTP header: expiry-date sometimes broken
Casey Bodley
02:35 PM Backport #64887 (Resolved): squid: kafka: RGW hangs when broker is down for no persistent notific...
Casey Bodley
02:35 PM Backport #64909 (Resolved): squid: rgw: rgw-restore-bucket-index -- sort uses specified temp dir
Casey Bodley

03/16/2024

06:54 AM Bug #64571: lifecycle transition crashes since merge end-to-end tracing
>>>
#0 __pthread_kill_implementation (
threadid=<optimized out>, signo=signo@entry=11,
no_tid=no_tid@entr...
Soumya Koduri
06:53 AM Bug #64571: lifecycle transition crashes since merge end-to-end tracing
Not able to reproduce this issue locally. Pasting the bt of two crashes reported so far -
>>>
2024-03-13T13:33...
Soumya Koduri

03/15/2024

05:41 PM Bug #64571: lifecycle transition crashes since merge end-to-end tracing
Casey Bodley wrote:
> hey Shreyansh and Soumya, any updates here? this is one urgent for the squid release
Hi Cas...
Soumya Koduri
04:53 PM Bug #64571: lifecycle transition crashes since merge end-to-end tracing
hey Shreyansh and Soumya, any updates here? this is one urgent for the squid release Casey Bodley
04:51 PM Backport #64954 (New): squid: Notification FilterRules for S3key, S3Metadata & S3Tags spit incorr...
Backport Bot
04:47 PM Bug #64653 (Pending Backport): Notification FilterRules for S3key, S3Metadata & S3Tags spit incor...
Casey Bodley
03:21 PM Backport #64949 (In Progress): squid: rgw-multisite: add x-rgw-replicated-at
Casey Bodley
01:50 PM Backport #64949 (In Progress): squid: rgw-multisite: add x-rgw-replicated-at
https://github.com/ceph/ceph/pull/56226 Backport Bot
03:08 PM Bug #64953 (Fix Under Review): [CVE-2023-46159] RGW crash upon misconfigured CORS rule
Casey Bodley
02:32 PM Bug #64950: rgw-nfs: various file mv (rename) operations fail
update: not quincy, reef Matt Benjamin
02:08 PM Bug #64950 (Fix Under Review): rgw-nfs: various file mv (rename) operations fail
Matt Benjamin
01:57 PM Bug #64950 (In Progress): rgw-nfs: various file mv (rename) operations fail
Matt Benjamin
01:56 PM Bug #64950 (Fix Under Review): rgw-nfs: various file mv (rename) operations fail
This is a regression, probably dating back to Quincy. The initial regression was caused by zipper integration. Matt Benjamin
02:27 PM Backport #64541 (Resolved): squid: metadata cache races on deletes
Casey Bodley
01:49 PM Feature #64365 (Pending Backport): rgw-multisite: add x-rgw-replicated-at
Casey Bodley
01:44 PM Backport #64948 (Resolved): squid: support lifecycle filters ObjectSizeLessThan and ObjectSizeGre...
squid backported included with https://tracker.ceph.com/issues/64876 Casey Bodley
01:27 PM Backport #64948 (Resolved): squid: support lifecycle filters ObjectSizeLessThan and ObjectSizeGre...
Backport Bot
01:25 PM Feature #63304 (Pending Backport): support lifecycle filters ObjectSizeLessThan and ObjectSizeGre...
Casey Bodley

03/14/2024

10:01 PM Bug #64803: ninja all on fedora 39 fails because arrow_ext requires C++14
Hey Casey, I just worked around it with...... Brad Hubbard
02:41 PM Bug #64803: ninja all on fedora 39 fails because arrow_ext requires C++14
thanks Brad. our arrow submodule is rather old, it needs to be updated
epel does have system packages for this (li...
Casey Bodley
07:46 PM Backport #64228: reef: sts: CreateRole fails with MalformedPolicyDocument if policy document cont...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55356
merged
Yuri Weinstein
02:43 PM Bug #64253 (Won't Fix): bucket notifications publish all events when TopicConfiguration.Events ar...
Yuval Lifshitz wrote:
> according to our documentation: https://docs.ceph.com/en/latest/radosgw/s3/bucketops/#create...
Casey Bodley
02:10 PM Bug #64571: lifecycle transition crashes since merge end-to-end tracing
saw an expiration crash in https://qa-proxy.ceph.com/teuthology/cbodley-2024-03-13_12:30:10-rgw-wip-cbodley-testing-d... Casey Bodley
05:59 AM Backport #64909 (In Progress): squid: rgw: rgw-restore-bucket-index -- sort uses specified temp dir
J. Eric Ivancich
05:58 AM Backport #64909 (Resolved): squid: rgw: rgw-restore-bucket-index -- sort uses specified temp dir
https://github.com/ceph/ceph/pull/56181 Backport Bot
05:58 AM Backport #64910 (New): quincy: rgw: rgw-restore-bucket-index -- sort uses specified temp dir
Backport Bot
05:58 AM Backport #64908 (New): reef: rgw: rgw-restore-bucket-index -- sort uses specified temp dir
Backport Bot
05:56 AM Bug #64875 (Pending Backport): rgw: rgw-restore-bucket-index -- sort uses specified temp dir
J. Eric Ivancich
03:08 AM Bug #63657: The usage of all buckets will be deleted(If you execute DELETE /admin/usage?bucket={b...
This bug does not reproduce on main.
See the output of this script (https://paste.sh/2IyRPtr4#tuYSmCnqmS4RlogGPvdX...
Ali Maredia

03/13/2024

09:11 PM Feature #64903 (New): sns: support AddPermission/RemovePermission for granular topic policy
rgw supports setting topic policy via the Policy attribute in SetTopicAttributes. add support for AddPermission and R... Casey Bodley
02:01 PM Bug #64184: test_bn.py -v -a kafka_test: Fatal glibc error: tpp.c:87 (__pthread_tpp_change_priori...
similar crash, but with "Attempt to free invalid pointer" in tcmalloc:... Yuval Lifshitz
01:09 PM Bug #64816: garbage collection not processing
Thanks for the info.
I've tried running `radosgw-admin gc process` a few times but doesn't appear to be doing anyt...
matt dyer
12:11 PM Backport #64886 (In Progress): quincy: kafka: RGW hangs when broker is down for no persistent not...
Yuval Lifshitz
10:35 AM Backport #64886 (In Progress): quincy: kafka: RGW hangs when broker is down for no persistent not...
https://github.com/ceph/ceph/pull/56163 Backport Bot
11:56 AM Bug #64889 (New): Deleting an rgw realm, does not clear the 'realm_id' and it is listed in the 'd...
Description of problem:
Deleting an rgw realm, does not clear the 'realm_id' and it is listed in the 'default_inf...
Shreyansh Sancheti
11:41 AM Bug #64888 (In Progress): RFE: Realm get default should show the realm name with id.

[root@magna016 ~]# radosgw-admin realm create --rgw-realm test2 --default
{
"id": "1f1ad6c8-47ae-46bf-8f29-b...
Shreyansh Sancheti
11:31 AM Backport #64885 (In Progress): reef: kafka: RGW hangs when broker is down for no persistent notif...
Yuval Lifshitz
10:35 AM Backport #64885 (In Progress): reef: kafka: RGW hangs when broker is down for no persistent notif...
https://github.com/ceph/ceph/pull/56158 Backport Bot
10:47 AM Backport #64887 (In Progress): squid: kafka: RGW hangs when broker is down for no persistent noti...
Yuval Lifshitz
10:36 AM Backport #64887 (Resolved): squid: kafka: RGW hangs when broker is down for no persistent notific...
https://github.com/ceph/ceph/pull/56156 Backport Bot
10:29 AM Bug #64710 (Pending Backport): kafka: RGW hangs when broker is down for no persistent notifications
Yuval Lifshitz
10:19 AM Bug #64253: bucket notifications publish all events when TopicConfiguration.Events array is empty
according to our documentation: https://docs.ceph.com/en/latest/radosgw/s3/bucketops/#create-notification... Yuval Lifshitz
01:49 AM Backport #64795 (Resolved): squid: rgw: compatibility issues on BucketPublicAccessBlock
Casey Bodley

03/12/2024

07:44 PM Feature #64083: Response code from rgw rate-limit should be 429 not 503 , best is configurable
+1 on this request Wes Dillingham
07:35 PM Backport #64793 (In Progress): quincy: Notification kafka: Persistent messages are removed even w...
Yuval Lifshitz
07:30 PM Backport #64876 (In Progress): squid: x-amz-expiration HTTP header: expiry-date sometimes broken
Casey Bodley
07:19 PM Backport #64876 (Resolved): squid: x-amz-expiration HTTP header: expiry-date sometimes broken
https://github.com/ceph/ceph/pull/56144 Backport Bot
07:19 PM Backport #64878 (New): reef: x-amz-expiration HTTP header: expiry-date sometimes broken
Backport Bot
07:19 PM Backport #64877 (New): quincy: x-amz-expiration HTTP header: expiry-date sometimes broken
Backport Bot
07:12 PM Bug #63973 (Pending Backport): x-amz-expiration HTTP header: expiry-date sometimes broken
Casey Bodley
07:01 PM Backport #64861: squid: Notification kafka: Persistent messages are removed even when the broker ...
Krunal Chheda wrote:
> @yuval, is the tag v19.0.0 for squid and is this the squid code base (https://github.com/cep...
Yuval Lifshitz
06:45 PM Backport #64861: squid: Notification kafka: Persistent messages are removed even when the broker ...
@yuval, is the tag v19.0.0 for squid and is this the squid code base (https://github.com/ceph/ceph/blob/v19.0.0/src/r... Krunal Chheda
12:41 PM Backport #64861 (Rejected): squid: Notification kafka: Persistent messages are removed even when ...
Krunal Chheda wrote:
> Why do we need backport for squid, this PR was part of main before the squid was cut
you ...
Yuval Lifshitz
12:37 PM Backport #64861: squid: Notification kafka: Persistent messages are removed even when the broker ...
Why do we need backport for squid, this PR was part of main before the squid was cut Krunal Chheda
12:14 PM Backport #64861 (Rejected): squid: Notification kafka: Persistent messages are removed even when ...
Backport Bot
05:29 PM Backport #64768 (Resolved): squid: rgw: awssigv4: new trailer boundary case
Casey Bodley
05:15 PM Bug #64875 (Pending Backport): rgw: rgw-restore-bucket-index -- sort uses specified temp dir
Allows sort to use the specified temporary directory. Also fixes a bug in the temp file clean-up (backslash missing). J. Eric Ivancich
03:41 PM Backport #64764 (Resolved): squid: SSL session id reuse speedup mechanism of the SSL_CTX_set_sess...
Casey Bodley
02:21 PM Backport #64792 (In Progress): reef: Notification kafka: Persistent messages are removed even whe...
Yuval Lifshitz
02:14 PM Backport #64661 (Resolved): squid: uncaught exception from AWSv4ComplMulti during java AWS4Test.t...
Casey Bodley
02:14 PM Backport #64664 (Resolved): squid: object lock: An object uploaded through a multipart upload can...
Casey Bodley
02:14 PM Backport #64493 (Resolved): squid: Disable/Enable access key Feature
Casey Bodley
01:49 PM Bug #64867 (New): Doc for #migrating-a-single-site-deployment-to-multi-site needs to be updated.
The upstream documentation for migrating a single site to a multisite(with default zone configuration) needs to be up... Vidushi Mishra
12:37 PM Backport #64773 (Resolved): squid: rgw: make rgw-restore-bucket-index more robust
Casey Bodley
12:32 PM Backport #63839 (Resolved): reef: [Errno 13] Permission denied: '/vstart_runner.log'
Casey Bodley
03:13 AM Bug #63177: RGW user quotas is not honored when bucket owner is different than uploader
The problem persists even after running sync-stats. In fact, I identified the issue weeks after the quota had already... Taha Jahangir

03/11/2024

07:20 PM Feature #64851 (New): RGW: Support read_from_replica everywhere
We would like RGW to support read-from-replica for stretch clusters. Greg Farnum
06:32 PM Backport #64693: reef: rgw/s3select: crashes in test_progress_expressions in run_s3select_on_csv
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55969
merged
Yuri Weinstein
06:31 PM Backport #64600: reef: unittest_rgw_dmclock_scheduler fails for arm64
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55790
merged
Yuri Weinstein
06:29 PM Backport #64500: reef: multisite: Deadlock in RGWDeleteMultiObj with default rgw_multi_obj_del_ma...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55655
merged
Yuri Weinstein
06:28 PM Backport #64426: reef: rgw: rados objects wrongly deleted
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55621
merged
Yuri Weinstein
06:28 PM Backport #64448: reef: invalid olh attributes on the target object after copy_object in a version...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55606
merged
Yuri Weinstein
06:26 PM Backport #64088: reef: multisite: don't write data/bilog entries for lifecycle transitions/deletes
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55289
merged
Yuri Weinstein
06:24 PM Backport #63960: reef: rgw: lack of headers in 304 response
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55094
merged
Yuri Weinstein
06:23 PM Backport #63940: reef: 'radosgw-admin zone set' overwrites default-placement target
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/55061
merged
Yuri Weinstein
06:22 PM Backport #63777: reef: [rgw][lc] using custom lc schedule (work time) may cause lc processing to ...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/54866
merged
Yuri Weinstein
05:33 PM Backport #64694 (Resolved): squid: rgw/s3select: crashes in test_progress_expressions in run_s3se...
Casey Bodley
05:06 PM Bug #64841 (New): java_s3tests: testObjectCreateBadExpectMismatch failure
ex. http://qa-proxy.ceph.com/teuthology/cbodley-2024-03-10_14:50:40-rgw-wip-cbodley2-testing-distro-default-smithi/75... Casey Bodley
03:54 PM Backport #64833 (In Progress): reef: RGW segmentation fault when reading object permissions via t...
https://github.com/ceph/ceph/pull/56004 Casey Bodley
03:39 PM Backport #64833 (In Progress): reef: RGW segmentation fault when reading object permissions via t...
Backport Bot
03:44 PM Backport #64834 (In Progress): squid: RGW segmentation fault when reading object permissions via ...
Casey Bodley
03:39 PM Backport #64834 (Resolved): squid: RGW segmentation fault when reading object permissions via the...
https://github.com/ceph/ceph/pull/56125 Backport Bot
03:43 PM Bug #64835 (New): valgrind invalid read related to D3nDataCache::d3n_libaio_create_write_request()
d3n datacache job failing with valgrind issue
example job: http://qa-proxy.ceph.com/teuthology/cbodley-2024-03-10_...
Casey Bodley
03:34 PM Bug #63684 (Pending Backport): RGW segmentation fault when reading object permissions via the swi...
Casey Bodley
03:19 PM Bug #64832 (New): valgrind UninitCondition in RGWSelectObj_ObjStore_S3::run_s3select_on_csv
from rgw/verify job: http://qa-proxy.ceph.com/teuthology/cbodley-2024-03-10_14:49:11-rgw-wip-cbodley-testing-distro-d... Casey Bodley
03:16 PM Bug #63786: rados_cls_all: TestCls2PCQueue.MultiProducer hangs
saw in http://qa-proxy.ceph.com/teuthology/cbodley-2024-03-10_14:49:11-rgw-wip-cbodley-testing-distro-default-smithi/... Casey Bodley
11:17 AM Backport #64766 (In Progress): reef: SSL session id reuse speedup mechanism of the SSL_CTX_set_se...
Mark Kogan
11:07 AM Backport #64767 (In Progress): quincy: SSL session id reuse speedup mechanism of the SSL_CTX_set_...
Mark Kogan

03/10/2024

02:45 PM rgw-testing Bug #64822 (Resolved): s3tests: boto2 test_headers.py failures
https://github.com/ceph/s3-tests/pull/555 Casey Bodley
02:38 PM rgw-testing Bug #64822: s3tests: boto2 test_headers.py failures
from a good run on 3/8: http://qa-proxy.ceph.com/teuthology/cbodley-2024-03-08_14:54:28-rgw-wip-rgw-account-v3-distro... Casey Bodley
02:27 PM rgw-testing Bug #64822 (Resolved): s3tests: boto2 test_headers.py failures
all of the below are failing with @AssertionError: S3ResponseError not raised@... Casey Bodley
02:00 PM Bug #64816 (Won't Fix - EOL): garbage collection not processing
> Is there anything that can be done to force GC to run?
`radosgw-admin gc process` will try to process the queue,...
Casey Bodley

03/08/2024

06:42 PM Backport #64818 (In Progress): squid: [RFE] multisite: Bucket notification information should be ...
https://github.com/ceph/ceph/pull/56069 Casey Bodley
06:14 PM Backport #64818 (In Progress): squid: [RFE] multisite: Bucket notification information should be ...
Casey Bodley
06:13 PM Feature #50078 (Pending Backport): [RFE] multisite: Bucket notification information should be sha...
Casey Bodley wrote:
> already merged:
> https://github.com/ceph/ceph/pull/55688 test/rgw/notifications: split tests...
Casey Bodley
02:36 PM Bug #64816 (Won't Fix - EOL): garbage collection not processing
Hello
Just noticed after deleting some large buckets from a rgw.buckets.data pool that GC is not actually deleting...
matt dyer
06:47 AM Bug #64805 (New): rgw: dynamic resharding will block write op
When rgw dynamic resharding is triggered, writing will be blocked. I think this is unreasonable and may have a seriou... changzhi tan
02:20 AM Bug #64803 (New): ninja all on fedora 39 fails because arrow_ext requires C++14
commit 6c9d1b64849f1531cde0b6dd9bc1fd91c9ce153... Brad Hubbard

03/07/2024

09:56 PM rgw-testing Bug #64801 (New): s3tests: unpin botocore version
the version was pinned to work around a v2 signature regression in botocore-1.28.0
Matt confirmed that botocore 1....
Casey Bodley
06:03 PM Feature #64797 (Fix Under Review): config option to disable s3 presigned urls
Casey Bodley
05:07 PM Feature #64797 (Fix Under Review): config option to disable s3 presigned urls
allow admins to disable authentication via presigned urls Casey Bodley
04:12 PM Backport #64795 (In Progress): squid: rgw: compatibility issues on BucketPublicAccessBlock
Casey Bodley
04:11 PM Backport #64795 (Resolved): squid: rgw: compatibility issues on BucketPublicAccessBlock
https://github.com/ceph/ceph/pull/56043 Casey Bodley
04:11 PM Backport #64796 (New): reef: rgw: compatibility issues on BucketPublicAccessBlock
Casey Bodley
04:11 PM Backport #64794 (New): quincy: rgw: compatibility issues on BucketPublicAccessBlock
Casey Bodley
04:04 PM Bug #64492 (Pending Backport): rgw: compatibility issues on BucketPublicAccessBlock
Casey Bodley
03:34 PM Bug #61716: Production random data not accessible. Object not found on healthy cluster.
This sounds like it could be a duplicate of this bug that was resolved:
https://tracker.ceph.com/issues/63642
...
J. Eric Ivancich
03:31 PM Backport #64793 (In Progress): quincy: Notification kafka: Persistent messages are removed even w...
https://github.com/ceph/ceph/pull/56145 Backport Bot
03:31 PM Backport #64792 (In Progress): reef: Notification kafka: Persistent messages are removed even whe...
https://github.com/ceph/ceph/pull/56140 Backport Bot
03:27 PM Bug #62808 (Can't reproduce): Buckets mtime equal to creation time
Casey Bodley
03:25 PM Bug #63335 (Pending Backport): Notification kafka: Persistent messages are removed even when the ...
Casey Bodley
03:23 PM Bug #63275 (Duplicate): RGW: Using bucket chown causes objects to change to the standard storage ...
Casey Bodley
03:22 PM Bug #63542 (Won't Fix): Delete-Marker deletion inconsistencies
Casey Bodley
03:21 PM Bug #63546 (Resolved): rgwlc: even current object versions have a unique instance
Casey Bodley
03:12 PM Bug #64264 (Resolved): RGW:use radosgw-admin list object in bucket, radosgw-admin -h no useful info
Casey Bodley
03:02 PM Bug #64710 (Fix Under Review): kafka: RGW hangs when broker is down for no persistent notifications
Casey Bodley
02:11 PM Backport #64764 (In Progress): squid: SSL session id reuse speedup mechanism of the SSL_CTX_set_s...
Casey Bodley
01:56 AM Backport #64764 (Resolved): squid: SSL session id reuse speedup mechanism of the SSL_CTX_set_sess...
https://github.com/ceph/ceph/pull/56037 Backport Bot
01:58 PM Backport #64768 (In Progress): squid: rgw: awssigv4: new trailer boundary case
Casey Bodley
01:57 AM Backport #64768 (Resolved): squid: rgw: awssigv4: new trailer boundary case
https://github.com/ceph/ceph/pull/56036 Backport Bot
12:35 PM Backport #64692 (Rejected): quincy: rgw/s3select: crashes in test_progress_expressions in run_s3s...
Gal Salomon
12:34 PM Backport #64692: quincy: rgw/s3select: crashes in test_progress_expressions in run_s3select_on_csv
this issue is not relevant to quincy.
at that time it was a different CSV system.
Gal Salomon
02:38 AM Backport #64773 (In Progress): squid: rgw: make rgw-restore-bucket-index more robust
J. Eric Ivancich
02:06 AM Backport #64773 (Resolved): squid: rgw: make rgw-restore-bucket-index more robust
https://github.com/ceph/ceph/pull/56009 Backport Bot
02:06 AM Backport #64772 (New): reef: rgw: make rgw-restore-bucket-index more robust
Backport Bot
02:06 AM Backport #64771 (New): quincy: rgw: make rgw-restore-bucket-index more robust
Backport Bot
01:57 AM Backport #64770 (New): quincy: rgw: awssigv4: new trailer boundary case
Backport Bot
01:57 AM Backport #64769 (New): reef: rgw: awssigv4: new trailer boundary case
Backport Bot
01:56 AM Backport #64767 (In Progress): quincy: SSL session id reuse speedup mechanism of the SSL_CTX_set_...
https://github.com/ceph/ceph/pull/56119 Backport Bot
01:56 AM Backport #64766 (In Progress): reef: SSL session id reuse speedup mechanism of the SSL_CTX_set_se...
https://github.com/ceph/ceph/pull/56120 Backport Bot
01:56 AM Feature #64765 (Pending Backport): rgw: make rgw-restore-bucket-index more robust
This experimental tool write a series of temporary files, the combined size of which is roughly proportional to some ... J. Eric Ivancich
01:54 AM Bug #64676 (Pending Backport): rgw: awssigv4: new trailer boundary case
J. Eric Ivancich
01:53 AM Bug #64719 (Pending Backport): SSL session id reuse speedup mechanism of the SSL_CTX_set_session_...
J. Eric Ivancich

03/06/2024

03:51 PM Bug #63684 (Fix Under Review): RGW segmentation fault when reading object permissions via the swi...
Casey Bodley
03:25 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
It seems https://github.com/ceph/ceph/commit/db8d1d455c7f41b2527fb79ab510f186a7d63109 just lost somehow during Ceph R... Peter Razumovsky
12:45 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
I see it was already fixed someday https://tracker.ceph.com/issues/56029. Wondering why it happens again, maybe becau... Peter Razumovsky
12:01 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
Do we have any WA for this? Peter Razumovsky
12:00 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
We are facing the same issue on ceph v18.2.1 (rook v1.12.10)... Peter Razumovsky
03:17 PM Feature #50078 (Fix Under Review): [RFE] multisite: Bucket notification information should be sha...
Krunal Chheda

03/05/2024

06:29 PM Feature #7791 (Rejected): radosgw-agent should show statistics
Casey Bodley
06:28 PM Feature #8800 (Rejected): Radosgw-agent on pypi.python.org
Casey Bodley
04:06 PM Backport #64693 (In Progress): reef: rgw/s3select: crashes in test_progress_expressions in run_s3...
Gal Salomon
03:23 PM Bug #64719 (Fix Under Review): SSL session id reuse speedup mechanism of the SSL_CTX_set_session_...
Casey Bodley
02:16 PM Bug #64719 (Pending Backport): SSL session id reuse speedup mechanism of the SSL_CTX_set_session_...
The OpenSSL session-id reuse acceleration mechanism that is described in SSL_CTX_set_session_id_context
https://ww...
Mark Kogan
09:29 AM Bug #64710 (Pending Backport): kafka: RGW hangs when broker is down for no persistent notifications
based on this comment: https://github.com/ceph/ceph/pull/55051#issuecomment-1961950841
the main issue is that the li...
Yuval Lifshitz
05:10 AM Backport #64694: squid: rgw/s3select: crashes in test_progress_expressions in run_s3select_on_csv
https://github.com/ceph/ceph/pull/55941 Gal Salomon

03/04/2024

05:27 PM Backport #64694 (Resolved): squid: rgw/s3select: crashes in test_progress_expressions in run_s3se...
Backport Bot
05:27 PM Backport #64693 (In Progress): reef: rgw/s3select: crashes in test_progress_expressions in run_s3...
https://github.com/ceph/ceph/pull/55969 Backport Bot
05:27 PM Backport #64692 (Rejected): quincy: rgw/s3select: crashes in test_progress_expressions in run_s3s...
Backport Bot
05:27 PM Bug #63245 (Pending Backport): rgw/s3select: crashes in test_progress_expressions in run_s3select...
Casey Bodley
03:12 PM Bug #63245 (New): rgw/s3select: crashes in test_progress_expressions in run_s3select_on_csv
the PR is fixing the issue of too-small-chunk (flow was changed to append these small chunks)
thus, upon compression...
Gal Salomon
02:54 PM Bug #63245 (Fix Under Review): rgw/s3select: crashes in test_progress_expressions in run_s3select...
Casey Bodley
03:57 PM Bug #64690 (New): TestAMQP.MaxConnections failure
a make check failure from https://jenkins.ceph.com/job/ceph-pull-requests/130468/consoleFull#-1839254854e840cee4-f4a4... Casey Bodley

03/03/2024

04:29 PM Bug #63245: rgw/s3select: crashes in test_progress_expressions in run_s3select_on_csv
ignore the previous comment.
the exception (before that it was an assert) was caused by a small-size chunk.
the s...
Gal Salomon

03/02/2024

07:36 PM Bug #64676 (Fix Under Review): rgw: awssigv4: new trailer boundary case
Matt Benjamin
07:34 PM Bug #64676 (Pending Backport): rgw: awssigv4: new trailer boundary case
I observed an environment in which the maven test suite, using http, generated a trailer chunk
boundary of "0;" rath...
Matt Benjamin
12:21 PM Bug #63245: rgw/s3select: crashes in test_progress_expressions in run_s3select_on_csv
https://github.com/ceph/ceph/pull/55891
this PR removes the assert residing in the CSV-parser and replaces it with...
Gal Salomon

03/01/2024

05:25 PM Backport #64664 (In Progress): squid: object lock: An object uploaded through a multipart upload ...
Casey Bodley
05:22 PM Backport #64664 (Resolved): squid: object lock: An object uploaded through a multipart upload can...
https://github.com/ceph/ceph/pull/55876 Backport Bot
05:22 PM Backport #64666 (New): reef: object lock: An object uploaded through a multipart upload can be de...
Backport Bot
05:22 PM Backport #64665 (New): quincy: object lock: An object uploaded through a multipart upload can be ...
Backport Bot
05:20 PM Bug #63724 (Pending Backport): object lock: An object uploaded through a multipart upload can be ...
Casey Bodley
01:56 PM Backport #64661 (In Progress): squid: uncaught exception from AWSv4ComplMulti during java AWS4Tes...
Casey Bodley
01:36 PM Backport #64661 (Resolved): squid: uncaught exception from AWSv4ComplMulti during java AWS4Test.t...
https://github.com/ceph/ceph/pull/55871 Backport Bot
01:28 PM Bug #64549 (Pending Backport): uncaught exception from AWSv4ComplMulti during java AWS4Test.testM...
Casey Bodley

02/29/2024

08:03 PM Bug #64653 (Fix Under Review): Notification FilterRules for S3key, S3Metadata & S3Tags spit incor...
Krunal Chheda
07:43 PM Bug #64653 (Pending Backport): Notification FilterRules for S3key, S3Metadata & S3Tags spit incor...

Currently if both prefix & suffix filter rules are set and if try to do a `radosgw-admin notification get` & captur...
Krunal Chheda
03:45 PM Backport #64501 (Resolved): squid: multisite: Deadlock in RGWDeleteMultiObj with default rgw_mult...
Casey Bodley
03:45 PM Backport #64601 (Resolved): squid: unittest_rgw_dmclock_scheduler fails for arm64
Casey Bodley
03:29 PM Bug #64418 (Can't reproduce): RGW garbage collection stuck and growing
Casey Bodley
03:28 PM Bug #64431 (Triaged): metadata sync does not replicate iam OpenIDConnectProvider metadata
Casey Bodley
03:12 PM Bug #64598 (Triaged): Radosgw Instance ID Mismatch between metadata counters and RGW exporter met...
Ali Maredia
03:12 PM Bug #64185 (Triaged): timeouts when listing versioned buckets that skip over many entries
Casey Bodley

02/28/2024

05:55 PM Bug #49387: several crashes from bad_alloc exceptions
i'm hearing reports that rhel 8.6 is shipping a gperftools 2.8.1 that has these same crashes?
edit: oops, this isn...
Casey Bodley
05:06 PM Bug #51437 (Resolved): the lifecycle transition operation does not work after set object acl
The fix is available from quincy release. Soumya Koduri
05:03 PM Bug #51437: the lifecycle transition operation does not work after set object acl
This issue was already fixed as part of https://tracker.ceph.com/issues/61770 (https://github.com/ceph/ceph/pull/52160) Soumya Koduri
04:43 PM Bug #62774: datalog crash consistency: missing objects on the secondary site after the multisite ...
design doc: https://pad.ceph.com/p/Datalog_Crash_Consistency Jane Zhu
02:43 PM Bug #64571: lifecycle transition crashes since merge end-to-end tracing
when testing the squid backport of end2end tracing https://github.com/ceph/ceph/pull/55625, i didn't see these crashe... Casey Bodley

02/27/2024

08:27 PM Feature #64251: allow AWS lifecycle event types to configure lifecycle notifications and Replicat...
As part of this tracker, the lifecycle and ObjectSynced(multisite Replication) events are made aws compatible along w... Krunal Chheda
04:21 PM Backport #64601 (In Progress): squid: unittest_rgw_dmclock_scheduler fails for arm64
Casey Bodley
04:15 PM Backport #64601 (Resolved): squid: unittest_rgw_dmclock_scheduler fails for arm64
https://github.com/ceph/ceph/pull/55791 Backport Bot
04:21 PM Backport #64600 (In Progress): reef: unittest_rgw_dmclock_scheduler fails for arm64
Casey Bodley
04:15 PM Backport #64600 (In Progress): reef: unittest_rgw_dmclock_scheduler fails for arm64
https://github.com/ceph/ceph/pull/55790 Backport Bot
04:20 PM Backport #64599 (In Progress): quincy: unittest_rgw_dmclock_scheduler fails for arm64
Casey Bodley
04:15 PM Backport #64599 (In Progress): quincy: unittest_rgw_dmclock_scheduler fails for arm64
https://github.com/ceph/ceph/pull/55789 Backport Bot
04:06 PM Bug #64568 (Pending Backport): unittest_rgw_dmclock_scheduler fails for arm64
Casey Bodley
02:41 PM Bug #64598 (Triaged): Radosgw Instance ID Mismatch between metadata counters and RGW exporter met...
Currently, metrics consumed by Prometheus related to the RGW are being generated by combining two parts:
1. The RGW ...
Ali Maredia

02/26/2024

08:14 PM Bug #64571: lifecycle transition crashes since merge end-to-end tracing
wasn't able to reproduce under vstart. tested both with a debug build and a release build
required extra storage-c...
Casey Bodley
03:58 PM Bug #64571 (New): lifecycle transition crashes since merge end-to-end tracing
regression from https://github.com/ceph/ceph/pull/52114, whose test results included these failures https://pulpito.c... Casey Bodley
03:36 PM Feature #64569 (New): sns: implement Subscribe/Unsubscribe instead of configuring endpoints in To...
Casey Bodley
02:48 PM Bug #64568 (Fix Under Review): unittest_rgw_dmclock_scheduler fails for arm64
can't test on arm, but i was able to reproduce failures by running the unittest under valgrind. the 1ms sleeps were j... Casey Bodley
02:01 PM Bug #64568 (Pending Backport): unittest_rgw_dmclock_scheduler fails for arm64
... Leonid Usov

02/25/2024

05:16 AM Bug #64557 (New): Error in rgw python bindings
Using python binding for rgw fails with this error:... Taha Jahangir

02/23/2024

06:16 PM Bug #64543: ceph_test_librgw_file_nfsns crashes on infinite loop
squid backport is included in https://github.com/ceph/ceph/pull/55625 Casey Bodley
06:16 PM Bug #64543 (Resolved): ceph_test_librgw_file_nfsns crashes on infinite loop
Casey Bodley
06:11 PM Bug #64543 (Pending Backport): ceph_test_librgw_file_nfsns crashes on infinite loop
Casey Bodley
04:07 PM Backport #64552 (New): squid: rgw/multisite: objects named "." or ".." are not replicated
Backport Bot
04:07 PM Backport #64551 (New): reef: rgw/multisite: objects named "." or ".." are not replicated
Backport Bot
04:07 PM Backport #64550 (New): quincy: rgw/multisite: objects named "." or ".." are not replicated
Backport Bot
04:01 PM Bug #64366 (Pending Backport): rgw/multisite: objects named "." or ".." are not replicated
Casey Bodley
03:47 PM Support #64547: List topic
Just FYI, you might also need to recreate the topic if the user info is not stored on topic.
the PR to store user i...
Krunal Chheda
08:43 AM Support #64547: List topic
we are facing a problem regarding the topic operations to send notification, particularly when using amqp protocol.
...
Giada Malatesta
08:36 AM Support #64547 (New): List topic
Giada Malatesta
02:23 PM Bug #64549 (Fix Under Review): uncaught exception from AWSv4ComplMulti during java AWS4Test.testM...
Casey Bodley
02:22 PM Bug #64549: uncaught exception from AWSv4ComplMulti during java AWS4Test.testMultipartUploadWithP...
... Casey Bodley
01:48 PM Bug #64549 (Pending Backport): uncaught exception from AWSv4ComplMulti during java AWS4Test.testM...
from http://qa-proxy.ceph.com/teuthology/cbodley-2024-02-23_03:36:00-rgw-wip-cbodley-testing-distro-default-smithi/75... Casey Bodley

02/22/2024

10:51 PM Bug #64543: ceph_test_librgw_file_nfsns crashes on infinite loop
touche Casey Bodley
10:38 PM Bug #64543: ceph_test_librgw_file_nfsns crashes on infinite loop
see how useful librgw is? :) Matt Benjamin
10:01 PM Bug #64543 (Fix Under Review): ceph_test_librgw_file_nfsns crashes on infinite loop
Casey Bodley
09:57 PM Bug #64543 (Resolved): ceph_test_librgw_file_nfsns crashes on infinite loop
examples from https://pulpito.ceph.com/cbodley-2024-02-21_22:01:37-rgw-wip-rgw-account-v3-distro-default-smithi/
<...
Casey Bodley
08:33 PM Feature #50078: [RFE] multisite: Bucket notification information should be shared between zones.
already merged:
https://github.com/ceph/ceph/pull/55688 test/rgw/notifications: split tests between basic, kafka and...
Casey Bodley
06:02 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
Steve Taylor wrote:
> Steve Taylor wrote:
> > J. Eric Ivancich wrote:
> > > J. Eric Ivancich wrote:
> > > > Steve...
Steve Taylor
05:56 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
Steve Taylor wrote:
> J. Eric Ivancich wrote:
> > J. Eric Ivancich wrote:
> > > Steve Taylor wrote:
> > > > After...
Steve Taylor
05:53 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
J. Eric Ivancich wrote:
> J. Eric Ivancich wrote:
> > Steve Taylor wrote:
> > > After some additional testing, it ...
Steve Taylor
05:51 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
J. Eric Ivancich wrote:
> Steve Taylor wrote:
> > After some additional testing, it doesn't look like the RGWBucket...
J. Eric Ivancich
05:27 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
Steve Taylor wrote:
> After some additional testing, it doesn't look like the RGWBucketInfo whose attempted retrieva...
J. Eric Ivancich
05:16 PM Backport #64539 (In Progress): quincy: metadata cache races on deletes
Casey Bodley
04:38 PM Backport #64539 (In Progress): quincy: metadata cache races on deletes
https://github.com/ceph/ceph/pull/55718 Backport Bot
04:41 PM Backport #64540 (In Progress): reef: metadata cache races on deletes
Casey Bodley
04:38 PM Backport #64540 (In Progress): reef: metadata cache races on deletes
https://github.com/ceph/ceph/pull/55716 Backport Bot
04:40 PM Backport #64541 (In Progress): squid: metadata cache races on deletes
Casey Bodley
04:38 PM Backport #64541 (Resolved): squid: metadata cache races on deletes
https://github.com/ceph/ceph/pull/55715 Backport Bot
04:37 PM Bug #64480 (Pending Backport): metadata cache races on deletes
Casey Bodley
04:01 PM Bug #64527: Radosgw 504 timeouts & Garbage collection is frozen
thanks Michael
this is unfortunately common for librados clients like radosgw when pgs are down or unresponsive. t...
Casey Bodley
02:32 AM Bug #64527: Radosgw 504 timeouts & Garbage collection is frozen
Ouch syntax errors... Sorry I expected markdown to work here. Michael Collins
02:30 AM Bug #64527 (New): Radosgw 504 timeouts & Garbage collection is frozen

Ceph version: 17.2.6-1
OS: Ubuntu 20.04
Deployed without Cephadm using SystemD.
Cluster specs:...
Michael Collins
03:11 PM Bug #63177: RGW user quotas is not honored when bucket owner is different than uploader
Paul,
The user stats not being update makes it seem as if the user stats are not being updated fast enough. Can yo...
Ali Maredia

02/21/2024

11:43 PM Bug #51437: the lifecycle transition operation does not work after set object acl
hi soumya, when you return, could you look at this older report?
thanks!
Matt
Matt Benjamin
09:17 PM Feature #64526 (New): support x-amz-expected-bucket-owner
https://docs.aws.amazon.com/AmazonS3/latest/userguide/bucket-owner-condition.html
> Bucket owner condition isn't a...
Casey Bodley
07:20 PM Bug #63445: valgrind leak from D3nDataCache::d3n_libaio_create_write_request
@D3nDataCache::d3n_libaio_create_write_request@ popped up again on main. maybe just an unlikely race vs @ainit.aio_id... Casey Bodley
09:26 AM Bug #64184: test_bn.py -v -a kafka_test: Fatal glibc error: tpp.c:87 (__pthread_tpp_change_priori...
Casey Bodley wrote:
> @Yuval maybe it would make sense to split the rgw/notifications suite into two separate jobs f...
Yuval Lifshitz

02/20/2024

07:08 PM Backport #64510 (In Progress): squid: backport rgw/lc: decorating log events with more details
Casey Bodley
06:57 PM Backport #64510: squid: backport rgw/lc: decorating log events with more details
Backport (to Squid) PR: https://github.com/ceph/ceph/pull/55673 Oguzhan Ozmen
06:33 PM Backport #64510 (In Progress): squid: backport rgw/lc: decorating log events with more details
https://github.com/ceph/ceph/pull/55673 (backported from https://github.com/ceph/ceph/pull/55286) Oguzhan Ozmen
05:14 PM Bug #64366 (Fix Under Review): rgw/multisite: objects named "." or ".." are not replicated
Casey Bodley
05:13 PM Bug #64366: rgw/multisite: objects named "." or ".." are not replicated
The existing integration test case _test_multi.py:test_object_sync_ is updated to reproduce the issue. Objects with k... Oguzhan Ozmen
05:07 PM Bug #63724 (Fix Under Review): object lock: An object uploaded through a multipart upload can be ...
Casey Bodley
05:05 PM Bug #64184: test_bn.py -v -a kafka_test: Fatal glibc error: tpp.c:87 (__pthread_tpp_change_priori...
another crash trace from kafka test:... Yuval Lifshitz
04:14 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
Steve Taylor wrote:
> After some additional testing, it doesn't look like the RGWBucketInfo whose attempted retrieva...
Steve Taylor
10:15 AM Bug #63909 (Fix Under Review): persistent topic stats test fails
Yuval Lifshitz

02/19/2024

09:44 PM cleanup Tasks #62741: rgw_thread_pool_size is no longer used
@rgw_thread_pool_size@ is still used by the beast frontend for the thread pool. it's just not limited to 1 connection... Casey Bodley
09:28 PM Bug #63684: RGW segmentation fault when reading object permissions via the swift API
After some additional testing, it doesn't look like the RGWBucketInfo whose attempted retrieval is causing the segfau... Steve Taylor
06:13 PM Backport #64500 (In Progress): reef: multisite: Deadlock in RGWDeleteMultiObj with default rgw_mu...
Casey Bodley
06:03 PM Backport #64500 (In Progress): reef: multisite: Deadlock in RGWDeleteMultiObj with default rgw_mu...
https://github.com/ceph/ceph/pull/55655 Backport Bot
06:12 PM Backport #64501 (In Progress): squid: multisite: Deadlock in RGWDeleteMultiObj with default rgw_m...
Casey Bodley
06:03 PM Backport #64501 (Resolved): squid: multisite: Deadlock in RGWDeleteMultiObj with default rgw_mult...
https://github.com/ceph/ceph/pull/55654 Backport Bot
06:11 PM Bug #64492 (Fix Under Review): rgw: compatibility issues on BucketPublicAccessBlock
Casey Bodley
05:34 PM Bug #64492: rgw: compatibility issues on BucketPublicAccessBlock
PR: https://github.com/ceph/ceph/pull/55652 Seena Fallah
05:28 PM Bug #64492 (Pending Backport): rgw: compatibility issues on BucketPublicAccessBlock
- The root element on GetPublicAccessBlock should be PublicAccessBlockConfiguration.
- s3GetBucketPublicAccessBlock ...
Seena Fallah
06:03 PM Backport #64499 (New): squid: rgw: add s3select bytes processed and bytes returned to usage
Backport Bot
06:03 PM Backport #64498 (New): quincy: rgw: add s3select bytes processed and bytes returned to usage
Backport Bot
06:02 PM Backport #64497 (New): reef: rgw: add s3select bytes processed and bytes returned to usage
Backport Bot
06:02 PM Backport #64496 (New): squid: keystone admin token is not invalidated on http 401 response
Backport Bot
06:02 PM Backport #64495 (New): quincy: keystone admin token is not invalidated on http 401 response
Backport Bot
06:02 PM Backport #64494 (New): reef: keystone admin token is not invalidated on http 401 response
Backport Bot
06:00 PM Backport #64493 (In Progress): squid: Disable/Enable access key Feature
Casey Bodley
05:54 PM Backport #64493 (Resolved): squid: Disable/Enable access key Feature
https://github.com/ceph/ceph/pull/55653 Backport Bot
05:59 PM Bug #63373 (Pending Backport): multisite: Deadlock in RGWDeleteMultiObj with default rgw_multi_ob...
Casey Bodley
05:57 PM Feature #63563 (Pending Backport): rgw: add s3select bytes processed and bytes returned to usage
Casey Bodley
05:55 PM Bug #64094 (Pending Backport): keystone admin token is not invalidated on http 401 response
Casey Bodley
05:51 PM Feature #59186 (Pending Backport): Disable/Enable access key Feature
Casey Bodley
04:18 PM Bug #64489 (Fix Under Review): rgw: pick the last ip in x-forwarded-for chain
Casey Bodley
03:45 PM Bug #64489: rgw: pick the last ip in x-forwarded-for chain
PR: https://github.com/ceph/ceph/pull/55646 Seena Fallah
03:43 PM Bug #64489 (Fix Under Review): rgw: pick the last ip in x-forwarded-for chain
Currently, when rgw_remote_addr_param is set to HTTP_X_FORWARDED_FOR, it will pick the first IP from the chain. As de... Seena Fallah
02:44 PM Bug #63973 (Fix Under Review): x-amz-expiration HTTP header: expiry-date sometimes broken
Matt Benjamin
02:02 PM Bug #63642: rgw: rados objects wrongly deleted
for future reference the `rgw-gap-list` has been tested to work correctly with the golang reproducer to find the affe... Mark Kogan
 

Also available in: Atom