Project

General

Profile

Activity

From 03/15/2022 to 04/13/2022

04/13/2022

06:25 PM Backport #55044: pacific: cls_rgw_suggest_changes() may accidentally delete newly-completed entries
I'm wondering if this is the cause of:
https://tracker.ceph.com/issues/52721
I'm hoping that the backport will ...
J. Eric Ivancich
05:35 PM Backport #55044 (In Progress): pacific: cls_rgw_suggest_changes() may accidentally delete newly-c...
J. Eric Ivancich
05:51 PM Backport #55045 (In Progress): octopus: cls_rgw_suggest_changes() may accidentally delete newly-c...
J. Eric Ivancich
05:46 PM Backport #55043 (In Progress): quincy: cls_rgw_suggest_changes() may accidentally delete newly-co...
J. Eric Ivancich
05:44 PM Bug #52721: Bucket index entry not always created
J. Eric Ivancich wrote:
> This sounds like it could result from the bug fixed here:
>
> https://tracker.ceph.com/...
J. Eric Ivancich
05:32 PM Bug #52721: Bucket index entry not always created
This sounds like it could result from the bug fixed here:
https://tracker.ceph.com/issues/54528
We should see i...
J. Eric Ivancich
05:33 PM Bug #54524: the bucket resharding logs should be INFO and not ERROR?
J. Eric Ivancich wrote:
Thanks, Eric.
> A failure to reshard seems like it deserves at least a WARNING (1st and...
Vikhyat Umrao
04:54 PM Bug #54524 (Need More Info): the bucket resharding logs should be INFO and not ERROR?
A failure to reshard seems like it deserves at least a WARNING (1st and 3rd examples).
Your 2nd example looks like...
J. Eric Ivancich
04:32 PM Feature #55320 (New): rgw: allow "bucket check --fix" to clean up unpaired plain/instance entries
A customer was having an issue where they couldn't delete specific versions of objects in a versioned bucket. It turn... J. Eric Ivancich
12:41 PM Backport #53007: pacific: segfault on FIPS enabled server as result of EVP_md5 disabled in openssl
hi, it seems the backport was merged on jan 25 in pacific, can we expect the fix to be in the next 16.2.8 release? Giulio Fidente
06:44 AM Bug #55310 (Duplicate): [pacific] RadosGW instance of Cloud Sync zone crashes when objects are up...
*Summary:*
Cloud tier RadosGW crashes with std::length_error and does not sync to S3-enabled cloud storage on Pacifi...
Baturay Soysal

04/12/2022

07:33 PM Bug #55131 (Fix Under Review): radosgw crashes at RGWIndexCompletionManager::create_completion
J. Eric Ivancich
01:40 PM Backport #55291 (Rejected): pacific: RGWPutObj accessing two 'bucket sync policy' objects without...
Backport Bot
01:40 PM Backport #55290 (Rejected): octopus: RGWPutObj accessing two 'bucket sync policy' objects without...
Backport Bot
01:40 PM Backport #55289 (New): quincy: RGWPutObj accessing two 'bucket sync policy' objects without multi...
Backport Bot
01:36 PM Bug #54531 (Pending Backport): RGWPutObj accessing two 'bucket sync policy' objects without multi...
> This issue might exist for delete_obj() as well.
thanks Soumya. this fix should apply to delete_obj as well, whi...
Casey Bodley
01:18 PM Bug #55288 (Resolved): rgw/dbstore: handle prefix/delim in Bucket::list operation
GET operation over a bucket on dbstore implementation, is producing a wrong set of items.
For example, if you feed ...
Giuseppe Baccini
12:36 PM Bug #55286 (Fix Under Review): Segfault when Open Policy Agent authorization is enabled
Casey Bodley
10:50 AM Bug #55286: Segfault when Open Policy Agent authorization is enabled
Pull request: https://github.com/ceph/ceph/pull/45873. Benoît Knecht
10:47 AM Bug #55286 (Resolved): Segfault when Open Policy Agent authorization is enabled
On Pacific, radosgw segfault when `rgw_use_opa_authz=true`:
```
2022-04-05T09:03:01.940+0000 7fa29c225700 -1 *** ...
Benoît Knecht
11:36 AM Bug #54655: crash: DispatchQueue::fast_dispatch(boost::intrusive_ptr<Message> const&)
in a log from an occurance of a similar issue, there was an indication of disconnection from the mon
(errno ENOTCON...
Mark Kogan

04/11/2022

04:45 PM rgw-testing Backport #55268 (New): quincy: bucket notifications lifecycle tests failing
Backport Bot
04:45 PM Backport #55267 (New): quincy: unittest_rgw_lua failing on TestRGWLua.OpsLog
Backport Bot
04:45 PM Backport #55266 (Rejected): pacific: unittest_rgw_lua failing on TestRGWLua.OpsLog
Backport Bot
04:43 PM Bug #55232 (Pending Backport): unittest_rgw_lua failing on TestRGWLua.OpsLog
Casey Bodley
04:41 PM rgw-testing Bug #54416 (Pending Backport): bucket notifications lifecycle tests failing
Casey Bodley
08:16 AM Backport #55249: octopus: Trim olh entries with empty name from bi
The reshard test hasn't been backported at all to octopus. Do we want just this change, or the change plus the full r... Dan van der Ster
07:58 AM Bug #55225 (Fix Under Review): rgw/dbstore: any delete operation causes rgw to seg-fault (dbstore...
Mykola Golub
07:20 AM Backport #55250 (In Progress): pacific: Trim olh entries with empty name from bi
Dan van der Ster
06:58 AM Backport #55251 (In Progress): quincy: Trim olh entries with empty name from bi
Dan van der Ster

04/10/2022

11:49 PM Documentation #53337 (Resolved): document rgw_max_chunk_size
I added this last year in this PR
https://github.com/ceph/ceph/pull/41565
and I've verified that it's visible a...
Anthony D'Atri
01:39 PM Bug #54054: dencoder: missing lots of rgw and cls_rgw types in src/tools/ceph-dencoder/rgw_types.h
ping zheng wrote:
> with the Signed-off-by I recreate the pr here , is there something wrong in the code?
Sorry, ...
ping zheng
01:38 PM Bug #54054: dencoder: missing lots of rgw and cls_rgw types in src/tools/ceph-dencoder/rgw_types.h
with the Signed-off-by I recreate the pr here , is there something wrong in the code? ping zheng
11:23 AM Bug #54054: dencoder: missing lots of rgw and cls_rgw types in src/tools/ceph-dencoder/rgw_types.h
Casey Bodley wrote:
> example commit that added cls_rgw_lc_get_entry_ret in https://github.com/ceph/ceph/pull/44743/...
ping zheng

04/09/2022

07:50 AM Bug #55194: RGW is not starting in public_network when MON are in cluster_network even when endpo...
Hmm. So Dashboard RGW and MON have to be on the same network, otherwise dashboard will not show information about buc... Diya Oweis

04/08/2022

04:35 PM Backport #55251 (Resolved): quincy: Trim olh entries with empty name from bi
https://github.com/ceph/ceph/pull/45846 Backport Bot
04:35 PM Backport #55250 (Resolved): pacific: Trim olh entries with empty name from bi
https://github.com/ceph/ceph/pull/45847 Backport Bot
04:35 PM Backport #55249 (Resolved): octopus: Trim olh entries with empty name from bi
Backport Bot
04:31 PM Bug #54500 (Pending Backport): Trim olh entries with empty name from bi
Casey Bodley
02:06 PM Backport #55246 (Rejected): pacific: rgw: RGWLC::process() may starve some bucket LCs at the end ...
Backport Bot
02:01 PM Bug #49446 (Pending Backport): rgw: RGWLC::process() may starve some bucket LCs at the end of a lc.N
Matt Benjamin
02:00 PM Backport #55245 (Resolved): pacific: rgwlc: ordinary expiration can remove delete-markers at end...
https://github.com/ceph/ceph/pull/47231 Backport Bot
02:00 PM Backport #55244 (Rejected): nautilus: rgwlc: ordinary expiration can remove delete-markers at en...
Backport Bot
02:00 PM Backport #55243 (Rejected): octopus: rgwlc: ordinary expiration can remove delete-markers at end...
Backport Bot
01:57 PM Bug #55168 (Pending Backport): rgwlc: ordinary expiration can remove delete-markers at end of cu...
Matt Benjamin
10:17 AM Bug #55225: rgw/dbstore: any delete operation causes rgw to seg-fault (dbstore be only)
submitted PR: https://github.com/ceph/ceph/pull/45828 Giuseppe Baccini

04/07/2022

05:13 PM Bug #55232 (Fix Under Review): unittest_rgw_lua failing on TestRGWLua.OpsLog
Casey Bodley
05:07 PM Bug #55232 (Pending Backport): unittest_rgw_lua failing on TestRGWLua.OpsLog
... Casey Bodley
02:13 PM rgw-testing Bug #55181 (Triaged): Ceph-s3tests :Test object/bucket testcases failing with "Access Denied" and...
Casey Bodley
02:13 PM rgw-testing Bug #55181: Ceph-s3tests :Test object/bucket testcases failing with "Access Denied" and "Remote e...
these are currently expected to fail. see comments, ie... Casey Bodley
02:11 PM rgw-testing Bug #55193 (Triaged): Ceph-s3tests failing in parameter validations
yeah, these tests were ported from boto2, which didn't do this validation stuff. they're disabled for rgw testing (vi... Casey Bodley
02:05 PM Bug #55168 (Fix Under Review): rgwlc: ordinary expiration can remove delete-markers at end of cu...
Matt Benjamin
01:57 PM Bug #55194 (Need More Info): RGW is not starting in public_network when MON are in cluster_networ...
i don't really understand the title:
> RGW is not starting in public_network when MON are in cluster_network even ...
Casey Bodley
01:25 PM Backport #55228 (Resolved): pacific: crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_stri...
https://github.com/ceph/ceph/pull/49095 Backport Bot
01:25 PM Backport #55227 (Resolved): quincy: crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_strin...
https://github.com/ceph/ceph/pull/49094 Backport Bot
01:25 PM Backport #55226 (Rejected): octopus: crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_stri...
Backport Bot
01:22 PM Bug #54167 (Resolved): segfault in radosgw-admin bucket rewrite --bucket
fixed with https://tracker.ceph.com/issues/54742 Casey Bodley
01:21 PM Bug #54742 (Pending Backport): crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_string<cha...
Casey Bodley
01:19 PM Bug #55225 (Resolved): rgw/dbstore: any delete operation causes rgw to seg-fault (dbstore be only)
h3. Built ceph from master and started rgw as stand-alone process with:... Giuseppe Baccini

04/06/2022

05:39 PM rgw-testing Bug #54416 (Fix Under Review): bucket notifications lifecycle tests failing
Yuval Lifshitz
08:43 AM Bug #55194 (Closed): RGW is not starting in public_network when MON are in cluster_network even w...

ERROR rgw_client] RGW REST API cannot be reached: Connection refused [errno 111]. Please check your configuration a...
Diya Oweis
08:34 AM rgw-testing Bug #55193 (Triaged): Ceph-s3tests failing in parameter validations
Some of ceph testcases are failing in parameter validations .
Below is the list of failed/error testcase :
s3te...
Dharmendra Jyani

04/05/2022

05:56 PM Bug #55026 (Fix Under Review): multisite: expose config option for data sync's polling interval
Casey Bodley
12:25 PM Feature #55184: Add support for MDLog over FIFO in rgw
https://github.com/ceph/ceph/pull/45779 Arjun Sharma
12:24 PM Feature #55184 (Fix Under Review): Add support for MDLog over FIFO in rgw
Arjun Sharma
11:20 AM Fix #54174 (Resolved): rgw dbstore test env init wrong
Soumya Koduri
11:19 AM Bug #53177 (Resolved): logging in rgw_main.cc has wrong dout_prefix "rgw dbstore: "
Soumya Koduri wrote:
> Sorry. I overlooked this part. Thanks for fixing it.
>
> >> "p.s. using namespace std; sh...
Soumya Koduri
09:32 AM rgw-testing Bug #55183 (Duplicate): test: pubsub tests are failing in multisite suite
this is seen in the master baseline from 6-March: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-04_22:06:30-rgw-m... Yuval Lifshitz
07:27 AM rgw-testing Bug #55181 (Triaged): Ceph-s3tests :Test object/bucket testcases failing with "Access Denied" and...
Some of ceph testcases are failing with "Access Denied" and "Remote end closed connection" errors.
Below is the list...
Dharmendra Jyani

04/04/2022

06:16 PM Bug #55179 (Fix Under Review): multisite: version_suspended_incremental_sync test sometime fails
from here: http://qa-proxy.ceph.com/teuthology/yuvalif-2022-04-04_17:22:55-rgw:multisite-wip-yuval-fix-54416-distro-b... Yuval Lifshitz
03:43 PM Bug #54742: crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_string<char, std::char_traits...
Hi Pritha,
To access the dashboard you need:
# access to the sepia lab
# to be a member of the Ceph organizatio...
Yaarit Hatuka
03:11 PM Bug #54742: crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_string<char, std::char_traits...
Pritha Srivastava wrote:
> @Casey: Does this crash occur, when a radosgw-admin bucket rewrite command is executed?
...
Casey Bodley
02:27 PM Backport #55175 (In Progress): quincy: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
https://github.com/ceph/ceph/pull/45766 Casey Bodley
02:20 PM Backport #55175 (Resolved): quincy: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
Backport Bot
02:16 PM Bug #55114 (Pending Backport): CentOS/RHEL does not support versions of utf8proc >= 2.2.0
Casey Bodley
01:36 PM Bug #53220: notification tests failing: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/c...
oof, thanks. it looks like it never got picked up for testing/merge because it was missing the needs-qa tag Casey Bodley
10:04 AM Bug #53220: notification tests failing: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/c...
the tests have to be backported first.
there is a PR for that: https://github.com/ceph/ceph/pull/41850 open now for...
Yuval Lifshitz

04/03/2022

08:50 PM Bug #55168 (Resolved): rgwlc: ordinary expiration can remove delete-markers at end of current li...
The incorrect return check fixed in #45391 apparently masked a subsequent side-effect to incorrectly remove delete ma... Matt Benjamin

04/02/2022

08:05 PM Bug #53585: RGW Garbage collector leads to slow ops and osd down when removing large object
pouria dehghani wrote:
> Mykola Golub wrote:
> > @pouria Don't you see errors like this in the osd logs before slow...
pouria dehghani
10:27 AM Bug #53585: RGW Garbage collector leads to slow ops and osd down when removing large object
Mykola Golub wrote:
> @pouria Don't you see errors like this in the osd logs before slow ops?
>
> "do_op msg da...
pouria dehghani
08:51 AM Bug #54054: dencoder: missing lots of rgw and cls_rgw types in src/tools/ceph-dencoder/rgw_types.h
I am trying to fix this ping zheng

04/01/2022

08:14 PM Feature #54476: rgw: allow S3 delete-marker behavior to be restored via config
Soumya Koduri wrote:
> I do not see this behaviour in the latest master. I tested using both s3 delete and by setti...
J. Eric Ivancich
08:13 PM Feature #54476 (Fix Under Review): rgw: allow S3 delete-marker behavior to be restored via config
J. Eric Ivancich
08:13 PM Feature #54476: rgw: allow S3 delete-marker behavior to be restored via config
After reading feedback and discussing with Matt, decided to make this configurable.
Note: commit 69d7589fb1305b7d2...
J. Eric Ivancich
08:13 AM Bug #54742: crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_string<char, std::char_traits...
@Casey: Does this crash occur, when a radosgw-admin bucket rewrite command is executed? I am unable to access http://... Pritha Srivastava

03/31/2022

02:30 PM Bug #54637 (Duplicate): crash: virtual ceph::common::RefCountedObject::~RefCountedObject(): asser...
Casey Bodley
02:30 PM Bug #54683 (Duplicate): crash: tcmalloc::allocate_full_cpp_throw_oom(unsigned long)
Casey Bodley
02:30 PM Bug #54694 (Duplicate): crash: virtual ceph::common::RefCountedObject::~RefCountedObject(): asser...
Casey Bodley
02:30 PM Bug #54699 (Duplicate): crash: RGWSI_Notify::finalize_watch()
Casey Bodley
02:29 PM Bug #54719 (Duplicate): crash: RGWSI_Notify::unwatch(RGWSI_RADOS::Obj&, unsigned long)
Casey Bodley
02:29 PM Bug #54722 (Duplicate): crash: virtual ceph::common::RefCountedObject::~RefCountedObject(): asser...
Casey Bodley
02:29 PM Bug #54739 (Duplicate): crash: RGWSI_Notify::unwatch(RGWSI_RADOS::Obj&, unsigned long)
Casey Bodley
02:25 PM Backport #55151 (In Progress): quincy: rgw: Update "CEPH_RGW_DIR_SUGGEST_LOG_OP" for remove entries
https://github.com/ceph/ceph/pull/50539 Backport Bot
02:25 PM Backport #55150 (Rejected): octopus: rgw: Update "CEPH_RGW_DIR_SUGGEST_LOG_OP" for remove entries
Backport Bot
02:25 PM Backport #55149 (Resolved): pacific: rgw: Update "CEPH_RGW_DIR_SUGGEST_LOG_OP" for remove entries
https://github.com/ceph/ceph/pull/50540 Backport Bot
02:24 PM Bug #54499 (Pending Backport): rgw: Update "CEPH_RGW_DIR_SUGGEST_LOG_OP" for remove entries
Casey Bodley
02:14 PM Bug #54774 (Duplicate): crash: UserAsyncRefreshHandler::init_fetch()
Casey Bodley
02:12 PM Bug #54802: crash: librados::IoCtx::nobjects_begin(librados::ObjectCursor const&, ceph::buffer::l...
looks like RGWSI_RADOS isn't handling exceptions from IoCtx::nobjects_begin()? Casey Bodley
02:05 PM Bug #55131 (In Progress): radosgw crashes at RGWIndexCompletionManager::create_completion
Casey Bodley
02:01 PM Bug #55114 (Fix Under Review): CentOS/RHEL does not support versions of utf8proc >= 2.2.0
Casey Bodley
02:00 PM Bug #53829 (Resolved): ceph/ragweed (octopus) bootstrap fails in teuthology with: "virtualenv: er...
Casey Bodley
01:53 PM Bug #54767 (Duplicate): crash: ceph::buffer::ptr_node::cloner::operator()(ceph::buffer::ptr_node ...
Casey Bodley
01:52 PM Bug #54746 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:51 PM Bug #54748 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:51 PM Bug #54751 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:51 PM Bug #54753 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:50 PM Bug #54766 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:49 PM Bug #54783 (Duplicate): crash: char* ceph::buffer::v15_2_0::ptr::c_str(): assert(_raw)
Casey Bodley
01:49 PM Bug #54789 (Duplicate): crash: ceph::buffer::ptr_node::cloner::operator()(ceph::buffer::ptr_node ...
Casey Bodley
01:48 PM Bug #54791 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:48 PM Bug #54793 (Duplicate): crash: ceph::buffer::ptr_node::cloner::operator()(ceph::buffer::ptr_node ...
Casey Bodley
01:47 PM Bug #54795 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:47 PM Bug #54811 (Duplicate): crash: char* ceph::buffer::v15_2_0::ptr::c_str(): assert(_raw)
Casey Bodley
01:47 PM Bug #54917 (Duplicate): crash: char* ceph::buffer::v15_2_0::ptr::c_str(): assert(_raw)
Casey Bodley
01:45 PM Bug #54818 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:44 PM Bug #54822 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:43 PM Bug #54933 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:42 PM Bug #54938 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley
01:39 PM Bug #54947 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)
Casey Bodley

03/30/2022

06:07 PM Bug #53829 (Fix Under Review): ceph/ragweed (octopus) bootstrap fails in teuthology with: "virtua...
Casey Bodley
06:07 PM Bug #53829: ceph/ragweed (octopus) bootstrap fails in teuthology with: "virtualenv: error: unreco...
i've cherry-picked a ragweed commit https://github.com/ceph/ragweed/commit/f514013dc1b03d3c4a8b4293ab5eb4b08fd6dee2 f... Casey Bodley
05:33 PM Backport #55136 (In Progress): quincy: multisite: data sync only spawns one bucket sync at a time
https://github.com/ceph/ceph/pull/45714 Casey Bodley
04:30 PM Backport #55136 (Resolved): quincy: multisite: data sync only spawns one bucket sync at a time
Backport Bot
05:33 PM Backport #55135 (In Progress): pacific: multisite: data sync only spawns one bucket sync at a time
https://github.com/ceph/ceph/pull/45713 Casey Bodley
04:30 PM Backport #55135 (Resolved): pacific: multisite: data sync only spawns one bucket sync at a time
Backport Bot
04:25 PM Bug #55000 (Pending Backport): multisite: data sync only spawns one bucket sync at a time
Casey Bodley
04:03 PM Feature #54972: [Feature specification] Introduce Storage classes in usage stats
I just posted a new comment with the full spec here. Sadly, I did not find a method to overwrite the initial post. Rafael Weingartner
04:02 PM Feature #54972: [Feature specification] Introduce Storage classes in usage stats
h3. Introduce Storage classes in usage stats
This specification proposes the addition of storage classes informati...
Rafael Weingartner
03:29 PM Feature #54972: [Feature specification] Introduce Storage classes in usage stats
hoan nv wrote:
> hoan nv wrote:
> > what abount radosgw-admin user stats command.
> >
> > Need to change it?
...
Rafael Weingartner
01:08 PM Bug #55131: radosgw crashes at RGWIndexCompletionManager::create_completion
Root Cause: cur_shard is of type std::atomic<int>, which may overflow and cause function next_shard() to return a neg... Yuanguo Huo
12:56 PM Bug #55131: radosgw crashes at RGWIndexCompletionManager::create_completion
I am working on this issue Yuanguo Huo
12:22 PM Bug #55131 (Pending Backport): radosgw crashes at RGWIndexCompletionManager::create_completion
I have a cluster and several radosgw instances. After running for some time (about 2 months), the radosgw instances c... Yuanguo Huo
12:59 PM Backport #49345 (Rejected): pacific: multisite: add testing for mixed cluster versions
Casey Bodley
08:59 AM Bug #55124 (New): When downloading a file encrypted with KMS, if you get the actual_ If the key i...
As stated above, when downloading a file encrypted with KMS, if you get the actual_ If the key is not 32 bits, it wil... wang kevin
08:49 AM Bug #55123 (New): When downloading a file encrypted with KMS method, when the key is wrong, the f...
When uploading encrypted objects, we use kms encryption. After uploading, the corresponding relationship between key ... wang kevin

03/29/2022

06:28 PM Feature #54476: rgw: allow S3 delete-marker behavior to be restored via config
I do not see this behaviour in the latest master. I tested using both s3 delete and by setting below lifecycle polic... Soumya Koduri
06:02 PM Bug #55114: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
thanks Laura, i raised this on the dev list for further discussion Casey Bodley
05:28 PM Bug #55114: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
Here is the link for utf8proc 2.1.1 for CentOS: https://centos.pkgs.org/8-stream/centos-appstream-x86_64/utf8proc-2.1... Laura Flores
05:08 PM Bug #55114: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
i just copied the "2.2.0" from the Arrow project's requirements: https://github.com/apache/arrow/blob/master/cpp/cmak... Casey Bodley
05:06 PM Bug #55114: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
Laura Flores wrote:
> I see that version 2.1.1 is supported
do you have a link to this 2.1.1 version? i didn't th...
Casey Bodley
04:45 PM Bug #55114: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
Thanks @Casey for looking into this. I'm not the best source of knowledge for this area, but I wonder if it would be ... Laura Flores
04:30 PM Bug #55114: CentOS/RHEL does not support versions of utf8proc >= 2.2.0
thanks Laura,
https://github.com/ceph/ceph/pull/44696 also added a 'utf8proc' submodule for use in rhel/centos bui...
Casey Bodley
04:19 PM Bug #55114 (Resolved): CentOS/RHEL does not support versions of utf8proc >= 2.2.0
h3. How to reproduce:
Run the do_cmake.sh script on the latest version of master on RHEL or CentOS.
h3. Output...
Laura Flores
04:15 PM Bug #53829: ceph/ragweed (octopus) bootstrap fails in teuthology with: "virtualenv: error: unreco...
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-28_15:36:59-upgrade:octopus-x-quincy-distro-default-smithi Yuri Weinstein
06:14 AM Bug #52721: Bucket index entry not always created
We ran into the exact same issue, with a very similar setup: Ceph Pacific (16.2.7), 3 radosgw instances behind HAprox... Benoît Knecht

03/28/2022

02:19 PM Backport #53471: pacific: cohort::lru may unlock twice
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45464
merged
Yuri Weinstein
02:17 PM Backport #51783: pacific: tempest: test_create_object_with_transfer_encoding fails
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45436
merged
Yuri Weinstein

03/25/2022

05:20 PM Backport #55072 (Rejected): pacific: rgw: allow configuration of bi tx timeout; add instrumentation
Backport Bot
05:20 PM Backport #55071 (Rejected): octopus: rgw: allow configuration of bi tx timeout; add instrumentation
Backport Bot
05:20 PM Backport #55070 (New): quincy: rgw: allow configuration of bi tx timeout; add instrumentation
Backport Bot
05:17 PM Feature #53957 (Pending Backport): rgw: allow configuration of bi tx timeout; add instrumentation
J. Eric Ivancich
03:03 PM Backport #54084: quincy: librgw: make rgw file handle versioned
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45494
merged
Yuri Weinstein
03:01 PM Backport #54520: quincy: add OPT_DATA_SYNC_RUN to gc_ops_list to initialize gc that prevents send...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45422
merged
Yuri Weinstein
03:01 PM Backport #54428: quincy: radosgw-admin bucket sync run command crashes when send_chain() gets inv...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45422
merged
Yuri Weinstein

03/24/2022

11:30 PM Backport #54152: pacific: rgw: in bucket reshard list, clarify new num shards is tentative
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45509
merged
Yuri Weinstein
08:21 PM Backport #53637: pacific: Test failures in ceph_test_cls_rgw_gc
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45477
merged
Yuri Weinstein
08:21 PM Backport #53518: pacific: pubsub: list topics, radosgw coredump
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45476
merged
Yuri Weinstein
04:02 PM Bug #54985 (Can't reproduce): pacific -> quincy upgrade bucket stats starts returning -2
Casey Bodley wrote:
> Vikhyat Umrao wrote:
> > The issue was not reproduced when the upgrade was run with upstream ...
Vikhyat Umrao
02:07 PM Bug #54985 (Need More Info): pacific -> quincy upgrade bucket stats starts returning -2
Casey Bodley
02:06 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
Vikhyat Umrao wrote:
> The issue was not reproduced when the upgrade was run with upstream pacific -> upstream quinc...
Casey Bodley
03:24 PM Bug #53829: ceph/ragweed (octopus) bootstrap fails in teuthology with: "virtualenv: error: unreco...
/a/yuriw-2022-03-24_01:56:50-rgw-wip-yuri4-testing-2022-03-23-1127-pacific-distro-default-smithi/6756540 Aishwarya Mathuria
02:55 PM Backport #53835: pacific: [doc] mention support for cross-region replication (added with per-buck...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45484
merged
Yuri Weinstein
02:55 PM Backport #53818: pacific: swift rest api on GET returns X-Container-* headers with zero value
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45483
merged
Yuri Weinstein
02:54 PM Backport #53654: pacific: `radosgw-admin reshard stale-instances rm` can't remove stale-indexs wh...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45480
merged
Yuri Weinstein
02:52 PM Backport #53639: pacific: compiler warning, enumeration value ‘AMQP_STATUS_SSL_SET_ENGINE_FAILED’...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45478
merged
Yuri Weinstein
02:38 PM Backport #53254: pacific: the root cause of rgw.none appearance
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45463
merged
Yuri Weinstein
02:25 PM Backport #55045 (Resolved): octopus: cls_rgw_suggest_changes() may accidentally delete newly-comp...
https://github.com/ceph/ceph/pull/45902 Backport Bot
02:25 PM Backport #55044 (Resolved): pacific: cls_rgw_suggest_changes() may accidentally delete newly-comp...
https://github.com/ceph/ceph/pull/45900 Backport Bot
02:25 PM Backport #55043 (Resolved): quincy: cls_rgw_suggest_changes() may accidentally delete newly-compl...
https://github.com/ceph/ceph/pull/45901 Backport Bot
02:20 PM Bug #54528 (Pending Backport): cls_rgw_suggest_changes() may accidentally delete newly-completed ...
Casey Bodley
09:47 AM Bug #53585: RGW Garbage collector leads to slow ops and osd down when removing large object
@pouria Don't you see errors like this in the osd logs before slow ops?
"do_op msg data len ... > osd_max_write_...
Mykola Golub

03/23/2022

06:50 PM Bug #55026 (Resolved): multisite: expose config option for data sync's polling interval
in rgw_data_sync.cc this interval is hard-coded as:... Casey Bodley
03:46 PM Bug #55017 (Resolved): limit number and size of IAM user policies
Casey Bodley
03:43 PM Feature #55016 (New): radosgw-admin should allow setting user policy
Casey Bodley
09:56 AM Feature #54972: [Feature specification] Introduce Storage classes in usage stats
hoan nv wrote:
> what abount radosgw-admin user stats command.
>
> Need to change it?
hoan nv
09:55 AM Feature #54972: [Feature specification] Introduce Storage classes in usage stats
what abount radosgw-admin user stats.
Need to change it?
hoan nv
01:21 AM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
The issue was not reproduced when the upgrade was run with upstream pacific -> upstream quincy builds. Maybe somethin... Vikhyat Umrao
01:05 AM Backport #51348: pacific: notification: zero size in COPY events
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45426
merged
Yuri Weinstein

03/22/2022

11:30 PM Backport #53079: pacific: notifications: http endpoints with one trailing slash are considered ma...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45459
merged
Yuri Weinstein
11:29 PM Backport #53036: pacific: rgw: cls_bucket_list_unordered() might return repeating or partial resu...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45457
merged
Yuri Weinstein
11:29 PM Backport #52107: pacific: multisite: if mdlogs are trimmed prematurely, 'radosgw-admin sync statu...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45442
merged
Yuri Weinstein
11:29 PM Backport #52071: pacific: PutObjRentention allows invalid changes to retention mode
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45440
merged
Yuri Weinstein
11:28 PM Backport #51351: pacific: TestAMQP.ClosedConnection failing in master
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45427
merged
Yuri Weinstein
09:58 PM Backport #52115: pacific: hadoop: broken mirror for apache-maven download
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45445
merged
Yuri Weinstein
09:57 PM Backport #52050: pacific: cephadm deployed RGW prints: "rgw is configured to optionally allow ins...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45439
merged
Yuri Weinstein
09:56 PM Backport #51777: pacific: rgw forward request in multisite for RGWDeleteBucketPolicy and RGWDelet...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45434
merged
Yuri Weinstein
09:56 PM Backport #51701: pacific: S3 CopyObject: failed to parse copy location
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45430
merged
Yuri Weinstein
09:55 PM Backport #52782: pacific: add role information and auth type to ops log
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/43956
merged
Yuri Weinstein
08:54 PM Bug #55000 (Fix Under Review): multisite: data sync only spawns one bucket sync at a time
Casey Bodley
08:41 PM Bug #55000 (Resolved): multisite: data sync only spawns one bucket sync at a time
RGWDataSyncShardCR has a 'int spawn_window = BUCKET_SHARD_SYNC_SPAWN_WINDOW' (20) that's meant to limit how many conc... Casey Bodley
08:48 PM Backport #52990: pacific: rgw: have "bucket check --fix" fix pool ids correctly
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45455
merged
Yuri Weinstein
08:47 PM Backport #53158: pacific: sse: on missing kms keyid, return 400 InvalidArgument instead 403 Inval...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45461
merged
Yuri Weinstein
08:47 PM Backport #52988: pacific: rgw: document rgw_lc_debug_interval configuration option
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45453
merged
Yuri Weinstein
08:46 PM Backport #52611: pacific: rgw: add function entry logging to make more thorough and consistent
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45450
merged
Yuri Weinstein
08:45 PM Backport #52348: pacific: XML responses return different order of XML elements
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45448
merged
Yuri Weinstein
08:44 PM Backport #52113: pacific: kmip and barbican tests failing on 'pip install pytz'
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45444
mergedhttps://tracker.ceph.com/issues/51810
Yuri Weinstein
08:43 PM Backport #51810: pacific: default value of follow_olh in get_obj_state() differs between sal::Obj...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45438
merged
Yuri Weinstein
08:43 PM Backport #51703: pacific: rgw: md5 signatures not match when enable rgw compress for RGWBulkUpload
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45432
merged
Yuri Weinstein
08:42 PM Backport #51352: pacific: Non-default storage class results in some garbage
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45428
merged
Yuri Weinstein
08:42 PM Backport #54519: pacific: add OPT_DATA_SYNC_RUN to gc_ops_list to initialize gc that prevents sen...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45421
merged
Yuri Weinstein
08:42 PM Backport #54426: pacific: radosgw-admin bucket sync run command crashes when send_chain() gets in...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45421
merged
Yuri Weinstein
08:41 PM Backport #54035: pacific: crypt: can't load client cert from /home/ubuntu/cephtest/ca/kmip-client...
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45413
merged
Yuri Weinstein
08:40 PM Backport #54494: pacific: segmentation fault in UserAsyncRefreshHandler::init_fetch
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45411
merged
Yuri Weinstein
08:40 PM Backport #53849: pacific: rgw:lc:remove lifecycle entry on bucket deletion
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/44729
merged
Yuri Weinstein

03/21/2022

08:39 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
The bucket stats in RHCS 5.1(pacific) before upgrading to quincy.... Vikhyat Umrao
08:34 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
... Vikhyat Umrao
08:34 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
Tried with the bucket - mycontainers5 and it ended with the same usage 0. Originally these buckets have ~70 million o... Vikhyat Umrao
08:01 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
... Vikhyat Umrao
08:00 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
- Reshard did help to bring the bucket stats command to work but usage is gone.... Vikhyat Umrao
07:18 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
We had a similar issue in the downstream version when RHCS 5 to RHCS 5.1 was reported here[1] but looks it got fixed ... Vikhyat Umrao
07:14 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
This looks like some kind of backward compatibility when the cluster was getting upgraded. Just like we have a pacifi... Vikhyat Umrao
07:10 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
Debug logs:... Vikhyat Umrao
06:58 PM Bug #54985: pacific -> quincy upgrade bucket stats starts returning -2
Pacific version - 16.2.7-89.el8cp Vikhyat Umrao
06:56 PM Bug #54985 (Can't reproduce): pacific -> quincy upgrade bucket stats starts returning -2
... Vikhyat Umrao
04:54 PM Feature #47342: usage: save storage class usage
Tobias Urdin wrote:
> The one you linked seems unrelated to my request?
I missed one character in the CTRL+C.
H...
Rafael Weingartner
04:16 PM Feature #47342: usage: save storage class usage
The one you linked seems unrelated to my request? Tobias Urdin
10:43 AM Feature #47342: usage: save storage class usage
Tobias Urdin wrote:
> There is no bucket usage stored on number of objects in a storage class.
Hello Tobias,
Ca...
Rafael Weingartner
04:34 PM Bug #54307: test_cls_rgw.sh: 'index_list_delimited' test times out
@Casey the first "timeout" Traceback message appears at the 71% mark in the teuthology log:... Laura Flores
01:45 PM Backport #54982 (New): quincy: common/compressor: crash when using qat compressor concurrently
Backport Bot
01:45 PM Backport #54981 (Rejected): octopus: common/compressor: crash when using qat compressor concurre...
Backport Bot
01:45 PM Backport #54980 (Rejected): pacific: common/compressor: crash when using qat compressor concurre...
Backport Bot
01:42 PM Bug #54361 (Pending Backport): common/compressor: crash when using qat compressor concurrently
Casey Bodley
10:30 AM Feature #54972 (New): [Feature specification] Introduce Storage classes in usage stats

h3. Introduce Storage classes in usage stats
This specification proposes the addition of storage classes informa...
Rafael Weingartner

03/20/2022

12:10 PM Backport #54969 (Resolved): octopus: segfault when Resharding occurs during LC
https://github.com/ceph/ceph/pull/46745 Backport Bot
12:10 PM Backport #54968 (Resolved): pacific: segfault when Resharding occurs during LC
https://github.com/ceph/ceph/pull/46744 Backport Bot
12:10 PM Backport #54967 (Resolved): quincy: segfault when Resharding occurs during LC
https://github.com/ceph/ceph/pull/46742 Backport Bot
12:06 PM Bug #54363 (Pending Backport): segfault when Resharding occurs during LC
Mark Kogan

03/19/2022

01:29 AM Bug #54947 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=84b4c8d9ea9507c1aa1ac1c8...
Telemetry Bot
01:29 AM Bug #54938 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=4be5dc7377ccf2419436aecf...
Telemetry Bot
01:29 AM Bug #54933 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=86ca742a8e3839b048189fed...
Telemetry Bot
01:28 AM Bug #54918 (New): crash: std::_Rb_tree<std::basic_string_view<char, std::char_traits<char> >, std...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=fdd112132443377c320ff4a4...
Telemetry Bot
01:28 AM Bug #54917 (Duplicate): crash: char* ceph::buffer::v15_2_0::ptr::c_str(): assert(_raw)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=b443327227029e0c08c08916...
Telemetry Bot
01:28 AM Bug #54913 (New): crash: std::_Rb_tree<std::basic_string_view<char, std::char_traits<char> >, std...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=b76662e67c8f4871a38d8ac3...
Telemetry Bot
01:28 AM Bug #54908 (New): crash: double const md_config_t::get_val<double>(ConfigValues const&, std::basi...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=d090ecc086ac4e2f8cbc283a...
Telemetry Bot
01:28 AM Bug #54902 (New): crash: tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::Free...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=fb01158e9db3faef8639bf41...
Telemetry Bot
01:25 AM Bug #54822 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=000536b99b6bf6a7a3ac1ef8...
Telemetry Bot
01:25 AM Bug #54818 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=32b533e199b1058ba77a4fb8...
Telemetry Bot
01:24 AM Bug #54811 (Duplicate): crash: char* ceph::buffer::v15_2_0::ptr::c_str(): assert(_raw)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=dd7707d67bb66db061cbf58a...
Telemetry Bot
01:24 AM Bug #54802 (Fix Under Review): crash: librados::IoCtx::nobjects_begin(librados::ObjectCursor cons...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=54fefe4543c26df5a5e4f943...
Telemetry Bot
01:24 AM Bug #54795 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=ac095a9bdb6dbb682b7c8762...
Telemetry Bot
01:24 AM Bug #54793 (Duplicate): crash: ceph::buffer::ptr_node::cloner::operator()(ceph::buffer::ptr_node ...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3e06e3c8f293400a0741384f...
Telemetry Bot
01:24 AM Bug #54791 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=4cdba9206dd4d0ca25983abe...
Telemetry Bot
01:24 AM Bug #54789 (Duplicate): crash: ceph::buffer::ptr_node::cloner::operator()(ceph::buffer::ptr_node ...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8be06ba8a24732c2836b3b51...
Telemetry Bot
01:23 AM Bug #54783 (Duplicate): crash: char* ceph::buffer::v15_2_0::ptr::c_str(): assert(_raw)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=b8f91bc101ec987f7d0b42ec...
Telemetry Bot
01:23 AM Bug #54779 (New): crash: std::_Rb_tree<std::basic_string_view<char, std::char_traits<char> >, std...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=2b0c2687a7b7cdc1f00ca364...
Telemetry Bot
01:23 AM Bug #54774 (Duplicate): crash: UserAsyncRefreshHandler::init_fetch()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=c682334c4c7543fe93f9807b...
Telemetry Bot
01:23 AM Bug #54770 (New): crash: ceph::common::RefCountedObject::put() const

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e8c4b3d56f1fb2843fa0bfbd...
Telemetry Bot
01:23 AM Bug #54768 (New): crash: rgw::BucketTrimManager::on_bucket_changed(std::basic_string_view<char, s...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0d52a991381c8c63c5313225...
Telemetry Bot
01:23 AM Bug #54767 (Duplicate): crash: ceph::buffer::ptr_node::cloner::operator()(ceph::buffer::ptr_node ...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7d69d872d40ceff2e0c307da...
Telemetry Bot
01:23 AM Bug #54766 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=257610127f0fc8a3c1716d36...
Telemetry Bot
01:22 AM Bug #54753 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=543045696d3fb377e3c10ca0...
Telemetry Bot
01:22 AM Bug #54751 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=2f3d91aa224b445472088fce...
Telemetry Bot
01:22 AM Bug #54748 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=353b7f1ae07ed481052aec74...
Telemetry Bot
01:22 AM Bug #54746 (Duplicate): crash: ceph::buffer::ptr::ptr(ceph::buffer::ptr const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=463301ec5c1ac6c302c6789a...
Telemetry Bot
01:22 AM Bug #54742 (Resolved): crash: RGWGC::send_chain(cls_rgw_obj_chain&, std::basic_string<char, std::...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=1bb7087131c2a460e20d5770...
Telemetry Bot
01:22 AM Bug #54739 (Duplicate): crash: RGWSI_Notify::unwatch(RGWSI_RADOS::Obj&, unsigned long)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0f3fccb24792d2a29286127e...
Telemetry Bot
01:21 AM Bug #54722 (Duplicate): crash: virtual ceph::common::RefCountedObject::~RefCountedObject(): asser...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a00f24505005c46fe8174820...
Telemetry Bot
01:21 AM Bug #54719 (Duplicate): crash: RGWSI_Notify::unwatch(RGWSI_RADOS::Obj&, unsigned long)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8b8042b6515679ab0f1aa8e4...
Telemetry Bot
01:20 AM Bug #54699 (Duplicate): crash: RGWSI_Notify::finalize_watch()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a94aef1cb0457262f55ea326...
Telemetry Bot
01:20 AM Bug #54694 (Duplicate): crash: virtual ceph::common::RefCountedObject::~RefCountedObject(): asser...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3d73b553bee4065ba61c7a2b...
Telemetry Bot
01:19 AM Bug #54683 (Duplicate): crash: tcmalloc::allocate_full_cpp_throw_oom(unsigned long)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e6961b902b0db3a7ad990525...
Telemetry Bot
01:18 AM Bug #54655 (New): crash: DispatchQueue::fast_dispatch(boost::intrusive_ptr<Message> const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8679e58416d08221eda3fb48...
Telemetry Bot
01:17 AM Bug #54637 (Duplicate): crash: virtual ceph::common::RefCountedObject::~RefCountedObject(): asser...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e2ec6442ef9ec9b4166fd555...
Telemetry Bot

03/18/2022

04:34 PM Backport #54622 (In Progress): octopus: multisite: full sync broken for tenanted buckets
https://github.com/ceph/ceph/pull/45523
merged
Casey Bodley
04:31 PM Backport #54622 (Resolved): octopus: multisite: full sync broken for tenanted buckets
Backport Bot
04:27 PM Bug #50785 (Pending Backport): multisite: full sync broken for tenanted buckets
apologies, i had assumed the regression was only for pacific. tagging for octopus backport Casey Bodley
04:19 PM Bug #50785: multisite: full sync broken for tenanted buckets
Hello ! No chance to have a backport in Octopus ? Gilles Mocellin

03/17/2022

05:46 PM Bug #53614 (Fix Under Review): The "--marker" option does not work for "radosgw-admin bucket chow...
Daniel Gryniewicz
05:20 PM Backport #54152 (In Progress): pacific: rgw: in bucket reshard list, clarify new num shards is te...
Cory Snyder
02:47 PM Bug #54405: beast: move access log line to separate log subsystem
updated tracker description based on discussion in https://github.com/ceph/ceph/pull/45153@@ Casey Bodley
02:46 PM Bug #54405 (New): beast: move access log line to separate log subsystem
Casey Bodley
02:44 PM Bug #53512: radosgw-admin bucket rm --bucket=${bucket} --bypass-gc --purge-objects failing crashi...
we shouldn't need to backport the zipper changes for RadosMultipartUpload::abort, no. in pacific/octopus, this logic ... Casey Bodley
02:25 PM Bug #54173 (Closed): User delete with purge data didn’t delete the data (multisite)
Casey Bodley
02:24 PM Bug #54307: test_cls_rgw.sh: 'index_list_delimited' test times out
@Laura i see there's a duplicate issue https://tracker.ceph.com/issues/54507 that points at problems with ceph-mgr? i... Casey Bodley
02:21 PM Bug #54307: test_cls_rgw.sh: 'index_list_delimited' test times out
very strange that this is timing out in the rados suite. the same test case is running in the rgw suite without failures Casey Bodley
02:17 PM Bug #54437 (Closed): dbstore: concurrent use of sqlite prepared statements
closing this one, because i think it's covered by the connection pooling work Casey Bodley
02:15 PM Backport #54610 (In Progress): quincy: can not get quota config via swift api
https://github.com/ceph/ceph/pull/52935 Backport Bot
02:15 PM Bug #54524 (Triaged): the bucket resharding logs should be INFO and not ERROR?
Casey Bodley
02:15 PM Backport #54609 (Rejected): pacific: can not get quota config via swift api
Backport Bot
02:10 PM Bug #54488 (Pending Backport): can not get quota config via swift api
Daniel Gryniewicz
02:10 PM Backport #54608 (New): quincy: Inverted check in RGWRados::check_disk_state()
Backport Bot
02:08 PM Bug #54607 (New): Rate limits not working on tenanted users
I have a tenanted users having rate limits set
/]# radosgw-admin ratelimit get --ratelimit-scope user --uid ten1/...
Tejas C
02:08 PM Bug #54452 (Pending Backport): Inverted check in RGWRados::check_disk_state()
Daniel Gryniewicz
01:42 PM Backport #54154 (In Progress): quincy: rgw: in bucket reshard list, clarify new num shards is ten...
Cory Snyder
01:39 PM Backport #54149 (In Progress): octopus: PostObj ignores error, may lose data
Cory Snyder
01:38 PM Backport #54148 (In Progress): pacific: PostObj ignores error, may lose data
Cory Snyder
01:38 PM Backport #54150 (In Progress): quincy: PostObj ignores error, may lose data
Cory Snyder
01:37 PM Backport #54147 (In Progress): pacific: admin: datalog list always return max-entries
Cory Snyder
01:36 PM Backport #54146 (In Progress): quincy: admin: datalog list always return max-entries
Cory Snyder
01:36 PM Backport #54093 (In Progress): quincy: rgwlc: warn at level 0 if lifecycle processing for a valid...
Cory Snyder
01:35 PM Backport #54092 (In Progress): pacific: rgwlc: warn at level 0 if lifecycle processing for a vali...
Cory Snyder
01:34 PM Backport #54085 (In Progress): octopus: librgw: make rgw file handle versioned
Cory Snyder
01:34 PM Backport #54083 (In Progress): pacific: librgw: make rgw file handle versioned
Cory Snyder
01:33 PM Backport #54084 (In Progress): quincy: librgw: make rgw file handle versioned
Cory Snyder
01:31 PM Backport #54078 (In Progress): quincy: The decode_json of default placement in zonegroup does not...
Cory Snyder
01:30 PM Backport #54075 (In Progress): octopus: Memory leak in radosgw-admin bucket chown command
Cory Snyder
01:29 PM Backport #54077 (In Progress): pacific: Memory leak in radosgw-admin bucket chown command
Cory Snyder
01:25 PM Backport #54076 (In Progress): quincy: Memory leak in radosgw-admin bucket chown command
Cory Snyder
01:22 PM Backport #54041 (In Progress): pacific: remove bucket API returns NoSuchKey than NoSuchBucket
Cory Snyder
01:20 PM Backport #53867 (In Progress): octopus: consecutive complete-multipart-upload requests following ...
Cory Snyder
01:16 PM Backport #53868 (In Progress): pacific: consecutive complete-multipart-upload requests following ...
Cory Snyder
01:15 PM Backport #53836 (In Progress): octopus: [doc] mention support for cross-region replication (added...
Cory Snyder
01:14 PM Backport #53835 (In Progress): pacific: [doc] mention support for cross-region replication (added...
Cory Snyder
01:13 PM Backport #53818 (In Progress): pacific: swift rest api on GET returns X-Container-* headers with ...
Cory Snyder
01:11 PM Backport #53656 (In Progress): pacific: "StorageClass" in ListMultipart's result allways is 'STAN...
Cory Snyder
01:10 PM Backport #53653 (In Progress): octopus: `radosgw-admin reshard stale-instances rm` can't remove s...
Cory Snyder
01:07 PM Backport #53654 (In Progress): pacific: `radosgw-admin reshard stale-instances rm` can't remove s...
Cory Snyder
01:05 PM Backport #53640 (In Progress): octopus: compiler warning, enumeration value ‘AMQP_STATUS_SSL_SET_...
Cory Snyder
01:05 PM Backport #53639 (In Progress): pacific: compiler warning, enumeration value ‘AMQP_STATUS_SSL_SET_...
Cory Snyder
01:04 PM Backport #53637 (In Progress): pacific: Test failures in ceph_test_cls_rgw_gc
Cory Snyder
01:01 PM Backport #53565 (Duplicate): pacific: rgw pubsub list topics coredump
Cory Snyder
12:56 PM Backport #53518 (In Progress): pacific: pubsub: list topics, radosgw coredump
Cory Snyder

03/16/2022

06:53 PM Backport #53470 (In Progress): octopus: cohort::lru may unlock twice
Cory Snyder
06:53 PM Backport #53471 (In Progress): pacific: cohort::lru may unlock twice
Cory Snyder
06:50 PM Backport #53254 (In Progress): pacific: the root cause of rgw.none appearance
Cory Snyder
06:49 PM Backport #53157 (In Progress): octopus: sse: on missing kms keyid, return 400 InvalidArgument ins...
Cory Snyder
06:48 PM Backport #53158 (In Progress): pacific: sse: on missing kms keyid, return 400 InvalidArgument ins...
Cory Snyder
06:36 PM Backport #53078 (In Progress): octopus: notifications: http endpoints with one trailing slash are...
Cory Snyder
06:36 PM Backport #53079 (In Progress): pacific: notifications: http endpoints with one trailing slash are...
Cory Snyder
06:35 PM Backport #53070 (Resolved): pacific: crash: RGWSI_MetaBackend_SObj
Cory Snyder
06:27 PM Backport #53037 (In Progress): octopus: rgw: cls_bucket_list_unordered() might return repeating o...
Cory Snyder
06:27 PM Backport #53036 (In Progress): pacific: rgw: cls_bucket_list_unordered() might return repeating o...
Cory Snyder
06:25 PM Backport #52991 (In Progress): octopus: rgw: have "bucket check --fix" fix pool ids correctly
Cory Snyder
06:21 PM Backport #52990 (In Progress): pacific: rgw: have "bucket check --fix" fix pool ids correctly
Cory Snyder
06:13 PM Backport #52989 (In Progress): octopus: rgw: document rgw_lc_debug_interval configuration option
Cory Snyder
06:08 PM Backport #52988 (In Progress): pacific: rgw: document rgw_lc_debug_interval configuration option
Cory Snyder
06:03 PM Backport #52957 (In Progress): octopus: ERROR: failed to list reshard log entries, oid=reshard.00...
Cory Snyder
06:01 PM Backport #52958 (In Progress): pacific: ERROR: failed to list reshard log entries, oid=reshard.00...
Cory Snyder
05:51 PM Bug #51429: radosgw-admin bi list fails with Input/Output error
Dan van der Ster wrote:
> Pawel Stefanski wrote:
> > Should I use patched OSD as well ?
>
> Yes in ceph octopu...
J. Eric Ivancich
05:16 PM Bug #51429: radosgw-admin bi list fails with Input/Output error
With new OSD patched with all https://github.com/ceph/ceph/pull/45087 it's Input/Output Error.
OSD log:...
Pawel Stefanski
01:09 PM Bug #51429: radosgw-admin bi list fails with Input/Output error
Dan van der Ster wrote:
> Pawel Stefanski wrote:
> > Should I use patched OSD as well ?
>
> Yes in ceph octopu...
Pawel Stefanski
12:55 PM Bug #51429: radosgw-admin bi list fails with Input/Output error
Pawel Stefanski wrote:
> Pawel Stefanski wrote:
> > > Dan van der Ster wrote:
> > > The pacific equivalent is at h...
Dan van der Ster
12:43 PM Bug #51429: radosgw-admin bi list fails with Input/Output error
Pawel Stefanski wrote:
> > Dan van der Ster wrote:
> > The pacific equivalent is at https://github.com/ceph/ceph/pu...
Pawel Stefanski
12:34 PM Bug #51429: radosgw-admin bi list fails with Input/Output error
Dan van der Ster wrote:
> Dan van der Ster wrote:
> > After updating to 15.2.15 we now have at least one bucket whi...
Pawel Stefanski
05:39 PM Backport #52611 (In Progress): pacific: rgw: add function entry logging to make more thorough and...
Cory Snyder
05:27 PM Backport #52500 (In Progress): octopus: rgw: fix bucket index list test error
Cory Snyder
05:25 PM Backport #52501 (Resolved): pacific: rgw: fix bucket index list test error
Cory Snyder
05:23 PM Backport #52349 (In Progress): octopus: XML responses return different order of XML elements
Cory Snyder
05:23 PM Backport #52348 (In Progress): pacific: XML responses return different order of XML elements
Cory Snyder
05:20 PM Backport #52286 (In Progress): pacific: aws-s3 incompatibility related metadata
Cory Snyder
05:18 PM Backport #52241 (In Progress): pacific: RadosGW requests to Open Policy Agent add 40ms latency
Cory Snyder
05:17 PM Backport #52114 (In Progress): octopus: hadoop: broken mirror for apache-maven download
Cory Snyder
05:17 PM Backport #52115 (In Progress): pacific: hadoop: broken mirror for apache-maven download
Cory Snyder
05:16 PM Backport #52113 (In Progress): pacific: kmip and barbican tests failing on 'pip install pytz'
Cory Snyder
05:15 PM Backport #52108 (In Progress): octopus: multisite: if mdlogs are trimmed prematurely, 'radosgw-ad...
Cory Snyder
05:15 PM Backport #52107 (In Progress): pacific: multisite: if mdlogs are trimmed prematurely, 'radosgw-ad...
Cory Snyder
05:14 PM Backport #52072 (In Progress): octopus: PutObjRentention allows invalid changes to retention mode
Cory Snyder
05:13 PM Backport #52071 (In Progress): pacific: PutObjRentention allows invalid changes to retention mode
Cory Snyder
05:11 PM Backport #52050 (In Progress): pacific: cephadm deployed RGW prints: "rgw is configured to option...
Cory Snyder
05:09 PM Backport #51810 (In Progress): pacific: default value of follow_olh in get_obj_state() differs be...
Cory Snyder
05:05 PM Backport #51782 (In Progress): octopus: tempest: test_create_object_with_transfer_encoding fails
Cory Snyder
05:05 PM Backport #51783 (In Progress): pacific: tempest: test_create_object_with_transfer_encoding fails
Cory Snyder
05:01 PM Backport #51776 (In Progress): octopus: rgw forward request in multisite for RGWDeleteBucketPolic...
Cory Snyder
04:47 PM Backport #51777 (In Progress): pacific: rgw forward request in multisite for RGWDeleteBucketPolic...
Cory Snyder
04:45 PM Backport #51702 (In Progress): octopus: rgw: md5 signatures not match when enable rgw compress fo...
Cory Snyder
04:43 PM Backport #51703 (In Progress): pacific: rgw: md5 signatures not match when enable rgw compress fo...
Cory Snyder
04:41 PM Backport #51700 (In Progress): octopus: S3 CopyObject: failed to parse copy location
Cory Snyder
04:38 PM Backport #51701 (In Progress): pacific: S3 CopyObject: failed to parse copy location
Cory Snyder
04:02 PM Bug #51469 (Resolved): Backport RGW - Don't move attrs before setting them
Cory Snyder
04:01 PM Backport #51470 (Resolved): pacific: Backport RGW - Don't move attrs before setting them
Cory Snyder
03:55 PM Backport #51352 (In Progress): pacific: Non-default storage class results in some garbage
Cory Snyder
03:52 PM Backport #51351 (In Progress): pacific: TestAMQP.ClosedConnection failing in master
Cory Snyder
03:52 PM Bug #48709 (Pending Backport): [RGW] [boto] PUT on versioned bucket fails with NoSuchKey
Mark Kogan
03:50 PM Bug #48709: [RGW] [boto] PUT on versioned bucket fails with NoSuchKey
with the following upstream fixes:
1. https://github.com/ceph/ceph/pull/45345 -- cls/rgw: rgw_dir_suggest_changes ...
Mark Kogan
03:50 PM Backport #51348 (In Progress): pacific: notification: zero size in COPY events
Cory Snyder
03:10 PM Backport #54519 (In Progress): pacific: add OPT_DATA_SYNC_RUN to gc_ops_list to initialize gc tha...
Cory Snyder
03:06 PM Backport #54520 (In Progress): quincy: add OPT_DATA_SYNC_RUN to gc_ops_list to initialize gc that...
Cory Snyder
02:47 PM Backport #54518: octopus: add OPT_DATA_SYNC_RUN to gc_ops_list to initialize gc that prevents sen...
Dependency on https://github.com/ceph/ceph/pull/45423 Cory Snyder
02:44 PM Backport #50802 (In Progress): octopus: slow radosgw-admin startup when large value of rgw_gc_max...
Cory Snyder
02:23 PM Backport #54428 (In Progress): quincy: radosgw-admin bucket sync run command crashes when send_ch...
Cory Snyder
02:22 PM Backport #54426 (In Progress): pacific: radosgw-admin bucket sync run command crashes when send_c...
Cory Snyder
01:39 PM Bug #53220: notification tests failing: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/c...
^ what do you think Yuval? the kafka stuff exists in pacific, should we backport the tests as well? Casey Bodley
01:28 PM Bug #53220: notification tests failing: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/c...
Casey, the qa/tasks/kafka.py file that was modified in the fix associated with this ticket does not exist on Pacific.... Cory Snyder
01:12 PM Backport #54036 (In Progress): octopus: crypt: can't load client cert from /home/ubuntu/cephtest/...
Cory Snyder
10:38 AM Backport #54035 (In Progress): pacific: crypt: can't load client cert from /home/ubuntu/cephtest/...
Cory Snyder
10:36 AM Backport #54495 (In Progress): octopus: segmentation fault in UserAsyncRefreshHandler::init_fetch
Cory Snyder
10:36 AM Backport #54494 (In Progress): pacific: segmentation fault in UserAsyncRefreshHandler::init_fetch
Cory Snyder
10:35 AM Bug #54130: OpsLogRados::log segfaults in rgw/multisite suite
Note that I closed the Octopus backport tracker since the offending ops log changes were never backported to that rel... Cory Snyder
10:34 AM Backport #54536 (Rejected): octopus: OpsLogRados::log segfaults in rgw/multisite suite
This backport is not relevant to Octopus since ops logs file changes were never backported there. Cory Snyder
10:29 AM Backport #54537 (In Progress): pacific: OpsLogRados::log segfaults in rgw/multisite suite
Cory Snyder

03/15/2022

02:50 PM Bug #54363 (Fix Under Review): segfault when Resharding occurs during LC
Casey Bodley
01:02 PM Bug #54363: segfault when Resharding occurs during LC
quick update, cause found:
below when an error condition occurs instead of false a true is returned as result of c...
Mark Kogan
11:49 AM Bug #54562 (New): Validation of a token signature may use a wrong certificate
This is a follow up bug report for issue originally created in Ceph project rather than in rgw
See https://tracker.c...
Daniel Iwan
 

Also available in: Atom