Project

General

Profile

Activity

From 08/27/2018 to 09/25/2018

09/25/2018

10:09 PM Bug #36034 (Pending Backport): multisite: intermittent test_bucket_index_log_trim failures
Casey Bodley
08:48 PM Bug #35851 (Pending Backport): multisite: invalid read in RGWCloneMetaLogCoroutine
Casey Bodley
08:41 PM Bug #35715 (Pending Backport): multisite: memory leak from curl_multi_add_handle()
Casey Bodley
08:29 PM Backport #36139: luminous: multisite: make redundant data sync errors less scary
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24135
merged
Yuri Weinstein
08:28 PM Bug #35812 (Pending Backport): multisite: use-after-free in RGWAsyncGetBucketInstanceInfo
Casey Bodley
05:54 PM Bug #36041: Beast frontend tries to bind (privileged) ports after dropping privileges to do so
Casey Bodley
02:32 PM Bug #36041: Beast frontend tries to bind (privileged) ports after dropping privileges to do so
https://github.com/ceph/ceph/pull/24271 Paul Emmerich
01:40 PM Backport #36141 (In Progress): luminous: rgw: return x-amz-version-id: null when delete obj in ve...
Nathan Cutler
01:40 PM Backport #36142 (In Progress): mimic: rgw: return x-amz-version-id: null when delete obj in versi...
Nathan Cutler
11:16 AM Backport #36179 (Need More Info): mimic: Update radosgw-admin bucket link command for bucket rena...
Nathan Cutler
11:11 AM Backport #36179 (Rejected): mimic: Update radosgw-admin bucket link command for bucket rename and...
Nathan Cutler
11:16 AM Bug #35885 (Fix Under Review): Update radosgw-admin bucket link command for bucket rename and move
Nathan Cutler
11:10 AM Bug #35885 (Pending Backport): Update radosgw-admin bucket link command for bucket rename and move
Nathan Cutler
11:12 AM Backport #36178 (Need More Info): luminous: Update radosgw-admin bucket link command for bucket r...
Backport PR opened early. All the commits have to be re-checked after the master PR gets merged. Nathan Cutler
11:11 AM Backport #36178 (Rejected): luminous: Update radosgw-admin bucket link command for bucket rename ...
https://github.com/ceph/ceph/pull/24195 Nathan Cutler
10:57 AM Bug #24873 (Resolved): 'radosgw-admin sync error trim' only trims partially
Nathan Cutler
10:57 AM Backport #24983 (Resolved): luminous: 'radosgw-admin sync error trim' only trims partially
Nathan Cutler
10:56 AM Backport #24985 (Resolved): luminous: multisite: object metadata operations are skipped by sync
Nathan Cutler
10:56 AM Backport #35709 (Resolved): luminous: deadlock on shutdown in RGWIndexCompletionManager::stop()
Nathan Cutler
07:47 AM Backport #35977 (In Progress): mimic: multisite: incremental data sync makes unnecessary call to ...
-PR: https://github.com/ceph/ceph/pull/24261- Jonathan Brielmaier

09/24/2018

12:41 PM Backport #35978 (In Progress): luminous: multisite: incremental data sync makes unnecessary call ...
PR: https://github.com/ceph/ceph/pull/24242 Jonathan Brielmaier
11:06 AM Backport #36139 (In Progress): luminous: multisite: make redundant data sync errors less scary
Nathan Cutler
11:00 AM Backport #36139 (Resolved): luminous: multisite: make redundant data sync errors less scary
https://github.com/ceph/ceph/pull/24135 Nathan Cutler
11:00 AM Backport #36142 (Resolved): mimic: rgw: return x-amz-version-id: null when delete obj in versioni...
https://github.com/ceph/ceph/pull/24189 Nathan Cutler
11:00 AM Backport #36141 (Resolved): luminous: rgw: return x-amz-version-id: null when delete obj in versi...
https://github.com/ceph/ceph/pull/24190 Nathan Cutler
11:00 AM Backport #36140 (Resolved): mimic: multisite: make redundant data sync errors less scary
https://github.com/ceph/ceph/pull/24418 Nathan Cutler
11:00 AM Backport #36138 (Resolved): mimic: multisite: update index segfault on shutdown/realm reload
https://github.com/ceph/ceph/pull/24417 Nathan Cutler
11:00 AM Backport #36137 (Resolved): luminous: multisite: update index segfault on shutdown/realm reload
https://github.com/ceph/ceph/pull/24397 Nathan Cutler
11:00 AM Backport #36129 (Resolved): mimic: abort_bucket_multiparts() fails on missing multipart meta objects
https://github.com/ceph/ceph/pull/24388 Nathan Cutler
11:00 AM Backport #36128 (Resolved): luminous: abort_bucket_multiparts() fails on missing multipart meta o...
https://github.com/ceph/ceph/pull/24389 Nathan Cutler
11:00 AM Backport #36125 (Resolved): mimic: Chunked encoding fails if chunk greater than 1MiB
https://github.com/ceph/ceph/pull/24363 Nathan Cutler
11:00 AM Backport #36124 (Resolved): luminous: Chunked encoding fails if chunk greater than 1MiB
https://github.com/ceph/ceph/pull/24361 Nathan Cutler
03:59 AM Backport #35857 (In Progress): mimic: multisite: segfault on shutdown/realm reload
https://github.com/ceph/ceph/pull/24235 Prashant D
03:33 AM Backport #35856 (In Progress): luminous: multisite: segfault on shutdown/realm reload
https://github.com/ceph/ceph/pull/24231 Prashant D

09/21/2018

04:19 PM Bug #36034 (Fix Under Review): multisite: intermittent test_bucket_index_log_trim failures
https://github.com/ceph/ceph/pull/24221 Casey Bodley
12:33 PM Bug #36106: rgw_file: list directory can only get 1000 files on NFS-Ganesha-RGW when mounting a b...
Updated title, specific to the new-ish ability to export a bucket (haven't reproduced yet) Matt Benjamin
12:32 PM Bug #36106 (Triaged): rgw_file: list directory can only get 1000 files on NFS-Ganesha-RGW when mo...
Matt Benjamin
10:14 AM Bug #36106: rgw_file: list directory can only get 1000 files on NFS-Ganesha-RGW when mounting a b...
Pull Request:
https://github.com/ceph/ceph/pull/24216
min-sheng Lin
10:13 AM Bug #36106: rgw_file: list directory can only get 1000 files on NFS-Ganesha-RGW when mounting a b...
Related issue:
https://github.com/nfs-ganesha/nfs-ganesha/issues/235
min-sheng Lin
09:53 AM Bug #36106 (Triaged): rgw_file: list directory can only get 1000 files on NFS-Ganesha-RGW when mo...
If using nfs-ganesha-rgw to export bucket as nfs, only first 1000 files be listed
> [vagrant@admin ~]$ ls -l /mnt/...
min-sheng Lin
02:53 AM Bug #36092: Radosgw elastic search sync module not working properly (all result same)
My ceph cluster is running on 13.2.1 version. hoan nv

09/20/2018

08:38 PM Bug #36077: rgw: master is on a different period
I was able to fix this issue by using the "radosgw-admin metadata sync init" command
and the "metadata sync" sub-co...
arnaud lawson
06:48 PM Bug #36077: rgw: master is on a different period
any idea how to fix this error?
""" """"""
ERROR: sync status period=318f6d70-6a9e-474d-8073-41a9ee9d645e does not...
arnaud lawson
06:46 PM Bug #36077: rgw: master is on a different period
Also, when i restart the rgw hosts in the secondary/slave zone i get this in their logs
""""""""
2018-09-20 18:44...
arnaud lawson
06:11 PM Bug #35988 (In Progress): RGW Ldap Authorization fails
Hi Warren,
Ok, actually this looks like RGW isn't attempting to use the ExternalAuthStrategy. It does look like y...
Matt Benjamin
04:22 PM Bug #35885: Update radosgw-admin bucket link command for bucket rename and move
luminous PR - https://github.com/ceph/ceph/pull/24195 Vikhyat Umrao
01:23 PM Support #24457: large omap object
I managed to get rid of this message by following a process:
* Enable dynamic sharding - there are many tutorials av...
Jacek S.
04:42 AM Bug #35814: rgw: return x-amz-version-id: null when delete obj in versioning suspended bucket
luminous backport https://github.com/ceph/ceph/pull/24190
mimic backport https://github.com/ceph/ceph/pull/24...
joke lee
02:33 AM Bug #36092 (Resolved): Radosgw elastic search sync module not working properly (all result same)
Hi all.
Currently, i create a zone with elasticsearch tier.
My radosgw log...
hoan nv

09/19/2018

04:07 PM Backport #24983: luminous: 'radosgw-admin sync error trim' only trims partially
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24054
merged
Yuri Weinstein
04:05 PM Backport #24985: luminous: multisite: object metadata operations are skipped by sync
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24056
merged
Yuri Weinstein
04:04 PM Backport #35709: luminous: deadlock on shutdown in RGWIndexCompletionManager::stop()
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24069
merged
Yuri Weinstein
02:50 PM Bug #35905 (Pending Backport): multisite: update index segfault on shutdown/realm reload
Casey Bodley
02:45 PM Bug #36077: rgw: master is on a different period
Attached is the output of this command
radosgw-admin sync status -c /etc/ceph/ceph_ewr_prod.conf --debug-rgw=10
arnaud lawson
02:36 PM Bug #35990 (Pending Backport): Chunked encoding fails if chunk greater than 1MiB
Casey Bodley
02:35 PM Bug #35986 (Pending Backport): abort_bucket_multiparts() fails on missing multipart meta objects
Casey Bodley
02:28 PM Bug #35814 (Pending Backport): rgw: return x-amz-version-id: null when delete obj in versioning s...
Casey Bodley
02:02 PM Bug #24595 (Fix Under Review): rgw: default quota not set in radosgw for Openstack users
https://github.com/ceph/ceph/pull/24177 Casey Bodley

09/18/2018

10:38 PM Bug #36077 (New): rgw: master is on a different period
Hello,
I am trying to configure object store replication between two clusters "us-east-1" and "us-east-2" and i a...
arnaud lawson
03:08 PM Bug #35990: Chunked encoding fails if chunk greater than 1MiB
Casey Bodley
03:05 PM Bug #36041: Beast frontend tries to bind (privileged) ports after dropping privileges to do so
Casey Bodley

09/17/2018

09:33 PM Bug #36041 (Resolved): Beast frontend tries to bind (privileged) ports after dropping privileges ...
To reproduce: configure beast to listen on port 80/443 and run with --user ceph --group ceph.
It will fail because...
Paul Emmerich
05:45 PM Bug #36034 (Resolved): multisite: intermittent test_bucket_index_log_trim failures
The 'bilog autotrim' command in this test sometimes fails to trim all entries, causing a failed assert(len(active_bil... Casey Bodley
03:40 PM Cleanup #35830 (Pending Backport): multisite: make redundant data sync errors less scary
Casey Bodley
08:48 AM Bug #24505: radosgw-admin user stats are incorrect when dynamic re-sharding is enabled
Thanks for the quick reproduction procedure in #27205
Those bugs seem related, I will debug.
Mark Kogan
08:41 AM Bug #18260: When uploading a large number of objects constantly, the objects number of bucket is ...
I am still debugging it case,
Reminder the stats discrepancy occurs when during multisite sync the replicating sit...
Mark Kogan
03:59 AM Bug #36027 (New): multisite: set removed zone master will affect original zonegroup
zonegroup have zones z1, z2; (e.g. realm_epoch 2, period epoch 3)
operations order:
1.zonegroup remove z2 in clus...
Tianshan Qu

09/16/2018

07:22 PM Bug #27219: lock in resharding may expires before the dynamic resharding completes
Update: I just noticed Mimic still uses stupidalloc by default. Either way, I’m not experiencing the same slowdown a... Jorge Campos
06:59 PM Bug #27219: lock in resharding may expires before the dynamic resharding completes
Thanks Orit.
I disabled resharding and have no problems writing to my buckets. I’ll await for the next major develo...
Jorge Campos

09/15/2018

12:13 AM Bug #35994 (Resolved): Configurable ListBucket max-keys limit
ListBucket max-keys has no defined limit in the RGW codebase.
Presently it will fall all the way down to the limit...
Robin Johnson
12:08 AM Bug #35993 (Resolved): AWSv4 presigned signature misses quoting on X-Amz-Credential
External ticket https://gitlab.com/gitlab-org/gitlab-workhorse/issues/181
The X-Amz-Credential query parameter is ...
Robin Johnson

09/14/2018

09:39 PM Bug #35990: Chunked encoding fails if chunk greater than 1MiB
https://github.com/ceph/ceph/pull/24114 Robin Johnson
08:46 PM Bug #35990 (Resolved): Chunked encoding fails if chunk greater than 1MiB
If a response uses chunked encoding, and the chunk is greater than 1MiB, the chunk length is not correctly printed.
...
Robin Johnson
07:57 PM Backport #26844 (Resolved): luminous: rgw_file: "deep stat"/stats of unenumerated paths not handled
Nathan Cutler
04:40 PM Backport #26844: luminous: rgw_file: "deep stat"/stats of unenumerated paths not handled
Patrick Donnelly wrote:
> https://github.com/ceph/ceph/pull/23499
merged
Yuri Weinstein
07:57 PM Bug #24572 (Resolved): Lifecycle rules number on one bucket should be limited.
Nathan Cutler
07:57 PM Backport #26846 (Resolved): luminous: Lifecycle rules number on one bucket should be limited.
Nathan Cutler
03:41 PM Backport #26846: luminous: Lifecycle rules number on one bucket should be limited.
Patrick Donnelly wrote:
> https://github.com/ceph/ceph/pull/23522
merged
Yuri Weinstein
07:56 PM Backport #26848 (Resolved): luminous: Delete marker generated by lifecycle has no owner
Nathan Cutler
03:41 PM Backport #26848: luminous: Delete marker generated by lifecycle has no owner
Patrick Donnelly wrote:
> https://github.com/ceph/ceph/pull/23545
merged
Yuri Weinstein
07:56 PM Bug #23801 (Resolved): possibly wrong log level in gc_iterate_entries (src/cls/rgw/cls_rgw.cc:3291)
Nathan Cutler
07:55 PM Backport #26922 (Resolved): luminous: possibly wrong log level in gc_iterate_entries (src/cls/rgw...
Nathan Cutler
03:40 PM Backport #26922: luminous: possibly wrong log level in gc_iterate_entries (src/cls/rgw/cls_rgw.cc...
Patrick Donnelly wrote:
> https://github.com/ceph/ceph/pull/23665
merged
Yuri Weinstein
07:55 PM Fix #34537 (Resolved): cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Nathan Cutler
07:55 PM Backport #35069 (Resolved): luminous: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Nathan Cutler
03:40 PM Backport #35069: luminous: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/23974
merged
Yuri Weinstein
07:54 PM Bug #24544 (Resolved): change default rgw_thread_pool_size to 512
Nathan Cutler
07:54 PM Backport #25087 (Resolved): luminous: change default rgw_thread_pool_size to 512
Nathan Cutler
03:39 PM Backport #25087: luminous: change default rgw_thread_pool_size to 512
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24034
merged
Yuri Weinstein
07:54 PM Bug #25214 (Resolved): valgrind failures related to --max-threads prevent radosgw from starting
Nathan Cutler
07:53 PM Backport #25217 (Resolved): luminous: valgrind failures related to --max-threads prevent radosgw ...
Nathan Cutler
03:39 PM Backport #25217: luminous: valgrind failures related to --max-threads prevent radosgw from starting
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24034
merged
Yuri Weinstein
07:36 PM Backport #35707 (Resolved): luminous: A period pull occasionally raises "curl_easy_perform return...
Nathan Cutler
03:38 PM Backport #35707: luminous: A period pull occasionally raises "curl_easy_perform returned status 2...
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24046
merged
Yuri Weinstein
07:10 PM Bug #35986 (Fix Under Review): abort_bucket_multiparts() fails on missing multipart meta objects
https://github.com/ceph/ceph/pull/24110 Casey Bodley
02:35 PM Bug #35986 (Resolved): abort_bucket_multiparts() fails on missing multipart meta objects
If there are multipart meta objects listed in the bucket index that don't exist in the data_extra_pool, the ENOENT/ER... Casey Bodley
06:35 PM Bug #23091 (Duplicate): rgw + OpenLDAP = Failed the auth strategy, reason=-13
I could not reopen this. So I opened a new report and marked this as a duplicate. Anonymous
06:21 PM Bug #23091: rgw + OpenLDAP = Failed the auth strategy, reason=-13
I believe that I have run into this issue in the sepia lab.
Running rgw on vpm019 (ceph cluster vpm019 vpm125 vpm1...
Anonymous
06:33 PM Bug #35988 (In Progress): RGW Ldap Authorization fails
I believe that this is the same problem as 23091.
Trying to authenticate an ldap RGW user fails....
Anonymous
05:43 PM Bug #35953: Aborted dynamic resharding should clean up created bucket index objs
@Orit:
This needs something to help clean up the leftovers from older aborts/fails. Can you cover how you think thes...
Robin Johnson
07:21 AM Backport #35710 (In Progress): mimic: deadlock on shutdown in RGWIndexCompletionManager::stop()
https://github.com/ceph/ceph/pull/24101 Prashant D
04:09 AM Bug #27654: Strange behavior of the S3 Get Bucket lifecycle when the Origin header is included in...
Abhishek Lekshmanan wrote:
> Can you create a PR with this changeset?
PR
https://github.com/ceph/ceph/pull/24096
Beom-Seok Park

09/13/2018

06:57 PM Backport #35980 (Resolved): luminous: multisite: data sync error repo processing does not back of...
https://github.com/ceph/ceph/pull/24318 Nathan Cutler
06:57 PM Backport #35979 (Resolved): mimic: multisite: data sync error repo processing does not back off o...
https://github.com/ceph/ceph/pull/24319 Nathan Cutler
06:57 PM Backport #35978 (Resolved): luminous: multisite: incremental data sync makes unnecessary call to ...
https://github.com/ceph/ceph/pull/24242 Nathan Cutler
06:57 PM Backport #35977 (Resolved): mimic: multisite: incremental data sync makes unnecessary call to RGW...
https://github.com/ceph/ceph/pull/24710 Nathan Cutler
06:01 PM Bug #26938 (Pending Backport): multisite: data sync error repo processing does not back off on empty
Casey Bodley
06:00 PM Bug #26952 (Pending Backport): multisite: incremental data sync makes unnecessary call to RGWRead...
Casey Bodley
05:52 PM Bug #27215 (Need More Info): radosgw:Segmentation fault lead to rgw hangup
Abhishek Lekshmanan
05:50 PM Bug #27364 (Fix Under Review): Swift example command got "Method Not Allowed (HTTP 405)"
Abhishek Lekshmanan
05:48 PM Bug #27654: Strange behavior of the S3 Get Bucket lifecycle when the Origin header is included in...
Can you create a PR with this changeset? Abhishek Lekshmanan
05:47 PM Bug #24364 (Resolved): rgw: s3cmd sync fails
Nathan Cutler
05:47 PM Backport #35954 (Resolved): mimic: rgw: s3cmd sync fails
Nathan Cutler
03:17 PM Backport #35954: mimic: rgw: s3cmd sync fails
Abhishek Lekshmanan wrote:
> https://github.com/ceph/ceph/pull/24058
merged
Yuri Weinstein
05:45 PM Bug #34540 (Need More Info): Get object: Failed to establish a new connection: [Errno 111] Connec...
Abhishek Lekshmanan
05:44 PM Bug #35814: rgw: return x-amz-version-id: null when delete obj in versioning suspended bucket
Abhishek Lekshmanan
05:43 PM Bug #35905: multisite: update index segfault on shutdown/realm reload
Casey Bodley
05:42 PM Bug #35973: radosgw-admin bucket limit check stuck generating high read ops with > 999 buckets pe...
Casey Bodley
05:19 PM Bug #35973 (Resolved): radosgw-admin bucket limit check stuck generating high read ops with > 999...
Created over 1k buckets for user and @radosgw-admin bucket limit check@ stuck generating 4-5k read ops in our case. L... Oleg Morozov
05:40 PM Bug #22775: rgw: multisite: the huge object sync is slow in unstable network environment
Lowering priority since teh curl network rate limit pr is merged Abhishek Lekshmanan
05:37 PM Bug #23661 (Resolved): RGWAsyncGetSystemObj failed assertion on shutdown/realm reload
resolved in http://tracker.ceph.com/issues/35543, and backports are tracked there Casey Bodley
06:48 AM Bug #27219: lock in resharding may expires before the dynamic resharding completes
Hi Joreg,
You can try disabling dynamic resharding in the ceph conf file as a temporary workaround.
You can use "re...
Orit Wasserman
06:45 AM Bug #27219: lock in resharding may expires before the dynamic resharding completes
Hello,
I’m experiencing this myself at the moment. Is there a workaround? I’m running Ceph 12.2.7 on a 4-node cl...
Orit Wasserman
06:08 AM Backport #35708 (In Progress): mimic: A period pull occasionally raises "curl_easy_perform return...
https://github.com/ceph/ceph/pull/24071 Prashant D
06:03 AM Backport #25025 (In Progress): luminous: cls_rgw test is only run in rados suite: add it to rgw s...
Nathan Cutler
04:35 AM Backport #35709 (In Progress): luminous: deadlock on shutdown in RGWIndexCompletionManager::stop()
https://github.com/ceph/ceph/pull/24069 Prashant D
02:32 AM Support #24457: large omap object
Will Marley wrote:
> jack jack wrote:
> > I have same issue ,I remove a large file used s3cmd and I got this issue ...
jack jack

09/12/2018

03:55 PM Bug #24364: rgw: s3cmd sync fails
Thank you very much for the quick fix. Using beast seems to work for now, and will change back to civetweb once this ... Kevin McCarthy
01:33 PM Backport #35954 (In Progress): mimic: rgw: s3cmd sync fails
Abhishek Lekshmanan
01:30 PM Backport #35954 (Resolved): mimic: rgw: s3cmd sync fails
https://github.com/ceph/ceph/pull/24058 Abhishek Lekshmanan
12:30 PM Bug #35953 (New): Aborted dynamic resharding should clean up created bucket index objs
Orit Wasserman
12:29 PM Bug #27219: lock in resharding may expires before the dynamic resharding completes
The renew of the lock logic is run in process_single_shard but a single buckert resharding can take a long time.
The...
Orit Wasserman
11:35 AM Backport #24985 (In Progress): luminous: multisite: object metadata operations are skipped by sync
Nathan Cutler
10:57 AM Bug #22870: rgw: bucket stats size_actual is incorrect
we just round to nearest 4k which might be ok as size on disk on filestore, though probably incorrect on bluestore? Abhishek Lekshmanan
10:28 AM Support #24457: large omap object
We face the same issue in 13.2.1. We have a bucket of around 60TB in size and it doesnt even sync anymore since lumin... Enrico Kern
09:59 AM Bug #34540: Get object: Failed to establish a new connection: [Errno 111] Connection refused
Can you paste a larger section of RGW log (including the part just before the coredump) most likely is https://github... Abhishek Lekshmanan
08:23 AM Backport #24983 (In Progress): luminous: 'radosgw-admin sync error trim' only trims partially
Nathan Cutler
03:01 AM Backport #35707 (In Progress): luminous: A period pull occasionally raises "curl_easy_perform ret...
https://github.com/ceph/ceph/pull/24046 Prashant D

09/11/2018

08:09 PM Documentation #23081 (Resolved): docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_searchfilter'
Nathan Cutler
08:09 PM Backport #32129 (Resolved): mimic: docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_searchfi...
Nathan Cutler
08:08 PM Backport #32127 (Resolved): luminous: docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_searc...
Nathan Cutler
04:02 PM Backport #25217 (In Progress): luminous: valgrind failures related to --max-threads prevent rados...
Nathan Cutler
11:16 AM Bug #24364: rgw: s3cmd sync fails
Kevin, For now, if you're blocked, changing the rgw_frontends string to use beast instead of civetweb will get you mo... Abhishek Lekshmanan
09:49 AM Bug #24364: rgw: s3cmd sync fails
Was able to trigger this, have a fix staged at https://github.com/ceph/civetweb/pull/29 Abhishek Lekshmanan

09/10/2018

09:55 PM Bug #24364: rgw: s3cmd sync fails
Browsing buckets with large object/file counts seems to trigger this. I updated the NOFILE to 10X and it did not help. Kevin McCarthy
09:42 PM Bug #24364: rgw: s3cmd sync fails
I am seeing exact same bug:
in thread 7f5644c45700 thread_name:civetweb-worker
ceph version 13.2.1 (5533ecdc0...
Kevin McCarthy
09:27 PM Bug #34307: radosgw: dynamic resharding does not drop old bucket indexes
Orit had created this bug - http://tracker.ceph.com/issues/24082 I hope it is related to dynamic sharding. Vikhyat Umrao
01:06 PM Bug #35905 (Fix Under Review): multisite: update index segfault on shutdown/realm reload
https://github.com/ceph/ceph/pull/24007 Casey Bodley
10:48 AM Bug #35905 (Resolved): multisite: update index segfault on shutdown/realm reload
RGWAsyncFetchRemoteObj and RGWAsyncRemoveObj use zone_trace pointer from RGWBucketSyncSingleEntryCR.
shutdown/realm ...
Tianshan Qu
11:59 AM Support #24457: large omap object
> as we should really exceed the default values anyway.
Shouldn't*
Will Marley
11:59 AM Support #24457: large omap object
jack jack wrote:
> I have same issue ,I remove a large file used s3cmd and I got this issue but I don't know how sol...
Will Marley
07:07 AM Support #24457: large omap object
I have same issue ,I remove a large file used s3cmd and I got this issue but I don't know how solution to this .
An...
jack jack

09/09/2018

01:13 AM Feature #23481 (Duplicate): radosgw-admin bucket rename command
http://tracker.ceph.com/issues/35885 Vikhyat Umrao
12:54 AM Bug #35885 (Fix Under Review): Update radosgw-admin bucket link command for bucket rename and move
PR - https://github.com/ceph/ceph/pull/23994 Vikhyat Umrao
12:52 AM Bug #35885 (Resolved): Update radosgw-admin bucket link command for bucket rename and move
Update radosgw-admin bucket link command for bucket rename and move
RHBZ# https://bugzilla.redhat.com/show_bug.cgi?i...
Vikhyat Umrao

09/07/2018

11:09 PM Backport #35857 (Resolved): mimic: multisite: segfault on shutdown/realm reload
https://github.com/ceph/ceph/pull/24235 Patrick Donnelly
11:09 PM Backport #35856 (Resolved): luminous: multisite: segfault on shutdown/realm reload
https://github.com/ceph/ceph/pull/24231 Patrick Donnelly
09:04 PM Bug #35851 (Fix Under Review): multisite: invalid read in RGWCloneMetaLogCoroutine
https://github.com/ceph/ceph/pull/23988 Casey Bodley
08:32 PM Bug #35851 (Resolved): multisite: invalid read in RGWCloneMetaLogCoroutine
from http://qa-proxy.ceph.com/teuthology/cbodley-2018-09-07_19:00:38-rgw-wip-rgw-beast-async-distro-basic-smithi/2989... Casey Bodley
08:16 PM Bug #35812 (Fix Under Review): multisite: use-after-free in RGWAsyncGetBucketInstanceInfo
https://github.com/ceph/ceph/pull/23987 Casey Bodley
08:14 PM Bug #35715 (Fix Under Review): multisite: memory leak from curl_multi_add_handle()
https://github.com/ceph/ceph/pull/23986 Casey Bodley
04:59 PM Cleanup #35830: multisite: make redundant data sync errors less scary
Thank you so much, Casey.
Nathan - This cleanup is important because these logs confuse multi-site users hence it ...
Vikhyat Umrao
02:04 PM Cleanup #35830: multisite: make redundant data sync errors less scary
Thanks Nathan, I separated the cleanups that should be backported from the rest of that refactoring work and linked t... Casey Bodley
02:03 PM Cleanup #35830 (Fix Under Review): multisite: make redundant data sync errors less scary
Casey Bodley
02:00 PM Cleanup #35830 (In Progress): multisite: make redundant data sync errors less scary
Casey Bodley
11:35 AM Cleanup #35830: multisite: make redundant data sync errors less scary
Is this really needed for luminous, and if so, why? Nathan Cutler
01:31 PM Bug #35543 (Pending Backport): multisite: segfault on shutdown/realm reload
Casey Bodley
06:46 AM Bug #23470: presigned URL for PUT with metadata fails: SignatureDoesNotMatch
I have some issue. My cluster running on mimic version.
Need backport to mimic version.
Thanks
hoan nv
05:21 AM Backport #35069 (In Progress): luminous: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
https://github.com/ceph/ceph/pull/23974 Prashant D
04:21 AM Documentation #35832 (New): Rgw multifactor authentication (MFA) detail documentation guide.
In mimic version, ceph radosgw support multifactor authentication.
http://docs.ceph.com/docs/mimic/radosgw/mfa/
...
hoan nv

09/06/2018

08:16 PM Cleanup #35830 (Resolved): multisite: make redundant data sync errors less scary
-https://github.com/ceph/ceph/pull/23843-
https://github.com/ceph/ceph/pull/23981
Vikhyat Umrao
04:34 PM Bug #24364: rgw: s3cmd sync fails
No dice even with the following set... David Galloway
04:20 PM Bug #24364: rgw: s3cmd sync fails
I was able to log in the node and see the bt, the bt itself arose from FD_SET where a fileno > 1024 was passed which ... Abhishek Lekshmanan
04:20 PM Bug #24364 (Fix Under Review): rgw: s3cmd sync fails
Abhishek Lekshmanan
04:20 PM Bug #24364: rgw: s3cmd sync fails
I was able to log in the node and see the bt, the bt itself arose from FD_SET where a fileno > 1024 was passed which ... Abhishek Lekshmanan
02:58 PM Bug #35814 (Resolved): rgw: return x-amz-version-id: null when delete obj in versioning suspended...
in aws
bucket wzyuliyangbucket01 is versioning suspend and we delete the pkbgum.jpg object without VersionId, ther...
joke lee
02:02 PM Bug #35812 (Resolved): multisite: use-after-free in RGWAsyncGetBucketInstanceInfo
from http://qa-proxy.ceph.com/teuthology/cbodley-2018-09-05_18:33:58-rgw:multisite-wip-multisite-testing-distro-basic... Casey Bodley
09:21 AM Backport #32129 (In Progress): mimic: docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_searc...
https://github.com/ceph/ceph/pull/23956 Prashant D

09/05/2018

09:05 PM Bug #35715 (Resolved): multisite: memory leak from curl_multi_add_handle()
on shutdown, requests that are still linked to the curl_multi handle are not being removed from the handle before fin... Casey Bodley
08:03 PM Backport #26845 (Resolved): mimic: Lifecycle rules number on one bucket should be limited.
Nathan Cutler
04:01 PM Backport #26845: mimic: Lifecycle rules number on one bucket should be limited.
Patrick Donnelly wrote:
> https://github.com/ceph/ceph/pull/23521
merged
Yuri Weinstein
08:02 PM Backport #26921 (Resolved): mimic: possibly wrong log level in gc_iterate_entries (src/cls/rgw/cl...
Nathan Cutler
04:00 PM Backport #26921: mimic: possibly wrong log level in gc_iterate_entries (src/cls/rgw/cls_rgw.cc:3291)
Patrick Donnelly wrote:
> https://github.com/ceph/ceph/pull/23686
merged
Yuri Weinstein
08:02 PM Bug #24158 (Resolved): rgw: civetweb fails on urls with control characters
Nathan Cutler
08:02 PM Backport #26849 (Resolved): mimic: rgw: civetweb fails on urls with control characters
Nathan Cutler
03:59 PM Backport #26849: mimic: rgw: civetweb fails on urls with control characters
Patrick Donnelly wrote:
> https://github.com/ceph/ceph/pull/23855
merged
Yuri Weinstein
08:01 PM Backport #26946 (Resolved): mimic: tempest tests failing with pysaml2 version conflict
Nathan Cutler
03:58 PM Backport #26946: mimic: tempest tests failing with pysaml2 version conflict
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/23771
merged
Yuri Weinstein
08:01 PM Backport #26980 (Resolved): mimic: multisite: intermittent failures in test_bucket_sync_disable_e...
Nathan Cutler
03:55 PM Backport #26980: mimic: multisite: intermittent failures in test_bucket_sync_disable_enable
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/23856
merged
Yuri Weinstein
08:00 PM Backport #35070 (Resolved): mimic: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Nathan Cutler
03:55 PM Backport #35070: mimic: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/23857
merged
Yuri Weinstein
07:58 PM Backport #35710 (Resolved): mimic: deadlock on shutdown in RGWIndexCompletionManager::stop()
https://github.com/ceph/ceph/pull/24101 Nathan Cutler
07:58 PM Backport #35709 (Resolved): luminous: deadlock on shutdown in RGWIndexCompletionManager::stop()
https://github.com/ceph/ceph/pull/24069 Nathan Cutler
07:58 PM Backport #35708 (Resolved): mimic: A period pull occasionally raises "curl_easy_perform returned ...
https://github.com/ceph/ceph/pull/24071 Nathan Cutler
07:58 PM Backport #35707 (Resolved): luminous: A period pull occasionally raises "curl_easy_perform return...
https://github.com/ceph/ceph/pull/24046 Nathan Cutler
07:58 PM Backport #35703 (Resolved): luminous: multisite: out of order updates to sync status markers
https://github.com/ceph/ceph/pull/24317 Nathan Cutler
07:57 PM Bug #12713: civetweb frontend: response is buffered in memory if content length is not explicitly...
I have a workaround-level fix for this here:
https://github.com/ceph/ceph/pull/23940
It causes the FE to avoid th...
Robin Johnson
02:05 PM Bug #27215: radosgw:Segmentation fault lead to rgw hangup
Can you paste the backtrace in the logs to determine possible causes Abhishek Lekshmanan

09/04/2018

09:58 PM Bug #26957 (Resolved): s3 returns MalformedXML when PutCORS with a invalid MaxAgeSeconds argument
https://github.com/ceph/ceph/pull/23626 Casey Bodley
09:57 PM Bug #26964 (Resolved): GetBucketCORS API returns "Not Found" error code when CORS configuration d...
https://github.com/ceph/ceph/pull/23646 Casey Bodley
09:56 PM Bug #27989 (Pending Backport): A period pull occasionally raises "curl_easy_perform returned stat...
Casey Bodley
09:55 PM Bug #26949 (Pending Backport): deadlock on shutdown in RGWIndexCompletionManager::stop()
Casey Bodley
09:17 PM Bug #35543: multisite: segfault on shutdown/realm reload
testing https://github.com/ceph/ceph/pull/23920 as a fix Casey Bodley
07:20 PM Bug #35543 (Resolved): multisite: segfault on shutdown/realm reload
I've been seeing a lot of these segfaults in multisite tests. For example, http://qa-proxy.ceph.com/teuthology/cbodle... Casey Bodley
02:23 PM Bug #35539 (Resolved): multisite: out of order updates to sync status markers
The cloud sync work in https://github.com/ceph/ceph/pull/18932 included a bug fix that should be backported to lumino... Casey Bodley

09/02/2018

11:42 AM Backport #35070 (In Progress): mimic: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Nathan Cutler
11:40 AM Backport #26980 (In Progress): mimic: multisite: intermittent failures in test_bucket_sync_disabl...
Nathan Cutler
11:37 AM Bug #24896 (Duplicate): rgw fail to put elasticsearch document when compression is set
The fix for this bug, https://github.com/ceph/ceph/pull/20796, was included in v13.2.0 (so mimic backport was not nee... Nathan Cutler
11:32 AM Backport #26849 (In Progress): mimic: rgw: civetweb fails on urls with control characters
Nathan Cutler

08/31/2018

11:06 AM Backport #35070 (Resolved): mimic: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
https://github.com/ceph/ceph/pull/23857 Nathan Cutler
11:06 AM Backport #35069 (Resolved): luminous: cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
https://github.com/ceph/ceph/pull/23974 Nathan Cutler
11:06 AM Fix #34537 (Pending Backport): cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Nathan Cutler
08:49 AM Bug #34540: Get object: Failed to establish a new connection: [Errno 111] Connection refused
Dai Dang Van wrote:
> Hi all,
>
> I'm facing with the problem that I can put and delete objects with swift client...
Dai Dang Van
08:42 AM Bug #34540 (Need More Info): Get object: Failed to establish a new connection: [Errno 111] Connec...
Hi all,
I'm facing with the problem that I can put and delete objects with swift client but got above error when I...
Dai Dang Van
03:32 AM Bug #24505: radosgw-admin user stats are incorrect when dynamic re-sharding is enabled
Hi Matt
please take a look at https://tracker.ceph.com/issues/27205#change-119598
Lei Liu
02:52 AM Bug #27654: Strange behavior of the S3 Get Bucket lifecycle when the Origin header is included in...
I'm not sure if I fixed it correctly.
However, the responses of the following cases are correct....
Beom-Seok Park

08/30/2018

09:40 PM Fix #34537 (Resolved): cls/rgw: add rgw_usage_log_entry type to ceph-dencoder
Fix is in master PR: https://github.com/ceph/ceph/pull/22344 Vaibhav Bhembre
05:57 PM Bug #27654: Strange behavior of the S3 Get Bucket lifecycle when the Origin header is included in...
thanks for tracking this down. can you suggest a fix? Casey Bodley
05:52 PM Bug #27989: A period pull occasionally raises "curl_easy_perform returned status 28 error: Operat...
Casey Bodley
05:50 PM Bug #18260: When uploading a large number of objects constantly, the objects number of bucket is ...
Mark, is this one resolved?
Matt
Matt Benjamin
05:39 PM Bug #24505: radosgw-admin user stats are incorrect when dynamic re-sharding is enabled
Mark, have we addressed any of these issues in recent stats work?
Matt
Matt Benjamin
05:37 PM Bug #24882: rgw assert in ceph::buffer::list::append from src/rgw/rgw_rest.cc:1151
(closed because we believe resolved) Matt Benjamin
05:36 PM Bug #24882 (Closed): rgw assert in ceph::buffer::list::append from src/rgw/rgw_rest.cc:1151
Matt Benjamin

08/29/2018

10:15 AM Bug #27205: Incorrect stats by "radosgw-admin user stats" after bucket resharding
Similar to https://tracker.ceph.com/issues/24505 Lei Liu
06:43 AM Bug #23489: [rgw] civetweb behind haproxy doesn't work with absolute URI
Sorry, I was under the impression this was on mimic but its luminous. AbsoluteURI and thus docker registry works on ... Dieter Roels
06:32 AM Bug #27048: s3aws: RequestError: send request failed after upgrade to mimic
Turns out this is already fixed in upstream civetweb: https://github.com/civetweb/civetweb/pull/540/files
I hope t...
Dieter Roels

08/28/2018

05:38 PM Backport #32127 (In Progress): luminous: docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_se...
Nathan Cutler
11:12 AM Backport #32127 (Resolved): luminous: docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_searc...
https://github.com/ceph/ceph/pull/23761 Nathan Cutler
04:08 PM Feature #34308 (Resolved): beast frontend option to set the TCP_NODELAY socket option
to match the tcp_nodelay option in civetweb Casey Bodley
03:40 PM Bug #26965 (In Progress): Compliance to aws s3's relaxed query handling behaviour
https://github.com/ceph/ceph/pull/23652 Abhishek Lekshmanan
02:18 PM Bug #34307: radosgw: dynamic resharding does not drop old bucket indexes
I thought that the design intent of resharding was that old indexes would be retired once resharding was successfully... Matt Benjamin
02:12 PM Bug #34307: radosgw: dynamic resharding does not drop old bucket indexes
bash oneliner find these bucket indexes using rgw admin commands ... Abhishek Lekshmanan
02:04 PM Bug #34307 (Resolved): radosgw: dynamic resharding does not drop old bucket indexes
ceph mon now complains when omap numbers exceed a threshold (12.2.6+, master/mimic), which can easily happen with lar... Abhishek Lekshmanan
11:53 AM Backport #26946 (In Progress): mimic: tempest tests failing with pysaml2 version conflict
https://github.com/ceph/ceph/pull/23771 Prashant D
11:12 AM Backport #32129 (Resolved): mimic: docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_searchfi...
https://github.com/ceph/ceph/pull/23956 Nathan Cutler
10:34 AM Backport #24627 (New): jewel: rgw: fail to recover index from crash
Nathan Cutler
10:34 AM Backport #24629 (Resolved): mimic: rgw: fail to recover index from crash
Nathan Cutler
10:31 AM Bug #23489: [rgw] civetweb behind haproxy doesn't work with absolute URI
should be fixed by this PR: https://github.com/ceph/civetweb/pull/27 Dieter Roels
10:26 AM Bug #27048: s3aws: RequestError: send request failed after upgrade to mimic
So, I was totally wrong in comment #2. It _is_ an absoluteURI issue. My curl did not do an absoluteURI obviously...... Dieter Roels
10:18 AM Backport #24984 (Resolved): mimic: 'radosgw-admin sync error trim' only trims partially
Nathan Cutler
10:18 AM Backport #24986 (Resolved): mimic: multisite: object metadata operations are skipped by sync
Nathan Cutler
10:17 AM Backport #25021 (Resolved): mimic: multisite: curl client does not time out on sync requests
Nathan Cutler
08:53 AM Bug #29419: Auto deleting is not working with multitenancy enabled
Important notice: on the same environment without... Jerzy Midura
08:49 AM Bug #29419 (New): Auto deleting is not working with multitenancy enabled
The issue was found on *Jewel 10.2.10* (5dc1e4c05cb68dbf62ae6fce3f0700e4654fdbbe) and confirmed also in *Luminous 12.... Jerzy Midura
01:49 AM Support #24457: large omap object
I have same issue. hoan nv

08/27/2018

08:01 PM Documentation #23081: docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_searchfilter'
luminous backport https://github.com/ceph/ceph/pull/23761 Konstantin Shalygin
01:26 PM Documentation #23081 (Pending Backport): docs: radosgw: ldap-auth: wrong option name 'rgw_ldap_se...
Casey Bodley
07:05 PM Bug #27989 (Fix Under Review): A period pull occasionally raises "curl_easy_perform returned stat...
https://github.com/ceph/ceph/pull/23759 Casey Bodley
07:03 PM Bug #27989 (Resolved): A period pull occasionally raises "curl_easy_perform returned status 28 er...
Casey Bodley
12:15 PM Bug #27048: s3aws: RequestError: send request failed after upgrade to mimic
To debug this further we need t oenable debug logging in civetweb but it seems there is no way of doing this? debug ... Dieter Roels
09:25 AM Bug #27654 (New): Strange behavior of the S3 Get Bucket lifecycle when the Origin header is inclu...
Steps to Reproduce
# Create a bucket.
# Request S3 Get Bucket lifecycle API with Origin header.
Actual results
...
Beom-Seok Park
 

Also available in: Atom