Project

General

Profile

Activity

From 11/17/2014 to 12/16/2014

12/16/2014

06:13 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Finally..mini test case.
1. New rgw instance
2. Create bucket + 4 x 10m objects (2 by fastcgi, 2 by civetweb)
3....
Richard Chan
05:54 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
1. The issue is reproducible only on objects created by civetweb.
The bucket can be created by either civetweb or...
Richard Chan
05:44 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Weird - the problem occurs with objects *created* by civetweb.
How to reproduce:
1. create new rgw instance
2....
Richard Chan
05:06 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
The corruption occurs if civetweb is the first thing that touches a new rgw setup.
How to reproduce:
1. rmpool ....
Richard Chan
04:35 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Suddenly civetweb is working, huh!!??
1. Delete 3 objects in succession
[
{ "tag": "default.7460.27",
...
Richard Chan
04:23 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Logs with good gc behaviour:
1. rm 1 object # 3 oids expected
[root@cephadm ~]# radosgw-admin gc list --include-a...
Richard Chan
08:33 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Can you provide logs to both your apache and civetweb gateways, when removing objects? (set 'debug rgw = 20', and 'de... Yehuda Sadeh
01:36 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
civetweb seems to "corrupt" the gc list.
1. rm one object (10M size) with civetweb, 3 oids in gc list
2. rm 2nd o...
Richard Chan
03:05 PM Feature #10342 (Resolved): rgw: tool to clean up clutter
... Yehuda Sadeh
01:28 PM Bug #9892 (Resolved): radosgw_admin.py: failed len(out['entries']) == 0 on usage show
merged commit 3abb3ff into master, giant, firefly, and dumpling
Commit hash is actually 47d56d779eb145f5bca1e8e1e...
Alfredo Deza
01:15 PM Bug #9892 (Fix Under Review): radosgw_admin.py: failed len(out['entries']) == 0 on usage show
changes had been made by yehuda already, PR opened https://github.com/ceph/ceph-qa-suite/pull/266
After it merges ...
Alfredo Deza
10:54 AM Bug #10334 (Resolved): rgw: s3 need to return InvalidAccessKeyId instead of AccessDenied
commit:56af795b1046a4c1bfba59e1fefde272bb0e5c1e... Yehuda Sadeh
10:07 AM Bug #10329 (Fix Under Review): rgw: s3 need to return SignatureDoesNotMatch instead of AccessDenied
Yehuda Sadeh
08:58 AM Bug #10329 (Resolved): rgw: s3 need to return SignatureDoesNotMatch instead of AccessDenied
commit:ef75d720f289ce2e18c0047380a16b7688864560 Yehuda Sadeh
10:00 AM Feature #10333 (Resolved): rgw: support AWS4 authentication
Yehuda Sadeh
09:59 AM Bug #10195: s3 java jdk conn.getobject(...) (get s3 object) method fails with latest version of a...
It seems that the jdk uses a new type of authentication (AWS4), that radosgw is yet to support. Yehuda Sadeh
09:55 AM Bug #10177: test_multipart_upload failed in upgrade:dumpling-firefly-x:parallel-giant-distro-basi...
For some reason boto got here a timeout (no real reason that I can see, everything flows nicely):... Yehuda Sadeh
09:40 AM Bug #10221 (Resolved): Crash in "radosgw-admin" in upgrade:firefly:singleton-firefly-distro-basic...
Fixed in commit:9d5e4edc15678de675d7a77badcbace0b710d553 Yehuda Sadeh
09:17 AM Bug #10227 (Duplicate): "Segmentation fault" radosgw() in smoke-master-distro-basic-multi suite
Yehuda Sadeh
09:15 AM Bug #10188 (Won't Fix): Can not create new rgw user when specifying an email already assigned to ...
Yehuda Sadeh
09:11 AM Bug #10102 (Resolved): sync agent: does not handle gracefully transient errors
https://github.com/ceph/radosgw-agent/pull/13 Josh Durgin
09:10 AM Bug #10194: rgw: fcgi connections are not closed when using mod-proxy-fcgi
fix for master needs to be reviewed / merged. Yehuda Sadeh
09:03 AM Bug #10251 (Resolved): "Segmentation fault" (radosgw()) in upgrade:dumpling-firefly-x:parallel-ne...
Yehuda Sadeh
09:03 AM Bug #9254 (Pending Backport): rgw: civetweb requires explicit \r\n for http headers
Josh Durgin
09:02 AM Bug #10066 (Pending Backport): rgw: failed md5sum on s3tests-test-readwrite
Yehuda Sadeh
06:19 AM Bug #10268: s3tests.functional.test_s3.test_bucket_create_exists fails with 'S3CreateError not ra...
Alfredo Deza

12/15/2014

06:44 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Revert rgw_gc_max_objs to 32, problem remains. Richard Chan
06:40 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
civetweb:
when you delete a second object, it does not appear in gc list --incude-all
How to reproduce:
1. add...
Richard Chan
05:35 PM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
The rgw parameters are in the global section.
Richard Chan
11:18 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Not sure how civetweb could affect gc work. I do see that your rgw_gc_max_objs is non standard. Did you put this conf... Yehuda Sadeh
09:53 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Summary of bug:
civetweb 0.89 is not correctly preparing the garbage collection list:
1. create 100 rgw objects (...
Richard Chan
09:40 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Should have written:
It is a civetweb bug.
With apache/fastcgi: I added 100 objects and rm'ed - 10M ea,
300 s...
Richard Chan
09:39 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
It is a civetweb bug.
I added 100 objects and rm'ed - 10M ea, 300 shadow objects created.
All 300 shadow objects ...
Richard Chan
09:02 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
No - I am following the exemplary simple configuration
with default zones; only changes are custom cluster name
and...
Richard Chan
08:44 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Do you by any chance have non default zone configuration? Yehuda Sadeh
08:24 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Reproduced this on a fresh 0.89.
Created 400 objects, deleted 300.
Found 3 objects in gc list --include-all.
...
Richard Chan
12:42 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Tested again: reduced rgw_gc settings to 300s.
On 0.80.7, the shadow object were purged.
On 0.87, 0.89 the garb...
Richard Chan
02:33 PM Feature #10322 (Resolved): rgw: s3-tests, coverage for object versioning
Some work has already been done (wip-rgw-object-versioning). Need to see if anything is missing, extend tests if needed. Yehuda Sadeh
02:30 PM Feature #10321 (New): rgw: verify proper tests coverage for bucket sharding
Yehuda Sadeh
02:29 PM Feature #10320 (New): rgw: ability to configure bucket sharding params in rgw teuthology test suite
Yehuda Sadeh
12:40 PM Bug #10268: s3tests.functional.test_s3.test_bucket_create_exists fails with 'S3CreateError not ra...
And the last one is correct too, using a valid Key ID but a wrong access_key on S3:... Alfredo Deza
11:45 AM Bug #10268: s3tests.functional.test_s3.test_bucket_create_exists fails with 'S3CreateError not ra...
The second failure I can confirm it is a problem with RGW, it should return 'InvalidAccessKeyId':... Alfredo Deza
07:44 AM Bug #10268 (In Progress): s3tests.functional.test_s3.test_bucket_create_exists fails with 'S3Crea...
Reverted first test. S3 docs state a duality in behavior depending on US Standard vs Regions and we support the forme... Alfredo Deza
12:51 AM Bug #10311 (Fix Under Review): Object is deleted automatically if conditional PUT returns 412
Sent out the PR for fix: https://github.com/ceph/ceph/pull/3176
Also committed some functional test cases in: http...
Xiangyu Lv
12:21 AM Documentation #10305: Update documentation on http://ceph.com/docs/master/radosgw/keystone/
In addition, this issue was pretty cryptic to debug (...a pun... I know) and it would have been pretty straightforwar... Mark Kirkwood

12/14/2014

06:59 PM Bug #10311 (Resolved): Object is deleted automatically if conditional PUT returns 412
After back-porting conditional PUT feature, test shows object will be deleted automatically if conditional PUT return... Zhi Zhang

12/12/2014

05:04 PM Bug #10307 (Fix Under Review): rgw: setting bucket attributes (swift POST on bucket) sometimes fail
Yehuda Sadeh
04:53 PM Bug #10307 (Resolved): rgw: setting bucket attributes (swift POST on bucket) sometimes fail
Issue related to the way we read the bucket attributes. Yehuda Sadeh
11:47 AM Bug #9254: rgw: civetweb requires explicit \r\n for http headers
opened a new pull request:
https://github.com/ceph/ceph/pull/3163
Yehuda Sadeh
11:35 AM Bug #10066 (Fix Under Review): rgw: failed md5sum on s3tests-test-readwrite
PR opened: https://github.com/ceph/s3-tests/pull/26 Alfredo Deza
10:43 AM Feature #8562 (Resolved): rgw: Conditional PUT on ETag
Merged, commit:7925b82c20c94043dd5e4ca69d3ef55ea43db1e0.
Tests commit:3e1e2ee43893264eb9ca2a3fbc581ebe46c06d0e
Yehuda Sadeh
12:42 AM Documentation #10305: Update documentation on http://ceph.com/docs/master/radosgw/keystone/
Unassigning myself because I'm not the best candidate ;-) Loïc Dachary

12/11/2014

11:33 PM Documentation #10305 (Closed): Update documentation on http://ceph.com/docs/master/radosgw/keystone/
Hi,
In the URL http://ceph.com/docs/master/radosgw/keystone/, where it mentions about converting the OpenSSL certi...
Vivek Cherian
01:44 PM Bug #10303 (Can't reproduce): "..s3.test_list_multipart_upload ... FAIL" in upgrade:firefly:newer...
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-12-10_17:00:02-upgrade:firefly:newer-firefly-distro-b... Yuri Weinstein
12:47 PM Bug #10301 (Resolved): "FATAL ERROR: cannot find a valid <xfs/xfs.h> header file" in powercycle-g...
A commit was made to ceph-qa-chef to include xfsprogs-devel shortly after this test ran:
038fdda63d363b193b028495e...
Sandon Van Ness
12:40 PM Bug #10301 (Resolved): "FATAL ERROR: cannot find a valid <xfs/xfs.h> header file" in powercycle-g...
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-12-09_13:44:11-powercycle-giant-distro-basic-multi/64... Yuri Weinstein
08:18 AM Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind
Need to wait for gc to run its course. Not all entries are going to show in the gc listing immediately. You need to r... Yehuda Sadeh
05:55 AM Bug #10295 (Resolved): rgw deleting S3 objects leaves __shadow_ objects behind
Using 0.80.7, observed also on .87, .89
1. Create 100 objects 10MB ea in rgw.
2. Observe that .rgw.buckets occupi...
Richard Chan

12/10/2014

05:20 PM Bug #10188: Can not create new rgw user when specifying an email already assigned to a user
Yehuda Sadeh wrote:
> That's by design. Users cannot share the same email, as S3 permissions can be granted by email...
song jipeng
10:34 AM Bug #10251: "Segmentation fault" (radosgw()) in upgrade:dumpling-firefly-x:parallel-next-distro-b...
cherr picked, commit:8b195eccadbd4d48518e33e08670b25527c3ca23 Yehuda Sadeh
09:28 AM Bug #10251: "Segmentation fault" (radosgw()) in upgrade:dumpling-firefly-x:parallel-next-distro-b...
need the string = null patch to be backported still? Sage Weil
09:19 AM Bug #10251: "Segmentation fault" (radosgw()) in upgrade:dumpling-firefly-x:parallel-next-distro-b...
Same problem in run http://pulpito.front.sepia.ceph.com/teuthology-2014-12-09_17:15:03-upgrade:dumpling-firefly-x:par... Yuri Weinstein

12/09/2014

06:49 AM Bug #10268: s3tests.functional.test_s3.test_bucket_create_exists fails with 'S3CreateError not ra...
ubuntu@teuthology:/a/teuthology-2014-12-08_02:35:02-smoke-master-distro-basic-multi/642112 Sage Weil

12/08/2014

10:33 AM Bug #10066 (In Progress): rgw: failed md5sum on s3tests-test-readwrite
Alfredo Deza
09:45 AM Bug #10271 (Resolved): Radosgw urlencode
When performing a multipart upload using AWS SDK JS v.2.0.29 I can see that the uploadId always starts with "2/" whic... Georgios Dimitrakakis

12/07/2014

10:06 AM Bug #10268 (Resolved): s3tests.functional.test_s3.test_bucket_create_exists fails with 'S3CreateE...
... Sage Weil

12/05/2014

08:12 AM Bug #10251 (Resolved): "Segmentation fault" (radosgw()) in upgrade:dumpling-firefly-x:parallel-ne...
Run http://pulpito.ceph.com/teuthology-2014-12-04_17:15:01-upgrade:dumpling-firefly-x:parallel-next-distro-basic-vps/... Yuri Weinstein

12/04/2014

08:59 AM Bug #10066: rgw: failed md5sum on s3tests-test-readwrite
That's the conf file I'm using for reproduction:... Yehuda Sadeh
06:36 AM Bug #10243: civetweb is hitting a limit (number of threads 1024)
The problem is in [1] as:
#define MAX_WORKER_THREADS 1024
I changed this to "MAX_WORKER_THREADS 20480" and it worke...
Mustafa Muhammad
04:00 AM Bug #10243 (Resolved): civetweb is hitting a limit (number of threads 1024)
When setting "rgw thread pool size" to a number higher than 1024 and enabling civetweb 'rgw_frontends="civetweb port=... Mustafa Muhammad

12/03/2014

04:24 PM Bug #10195: s3 java jdk conn.getobject(...) (get s3 object) method fails with latest version of a...
Both test runs used the exact same code, same endpoint, same authentication keys, and same GET request. The only thin... Selwyn Jacobs
08:45 AM Bug #10227 (Duplicate): "Segmentation fault" radosgw() in smoke-master-distro-basic-multi suite
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-11-30_02:35:03-smoke-master-distro-basic-multi/626596... Yuri Weinstein

12/02/2014

12:41 PM Bug #10015 (Fix Under Review): rgw sync agent: 403 when syncing object that has tilde in its name
PR opened https://github.com/ceph/radosgw-agent/pull/12 Alfredo Deza
10:56 AM Bug #10066: rgw: failed md5sum on s3tests-test-readwrite
test fails, and can be reproduced with the specific random seeds, with a specific object size (at the larger side of ... Yehuda Sadeh
10:53 AM Bug #10221 (Resolved): Crash in "radosgw-admin" in upgrade:firefly:singleton-firefly-distro-basic...
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-12-01_17:05:01-upgrade:firefly:singleton-firefly-dist... Yuri Weinstein
10:27 AM Bug #10062: s3-test failures using keystone authentication
Hi Yehuda, Sage
the patch addressed only the first 5 or so failures as mentioned.
The post_object* tests were s...
Abhishek Lekshmanan
09:38 AM Bug #10062 (Resolved): s3-test failures using keystone authentication
Yehuda Sadeh
09:38 AM Bug #10062: s3-test failures using keystone authentication
Fix merged into master. Yehuda Sadeh
09:50 AM Bug #10162 (Duplicate): s3tests-test-readwrite failure
A duplicate of #10082 Yehuda Sadeh
09:34 AM Bug #10188: Can not create new rgw user when specifying an email already assigned to a user
That's by design. Users cannot share the same email, as S3 permissions can be granted by email address, so email need... Yehuda Sadeh
09:32 AM Bug #10195 (Need More Info): s3 java jdk conn.getobject(...) (get s3 object) method fails with la...
Can you provide rgw log (debug rgw = 20), for such a failed request? Yehuda Sadeh
09:29 AM Bug #10106: rgw acl response should start with <?xml version="1.0" ?>
Note that Amazon's API definition does not specify this:
http://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectGE...
Yehuda Sadeh
09:24 AM Bug #10108 (Duplicate): s3tests fail in upgrade:dumpling-firefly-x:parallel-next-distro-basic-mul...
Duplicate of #10082 Yehuda Sadeh
09:22 AM Bug #10121 (Duplicate): "test.functional.tests.TestAccountUTF8" error in upgrade:dumpling-x-firef...
Duplicate of #10082 Yehuda Sadeh
09:18 AM Bug #9886 (Resolved): rgw: apache 2.4 does not send http status reason string
Sage Weil
09:11 AM Bug #10145 (Can't reproduce): rgw swift functional test: testChunkedPut (test.functional.tests.Te...
Sage Weil
09:11 AM Bug #10144 (Can't reproduce): rgw swift functional test: testChunkedPut (test.functional.tests.Te...
Sage Weil
09:08 AM Bug #9899 (Resolved): Error "coverage ceph osd pool get '' pg_num" in upgrade:dumpling-dumpling-d...
Sage Weil
09:04 AM Bug #10219 (Resolved): s3-tests failing to clone
http://pulpito.ceph.com/sage-2014-12-01_11:07:39-rgw-next-distro-basic-multi Sage Weil

12/01/2014

12:18 PM Bug #10195: s3 java jdk conn.getobject(...) (get s3 object) method fails with latest version of a...
typo... in bug title/description anywhere you see "jdk" I meant "sdk"... it was late before thanksgiving when I compo... Selwyn Jacobs

11/26/2014

03:56 PM Bug #10195 (Closed): s3 java jdk conn.getobject(...) (get s3 object) method fails with latest ver...
For instance,
in the Java example ( http://docs.ceph.com/docs/master/radosgw/s3/java/ )
The example: ...
Selwyn Jacobs
03:09 PM Bug #10194 (Resolved): rgw: fcgi connections are not closed when using mod-proxy-fcgi
Yehuda Sadeh

11/25/2014

04:07 PM Bug #8233: Installation & Documentation broken for Ubuntu Trusty 14.04 - rgw
The 100-Continue stuff was all in fastcgi, not httpd. So you can use Ubunu's httpd 2.4 if you want. Here's the patch ... Ken Dreyer
03:09 PM Documentation #10142 (Resolved): Update S3 compatibility table to reflect bucket location support
Neil Levine
03:06 PM Feature #10191 (Resolved): rgw: object versioning multi-zone support
Neil Levine
03:05 PM Feature #8216 (Fix Under Review): rgw: object versioning objclass support
Yehuda Sadeh
03:05 PM Feature #8218 (Fix Under Review): rgw: object versioning manifest changes
Yehuda Sadeh
03:05 PM Feature #8217 (Fix Under Review): rgw: object versioning object overwrite / delete changes
Neil Levine
10:52 AM Bug #10188 (Won't Fix): Can not create new rgw user when specifying an email already assigned to ...
The error can be seen in the output of the commands below. In the first command we create a user "jj1" with an email ... JuanJose Galvez

11/24/2014

07:56 PM Documentation #10184 (Resolved): rgw: document swift temp url functionality
Swift-temp-url functionality seems to have been merged from v0.78 or so. (Feature #3454) This needs to be documented.... Abhishek Lekshmanan
09:41 AM Bug #10177 (Can't reproduce): test_multipart_upload failed in upgrade:dumpling-firefly-x:parallel...
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-11-22_18:15:02-upgrade:dumpling-firefly-x:parallel-gi... Yuri Weinstein

11/23/2014

10:56 PM Bug #10145: rgw swift functional test: testChunkedPut (test.functional.tests.TestFileUTF8)
I am using Ubuntu 14.04
And these are my apache ang fast cgi version:...
Shambhu Rajak

11/22/2014

09:17 AM Bug #10103 (Pending Backport): swift tests failing
Sage Weil

11/21/2014

02:30 PM Bug #9206: rgw: cross rgw message headers filtered by apache 2.4
Because this came up on ceph-users recently: this is fixed in master with this commit:... Ken Dreyer
10:19 AM Bug #10162: s3tests-test-readwrite failure
This appears to be happening on the overnight tests: See #10108 Anonymous

11/20/2014

05:46 PM Bug #10162 (Duplicate): s3tests-test-readwrite failure
Running teuthology using the following yaml file failed:... Anonymous
03:35 PM Feature #10159 (New): rgw: sync agent support for object versioning
Yehuda Sadeh
03:35 PM Feature #10158 (Closed): rgw: sync agent support for bucket sharding
Yehuda Sadeh
12:09 PM Bug #10015 (In Progress): rgw sync agent: 403 when syncing object that has tilde in its name
Confirmed that requests is doing the unquoting of a quoted url with the tilde char:... Alfredo Deza
09:59 AM Bug #10145: rgw swift functional test: testChunkedPut (test.functional.tests.TestFileUTF8)
Chunked put can fail if running the wrong fastcgi module. Yehuda Sadeh

11/19/2014

09:43 PM Bug #10145 (Can't reproduce): rgw swift functional test: testChunkedPut (test.functional.tests.Te...
... Shambhu Rajak
09:36 PM Bug #10144 (Can't reproduce): rgw swift functional test: testChunkedPut (test.functional.tests.Te...
... Shambhu Rajak
02:20 PM Bug #10099 (Duplicate): radosgw-agent - error geting op state: list index out of range
Brian Andrus
12:37 PM Bug #10102 (Fix Under Review): sync agent: does not handle gracefully transient errors
PR opened: https://github.com/ceph/radosgw-agent/pull/11 Alfredo Deza
12:05 PM Documentation #10142 (Resolved): Update S3 compatibility table to reflect bucket location support
Table at http://ceph.com/docs/master/radosgw/s3/ Neil Levine
09:43 AM Feature #9932 (Fix Under Review): rgw: map swift X-Storage-Policy header to rgw pools
Yehuda Sadeh

11/18/2014

03:12 PM Bug #10103: swift tests failing
Seem to be the same problem in run http://pulpito.front.sepia.ceph.com/teuthology-2014-11-17_17:15:01-upgrade:dumplin... Yuri Weinstein
01:19 PM Bug #10102: sync agent: does not handle gracefully transient errors
Updated the description, and the RGW is not returning a 400 but a 500. The agent should probably get updated to under... Alfredo Deza
07:12 AM Bug #10102 (In Progress): sync agent: does not handle gracefully transient errors
Alfredo Deza

11/17/2014

09:39 AM Bug #10121 (Duplicate): "test.functional.tests.TestAccountUTF8" error in upgrade:dumpling-x-firef...
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-11-16_19:13:03-upgrade:dumpling-x-firefly-distro-basi... Yuri Weinstein
07:52 AM Bug #10103: swift tests failing
Also in runs:
http://pulpito.front.sepia.ceph.com/teuthology-2014-11-14_02:35:01-smoke-master-distro-basic-multi/
...
Yuri Weinstein
 

Also available in: Atom