https://tracker.ceph.com/
https://tracker.ceph.com/favicon.ico
2016-08-19T05:24:42Z
Ceph
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=76908
2016-08-19T05:24:42Z
Loïc Dachary
loic@dachary.org
<ul><li><strong>Target version</strong> deleted (<del><i>v10.2.3</i></del>)</li></ul>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=77103
2016-08-23T13:03:00Z
Pritha Srivastava
prsrivas@redhat.com
<ul></ul><p>Jan, Can you provide more details, like steps to reproduce the issue and the exact command that you issued?</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=77111
2016-08-23T14:57:31Z
Jan Hugo Prins
jprins@betterbe.com
<ul></ul><p>Pritha Srivastava wrote:</p>
<blockquote>
<p>Jan, Can you provide more details, like steps to reproduce the issue and the exact command that you issued?</p>
</blockquote>
<p>Steps to reproduce:</p>
<p>- Install clean Ceph cluster version 10.2.2<br />- Install rados gateways.<br />- Create a bucket<br />- Create a user with full_controll on the bucket<br />- Start copying data towards the bucket.<br />- Some files fail with a signature error.<br />- The fails that fail in the bulk transfer will also fail when copying separately.</p>
<p>The configuration of my current running cluster:</p>
<p>[root@blsceph01-1 ~]# radosgw-admin realm list
{<br /> "default_info": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa",<br /> "realms": [<br /> "default" <br /> ]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin zonegroup list<br />read_default_id : 0
{<br /> "default_info": "d5ad18ed-dfb3-4e4a-a6ee-3c7b4f0cddae",<br /> "zonegroups": [<br /> "default" <br /> ]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin zone list
{<br /> "default_info": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br /> "zones": [<br /> "default" <br /> ]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin realm get
{<br /> "id": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa",<br /> "name": "default",<br /> "current_period": "df62cf41-73e6-4128-ba01-104726754ed7",<br /> "epoch": 2<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin period list
{<br /> "periods": [<br /> "d825f817-43d1-4ca0-9ca2-0f3946c1e9b7",<br /> "df62cf41-73e6-4128-ba01-104726754ed7",<br /> "f8cdcfe3-238a-4e0d-84c4-d58fada869aa:staging" <br /> ]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin period get
{<br /> "id": "df62cf41-73e6-4128-ba01-104726754ed7",<br /> "epoch": 4,<br /> "predecessor_uuid": "d825f817-43d1-4ca0-9ca2-0f3946c1e9b7",<br /> "sync_status": [<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "",<br /> "" <br /> ],<br /> "period_map": {<br /> "id": "df62cf41-73e6-4128-ba01-104726754ed7",<br /> "zonegroups": [
{<br /> "id": "d5ad18ed-dfb3-4e4a-a6ee-3c7b4f0cddae",<br /> "name": "default",<br /> "api_name": "",<br /> "is_master": "true",<br /> "endpoints": [],<br /> "hostnames": [],<br /> "hostnames_s3website": [],<br /> "master_zone": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br /> "zones": [
{<br /> "id": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br /> "name": "default",<br /> "endpoints": [],<br /> "log_meta": "false",<br /> "log_data": "false",<br /> "bucket_index_max_shards": 0,<br /> "read_only": "false" <br /> }<br /> ],<br /> "placement_targets": [
{<br /> "name": "default-placement",<br /> "tags": []<br /> },
{<br /> "name": "dev-placement",<br /> "tags": []<br /> },
{<br /> "name": "nl-demo-placement",<br /> "tags": []<br /> }<br /> ],<br /> "default_placement": "default-placement",<br /> "realm_id": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa" <br /> }<br /> ],<br /> "short_zone_ids": [
{<br /> "key": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br /> "val": 588843695<br /> }<br /> ]<br /> },<br /> "master_zonegroup": "d5ad18ed-dfb3-4e4a-a6ee-3c7b4f0cddae",<br /> "master_zone": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br /> "period_config": {<br /> "bucket_quota": {<br /> "enabled": false,<br /> "max_size_kb": -1,<br /> "max_objects": -1<br /> },<br /> "user_quota": {<br /> "enabled": false,<br /> "max_size_kb": -1,<br /> "max_objects": -1<br /> }<br /> },<br /> "realm_id": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa",<br /> "realm_name": "default",<br /> "realm_epoch": 2<br />}</p>
<p>If you need more information regarding the cluster, just let me know.</p>
<p>The commands used:</p>
<p>s3cmd sync . s3://testbucket/Photos/<br />s3cmd put "./Options/BMW/SERIES 1/2012/216/180x102.jpg" s3://testbucket/Photos/</p>
<p>Jan Hugo Prins</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=77293
2016-08-25T10:21:04Z
Pritha Srivastava
prsrivas@redhat.com
<ul></ul><p>Jan Hugo Prins wrote:</p>
<blockquote>
<p>Pritha Srivastava wrote:</p>
<blockquote>
<p>Jan, Can you provide more details, like steps to reproduce the issue and the exact command that you issued?</p>
</blockquote>
<p>Steps to reproduce:</p>
<p>- Install clean Ceph cluster version 10.2.2<br />- Install rados gateways.<br />- Create a bucket<br />- Create a user with full_controll on the bucket<br />- Start copying data towards the bucket.<br />- Some files fail with a signature error.<br />- The fails that fail in the bulk transfer will also fail when copying separately.</p>
<p>The configuration of my current running cluster:</p>
<p>[root@blsceph01-1 ~]# radosgw-admin realm list
{<br />"default_info": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa",<br />"realms": [<br />"default" <br />]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin zonegroup list<br />read_default_id : 0
{<br />"default_info": "d5ad18ed-dfb3-4e4a-a6ee-3c7b4f0cddae",<br />"zonegroups": [<br />"default" <br />]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin zone list
{<br />"default_info": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br />"zones": [<br />"default" <br />]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin realm get
{<br />"id": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa",<br />"name": "default",<br />"current_period": "df62cf41-73e6-4128-ba01-104726754ed7",<br />"epoch": 2<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin period list
{<br />"periods": [<br />"d825f817-43d1-4ca0-9ca2-0f3946c1e9b7",<br />"df62cf41-73e6-4128-ba01-104726754ed7",<br />"f8cdcfe3-238a-4e0d-84c4-d58fada869aa:staging" <br />]<br />}</p>
<p>[root@blsceph01-1 ~]# radosgw-admin period get
{<br />"id": "df62cf41-73e6-4128-ba01-104726754ed7",<br />"epoch": 4,<br />"predecessor_uuid": "d825f817-43d1-4ca0-9ca2-0f3946c1e9b7",<br />"sync_status": [<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"",<br />"" <br />],<br />"period_map": {<br />"id": "df62cf41-73e6-4128-ba01-104726754ed7",<br />"zonegroups": [
{<br />"id": "d5ad18ed-dfb3-4e4a-a6ee-3c7b4f0cddae",<br />"name": "default",<br />"api_name": "",<br />"is_master": "true",<br />"endpoints": [],<br />"hostnames": [],<br />"hostnames_s3website": [],<br />"master_zone": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br />"zones": [
{<br />"id": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br />"name": "default",<br />"endpoints": [],<br />"log_meta": "false",<br />"log_data": "false",<br />"bucket_index_max_shards": 0,<br />"read_only": "false" <br />}<br />],<br />"placement_targets": [
{<br />"name": "default-placement",<br />"tags": []<br />},
{<br />"name": "dev-placement",<br />"tags": []<br />},
{<br />"name": "nl-demo-placement",<br />"tags": []<br />}<br />],<br />"default_placement": "default-placement",<br />"realm_id": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa" <br />}<br />],<br />"short_zone_ids": [
{<br />"key": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br />"val": 588843695<br />}<br />]<br />},<br />"master_zonegroup": "d5ad18ed-dfb3-4e4a-a6ee-3c7b4f0cddae",<br />"master_zone": "1adc4b51-3345-4a4b-bf6d-b55b35991530",<br />"period_config": {<br />"bucket_quota": {<br />"enabled": false,<br />"max_size_kb": -1,<br />"max_objects": -1<br />},<br />"user_quota": {<br />"enabled": false,<br />"max_size_kb": -1,<br />"max_objects": -1<br />}<br />},<br />"realm_id": "f8cdcfe3-238a-4e0d-84c4-d58fada869aa",<br />"realm_name": "default",<br />"realm_epoch": 2<br />}</p>
<p>If you need more information regarding the cluster, just let me know.</p>
<p>The commands used:</p>
<p>s3cmd sync . s3://testbucket/Photos/<br />s3cmd put "./Options/BMW/SERIES 1/2012/216/180x102.jpg" s3://testbucket/Photos/</p>
<p>Jan Hugo Prins</p>
</blockquote>
<p>I have not been able to reproduce the issue, were the files of a particular size, or can you share any other detail that may help me here.</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=77297
2016-08-25T10:46:07Z
Jan Hugo Prins
jprins@betterbe.com
<ul></ul><p>Pritha Srivastava wrote:</p>
<blockquote>
<p>I have not been able to reproduce the issue, were the files of a particular size, or can you share any other detail that may help me here.</p>
</blockquote>
<p>What kind of information do you need.<br />The files is just a set of default files (images and data files) from our production environment.<br />Nothing special about them.</p>
<p>Today someone send a mail to the user mailinglist with similar issues. In his case he thought it was because of some special character. In my case this is not the issue I think.</p>
<p>The source data is on an Isilon cluster (NFS) and the transfer node I used to test was my laptop (Fedora 23) and a stepstone machine (Fedora 18). I can also try to reproduce the issue using Centos systems.</p>
<p>Jan Hugo</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=77351
2016-08-25T14:47:30Z
Jan Hugo Prins
jprins@betterbe.com
<ul></ul><p>Jan Hugo Prins wrote:</p>
<blockquote>
<p>Pritha Srivastava wrote:</p>
<blockquote>
<p>I have not been able to reproduce the issue, were the files of a particular size, or can you share any other detail that may help me here.</p>
</blockquote>
<p>What kind of information do you need.<br />The files is just a set of default files (images and data files) from our production environment.<br />Nothing special about them.</p>
<p>Today someone send a mail to the user mailinglist with similar issues. In his case he thought it was because of some special character. In my case this is not the issue I think.</p>
<p>The source data is on an Isilon cluster (NFS) and the transfer node I used to test was my laptop (Fedora 23) and a stepstone machine (Fedora 18). I can also try to reproduce the issue using Centos systems.</p>
<p>Jan Hugo</p>
</blockquote>
<p>Just to test if the problem was not my NFS source, I just used a local source tree and got the following:</p>
<p>upload: 'testdir/data1/Adobe Flex Builder 2.0.1/ColdFusion Extensions for Flex Builder/CF_FB_Extensions.zip' -> 's3://testbucket/Adobe Flex Builder 2.0.1/ColdFusion Extensions for Flex Builder/CF_FB_Extensions.zip' [9 of 41537]<br /> 12109555 of 12109555 100% in 0s 30.14 MB/s done<br />ERROR: S3 error: 403 (SignatureDoesNotMatch)<br />[jprins@stepstone01 ~]$</p>
<p>Can you please run s3cmd with --debug option and then post the debug logs alongwith the rgw logs? That may help in understanding what is going wrong there.</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=77584
2016-08-26T14:49:13Z
Pritha Srivastava
prsrivas@redhat.com
<ul></ul><p>Jan Hugo Prins wrote:</p>
<blockquote>
<p>Jan Hugo Prins wrote:</p>
<blockquote>
<p>Pritha Srivastava wrote:</p>
<blockquote>
<p>I have not been able to reproduce the issue, were the files of a particular size, or can you share any other detail that may help me here.</p>
</blockquote>
<p>What kind of information do you need.<br />The files is just a set of default files (images and data files) from our production environment.<br />Nothing special about them.</p>
<p>Today someone send a mail to the user mailinglist with similar issues. In his case he thought it was because of some special character. In my case this is not the issue I think.</p>
<p>The source data is on an Isilon cluster (NFS) and the transfer node I used to test was my laptop (Fedora 23) and a stepstone machine (Fedora 18). I can also try to reproduce the issue using Centos systems.</p>
<p>Jan Hugo</p>
</blockquote>
<p>Just to test if the problem was not my NFS source, I just used a local source tree and got the following:</p>
<p>upload: 'testdir/data1/Adobe Flex Builder 2.0.1/ColdFusion Extensions for Flex Builder/CF_FB_Extensions.zip' -> 's3://testbucket/Adobe Flex Builder 2.0.1/ColdFusion Extensions for Flex Builder/CF_FB_Extensions.zip' [9 of 41537]<br />12109555 of 12109555 100% in 0s 30.14 MB/s done<br />ERROR: S3 error: 403 (SignatureDoesNotMatch)<br />[jprins@stepstone</p>
</blockquote>
<p>Based on the logs received from Jan, can see that space in the path 'Adobe Flex Builder 2.0.1/ColdFusion Extensions for Flex Builder/' is encoded as %20 in s3cmd and as '+' in rgwlogs.</p>
<p>s3cmdlogs<br />---------<br />DEBUG: Canonical Request:<br />PUT<br />/Adobe%20Flex%20Builder%202.0.1/ColdFusion%20Extensions%20for%20Flex%20Builder/CF_FB_Extensions.zip</p>
<p>content-length:12109555<br />content-type:application/zip</p>
<p>rgwlogs<br />--------<br />canonical request = PUT<br />/Adobe+Flex+Builder+2.0.1/ColdFusion+Extensions+for+Flex+Builder/CF_FB_Extensions.zip</p>
<p>content-length:12109555<br />content-type:application/zip</p>
<p>I was also able to repro the issue by inserting a space in the file name.</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=77731
2016-08-30T07:37:57Z
Pritha Srivastava
prsrivas@redhat.com
<ul></ul><p>s3cmd encodes space as "%20" while computing signature whereas it encodes space as "+" while passing the canonical uri to rgw. rgw uses this canonical uri to compute the signature at its end, which results in a SignatureMismatch error. I have a tentative fix which replaces '+' with "%20" in the canonical uri, which solves the issue:</p>
<p><a class="external" href="https://github.com/ceph/ceph/pull/10919">https://github.com/ceph/ceph/pull/10919</a></p>
<p>I have also raised this issue with s3cmd developers and we can wait till we hear back from them.</p>
<p>Note: Boto2 doesn't have this issue.They are consistently using "%20" everywhere. The Amazon docs also clearly says that space should be encoded as "%20": <a class="external" href="http://docs.aws.amazon.com/general/latest/gr/sigv4-create-canonical-request.html">http://docs.aws.amazon.com/general/latest/gr/sigv4-create-canonical-request.html</a></p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=78294
2016-09-16T08:39:35Z
Luis Periquito
luis.periquito@ocado.com
<ul></ul><p>I'm using s3cmd 1.6.1 (as it comes in Xenial). As server I have 10.2.2, both installed initially as Jewel and upgraded from Hammer/Giant.</p>
<p>All works fine with s3cmd 1.1 (as it comes in Trusty), and s3cmd 1.6 with the option "--signature-v2".</p>
<p>Upload, both multipart or not, works fine.</p>
<p>Download and sync always fails. My files have no spaces in them, and I haven't tested against amazon AWS.</p>
<p>This is what I get from running radosgw with "-d --debug-rgw=20"</p>
<p>2016-09-16 09:18:23.799090 7fd5c7f87700 20 enqueued request req=0x7fd62c0212a0<br />2016-09-16 09:18:23.799101 7fd5c7f87700 20 RGWWQ:<br />2016-09-16 09:18:23.799103 7fd5c7f87700 20 req: 0x7fd62c0212a0<br />2016-09-16 09:18:23.799108 7fd5c7f87700 10 allocated request req=0x7fd62c022a10<br />2016-09-16 09:18:23.799137 7fd5c4780700 20 dequeued request req=0x7fd62c0212a0<br />2016-09-16 09:18:23.799142 7fd5c4780700 20 RGWWQ: empty<br />2016-09-16 09:18:23.799172 7fd5c4780700 20 CONTENT_LENGTH=0<br />2016-09-16 09:18:23.799177 7fd5c4780700 20 CONTEXT_DOCUMENT_ROOT=/var/lib/ceph/radosgw/stratus-el02sv20/htdocs/<br />2016-09-16 09:18:23.799177 7fd5c4780700 20 CONTEXT_PREFIX=<br />2016-09-16 09:18:23.799178 7fd5c4780700 20 DOCUMENT_ROOT=/var/lib/ceph/radosgw/stratus-el02sv20/htdocs/<br />2016-09-16 09:18:23.799178 7fd5c4780700 20 FCGI_ROLE=RESPONDER<br />2016-09-16 09:18:23.799179 7fd5c4780700 20 GATEWAY_INTERFACE=CGI/1.1<br />2016-09-16 09:18:23.799179 7fd5c4780700 20 HTTP_ACCEPT_ENCODING=identity<br />2016-09-16 09:18:23.799179 7fd5c4780700 20 HTTP_AUTHORIZATION=AWS4-HMAC-SHA256 Credential=C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=ffba2fed4bb82f44e1cf2ba78453e7b64a5523e4031a4bd746aeaaf3b79aab55<br />2016-09-16 09:18:23.799181 7fd5c4780700 20 HTTP_HOST=luis.s3stratus.inflab.ocado.com<br />2016-09-16 09:18:23.799181 7fd5c4780700 20 HTTP_X_AMZ_CONTENT_SHA256=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />2016-09-16 09:18:23.799182 7fd5c4780700 20 HTTP_X_AMZ_DATE=20160916T081823Z<br />2016-09-16 09:18:23.799182 7fd5c4780700 20 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin<br />2016-09-16 09:18:23.799183 7fd5c4780700 20 QUERY_STRING=page=&params=&prefix=.<br />2016-09-16 09:18:23.799183 7fd5c4780700 20 REMOTE_ADDR=10.252.24.104<br />2016-09-16 09:18:23.799183 7fd5c4780700 20 REMOTE_PORT=51522<br />2016-09-16 09:18:23.799184 7fd5c4780700 20 REQUEST_METHOD=GET<br />2016-09-16 09:18:23.799184 7fd5c4780700 20 REQUEST_SCHEME=http<br />2016-09-16 09:18:23.799185 7fd5c4780700 20 REQUEST_URI=/?prefix=.<br />2016-09-16 09:18:23.799185 7fd5c4780700 20 SCRIPT_FILENAME=/var/lib/ceph/radosgw/stratus-el02sv20/htdocs/s3gw<br />2016-09-16 09:18:23.799185 7fd5c4780700 20 SCRIPT_NAME=/<br />2016-09-16 09:18:23.799186 7fd5c4780700 20 SCRIPT_URI=http://luis.s3stratus.inflab.ocado.com/<br />2016-09-16 09:18:23.799186 7fd5c4780700 20 SCRIPT_URL=/<br />2016-09-16 09:18:23.799195 7fd5c4780700 20 SERVER_ADDR=10.64.134.16<br />2016-09-16 09:18:23.799195 7fd5c4780700 20 SERVER_ADMIN=[no address given]<br />2016-09-16 09:18:23.799196 7fd5c4780700 20 SERVER_NAME=luis.s3stratus.inflab.ocado.com<br />2016-09-16 09:18:23.799196 7fd5c4780700 20 SERVER_PORT=80<br />2016-09-16 09:18:23.799196 7fd5c4780700 20 SERVER_PROTOCOL=HTTP/1.1<br />2016-09-16 09:18:23.799197 7fd5c4780700 20 SERVER_SIGNATURE=<br />2016-09-16 09:18:23.799197 7fd5c4780700 20 SERVER_SOFTWARE=Apache/2.4.7 (Ubuntu)<br />2016-09-16 09:18:23.799200 7fd5c4780700 1 ====== starting new request req=0x7fd62c0212a0 =====<br />2016-09-16 09:18:23.799223 7fd5c4780700 2 req 1:0.000023::GET /::initializing for trans_id = tx000000000000000000001-0057dbaacf-1dd797-default<br />2016-09-16 09:18:23.799227 7fd5c4780700 10 host=luis.s3stratus.inflab.ocado.com<br />2016-09-16 09:18:23.799233 7fd5c4780700 20 subdomain=luis domain=s3stratus.inflab.ocado.com in_hosted_domain=1 in_hosted_domain_s3website=0<br />2016-09-16 09:18:23.799243 7fd5c4780700 10 meta>> HTTP_X_AMZ_CONTENT_SHA256<br />2016-09-16 09:18:23.799247 7fd5c4780700 10 meta>> HTTP_X_AMZ_DATE<br />2016-09-16 09:18:23.799250 7fd5c4780700 10 x>> x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />2016-09-16 09:18:23.799251 7fd5c4780700 10 x>> x-amz-date:20160916T081823Z<br />2016-09-16 09:18:23.799273 7fd5c4780700 20 get_handler handler=25RGWHandler_REST_Bucket_S3<br />2016-09-16 09:18:23.799278 7fd5c4780700 10 handler=25RGWHandler_REST_Bucket_S3<br />2016-09-16 09:18:23.799279 7fd5c4780700 2 req 1:0.000079:s3:GET /::getting op 0<br />2016-09-16 09:18:23.799289 7fd5c4780700 10 op=25RGWListBucket_ObjStore_S3<br />2016-09-16 09:18:23.799290 7fd5c4780700 2 req 1:0.000090:s3:GET /:list_bucket:authorizing<br />2016-09-16 09:18:23.799298 7fd5c4780700 10 v4 signedheaders format = host;x-amz-content-sha256;x-amz-date<br />2016-09-16 09:18:23.799302 7fd5c4780700 10 v4 signature format = ffba2fed4bb82f44e1cf2ba78453e7b64a5523e4031a4bd746aeaaf3b79aab55<br />2016-09-16 09:18:23.799313 7fd5c4780700 10 v4 credential format = C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request<br />2016-09-16 09:18:23.799315 7fd5c4780700 10 access key id = C0K66XRJC2NW0O0WN06U<br />2016-09-16 09:18:23.799316 7fd5c4780700 10 credential scope = 20160916/US/s3/aws4_request<br />2016-09-16 09:18:23.799333 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477d4f0 obj=.users:C0K66XRJC2NW0O0WN06U state=0x7fd644013f68 s->prefetch_data=0<br />2016-09-16 09:18:23.799338 7fd5c4780700 10 cache get: name=.users+C0K66XRJC2NW0O0WN06U : miss<br />2016-09-16 09:18:23.800192 7fd5c4780700 10 cache put: name=.users+C0K66XRJC2NW0O0WN06U info.flags=6<br />2016-09-16 09:18:23.800203 7fd5c4780700 10 adding .users+C0K66XRJC2NW0O0WN06U to cache LRU end<br />2016-09-16 09:18:23.800207 7fd5c4780700 20 get_system_obj_state: s->obj_tag was set empty<br />2016-09-16 09:18:23.800211 7fd5c4780700 10 cache get: name=.users+C0K66XRJC2NW0O0WN06U : type miss (requested=1, cached=6)<br />2016-09-16 09:18:23.800214 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477d4f0 obj=.users:C0K66XRJC2NW0O0WN06U state=0x7fd644013f68 s->prefetch_data=0<br />2016-09-16 09:18:23.800216 7fd5c4780700 20 rados->read ofs=0 len=524288<br />2016-09-16 09:18:23.800865 7fd5c4780700 20 rados->read r=0 bl.length=8<br />2016-09-16 09:18:23.800885 7fd5c4780700 10 cache put: name=.users+C0K66XRJC2NW0O0WN06U info.flags=1<br />2016-09-16 09:18:23.800887 7fd5c4780700 10 moving .users+C0K66XRJC2NW0O0WN06U to cache LRU end<br />2016-09-16 09:18:23.800901 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477d010 obj=.users.uid:luis state=0x7fd644015b58 s->prefetch_data=0<br />2016-09-16 09:18:23.800908 7fd5c4780700 10 cache get: name=.users.uid+luis : miss<br />2016-09-16 09:18:23.801404 7fd5c4780700 10 cache put: name=.users.uid+luis info.flags=22<br />2016-09-16 09:18:23.801410 7fd5c4780700 10 adding .users.uid+luis to cache LRU end<br />2016-09-16 09:18:23.801413 7fd5c4780700 20 get_system_obj_state: s->obj_tag was set empty<br />2016-09-16 09:18:23.801416 7fd5c4780700 10 cache get: name=.users.uid+luis : type miss (requested=17, cached=22)<br />2016-09-16 09:18:23.801418 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477d010 obj=.users.uid:luis state=0x7fd644015b58 s->prefetch_data=0<br />2016-09-16 09:18:23.801439 7fd5c4780700 20 rados->read ofs=0 len=524288<br />2016-09-16 09:18:23.801793 7fd5c4780700 20 rados->read r=0 bl.length=320<br />2016-09-16 09:18:23.801803 7fd5c4780700 10 cache put: name=.users.uid+luis info.flags=17<br />2016-09-16 09:18:23.801805 7fd5c4780700 10 moving .users.uid+luis to cache LRU end<br />2016-09-16 09:18:23.801832 7fd5c4780700 10 chain_cache_entry: cache_locator=.users.uid+luis<br />2016-09-16 09:18:23.801870 7fd5c4780700 10 canonical headers format = host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />x-amz-date:20160916T081823Z</p>
<p>2016-09-16 09:18:23.801897 7fd5c4780700 10 payload request hash = e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />2016-09-16 09:18:23.801908 7fd5c4780700 10 canonical request = GET<br />/<br />prefix=.<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />x-amz-date:20160916T081823Z</p>
<p>host;x-amz-content-sha256;x-amz-date<br />e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />2016-09-16 09:18:23.801911 7fd5c4780700 10 canonical request hash = bf02e42eba3ad2bda2f03ed3801956c5df3bae08de48daa9ecded316ea1a9640<br />2016-09-16 09:18:23.801913 7fd5c4780700 10 string to sign = AWS4-HMAC-SHA256<br />20160916T081823Z<br />20160916/US/s3/aws4_request<br />bf02e42eba3ad2bda2f03ed3801956c5df3bae08de48daa9ecded316ea1a9640<br />2016-09-16 09:18:23.801953 7fd5c4780700 10 date_k = 5de0fe6cbbd1c7f0cbae1b9123e0df1300de69e86cce88bb9b2aab2837dd1fee<br />2016-09-16 09:18:23.801970 7fd5c4780700 10 region_k = 8d598fb8a0cd5658cce911790d8f7295c1b80a975cbc7cc20bf8fc0d92701ed8<br />2016-09-16 09:18:23.801986 7fd5c4780700 10 service_k = 06f9337b2ddcd0ef62f3c5bb898f1e79653a13db810580873e69bb85516260f1<br />2016-09-16 09:18:23.802000 7fd5c4780700 10 signing_k = 3e60b563bb70c72120462681bbaed28e67a63aae268f748980f4c4fa4b5d0a6d<br />2016-09-16 09:18:23.802015 7fd5c4780700 10 signature_k = ffba2fed4bb82f44e1cf2ba78453e7b64a5523e4031a4bd746aeaaf3b79aab55<br />2016-09-16 09:18:23.802017 7fd5c4780700 10 new signature = ffba2fed4bb82f44e1cf2ba78453e7b64a5523e4031a4bd746aeaaf3b79aab55<br />2016-09-16 09:18:23.802018 7fd5c4780700 10 ----------------------------- Verifying signatures<br />2016-09-16 09:18:23.802019 7fd5c4780700 10 Signature = ffba2fed4bb82f44e1cf2ba78453e7b64a5523e4031a4bd746aeaaf3b79aab55<br />2016-09-16 09:18:23.802020 7fd5c4780700 10 New Signature = ffba2fed4bb82f44e1cf2ba78453e7b64a5523e4031a4bd746aeaaf3b79aab55<br />2016-09-16 09:18:23.802020 7fd5c4780700 10 -----------------------------<br />2016-09-16 09:18:23.802022 7fd5c4780700 10 v4 auth ok<br />2016-09-16 09:18:23.802025 7fd5c4780700 2 req 1:0.002825:s3:GET /:list_bucket:normalizing buckets and tenants<br />2016-09-16 09:18:23.802029 7fd5c4780700 10 s->object=<NULL> s->bucket=luis<br />2016-09-16 09:18:23.802033 7fd5c4780700 2 req 1:0.002833:s3:GET /:list_bucket:init permissions<br />2016-09-16 09:18:23.802046 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477e710 obj=.rgw:luis state=0x7fd64401bfe8 s->prefetch_data=0<br />2016-09-16 09:18:23.802059 7fd5c4780700 10 cache get: name=.rgw+luis : miss<br />2016-09-16 09:18:23.802914 7fd5c4780700 10 cache put: name=.rgw+luis info.flags=22<br />2016-09-16 09:18:23.802919 7fd5c4780700 10 adding .rgw+luis to cache LRU end<br />2016-09-16 09:18:23.802922 7fd5c4780700 20 get_system_obj_state: s->obj_tag was set empty<br />2016-09-16 09:18:23.802924 7fd5c4780700 20 Read xattr: user.rgw.idtag<br />2016-09-16 09:18:23.802925 7fd5c4780700 20 Read xattr: user.rgw.manifest<br />2016-09-16 09:18:23.802927 7fd5c4780700 10 cache get: name=.rgw+luis : type miss (requested=17, cached=22)<br />2016-09-16 09:18:23.802929 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477e710 obj=.rgw:luis state=0x7fd64401bfe8 s->prefetch_data=0<br />2016-09-16 09:18:23.802941 7fd5c4780700 20 rados->read ofs=0 len=524288<br />2016-09-16 09:18:23.803507 7fd5c4780700 20 rados->read r=0 bl.length=139<br />2016-09-16 09:18:23.803512 7fd5c4780700 10 cache put: name=.rgw+luis info.flags=17<br />2016-09-16 09:18:23.803513 7fd5c4780700 10 moving .rgw+luis to cache LRU end<br />2016-09-16 09:18:23.803519 7fd5c4780700 20 rgw_get_bucket_info: bucket instance: luis(<code>{i=.rgw.buckets.index,e=.rgw.buckets.extra}.rgw.buckets[default.1330123.1])<br />2016-09-16 09:18:23.803526 7fd5c4780700 20 reading from .rgw:.bucket.meta.luis:default.1330123.1<br />2016-09-16 09:18:23.803530 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477e710 obj=.rgw:.bucket.meta.luis:default.1330123.1 state=0x7fd64401ec48 s->prefetch_data=0<br />2016-09-16 09:18:23.803533 7fd5c4780700 10 cache get: name=.rgw+.bucket.meta.luis:default.1330123.1 : miss<br />2016-09-16 09:18:23.803894 7fd5c4780700 10 cache put: name=.rgw+.bucket.meta.luis:default.1330123.1 info.flags=22<br />2016-09-16 09:18:23.803902 7fd5c4780700 10 adding .rgw+.bucket.meta.luis:default.1330123.1 to cache LRU end<br />2016-09-16 09:18:23.803903 7fd5c4780700 10 updating xattr: name=user.rgw.acl bl.length()=141<br />2016-09-16 09:18:23.803906 7fd5c4780700 20 get_system_obj_state: s->obj_tag was set empty<br />2016-09-16 09:18:23.803907 7fd5c4780700 20 Read xattr: user.rgw.acl<br />2016-09-16 09:18:23.803907 7fd5c4780700 20 Read xattr: user.rgw.idtag<br />2016-09-16 09:18:23.803908 7fd5c4780700 20 Read xattr: user.rgw.manifest<br />2016-09-16 09:18:23.803910 7fd5c4780700 10 cache get: name=.rgw+.bucket.meta.luis:default.1330123.1 : type miss (requested=17, cached=22)<br />2016-09-16 09:18:23.803913 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477e710 obj=.rgw:.bucket.meta.luis:default.1330123.1 state=0x7fd64401ec48 s->prefetch_data=0<br />2016-09-16 09:18:23.803927 7fd5c4780700 20 rados->read ofs=0 len=524288<br />2016-09-16 09:18:23.804191 7fd5c4780700 20 rados->read r=0 bl.length=203<br />2016-09-16 09:18:23.804198 7fd5c4780700 10 cache put: name=.rgw+.bucket.meta.luis:default.1330123.1 info.flags=17<br />2016-09-16 09:18:23.804200 7fd5c4780700 10 moving .rgw+.bucket.meta.luis:default.1330123.1 to cache LRU end<br />2016-09-16 09:18:23.804211 7fd5c4780700 10 chain_cache_entry: cache_locator=.rgw+luis<br />2016-09-16 09:18:23.804214 7fd5c4780700 10 chain_cache_entry: cache_locator=.rgw+.bucket.meta.luis:default.1330123.1<br />2016-09-16 09:18:23.804233 7fd5c4780700 15 decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>luis</ID><DisplayName>luis test user</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>luis</ID><DisplayName>luis test user</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy><br />2016-09-16 09:18:23.804247 7fd5c4780700 2 req 1:0.005047:s3:GET /:list_bucket:recalculating target<br />2016-09-16 09:18:23.804251 7fd5c4780700 2 req 1:0.005051:s3:GET /:list_bucket:reading permissions<br />2016-09-16 09:18:23.804254 7fd5c4780700 2 req 1:0.005054:s3:GET /:list_bucket:init op<br />2016-09-16 09:18:23.804257 7fd5c4780700 2 req 1:0.005057:s3:GET /:list_bucket:verifying op mask<br />2016-09-16 09:18:23.804259 7fd5c4780700 20 required_mask= 1 user.op_mask=7<br />2016-09-16 09:18:23.804260 7fd5c4780700 2 req 1:0.005060:s3:GET /:list_bucket:verifying op permissions<br />2016-09-16 09:18:23.804263 7fd5c4780700 5 Searching permissions for uid=luis mask=49<br />2016-09-16 09:18:23.804265 7fd5c4780700 5 Found permission: 15<br />2016-09-16 09:18:23.804266 7fd5c4780700 5 Searching permissions for group=1 mask=49<br />2016-09-16 09:18:23.804266 7fd5c4780700 5 Permissions for group not found<br />2016-09-16 09:18:23.804267 7fd5c4780700 5 Searching permissions for group=2 mask=49<br />2016-09-16 09:18:23.804268 7fd5c4780700 5 Permissions for group not found<br />2016-09-16 09:18:23.804268 7fd5c4780700 5 Getting permissions id=luis owner=luis perm=1<br />2016-09-16 09:18:23.804269 7fd5c4780700 10 uid=luis requested perm (type)=1, policy perm=1, user_perm_mask=1, acl perm=1<br />2016-09-16 09:18:23.804270 7fd5c4780700 2 req 1:0.005070:s3:GET /:list_bucket:verifying op params<br />2016-09-16 09:18:23.804271 7fd5c4780700 2 req 1:0.005071:s3:GET /:list_bucket:pre-executing<br />2016-09-16 09:18:23.804273 7fd5c4780700 2 req 1:0.005073:s3:GET /:list_bucket:executing<br />2016-09-16 09:18:23.804285 7fd5c4780700 10 cls_bucket_list luis(</code>{i=.rgw.buckets.index,e=.rgw.buckets.extra}.rgw.buckets[default.1330123.1]) start [] num_entries 1001<br />2016-09-16 09:18:23.804294 7fd5c4780700 20 reading from .rgw:.bucket.meta.luis:default.1330123.1<br />2016-09-16 09:18:23.804298 7fd5c4780700 20 get_system_obj_state: rctx=0x7fd5c477d080 obj=.rgw:.bucket.meta.luis:default.1330123.1 state=0x7fd644023768 s->prefetch_data=0<br />2016-09-16 09:18:23.804301 7fd5c4780700 10 cache get: name=.rgw+.bucket.meta.luis:default.1330123.1 : type miss (requested=22, cached=19)<br />2016-09-16 09:18:23.804553 7fd5c4780700 10 cache put: name=.rgw+.bucket.meta.luis:default.1330123.1 info.flags=22<br />2016-09-16 09:18:23.804559 7fd5c4780700 10 moving .rgw+.bucket.meta.luis:default.1330123.1 to cache LRU end<br />2016-09-16 09:18:23.804560 7fd5c4780700 10 updating xattr: name=user.rgw.acl bl.length()=141<br />2016-09-16 09:18:23.804563 7fd5c4780700 20 get_system_obj_state: s->obj_tag was set empty<br />2016-09-16 09:18:23.804565 7fd5c4780700 10 cache get: name=.rgw+.bucket.meta.luis:default.1330123.1 : hit (requested=17, cached=23)<br />2016-09-16 09:18:23.805146 7fd5c4780700 2 req 1:0.005946:s3:GET /:list_bucket:completing<br />2016-09-16 09:18:23.805182 7fd5c4780700 2 req 1:0.005982:s3:GET /:list_bucket:op status=0<br />2016-09-16 09:18:23.805185 7fd5c4780700 2 req 1:0.005985:s3:GET /:list_bucket:http status=200<br />2016-09-16 09:18:23.805192 7fd5c4780700 1 ====== req done req=0x7fd62c0212a0 op status=0 http_status=200 ======<br />2016-09-16 09:18:23.815953 7fd5c7f87700 20 enqueued request req=0x7fd62c022a10<br />2016-09-16 09:18:23.815964 7fd5c7f87700 20 RGWWQ:<br />2016-09-16 09:18:23.815966 7fd5c7f87700 20 req: 0x7fd62c022a10<br />2016-09-16 09:18:23.815970 7fd5c7f87700 10 allocated request req=0x7fd62c022230<br />2016-09-16 09:18:23.816001 7fd5c4f81700 20 dequeued request req=0x7fd62c022a10<br />2016-09-16 09:18:23.816005 7fd5c4f81700 20 RGWWQ: empty<br />2016-09-16 09:18:23.816047 7fd5c4f81700 20 CONTENT_LENGTH=1354<br />2016-09-16 09:18:23.816052 7fd5c4f81700 20 CONTENT_TYPE=text/plain<br />2016-09-16 09:18:23.816052 7fd5c4f81700 20 CONTEXT_DOCUMENT_ROOT=/var/lib/ceph/radosgw/stratus-el02sv20/htdocs/<br />2016-09-16 09:18:23.816053 7fd5c4f81700 20 CONTEXT_PREFIX=<br />2016-09-16 09:18:23.816053 7fd5c4f81700 20 DOCUMENT_ROOT=/var/lib/ceph/radosgw/stratus-el02sv20/htdocs/<br />2016-09-16 09:18:23.816054 7fd5c4f81700 20 FCGI_ROLE=RESPONDER<br />2016-09-16 09:18:23.816056 7fd5c4f81700 20 GATEWAY_INTERFACE=CGI/1.1<br />2016-09-16 09:18:23.816056 7fd5c4f81700 20 HTTP_ACCEPT_ENCODING=identity<br />2016-09-16 09:18:23.816057 7fd5c4f81700 20 HTTP_AUTHORIZATION=AWS4-HMAC-SHA256 Credential=C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class,Signature=6845cb459d6ec0c4770318f5948ed2c216d97776c13154ab9b041283df74b692<br />2016-09-16 09:18:23.816058 7fd5c4f81700 20 HTTP_HOST=luis.s3stratus.inflab.ocado.com<br />2016-09-16 09:18:23.816059 7fd5c4f81700 20 HTTP_X_AMZ_CONTENT_SHA256=b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />2016-09-16 09:18:23.816059 7fd5c4f81700 20 HTTP_X_AMZ_DATE=20160916T081823Z<br />2016-09-16 09:18:23.816059 7fd5c4f81700 20 HTTP_X_AMZ_META_S3CMD_ATTRS=uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />2016-09-16 09:18:23.816060 7fd5c4f81700 20 HTTP_X_AMZ_STORAGE_CLASS=STANDARD<br />2016-09-16 09:18:23.816060 7fd5c4f81700 20 PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin<br />2016-09-16 09:18:23.816061 7fd5c4f81700 20 QUERY_STRING=page=s3cfg_stratus&params=<br />2016-09-16 09:18:23.816061 7fd5c4f81700 20 REMOTE_ADDR=10.252.24.104<br />2016-09-16 09:18:23.816062 7fd5c4f81700 20 REMOTE_PORT=51523<br />2016-09-16 09:18:23.816062 7fd5c4f81700 20 REQUEST_METHOD=PUT<br />2016-09-16 09:18:23.816063 7fd5c4f81700 20 REQUEST_SCHEME=http<br />2016-09-16 09:18:23.816064 7fd5c4f81700 20 REQUEST_URI=/s3cfg_stratus<br />2016-09-16 09:18:23.816064 7fd5c4f81700 20 SCRIPT_FILENAME=/var/lib/ceph/radosgw/stratus-el02sv20/htdocs/s3gw<br />2016-09-16 09:18:23.816065 7fd5c4f81700 20 SCRIPT_NAME=/s3cfg_stratus<br />2016-09-16 09:18:23.816065 7fd5c4f81700 20 SCRIPT_URI=http://luis.s3stratus.inflab.ocado.com/s3cfg_stratus<br />2016-09-16 09:18:23.816065 7fd5c4f81700 20 SCRIPT_URL=/s3cfg_stratus<br />2016-09-16 09:18:23.816066 7fd5c4f81700 20 SERVER_ADDR=10.64.134.16<br />2016-09-16 09:18:23.816066 7fd5c4f81700 20 SERVER_ADMIN=[no address given]<br />2016-09-16 09:18:23.816066 7fd5c4f81700 20 SERVER_NAME=luis.s3stratus.inflab.ocado.com<br />2016-09-16 09:18:23.816067 7fd5c4f81700 20 SERVER_PORT=80<br />2016-09-16 09:18:23.816067 7fd5c4f81700 20 SERVER_PROTOCOL=HTTP/1.1<br />2016-09-16 09:18:23.816067 7fd5c4f81700 20 SERVER_SIGNATURE=<br />2016-09-16 09:18:23.816068 7fd5c4f81700 20 SERVER_SOFTWARE=Apache/2.4.7 (Ubuntu)<br />2016-09-16 09:18:23.816068 7fd5c4f81700 1 ====== starting new request req=0x7fd62c022a10 =====<br />2016-09-16 09:18:23.816077 7fd5c4f81700 2 req 2:0.000008::PUT /s3cfg_stratus::initializing for trans_id = tx000000000000000000002-0057dbaacf-1dd797-default<br />2016-09-16 09:18:23.816080 7fd5c4f81700 10 host=luis.s3stratus.inflab.ocado.com<br />2016-09-16 09:18:23.816083 7fd5c4f81700 20 subdomain=luis domain=s3stratus.inflab.ocado.com in_hosted_domain=1 in_hosted_domain_s3website=0<br />2016-09-16 09:18:23.816091 7fd5c4f81700 10 meta>> HTTP_X_AMZ_CONTENT_SHA256<br />2016-09-16 09:18:23.816093 7fd5c4f81700 10 meta>> HTTP_X_AMZ_DATE<br />2016-09-16 09:18:23.816094 7fd5c4f81700 10 meta>> HTTP_X_AMZ_META_S3CMD_ATTRS<br />2016-09-16 09:18:23.816096 7fd5c4f81700 10 meta>> HTTP_X_AMZ_STORAGE_CLASS<br />2016-09-16 09:18:23.816098 7fd5c4f81700 10 x>> x-amz-content-sha256:b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />2016-09-16 09:18:23.816099 7fd5c4f81700 10 x>> x-amz-date:20160916T081823Z<br />2016-09-16 09:18:23.816099 7fd5c4f81700 10 x>> x-amz-meta-s3cmd-attrs:uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />2016-09-16 09:18:23.816100 7fd5c4f81700 10 x>> x-amz-storage-class:STANDARD<br />2016-09-16 09:18:23.816121 7fd5c4f81700 20 get_handler handler=22RGWHandler_REST_Obj_S3<br />2016-09-16 09:18:23.816123 7fd5c4f81700 10 handler=22RGWHandler_REST_Obj_S3<br />2016-09-16 09:18:23.816124 7fd5c4f81700 2 req 2:0.000056:s3:PUT /s3cfg_stratus::getting op 1<br />2016-09-16 09:18:23.816128 7fd5c4f81700 10 op=21RGWPutObj_ObjStore_S3<br />2016-09-16 09:18:23.816129 7fd5c4f81700 2 req 2:0.000061:s3:PUT /s3cfg_stratus:put_obj:authorizing<br />2016-09-16 09:18:23.816133 7fd5c4f81700 10 v4 signedheaders format = content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class<br />2016-09-16 09:18:23.816136 7fd5c4f81700 10 v4 signature format = 6845cb459d6ec0c4770318f5948ed2c216d97776c13154ab9b041283df74b692<br />2016-09-16 09:18:23.816139 7fd5c4f81700 10 v4 credential format = C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request<br />2016-09-16 09:18:23.816140 7fd5c4f81700 10 access key id = C0K66XRJC2NW0O0WN06U<br />2016-09-16 09:18:23.816141 7fd5c4f81700 10 credential scope = 20160916/US/s3/aws4_request<br />2016-09-16 09:18:23.816164 7fd5c4f81700 10 canonical headers format = content-length:1354<br />content-type:text/plain<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />x-amz-date:20160916T081823Z<br />x-amz-meta-s3cmd-attrs:uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />x-amz-storage-class:STANDARD</p>
<p>2016-09-16 09:18:23.816166 7fd5c4f81700 10 body content detected... delaying v4 auth<br />2016-09-16 09:18:23.816168 7fd5c4f81700 2 req 2:0.000099:s3:PUT /s3cfg_stratus:put_obj:normalizing buckets and tenants<br />2016-09-16 09:18:23.816169 7fd5c4f81700 10 s->object=s3cfg_stratus s->bucket=luis<br />2016-09-16 09:18:23.816170 7fd5c4f81700 2 req 2:0.000101:s3:PUT /s3cfg_stratus:put_obj:init permissions<br />2016-09-16 09:18:23.816176 7fd5c4f81700 20 get_system_obj_state: rctx=0x7fd5c4f7f710 obj=.rgw:luis state=0x7fd6380166b8 s->prefetch_data=0<br />2016-09-16 09:18:23.816179 7fd5c4f81700 10 cache get: name=.rgw+luis : type miss (requested=22, cached=19)<br />2016-09-16 09:18:23.816923 7fd5c4f81700 10 cache put: name=.rgw+luis info.flags=22<br />2016-09-16 09:18:23.816931 7fd5c4f81700 10 moving .rgw+luis to cache LRU end<br />2016-09-16 09:18:23.816935 7fd5c4f81700 20 get_system_obj_state: s->obj_tag was set empty<br />2016-09-16 09:18:23.816945 7fd5c4f81700 20 Read xattr: user.rgw.idtag<br />2016-09-16 09:18:23.816946 7fd5c4f81700 20 Read xattr: user.rgw.manifest<br />2016-09-16 09:18:23.816948 7fd5c4f81700 10 cache get: name=.rgw+luis : hit (requested=17, cached=23)<br />2016-09-16 09:18:23.816956 7fd5c4f81700 20 rgw_get_bucket_info: bucket instance: luis(@{i=.rgw.buckets.index,e=.rgw.buckets.extra}.rgw.buckets[default.1330123.1])<br />2016-09-16 09:18:23.816959 7fd5c4f81700 20 reading from .rgw:.bucket.meta.luis:default.1330123.1<br />2016-09-16 09:18:23.816963 7fd5c4f81700 20 get_system_obj_state: rctx=0x7fd5c4f7f710 obj=.rgw:.bucket.meta.luis:default.1330123.1 state=0x7fd638017c28 s->prefetch_data=0<br />2016-09-16 09:18:23.816967 7fd5c4f81700 10 cache get: name=.rgw+.bucket.meta.luis:default.1330123.1 : hit (requested=22, cached=23)<br />2016-09-16 09:18:23.816970 7fd5c4f81700 20 get_system_obj_state: s->obj_tag was set empty<br />2016-09-16 09:18:23.816971 7fd5c4f81700 20 Read xattr: user.rgw.acl<br />2016-09-16 09:18:23.816972 7fd5c4f81700 20 Read xattr: user.rgw.idtag<br />2016-09-16 09:18:23.816972 7fd5c4f81700 20 Read xattr: user.rgw.manifest<br />2016-09-16 09:18:23.816973 7fd5c4f81700 10 cache get: name=.rgw+.bucket.meta.luis:default.1330123.1 : hit (requested=17, cached=23)<br />2016-09-16 09:18:23.816984 7fd5c4f81700 10 chain_cache_entry: cache_locator=.rgw+luis<br />2016-09-16 09:18:23.816985 7fd5c4f81700 10 chain_cache_entry: cache_locator=.rgw+.bucket.meta.luis:default.1330123.1<br />2016-09-16 09:18:23.816994 7fd5c4f81700 15 decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>luis</ID><DisplayName>luis test user</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>luis</ID><DisplayName>luis test user</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy><br />2016-09-16 09:18:23.816999 7fd5c4f81700 2 req 2:0.000930:s3:PUT /s3cfg_stratus:put_obj:recalculating target<br />2016-09-16 09:18:23.817001 7fd5c4f81700 2 req 2:0.000933:s3:PUT /s3cfg_stratus:put_obj:reading permissions<br />2016-09-16 09:18:23.817005 7fd5c4f81700 2 req 2:0.000936:s3:PUT /s3cfg_stratus:put_obj:init op<br />2016-09-16 09:18:23.817007 7fd5c4f81700 2 req 2:0.000938:s3:PUT /s3cfg_stratus:put_obj:verifying op mask<br />2016-09-16 09:18:23.817007 7fd5c4f81700 20 required_mask= 2 user.op_mask=7<br />2016-09-16 09:18:23.817008 7fd5c4f81700 2 req 2:0.000939:s3:PUT /s3cfg_stratus:put_obj:verifying op permissions<br />2016-09-16 09:18:23.817009 7fd5c4f81700 5 Searching permissions for uid=luis mask=50<br />2016-09-16 09:18:23.817010 7fd5c4f81700 5 Found permission: 15<br />2016-09-16 09:18:23.817011 7fd5c4f81700 5 Searching permissions for group=1 mask=50<br />2016-09-16 09:18:23.817011 7fd5c4f81700 5 Permissions for group not found<br />2016-09-16 09:18:23.817012 7fd5c4f81700 5 Searching permissions for group=2 mask=50<br />2016-09-16 09:18:23.817013 7fd5c4f81700 5 Permissions for group not found<br />2016-09-16 09:18:23.817013 7fd5c4f81700 5 Getting permissions id=luis owner=luis perm=2<br />2016-09-16 09:18:23.817014 7fd5c4f81700 10 uid=luis requested perm (type)=2, policy perm=2, user_perm_mask=2, acl perm=2<br />2016-09-16 09:18:23.817016 7fd5c4f81700 2 req 2:0.000945:s3:PUT /s3cfg_stratus:put_obj:verifying op params<br />2016-09-16 09:18:23.817018 7fd5c4f81700 2 req 2:0.000949:s3:PUT /s3cfg_stratus:put_obj:pre-executing<br />2016-09-16 09:18:23.817019 7fd5c4f81700 2 req 2:0.000950:s3:PUT /s3cfg_stratus:put_obj:executing<br />2016-09-16 09:18:23.817103 7fd5c4f81700 10 payload request hash = b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />2016-09-16 09:18:23.817126 7fd5c4f81700 10 canonical request = PUT<br />/s3cfg_stratus<br />page=s3cfg_stratus&params=<br />content-length:1354<br />content-type:text/plain<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />x-amz-date:20160916T081823Z<br />x-amz-meta-s3cmd-attrs:uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />x-amz-storage-class:STANDARD</p>
<p>content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class<br />b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />2016-09-16 09:18:23.817129 7fd5c4f81700 10 canonical request hash = 2a90d1d6c42904cfda59965501748ab03a197f63be3ea9f0490cfdacacd572be<br />2016-09-16 09:18:23.817132 7fd5c4f81700 10 string to sign = AWS4-HMAC-SHA256<br />20160916T081823Z<br />20160916/US/s3/aws4_request<br />2a90d1d6c42904cfda59965501748ab03a197f63be3ea9f0490cfdacacd572be<br />2016-09-16 09:18:23.817153 7fd5c4f81700 10 date_k = 5de0fe6cbbd1c7f0cbae1b9123e0df1300de69e86cce88bb9b2aab2837dd1fee<br />2016-09-16 09:18:23.817183 7fd5c4f81700 10 region_k = 8d598fb8a0cd5658cce911790d8f7295c1b80a975cbc7cc20bf8fc0d92701ed8<br />2016-09-16 09:18:23.817220 7fd5c4f81700 10 service_k = 06f9337b2ddcd0ef62f3c5bb898f1e79653a13db810580873e69bb85516260f1<br />2016-09-16 09:18:23.817236 7fd5c4f81700 10 signing_k = 3e60b563bb70c72120462681bbaed28e67a63aae268f748980f4c4fa4b5d0a6d<br />2016-09-16 09:18:23.817251 7fd5c4f81700 10 signature_k = 7221be9c76ae6595b5190f54bd898548cb16fd817a331a7eb6da80e0110078b9<br />2016-09-16 09:18:23.817253 7fd5c4f81700 10 new signature = 7221be9c76ae6595b5190f54bd898548cb16fd817a331a7eb6da80e0110078b9<br />2016-09-16 09:18:23.817254 7fd5c4f81700 10 ----------------------------- Verifying signatures<br />2016-09-16 09:18:23.817255 7fd5c4f81700 10 Signature = 6845cb459d6ec0c4770318f5948ed2c216d97776c13154ab9b041283df74b692<br />2016-09-16 09:18:23.817255 7fd5c4f81700 10 New Signature = 7221be9c76ae6595b5190f54bd898548cb16fd817a331a7eb6da80e0110078b9<br />2016-09-16 09:18:23.817256 7fd5c4f81700 10 -----------------------------<br />2016-09-16 09:18:23.817257 7fd5c4f81700 20 delayed aws4 auth failed<br />2016-09-16 09:18:23.817264 7fd5c4f81700 2 req 2:0.001195:s3:PUT /s3cfg_stratus:put_obj:completing<br />2016-09-16 09:18:23.817282 7fd5c4f81700 2 req 2:0.001214:s3:PUT /s3cfg_stratus:put_obj:op status=-2027<br />2016-09-16 09:18:23.817285 7fd5c4f81700 2 req 2:0.001216:s3:PUT /s3cfg_stratus:put_obj:http status=403<br />2016-09-16 09:18:23.817288 7fd5c4f81700 1 ====== req done req=0x7fd62c022a10 op status=-2027 http_status=403 ======<br />2016-09-16 09:18:23.817296 7fd5c4f81700 20 process_request() returned -2027</p>
<p>and this is what I get on "s3cmd <del>c s3cfg_stratus --debug sync . s3://luis/" <br />DEBUG: s3cmd version 1.6.1<br />DEBUG: ConfigParser: Reading file 's3cfg_stratus'<br />DEBUG: ConfigParser: access_key->C0...17_chars...U<br />DEBUG: ConfigParser: bucket_location->US<br />DEBUG: ConfigParser: cloudfront_host->cloudfront.amazonaws.com<br />DEBUG: ConfigParser: default_mime_type->binary/octet-stream<br />DEBUG: ConfigParser: delete_removed->False<br />DEBUG: ConfigParser: dry_run->False<br />DEBUG: ConfigParser: enable_multipart->True<br />DEBUG: ConfigParser: encoding->ANSI_X3.4-1968<br />DEBUG: ConfigParser: encrypt->False<br />DEBUG: ConfigParser: follow_symlinks->False<br />DEBUG: ConfigParser: force->False<br />DEBUG: ConfigParser: get_continue->False<br />DEBUG: ConfigParser: gpg_command->/usr/bin/gpg<br />DEBUG: ConfigParser: gpg_decrypt-><span class="gpg_command">s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s<br />DEBUG: ConfigParser: gpg_encrypt-></span>(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd <span class="passphrase_fd">s -o %(output_file)s %(input_file)s<br />DEBUG: ConfigParser: gpg_passphrase->...-3_chars...<br />DEBUG: ConfigParser: guess_mime_type->True<br />DEBUG: ConfigParser: host_base->s3stratus.inflab.ocado.com<br />DEBUG: ConfigParser: host_bucket-></span>(bucket)s.s3stratus.inflab.ocado.com<br />DEBUG: ConfigParser: human_readable_sizes->False<br />DEBUG: ConfigParser: invalidate_on_cf->False<br />DEBUG: ConfigParser: list_md5->False<br />DEBUG: ConfigParser: log_target_prefix-><br />DEBUG: ConfigParser: mime_type-><br />DEBUG: ConfigParser: multipart_chunk_size_mb->15<br />DEBUG: ConfigParser: preserve_attrs->True<br />DEBUG: ConfigParser: progress_meter->True<br />DEBUG: ConfigParser: proxy_host-><br />DEBUG: ConfigParser: proxy_port->0<br />DEBUG: ConfigParser: recursive->False<br />DEBUG: ConfigParser: recv_chunk->4096<br />DEBUG: ConfigParser: reduced_redundancy->False<br />DEBUG: ConfigParser: secret_key->7P...37_chars...Z<br />DEBUG: ConfigParser: send_chunk->4096<br />DEBUG: ConfigParser: simpledb_host->sdb.amazonaws.com<br />DEBUG: ConfigParser: skip_existing->False<br />DEBUG: ConfigParser: socket_timeout->300<br />DEBUG: ConfigParser: urlencoding_mode->normal<br />DEBUG: ConfigParser: use_https->False<br />DEBUG: ConfigParser: verbosity->WARNING<br />DEBUG: ConfigParser: website_endpoint->http://%(bucket)s.s3-website</del>%(location)s.amazonaws.com/<br />DEBUG: ConfigParser: website_error-><br />DEBUG: ConfigParser: website_index->index.html<br />DEBUG: Updating Config.Config cache_file -> <br />DEBUG: Updating Config.Config follow_symlinks -> False<br />DEBUG: Updating Config.Config verbosity -> 10<br />DEBUG: Unicodising 'sync' using ANSI_X3.4-1968<br />DEBUG: Unicodising '.' using ANSI_X3.4-1968<br />DEBUG: Unicodising 's3://luis/' using ANSI_X3.4-1968<br />DEBUG: Command: sync<br />DEBUG: DeUnicodising u'.' using ANSI_X3.4-1968<br />DEBUG: DeUnicodising u'.' using ANSI_X3.4-1968<br />INFO: Compiling list of local files...<br />DEBUG: DeUnicodising u'.' using ANSI_X3.4-1968<br />DEBUG: DeUnicodising u'.' using ANSI_X3.4-1968<br />DEBUG: Unicodising 's3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: Applying --exclude/--include<br />DEBUG: CHECK: s3cfg_stratus<br />DEBUG: PASS: u's3cfg_stratus'<br />INFO: Running stat() and reading/calculating MD5 values on 1 files, this may take some time...<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: doing file I/O to read md5 of s3cfg_stratus<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />INFO: Retrieving list of remote files for s3://luis/. ...<br />DEBUG: String '.' encoded to '.'<br />DEBUG: CreateRequest: resource[uri]=/<br />DEBUG: Using signature v4<br />DEBUG: get_hostname(luis): luis.s3stratus.inflab.ocado.com<br />DEBUG: canonical_headers = host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />x-amz-date:20160916T083811Z</p>
<p>DEBUG: Canonical Request:<br />GET<br />/<br />prefix=.<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />x-amz-date:20160916T083811Z</p>
<p>host;x-amz-content-sha256;x-amz-date<br />e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />----------------------<br />DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=6e6d71b78d7d0d00c3d42047f3af5b87077fa903ad1a4580cc8ac0ea164b3c9c', 'x-amz-date': '20160916T083811Z'}<br />DEBUG: Processing request, please wait...<br />DEBUG: get_hostname(luis): luis.s3stratus.inflab.ocado.com<br />DEBUG: ConnMan.get(): creating new connection: <a class="external" href="http://luis.s3stratus.inflab.ocado.com">http://luis.s3stratus.inflab.ocado.com</a><br />DEBUG: non-proxied HTTPConnection(luis.s3stratus.inflab.ocado.com)<br />DEBUG: format_uri(): /?prefix=.<br />DEBUG: Sending request method_string='GET', uri='/?prefix=.', headers={'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': 'AWS4-HMAC-SHA256 Credential=C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=6e6d71b78d7d0d00c3d42047f3af5b87077fa903ad1a4580cc8ac0ea164b3c9c', 'x-amz-date': '20160916T083811Z'}, body=(0 bytes)<br />DEBUG: Response: {'status': 200, 'headers': {'transfer-encoding': 'chunked', 'server': 'Apache/2.4.7 (Ubuntu)', 'connection': 'close', 'x-amz-request-id': 'tx000000000000000000001-0057dbaf73-1dd7a3-default', 'date': 'Fri, 16 Sep 2016 08:38:11 GMT', 'content-type': 'application/xml'}, 'reason': 'OK', 'data': '<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>luis</Name><Prefix>.</Prefix><Marker></Marker><MaxKeys>1000</MaxKeys><IsTruncated>false</IsTruncated></ListBucketResult>'}<br />DEBUG: ConnMan.put(): connection put back to pool (<a class="external" href="http://luis.s3stratus.inflab.ocado.com#1">http://luis.s3stratus.inflab.ocado.com#1</a>)<br />DEBUG: Applying --exclude/--include<br />INFO: Found 1 local files, 0 remote files<br />INFO: Verifying attributes...<br />DEBUG: Comparing filelists (direction: local -> remote)<br />DEBUG: CHECK: s3cfg_stratus<br />INFO: Summary: 1 local files to upload, 0 files to remote copy, 0 remote files to delete<br />DEBUG: attr_header: {'x-amz-meta-s3cmd-attrs': 'uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666'}<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: String 's3cfg_stratus' encoded to 's3cfg_stratus'<br />DEBUG: CreateRequest: resource[uri]=/s3cfg_stratus<br />DEBUG: Using signature v4<br />DEBUG: get_hostname(luis): luis.s3stratus.inflab.ocado.com<br />DEBUG: canonical_headers = content-length:1354<br />content-type:text/plain<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />x-amz-date:20160916T083811Z<br />x-amz-meta-s3cmd-attrs:uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />x-amz-storage-class:STANDARD</p>
<p>DEBUG: Canonical Request:<br />PUT<br />/s3cfg_stratus</p>
<p>content-length:1354<br />content-type:text/plain<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />x-amz-date:20160916T083811Z<br />x-amz-meta-s3cmd-attrs:uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />x-amz-storage-class:STANDARD</p>
<p>content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class<br />e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855<br />----------------------<br />DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'content-length': '1354', 'x-amz-storage-class': 'STANDARD', 'x-amz-meta-s3cmd-attrs': 'uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666', 'x-amz-date': '20160916T083811Z', 'content-type': 'text/plain', 'Authorization': 'AWS4-HMAC-SHA256 Credential=C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class,Signature=7439a11f3d764c99453de9edaeca3b27ec6c37d5594e508c622d91279d8fa3e6'}<br />DEBUG: Unicodising './s3cfg_stratus' using ANSI_X3.4-1968<br />upload: './s3cfg_stratus' -> 's3://luis/s3cfg_stratus' [1 of 1]<br />DEBUG: DeUnicodising u'./s3cfg_stratus' using ANSI_X3.4-1968<br />DEBUG: Using signature v4<br />DEBUG: get_hostname(luis): luis.s3stratus.inflab.ocado.com<br />DEBUG: canonical_headers = content-length:1354<br />content-type:text/plain<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />x-amz-date:20160916T083811Z<br />x-amz-meta-s3cmd-attrs:uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />x-amz-storage-class:STANDARD</p>
<p>DEBUG: Canonical Request:<br />PUT<br />/s3cfg_stratus</p>
<p>content-length:1354<br />content-type:text/plain<br />host:luis.s3stratus.inflab.ocado.com<br />x-amz-content-sha256:b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />x-amz-date:20160916T083811Z<br />x-amz-meta-s3cmd-attrs:uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666<br />x-amz-storage-class:STANDARD</p>
<p>content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class<br />b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979<br />----------------------<br />DEBUG: signature-v4 headers: {'x-amz-content-sha256': 'b18765bc05bf77dd750cd05e57195081222a211b0e3ec4637be54756d71de979', 'content-length': '1354', 'x-amz-storage-class': 'STANDARD', 'x-amz-meta-s3cmd-attrs': 'uid:1000/gname:luis/uname:luis/gid:1000/mode:33152/mtime:1474013666/atime:1474013678/md5:e9aee935aba54366ec3cf58869e598dc/ctime:1474013666', 'x-amz-date': '20160916T083811Z', 'content-type': 'text/plain', 'Authorization': 'AWS4-HMAC-SHA256 Credential=C0K66XRJC2NW0O0WN06U/20160916/US/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class,Signature=c6aeec7ec539a872e0a604f69cb456ec6158aef2a0e5ef1f6f562820190efab6'}<br />DEBUG: get_hostname(luis): luis.s3stratus.inflab.ocado.com<br />DEBUG: ConnMan.get(): re-using connection: <a class="external" href="http://luis.s3stratus.inflab.ocado.com#1">http://luis.s3stratus.inflab.ocado.com#1</a><br />DEBUG: format_uri(): /s3cfg_stratus<br /> 1354 of 1354 100% in 0s 461.36 kB/sDEBUG: ConnMan.put(): connection put back to pool (<a class="external" href="http://luis.s3stratus.inflab.ocado.com#2">http://luis.s3stratus.inflab.ocado.com#2</a>)<br />DEBUG: Response: {'status': 403, 'headers': {'content-length': '227', 'accept-ranges': 'bytes', 'server': 'Apache/2.4.7 (Ubuntu)', 'connection': 'close', 'x-amz-request-id': 'tx000000000000000000002-0057dbaf73-1dd7a3-default', 'date': 'Fri, 16 Sep 2016 08:38:11 GMT', 'content-type': 'application/xml'}, 'reason': 'Forbidden', 'data': '<?xml version="1.0" encoding="UTF-8"?><Error><Code>SignatureDoesNotMatch</Code><BucketName>luis</BucketName><RequestId>tx000000000000000000002-0057dbaf73-1dd7a3-default</RequestId><HostId>1dd7a3-default-default</HostId></Error>', 'size': 1354L}<br /> 1354 of 1354 100% in 0s 188.12 kB/s done<br />DEBUG: S3Error: 403 (Forbidden)<br />DEBUG: HttpHeader: content-length: 227<br />DEBUG: HttpHeader: accept-ranges: bytes<br />DEBUG: HttpHeader: server: Apache/2.4.7 (Ubuntu)<br />DEBUG: HttpHeader: connection: close<br />DEBUG: HttpHeader: x-amz-request-id: tx000000000000000000002-0057dbaf73-1dd7a3-default<br />DEBUG: HttpHeader: date: Fri, 16 Sep 2016 08:38:11 GMT<br />DEBUG: HttpHeader: content-type: application/xml<br />DEBUG: ErrorXML: Code: 'SignatureDoesNotMatch'<br />DEBUG: ErrorXML: BucketName: 'luis'<br />DEBUG: ErrorXML: RequestId: 'tx000000000000000000002-0057dbaf73-1dd7a3-default'<br />DEBUG: ErrorXML: HostId: '1dd7a3-default-default'<br />ERROR: S3 error: 403 (SignatureDoesNotMatch)</p>
<p>I can also send a tcpdump of the connection, but it doesn't say much...</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=80036
2016-10-19T13:33:47Z
Orit Wasserman
owasserm@redhat.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Resolved</i></li></ul>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=82397
2016-12-02T12:34:34Z
Dennis Kramer
<ul></ul><p>Hi, is the fix (<a class="external" href="https://github.com/ceph/ceph/pull/10919">https://github.com/ceph/ceph/pull/10919</a>) going to be backported for 10.2.4 point release?</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=83436
2016-12-23T13:40:44Z
Loïc Dachary
loic@dachary.org
<ul><li><strong>Status</strong> changed from <i>Resolved</i> to <i>Pending Backport</i></li><li><strong>Backport</strong> set to <i>jewel</i></li></ul>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=83439
2016-12-23T13:43:22Z
Loïc Dachary
loic@dachary.org
<ul><li><strong>Copied to</strong> <i><a class="issue tracker-9 status-3 priority-4 priority-default closed" href="/issues/18349">Backport #18349</a>: jewel: AWS S3 Version 4 signatures fail sometimes.</i> added</li></ul>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=85428
2017-02-01T21:40:33Z
Nathan Cutler
ncutler@suse.cz
<ul><li><strong>Status</strong> changed from <i>Pending Backport</i> to <i>Resolved</i></li></ul>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=88861
2017-04-12T06:30:44Z
Ben Hines
bhines@gmail.com
<ul></ul><p>This basically prevents RadosGW use with Kraken with modern clients by default. Could it be backported to K?</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=89128
2017-04-12T20:21:34Z
Nathan Cutler
ncutler@suse.cz
<ul><li><strong>Project</strong> changed from <i>Ceph</i> to <i>rgw</i></li><li><strong>Category</strong> deleted (<del><i>22</i></del>)</li></ul>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=89130
2017-04-12T20:21:53Z
Nathan Cutler
ncutler@suse.cz
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-1 priority-4 priority-default" href="/issues/19008">Bug #19008</a>: rgw: adding bucket lifecycle does not work with V4 signature</i> added</li></ul>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=89132
2017-04-12T20:26:36Z
Nathan Cutler
ncutler@suse.cz
<ul></ul><p>As far as I can tell the SHA1 of the fix is 20e5ff023ebad89c386a520d07613547d4836399 and it is included in the kraken (v11.2.0) release.</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=89154
2017-04-12T21:15:24Z
Ben Hines
bhines@gmail.com
<ul></ul><p>Thanks -- i'm still seeing general -2201 failures with AWSv4 auth on Kraken 11.2.0. Perhaps i will file a new issue, then.</p>
rgw - Bug #17076: AWS S3 Version 4 signatures fail sometimes.
https://tracker.ceph.com/issues/17076?journal_id=94009
2017-06-28T21:57:59Z
Marcus Watts
mwatts@redhat.com
<ul></ul><p>I just fixed another problem with chunked transfers and AWSv4 signatures - see <a class="external" href="http://tracker.ceph.com/issues/20447">http://tracker.ceph.com/issues/20447</a> . The problem would most likely only manifest with "large" files in the wild, but I have sample code there that can reliably reproduce the problem with small files.</p>