Project

General

Profile

Actions

Bug #19283

closed

Error parsing xml when get bucket lifecycle

Added by Diluga Salome about 7 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
High
Assignee:
-
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
kraken
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

we use ceph version 12.0.0 (b7d9d6eb542e2b946ac778bd3a381ce466f60f6a)

with boto

```
from boto.s3.connection import S3Connection
import boto

access_key = 'xx'
secret_key = 'xx'
host = 'ceph.vip'
bucket = 'test1'

conn = boto.connect_s3(
aws_access_key_id = access_key,
aws_secret_access_key = secret_key,
host = host,
is_secure=False,
calling_format = boto.s3.connection.SubdomainCallingFormat(),
validate_certs = True,
)
bucket = conn.get_bucket(bucket)
try:
bucket.get_lifecycle_config()
finally:
print bucket.get_xml_acl()

```

we got this

```
Traceback (most recent call last):
<LifecycleConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;/LifecycleConfiguration&gt;HTTP/1.1 200 OK
File "/Users/Diluga/SourceCode/PycharmProjects/kv_server/boto_demo/demo1.py", line 23, in <module>
Server: openresty
bucket.get_lifecycle_config()
Date: Thu, 16 Mar 2017 05:01:55 GMT
File "/Users/Diluga/lwc/lib/python2.7/site-packages/boto/s3/bucket.py", line 1387, in get_lifecycle_config
Content-Type: application/xml
Content-Length: 441
Connection: keep-alive
x-amz-request-id: tx000000000000000000006-0058ca1c43-1071-default

<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;Owner&gt;&lt;ID&gt;u-gfn2636&lt;/ID&gt;&lt;DisplayName&gt;u-gfn2636&lt;/DisplayName&gt;&lt;/Owner&gt;&lt;AccessControlList&gt;&lt;Grant&gt;&lt;Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance&quot; xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 404 Not Found
<Error><Code>NoSuchLifecycleConfiguration</Code><BucketName>test1</BucketName><RequestId>tx000000000000000000005-0058ca1c43-1071-default</RequestId><HostId>1071-default-default</HostId></Error>

```

with s3cmd we got

```
s3cmd c ~/s3cfg.ceph.vip info s3://test1 -d 1 ↵
DEBUG: s3cmd version 1.6.1
DEBUG: ConfigParser: Reading file '/Users/Diluga/s3cfg.ceph.vip'
DEBUG: ConfigParser: access_key
>TS...17_chars...9
DEBUG: ConfigParser: secret_key->xJ...37_chars...0
DEBUG: ConfigParser: host_base->ceph.vip
DEBUG: ConfigParser: host_bucket->%(bucket)s.ceph.vip
DEBUG: ConfigParser: bucket_location->US
DEBUG: ConfigParser: check_ssl_certificate->False
DEBUG: ConfigParser: check_ssl_hostname->False
DEBUG: ConfigParser: default_mime_type->binary/octet-stream
DEBUG: ConfigParser: delay_updates->False
DEBUG: ConfigParser: delete_after->False
DEBUG: ConfigParser: delete_after_fetch->False
DEBUG: ConfigParser: delete_removed->False
DEBUG: ConfigParser: dry_run->False
DEBUG: ConfigParser: enable_multipart->True
DEBUG: ConfigParser: encoding->UTF-8
DEBUG: ConfigParser: encrypt->False
DEBUG: ConfigParser: follow_symlinks->False
DEBUG: ConfigParser: force->False
DEBUG: ConfigParser: get_continue->False
DEBUG: ConfigParser: guess_mime_type->True
DEBUG: ConfigParser: human_readable_sizes->False
DEBUG: ConfigParser: limitrate->0
DEBUG: ConfigParser: list_md5->True
DEBUG: ConfigParser: max_delete->1
DEBUG: ConfigParser: mime_type
>
DEBUG: ConfigParser: multipart_chunk_size_mb->15
DEBUG: ConfigParser: preserve_attrs->True
DEBUG: ConfigParser: progress_meter->True
DEBUG: ConfigParser: put_continue->False
DEBUG: ConfigParser: recursive->False
DEBUG: ConfigParser: recv_chunk->65536
DEBUG: ConfigParser: reduced_redundancy->False
DEBUG: ConfigParser: requester_pays->False
DEBUG: ConfigParser: restore_days->1
DEBUG: ConfigParser: send_chunk->65536
DEBUG: ConfigParser: server_side_encryption->False
DEBUG: ConfigParser: signature_v2->True
DEBUG: ConfigParser: skip_existing->False
DEBUG: ConfigParser: socket_timeout->300
DEBUG: ConfigParser: stop_on_error->False
DEBUG: ConfigParser: storage_class->
DEBUG: ConfigParser: urlencoding_mode->normal
DEBUG: ConfigParser: use_https->True
DEBUG: ConfigParser: use_mime_magic->True
DEBUG: ConfigParser: verbosity->WARNING
DEBUG: Updating Config.Config cache_file ->
DEBUG: Updating Config.Config follow_symlinks -> False
DEBUG: Updating Config.Config verbosity -> 10
DEBUG: Unicodising 'info' using UTF-8
DEBUG: Unicodising 's3://test1' using UTF-8
DEBUG: Command: info
DEBUG: CreateRequest: resource[uri]=/?location
DEBUG: Using signature v2
DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Thu, 16 Mar 2017 04:31:22 +0000\n/test1/?location'
DEBUG: Processing request, please wait...
DEBUG: get_hostname(test1): test1.ceph.vip
DEBUG: ConnMan.get(): creating new connection: https://test1.ceph.vip
DEBUG: Using ca_certs_file None
DEBUG: Disabling SSL certificate checking
DEBUG: httplib.HTTPSConnection() has only context
DEBUG: non-proxied HTTPSConnection(test1.ceph.vip)
DEBUG: format_uri(): /?location
DEBUG: Sending request method_string='GET', uri='/?location', headers={'Authorization': 'AWS TS7ESWTPA52438D3JVA9:JP3AGEjJ2rmD9AqqF0Zo8vO7zzQ=', 'x-amz-date': 'Thu, 16 Mar 2017 04:31:22 +0000'}, body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {'date': 'Thu, 16 Mar 2017 04:31:22 GMT', 'content-length': '127', 'x-amz-request-id': 'tx00000000000000000001e-0058ca151a-106e-default', 'connection': 'keep-alive', 'server': 'openresty'}, 'reason': 'OK', 'data': '<LocationConstraint xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;/LocationConstraint&gt;'}
DEBUG: ConnMan.put(): connection put back to pool (https://test1.ceph.vip#1)
DEBUG: CreateRequest: resource[uri]=/?requestPayment
DEBUG: Using signature v2
DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Thu, 16 Mar 2017 04:31:23 +0000\n/test1/?requestPayment'
DEBUG: Processing request, please wait...
DEBUG: get_hostname(test1): test1.ceph.vip
DEBUG: ConnMan.get(): re-using connection: https://test1.ceph.vip#1
DEBUG: format_uri(): /?requestPayment
DEBUG: Sending request method_string='GET', uri='/?requestPayment', headers={'Authorization': 'AWS TS7ESWTPA52438D3JVA9:s1fmfUBiLLWGR8m8/ExIdlXWH1E=', 'x-amz-date': 'Thu, 16 Mar 2017 04:31:23 +0000'}, body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '171', 'server': 'openresty', 'connection': 'keep-alive', 'x-amz-request-id': 'tx00000000000000000001f-0058ca151b-106e-default', 'date': 'Thu, 16 Mar 2017 04:31:23 GMT', 'content-type': 'application/xml'}, 'reason': 'OK', 'data': '<RequestPaymentConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;Payer&gt;BucketOwner&lt;/Payer&gt;&lt;/RequestPaymentConfiguration&gt;'}
DEBUG: ConnMan.put(): connection put back to pool (https://test1.ceph.vip#2)
s3://test1/ (bucket):
Location: us-east-1
Payer: BucketOwner
DEBUG: CreateRequest: resource[uri]=/?lifecycle
DEBUG: Using signature v2
DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Thu, 16 Mar 2017 04:31:23 +0000\n/test1/?lifecycle'
DEBUG: Processing request, please wait...
DEBUG: get_hostname(test1): test1.ceph.vip
DEBUG: ConnMan.get(): re-using connection: https://test1.ceph.vip#2
DEBUG: format_uri(): /?lifecycle
DEBUG: Sending request method_string='GET', uri='/?lifecycle', headers={'Authorization': 'AWS TS7ESWTPA52438D3JVA9:IJZY0hlvVeGNiWBenjmEooDfXd4=', 'x-amz-date': 'Thu, 16 Mar 2017 04:31:23 +0000'}, body=(0 bytes)
DEBUG: Response: {'status': 404, 'headers': {'content-length': '231', 'accept-ranges': 'bytes', 'server': 'openresty', 'connection': 'keep-alive', 'x-amz-request-id': 'tx000000000000000000020-0058ca151b-106e-default', 'date': 'Thu, 16 Mar 2017 04:31:23 GMT', 'content-type': 'application/xml'}, 'reason': 'Not Found', 'data': '<Error><Code>NoSuchLifecycleConfiguration</Code><BucketName>test1</BucketName><RequestId>tx000000000000000000020-0058ca151b-106e-default</RequestId><HostId>106e-default-default</HostId></Error>'}
DEBUG: ConnMan.put(): connection put back to pool (https://test1.ceph.vip#3)
DEBUG: S3Error: 404 (Not Found)
DEBUG: HttpHeader: content-length: 231
DEBUG: HttpHeader: accept-ranges: bytes
DEBUG: HttpHeader: server: openresty
DEBUG: HttpHeader: connection: keep-alive
DEBUG: HttpHeader: x-amz-request-id: tx000000000000000000020-0058ca151b-106e-default
DEBUG: HttpHeader: date: Thu, 16 Mar 2017 04:31:23 GMT
DEBUG: HttpHeader: content-type: application/xml
DEBUG: ErrorXML: Code: 'NoSuchLifecycleConfiguration'
DEBUG: ErrorXML: BucketName: 'test1'
DEBUG: ErrorXML: RequestId: 'tx000000000000000000020-0058ca151b-106e-default'
DEBUG: ErrorXML: HostId: '106e-default-default'
DEBUG: Could not get /?lifecycle - lifecycle probably not configured for this bucket
Expiration Rule: none
DEBUG: CreateRequest: resource[uri]=/?acl
DEBUG: Using signature v2
DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Thu, 16 Mar 2017 04:31:23 +0000\n/test1/?acl'
DEBUG: Processing request, please wait...
DEBUG: get_hostname(test1): test1.ceph.vip
DEBUG: ConnMan.get(): re-using connection: https://test1.ceph.vip#3
DEBUG: format_uri(): /?acl
DEBUG: Sending request method_string='GET', uri='/?acl', headers={'Authorization': 'AWS TS7ESWTPA52438D3JVA9:yJqPQgBbWTCA68zWEmXgZreDM6g=', 'x-amz-date': 'Thu, 16 Mar 2017 04:31:23 +0000'}, body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {}, 'reason': '', 'data': '<LifecycleConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;/LifecycleConfiguration&gt;HTTP/1.1 200 OK\r\nServer: openresty\r\nDate: Thu, 16 Mar 2017 04:31:23 GMT\r\nContent-Type: application/xml\r\nContent-Length: 441\r\nConnection: keep-alive\r\nx-amz-request-id: tx000000000000000000021-0058ca151b-106e-default\r\n\r\n<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;Owner&gt;&lt;ID&gt;u-gfn2636&lt;/ID&gt;&lt;DisplayName&gt;u-gfn2636&lt;/DisplayName&gt;&lt;/Owner&gt;&lt;AccessControlList&gt;&lt;Grant&gt;&lt;Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance&quot; xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>'}
DEBUG: ConnMan.put(): connection put back to pool (https://test1.ceph.vip#4)
ERROR: Error parsing xml: not well-formed (invalid token): line 1, column 101
ERROR: <LifecycleConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;/LifecycleConfiguration&gt;HTTP/1.1 200 OK
Server: openresty
Date: Thu, 16 Mar 2017 04:31:23 GMT
Content-Type: application/xml
Content-Length: 441
Connection: keep-alive
x-amz-request-id: tx000000000000000000021-0058ca151b-106e-default

<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;Owner&gt;&lt;ID&gt;u-gfn2636&lt;/ID&gt;&lt;DisplayName&gt;u-gfn2636&lt;/DisplayName&gt;&lt;/Owner&gt;&lt;AccessControlList&gt;&lt;Grant&gt;&lt;Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance&quot; xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
An unexpected error has occurred.
Please try reproducing the error using
the latest s3cmd code from the git master
branch found at:
https://github.com/s3tools/s3cmd
and have a look at the known issues list:
https://github.com/s3tools/s3cmd/wiki/Common-known-issues-and-their-solutions
If the error persists, please report the
following lines (removing any private
info as necessary) to:

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

DEBUG: Unicodising '/usr/local/bin/s3cmd' using UTF-8
DEBUG: Unicodising '-c' using UTF-8
DEBUG: Unicodising '/Users/Diluga/s3cfg.ceph.vip' using UTF-8
DEBUG: Unicodising 'info' using UTF-8
DEBUG: Unicodising 's3://test1' using UTF-8
DEBUG: Unicodising '-d' using UTF-8
Invoked as: /usr/local/bin/s3cmd -c /Users/Diluga/s3cfg.ceph.vip info s3://test1 -d
Problem: ParseError: not well-formed (invalid token): line 1, column 101
S3cmd: 1.6.1
python: 2.7.10 (default, Oct 23 2015, 19:19:21)
[GCC 4.2.1 Compatible Apple LLVM 7.0.0 (clang-700.0.59.5)]
environment LANG=zh_CN.UTF-8

Traceback (most recent call last):
File "/usr/local/bin/s3cmd", line 2919, in <module>
rc = main()
File "/usr/local/bin/s3cmd", line 2841, in main
rc = cmd_func(args)
File "/usr/local/bin/s3cmd", line 889, in cmd_info
acl = s3.get_acl(uri)
File "/Library/Python/2.7/site-packages/S3/S3.py", line 837, in get_acl
acl = ACL
File "/Library/Python/2.7/site-packages/S3/ACL.py", line 82, in init
tree = getTreeFromXml(xml)
File "/Library/Python/2.7/site-packages/S3/Utils.py", line 89, in getTreeFromXml
tree = ET.fromstring(xml)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/xml/etree/ElementTree.py", line 1300, in XML
parser.feed(text)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/xml/etree/ElementTree.py", line 1642, in feed
self._raiseerror(v)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/xml/etree/ElementTree.py", line 1506, in _raiseerror
raise err
ParseError: not well-formed (invalid token): line 1, column 101

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
An unexpected error has occurred.
Please try reproducing the error using
the latest s3cmd code from the git master
branch found at:
https://github.com/s3tools/s3cmd
and have a look at the known issues list:
https://github.com/s3tools/s3cmd/wiki/Common-known-issues-and-their-solutions
If the error persists, please report the
above lines (removing any private
info as necessary) to:

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

```

it look like a bug,if run get_bucket_lifecycle before get_bucket_acl, the get_bucket_acl's response will add some lifecycle xml info,like this

```
<LifecycleConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;/LifecycleConfiguration&gt;HTTP/1.1 200 OK\r\nServer: openresty\r\nDate: Thu, 16 Mar 2017 04:31:23 GMT\r\nContent-Type: application/xml\r\nContent-Length: 441\r\nConnection: keep-alive\r\nx-amz-request-id: tx000000000000000000021-0058ca151b-106e-default\r\n\r\n<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;Owner&gt;&lt;ID&gt;u-gfn2636&lt;/ID&gt;&lt;DisplayName&gt;u-gfn2636&lt;/DisplayName&gt;&lt;/Owner&gt;&lt;AccessControlList&gt;&lt;Grant&gt;&lt;Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance&quot; xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
```


Related issues 1 (0 open1 closed)

Copied to rgw - Backport #19534: kraken: rgw: Error parsing xml when get bucket lifecycle ResolvedNathan CutlerActions
Actions #1

Updated by Diluga Salome about 7 years ago

radosgw.log

```
2017-03-16 13:01:55.568315 7f3fcd3d6700 20 enqueued request req=0x7f400148da80
2017-03-16 13:01:55.568342 7f3fcd3d6700 20 RGWWQ:
2017-03-16 13:01:55.568345 7f3fcd3d6700 20 req: 0x7f400148da80
2017-03-16 13:01:55.568370 7f3fcd3d6700 10 allocated request req=0x7f400148f9c0
2017-03-16 13:01:55.568393 7f3fc6bc9700 20 dequeued request req=0x7f400148da80
2017-03-16 13:01:55.568402 7f3fc6bc9700 20 RGWWQ: empty
2017-03-16 13:01:55.568480 7f3fc6bc9700 20 CONTENT_LENGTH=0
2017-03-16 13:01:55.568484 7f3fc6bc9700 20 CONTENT_TYPE=
2017-03-16 13:01:55.568485 7f3fc6bc9700 20 DOCUMENT_ROOT=/etc/nginx/nginx/html
2017-03-16 13:01:55.568486 7f3fc6bc9700 20 DOCUMENT_URI=/
2017-03-16 13:01:55.568487 7f3fc6bc9700 20 FCGI_ROLE=RESPONDER
2017-03-16 13:01:55.568488 7f3fc6bc9700 20 GATEWAY_INTERFACE=CGI/1.1
2017-03-16 13:01:55.568489 7f3fc6bc9700 20 HTTP_ACCEPT_ENCODING=identity
2017-03-16 13:01:55.568490 7f3fc6bc9700 20 HTTP_AUTHORIZATION=AWS TS7ESWTPA52438D3JVA9:ylLldOfGP1cSjsJ+U4nMPgpXHzo=
2017-03-16 13:01:55.568492 7f3fc6bc9700 20 HTTP_CONTENT_LENGTH=0
2017-03-16 13:01:55.568493 7f3fc6bc9700 20 HTTP_DATE=Thu, 16 Mar 2017 05:01:55 GMT
2017-03-16 13:01:55.568493 7f3fc6bc9700 20 HTTP_HOST=test1.ceph.vip
2017-03-16 13:01:55.568495 7f3fc6bc9700 20 HTTP_USER_AGENT=Boto/2.38.0 Python/2.7.10 Darwin/15.5.0
2017-03-16 13:01:55.568496 7f3fc6bc9700 20 QUERY_STRING=lifecycle
2017-03-16 13:01:55.568498 7f3fc6bc9700 20 REDIRECT_STATUS=200
2017-03-16 13:01:55.568499 7f3fc6bc9700 20 REMOTE_ADDR=10.120.170.102
2017-03-16 13:01:55.568500 7f3fc6bc9700 20 REMOTE_PORT=52323
2017-03-16 13:01:55.568500 7f3fc6bc9700 20 REQUEST_METHOD=GET
2017-03-16 13:01:55.568502 7f3fc6bc9700 20 REQUEST_SCHEME=http
2017-03-16 13:01:55.568503 7f3fc6bc9700 20 REQUEST_URI=/?lifecycle
2017-03-16 13:01:55.568504 7f3fc6bc9700 20 SCRIPT_NAME=/
2017-03-16 13:01:55.568505 7f3fc6bc9700 20 SERVER_ADDR=10.63.48.9
2017-03-16 13:01:55.568506 7f3fc6bc9700 20 SERVER_NAME=ceph.vip
2017-03-16 13:01:55.568507 7f3fc6bc9700 20 SERVER_PORT=80
2017-03-16 13:01:55.568508 7f3fc6bc9700 20 SERVER_PROTOCOL=HTTP/1.1
2017-03-16 13:01:55.568509 7f3fc6bc9700 20 SERVER_SOFTWARE=nginx/1.9.15
2017-03-16 13:01:55.568511 7f3fc6bc9700 1 ====== starting new request req=0x7f400148da80 =====
2017-03-16 13:01:55.568529 7f3fc6bc9700 2 req 5:0.000017::GET /::initializing for trans_id = tx000000000000000000005-0058ca1c43-1071-default
2017-03-16 13:01:55.568552 7f3fc6bc9700 10 rgw api priority: s3=5 s3website=4
2017-03-16 13:01:55.568557 7f3fc6bc9700 10 host=test1.ceph.vip
2017-03-16 13:01:55.568564 7f3fc6bc9700 20 subdomain=test1 domain=ceph.vip in_hosted_domain=1 in_hosted_domain_s3website=0
2017-03-16 13:01:55.568568 7f3fc6bc9700 20 final domain/bucket subdomain=test1 domain=ceph.vip in_hosted_domain=1 in_hosted_domain_s3website=0 s->info.domain=ceph.vip s->info.request_uri=/test1/
2017-03-16 13:01:55.568600 7f3fc6bc9700 20 get_handler handler=25RGWHandler_REST_Bucket_S3
2017-03-16 13:01:55.568604 7f3fc6bc9700 10 handler=25RGWHandler_REST_Bucket_S3
2017-03-16 13:01:55.568608 7f3fc6bc9700 2 req 5:0.000096:s3:GET /::getting op 0
2017-03-16 13:01:55.568615 7f3fc6bc9700 10 op=20RGWGetLC_ObjStore_S3
2017-03-16 13:01:55.568617 7f3fc6bc9700 2 req 5:0.000106:s3:GET /:get_lifecycle:authorizing
2017-03-16 13:01:55.568722 7f3fc6bc9700 10 get_canon_resource(): dest=/test1/?lifecycle
2017-03-16 13:01:55.568735 7f3fc6bc9700 10 auth_hdr:
GET

Thu, 16 Mar 2017 05:01:55 GMT
/test1/?lifecycle
2017-03-16 13:01:55.568789 7f3fc6bc9700 15 calculated digest=ylLldOfGP1cSjsJ+U4nMPgpXHzo=
2017-03-16 13:01:55.568791 7f3fc6bc9700 15 auth_sign=ylLldOfGP1cSjsJ+U4nMPgpXHzo=
2017-03-16 13:01:55.568793 7f3fc6bc9700 15 compare=0
2017-03-16 13:01:55.568804 7f3fc6bc9700 2 req 5:0.000292:s3:GET /:get_lifecycle:normalizing buckets and tenants
2017-03-16 13:01:55.568808 7f3fc6bc9700 10 s->object=<NULL> s->bucket=test1
2017-03-16 13:01:55.568812 7f3fc6bc9700 2 req 5:0.000301:s3:GET /:get_lifecycle:init permissions
2017-03-16 13:01:55.568833 7f3fc6bc9700 15 decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;Owner&gt;&lt;ID&gt;u-gfn2636&lt;/ID&gt;&lt;DisplayName&gt;u-gfn2636&lt;/DisplayName&gt;&lt;/Owner&gt;&lt;AccessControlList&gt;&lt;Grant&gt;&lt;Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance&quot; xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
2017-03-16 13:01:55.568843 7f3fc6bc9700 2 req 5:0.000332:s3:GET /:get_lifecycle:recalculating target
2017-03-16 13:01:55.568847 7f3fc6bc9700 2 req 5:0.000335:s3:GET /:get_lifecycle:reading permissions
2017-03-16 13:01:55.568849 7f3fc6bc9700 2 req 5:0.000338:s3:GET /:get_lifecycle:init op
2017-03-16 13:01:55.568852 7f3fc6bc9700 2 req 5:0.000341:s3:GET /:get_lifecycle:verifying op mask
2017-03-16 13:01:55.568854 7f3fc6bc9700 20 required_mask= 2 user.op_mask=7
2017-03-16 13:01:55.568856 7f3fc6bc9700 2 req 5:0.000345:s3:GET /:get_lifecycle:verifying op permissions
2017-03-16 13:01:55.568860 7f3fc6bc9700 5 Searching permissions for identity=RGWThirdPartyAccountAuthApplier() > RGWLocalAuthApplier(acct_user=u-gfn2636, acct_name=u-gfn2636, subuser=, perm_mask=15, is_admin=) mask=56
2017-03-16 13:01:55.568864 7f3fc6bc9700 5 Searching permissions for uid=u-gfn2636
2017-03-16 13:01:55.568865 7f3fc6bc9700 5 Found permission: 15
2017-03-16 13:01:55.568867 7f3fc6bc9700 5 Searching permissions for group=1 mask=56
2017-03-16 13:01:55.568868 7f3fc6bc9700 5 Permissions for group not found
2017-03-16 13:01:55.568870 7f3fc6bc9700 5 Searching permissions for group=2 mask=56
2017-03-16 13:01:55.569042 7f3fc6bc9700 5 Permissions for group not found
2017-03-16 13:01:55.569048 7f3fc6bc9700 5 Getting permissions identity=RGWThirdPartyAccountAuthApplier() -> RGWLocalAuthApplier(acct_user=u-gfn2636, acct_name=u-gfn2636, subuser=, perm_mask=15, is_admin=) owner=u-gfn2636 perm=8
2017-03-16 13:01:55.569057 7f3fc6bc9700 10 identity=RGWThirdPartyAccountAuthApplier() -> RGWLocalAuthApplier(acct_user=u-gfn2636, acct_name=u-gfn2636, subuser=, perm_mask=15, is_admin=) requested perm (type)=8, policy perm=8, user_perm_mask=8, acl perm=8
2017-03-16 13:01:55.569065 7f3fc6bc9700 2 req 5:0.000552:s3:GET /:get_lifecycle:verifying op params
2017-03-16 13:01:55.569072 7f3fc6bc9700 2 req 5:0.000561:s3:GET /:get_lifecycle:pre-executing
2017-03-16 13:01:55.569076 7f3fc6bc9700 2 req 5:0.000565:s3:GET /:get_lifecycle:executing
2017-03-16 13:01:55.569082 7f3fc6bc9700 2 req 5:0.000571:s3:GET /:get_lifecycle:completing
2017-03-16 13:01:55.569187 7f3fc6bc9700 2 req 5:0.000675:s3:GET /:get_lifecycle:op status=-2
2017-03-16 13:01:55.569194 7f3fc6bc9700 2 req 5:0.000682:s3:GET /:get_lifecycle:http status=404
2017-03-16 13:01:55.569200 7f3fc6bc9700 1 ====== req done req=0x7f400148da80 op status=-2 http_status=404 ======
2017-03-16 13:01:55.569220 7f3fc6bc9700 20 process_request() returned -2041
2017-03-16 13:01:55.610198 7f3fcd3d6700 20 enqueued request req=0x7f400148f9c0
2017-03-16 13:01:55.610212 7f3fcd3d6700 20 RGWWQ:
2017-03-16 13:01:55.610214 7f3fcd3d6700 20 req: 0x7f400148f9c0
2017-03-16 13:01:55.610232 7f3fcd3d6700 10 allocated request req=0x7f400148fac0
2017-03-16 13:01:55.610263 7f3fc2bc1700 20 dequeued request req=0x7f400148f9c0
2017-03-16 13:01:55.610272 7f3fc2bc1700 20 RGWWQ: empty
2017-03-16 13:01:55.610335 7f3fc2bc1700 20 CONTENT_LENGTH=0
2017-03-16 13:01:55.610358 7f3fc2bc1700 20 CONTENT_TYPE=
2017-03-16 13:01:55.610360 7f3fc2bc1700 20 DOCUMENT_ROOT=/etc/nginx/nginx/html
2017-03-16 13:01:55.610361 7f3fc2bc1700 20 DOCUMENT_URI=/
2017-03-16 13:01:55.610362 7f3fc2bc1700 20 FCGI_ROLE=RESPONDER
2017-03-16 13:01:55.610363 7f3fc2bc1700 20 GATEWAY_INTERFACE=CGI/1.1
2017-03-16 13:01:55.610364 7f3fc2bc1700 20 HTTP_ACCEPT_ENCODING=identity
2017-03-16 13:01:55.610364 7f3fc2bc1700 20 HTTP_AUTHORIZATION=AWS TS7ESWTPA52438D3JVA9:/uDeDN+JqvvObdIrKu8VaieeTRk=
2017-03-16 13:01:55.610367 7f3fc2bc1700 20 HTTP_CONTENT_LENGTH=0
2017-03-16 13:01:55.610368 7f3fc2bc1700 20 HTTP_DATE=Thu, 16 Mar 2017 05:01:55 GMT
2017-03-16 13:01:55.610369 7f3fc2bc1700 20 HTTP_HOST=test1.ceph.vip
2017-03-16 13:01:55.610369 7f3fc2bc1700 20 HTTP_USER_AGENT=Boto/2.38.0 Python/2.7.10 Darwin/15.5.0
2017-03-16 13:01:55.610370 7f3fc2bc1700 20 QUERY_STRING=acl
2017-03-16 13:01:55.610372 7f3fc2bc1700 20 REDIRECT_STATUS=200
2017-03-16 13:01:55.610372 7f3fc2bc1700 20 REMOTE_ADDR=10.120.170.102
2017-03-16 13:01:55.610373 7f3fc2bc1700 20 REMOTE_PORT=52323
2017-03-16 13:01:55.610374 7f3fc2bc1700 20 REQUEST_METHOD=GET
2017-03-16 13:01:55.610375 7f3fc2bc1700 20 REQUEST_SCHEME=http
2017-03-16 13:01:55.610376 7f3fc2bc1700 20 REQUEST_URI=/?acl
2017-03-16 13:01:55.610377 7f3fc2bc1700 20 SCRIPT_NAME=/
2017-03-16 13:01:55.610378 7f3fc2bc1700 20 SERVER_ADDR=10.63.48.9
2017-03-16 13:01:55.610379 7f3fc2bc1700 20 SERVER_NAME=ceph.vip
2017-03-16 13:01:55.610380 7f3fc2bc1700 20 SERVER_PORT=80
2017-03-16 13:01:55.610381 7f3fc2bc1700 20 SERVER_PROTOCOL=HTTP/1.1
2017-03-16 13:01:55.610381 7f3fc2bc1700 20 SERVER_SOFTWARE=nginx/1.9.15
2017-03-16 13:01:55.610383 7f3fc2bc1700 1 ====== starting new request req=0x7f400148f9c0 =====
2017-03-16 13:01:55.610413 7f3fc2bc1700 2 req 6:0.000029::GET /::initializing for trans_id = tx000000000000000000006-0058ca1c43-1071-default
2017-03-16 13:01:55.610422 7f3fc2bc1700 10 rgw api priority: s3=5 s3website=4
2017-03-16 13:01:55.610424 7f3fc2bc1700 10 host=test1.ceph.vip
2017-03-16 13:01:55.610428 7f3fc2bc1700 20 subdomain=test1 domain=ceph.vip in_hosted_domain=1 in_hosted_domain_s3website=0
2017-03-16 13:01:55.610432 7f3fc2bc1700 20 final domain/bucket subdomain=test1 domain=ceph.vip in_hosted_domain=1 in_hosted_domain_s3website=0 s
>info.domain=ceph.vip s->info.request_uri=/test1/
2017-03-16 13:01:55.610466 7f3fc2bc1700 20 get_handler handler=25RGWHandler_REST_Bucket_S3
2017-03-16 13:01:55.610470 7f3fc2bc1700 10 handler=25RGWHandler_REST_Bucket_S3
2017-03-16 13:01:55.610473 7f3fc2bc1700 2 req 6:0.000089:s3:GET /::getting op 0
2017-03-16 13:01:55.610478 7f3fc2bc1700 10 op=22RGWGetACLs_ObjStore_S3
2017-03-16 13:01:55.610480 7f3fc2bc1700 2 req 6:0.000096:s3:GET /:get_acls:authorizing
2017-03-16 13:01:55.610875 7f3fc2bc1700 10 get_canon_resource(): dest=/test1/?acl
2017-03-16 13:01:55.610883 7f3fc2bc1700 10 auth_hdr:
GET

Thu, 16 Mar 2017 05:01:55 GMT
/test1/?acl
2017-03-16 13:01:55.610965 7f3fc2bc1700 15 calculated digest=/uDeDN+JqvvObdIrKu8VaieeTRk=
2017-03-16 13:01:55.610991 7f3fc2bc1700 15 auth_sign=/uDeDN+JqvvObdIrKu8VaieeTRk=
2017-03-16 13:01:55.611006 7f3fc2bc1700 15 compare=0
2017-03-16 13:01:55.611018 7f3fc2bc1700 2 req 6:0.000634:s3:GET /:get_acls:normalizing buckets and tenants
2017-03-16 13:01:55.611022 7f3fc2bc1700 10 s->object=<NULL> s->bucket=test1
2017-03-16 13:01:55.611026 7f3fc2bc1700 2 req 6:0.000642:s3:GET /:get_acls:init permissions
2017-03-16 13:01:55.611048 7f3fc2bc1700 15 decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/&quot;&gt;&lt;Owner&gt;&lt;ID&gt;u-gfn2636&lt;/ID&gt;&lt;DisplayName&gt;u-gfn2636&lt;/DisplayName&gt;&lt;/Owner&gt;&lt;AccessControlList&gt;&lt;Grant&gt;&lt;Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance&quot; xsi:type="CanonicalUser"><ID>u-gfn2636</ID><DisplayName>u-gfn2636</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
2017-03-16 13:01:55.611058 7f3fc2bc1700 2 req 6:0.000674:s3:GET /:get_acls:recalculating target
2017-03-16 13:01:55.611061 7f3fc2bc1700 2 req 6:0.000678:s3:GET /:get_acls:reading permissions
2017-03-16 13:01:55.611064 7f3fc2bc1700 2 req 6:0.000680:s3:GET /:get_acls:init op
2017-03-16 13:01:55.611066 7f3fc2bc1700 2 req 6:0.000682:s3:GET /:get_acls:verifying op mask
2017-03-16 13:01:55.611067 7f3fc2bc1700 20 required_mask= 1 user.op_mask=7
2017-03-16 13:01:55.611069 7f3fc2bc1700 2 req 6:0.000686:s3:GET /:get_acls:verifying op permissions
2017-03-16 13:01:55.611073 7f3fc2bc1700 5 Searching permissions for identity=RGWThirdPartyAccountAuthApplier() -> RGWLocalAuthApplier(acct_user=u-gfn2636, acct_name=u-gfn2636, subuser=, perm_mask=15, is_admin=) mask=52
2017-03-16 13:01:55.611078 7f3fc2bc1700 5 Searching permissions for uid=u-gfn2636
2017-03-16 13:01:55.611079 7f3fc2bc1700 5 Found permission: 15
2017-03-16 13:01:55.611081 7f3fc2bc1700 5 Searching permissions for group=1 mask=52
2017-03-16 13:01:55.611083 7f3fc2bc1700 5 Permissions for group not found
2017-03-16 13:01:55.611103 7f3fc2bc1700 5 Searching permissions for group=2 mask=52
2017-03-16 13:01:55.611106 7f3fc2bc1700 5 Permissions for group not found
2017-03-16 13:01:55.611107 7f3fc2bc1700 5 Getting permissions identity=RGWThirdPartyAccountAuthApplier() -> RGWLocalAuthApplier(acct_user=u-gfn2636, acct_name=u-gfn2636, subuser=, perm_mask=15, is_admin=) owner=u-gfn2636 perm=4
2017-03-16 13:01:55.611111 7f3fc2bc1700 10 identity=RGWThirdPartyAccountAuthApplier() -> RGWLocalAuthApplier(acct_user=u-gfn2636, acct_name=u-gfn2636, subuser=, perm_mask=15, is_admin=) requested perm (type)=4, policy perm=4, user_perm_mask=4, acl perm=4
2017-03-16 13:01:55.611115 7f3fc2bc1700 2 req 6:0.000731:s3:GET /:get_acls:verifying op params
2017-03-16 13:01:55.611117 7f3fc2bc1700 2 req 6:0.000734:s3:GET /:get_acls:pre-executing
2017-03-16 13:01:55.611120 7f3fc2bc1700 2 req 6:0.000736:s3:GET /:get_acls:executing
2017-03-16 13:01:55.611137 7f3fc2bc1700 2 req 6:0.000753:s3:GET /:get_acls:completing
2017-03-16 13:01:55.611225 7f3fc2bc1700 2 req 6:0.000841:s3:GET /:get_acls:op status=0
2017-03-16 13:01:55.611231 7f3fc2bc1700 2 req 6:0.000848:s3:GET /:get_acls:http status=200
2017-03-16 13:01:55.611234 7f3fc2bc1700 1 ====== req done req=0x7f400148f9c0 op status=0 http_status=200 ======

```

Actions #3

Updated by Nathan Cutler about 7 years ago

  • Status changed from New to Fix Under Review
Actions #4

Updated by Yehuda Sadeh about 7 years ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport set to kraken
Actions #5

Updated by Nathan Cutler about 7 years ago

  • Copied to Backport #19534: kraken: rgw: Error parsing xml when get bucket lifecycle added
Actions #6

Updated by Nathan Cutler almost 7 years ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF