Project

General

Profile

Bug #20037 ยป bad.rgw.log

Jens Harbott, 05/22/2017 02:35 PM

 
2017-05-22 14:29:15.097957 7f7727288700 20 CONTENT_LENGTH=21
2017-05-22 14:29:15.097974 7f7727288700 20 CONTENT_TYPE=text/plain
2017-05-22 14:29:15.097975 7f7727288700 20 HTTP_ACCEPT_ENCODING=identity
2017-05-22 14:29:15.097977 7f7727288700 20 HTTP_AUTHORIZATION=AWS4-HMAC-SHA256 Credential=0555b35654ad1656d804/20170522/de/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class,Signature=e3ab9589f7aeac9d9fd86812d8e92b19fdcc1eb6d4da448f4c4eb39dc40bd1d1
2017-05-22 14:29:15.097984 7f7727288700 20 HTTP_HOST=test.localhost:8000
2017-05-22 14:29:15.097985 7f7727288700 20 HTTP_X_AMZ_CONTENT_SHA256=c6028deecf6fe1f8e4dfdfbfc154912fbd67b67491dd704849a17a759dba2659
2017-05-22 14:29:15.097987 7f7727288700 20 HTTP_X_AMZ_DATE=20170522T142915Z
2017-05-22 14:29:15.097988 7f7727288700 20 HTTP_X_AMZ_META_S3CMD_ATTRS=uid:1000/gname:ubuntu/uname:ubuntu/gid:1000/mode:33204/mtime:1495453548/atime:1495453557/md5:865817e20f61ef9517802ba191ebaf6d/ctime:1495453548
2017-05-22 14:29:15.097990 7f7727288700 20 HTTP_X_AMZ_STORAGE_CLASS=STANDARD
2017-05-22 14:29:15.097992 7f7727288700 20 REQUEST_METHOD=PUT
2017-05-22 14:29:15.097992 7f7727288700 20 REQUEST_URI=/test2
2017-05-22 14:29:15.097993 7f7727288700 20 SCRIPT_URI=/test2
2017-05-22 14:29:15.097993 7f7727288700 20 SERVER_PORT=8000
2017-05-22 14:29:15.097995 7f7727288700 1 ====== starting new request req=0x7f7727282970 =====
2017-05-22 14:29:15.098028 7f7727288700 2 req 8:0.000032::PUT /test2::initializing for trans_id = tx000000000000000000008-005922f5bb-1013-default
2017-05-22 14:29:15.098037 7f7727288700 10 rgw api priority: s3=5 s3website=4
2017-05-22 14:29:15.098038 7f7727288700 10 host=test.localhost
2017-05-22 14:29:15.098042 7f7727288700 20 subdomain=test domain=localhost in_hosted_domain=1 in_hosted_domain_s3website=0
2017-05-22 14:29:15.098044 7f7727288700 20 final domain/bucket subdomain=test domain=localhost in_hosted_domain=1 in_hosted_domain_s3website=0 s->info.domain=localhost s->info.request_uri=/test/test2
2017-05-22 14:29:15.098054 7f7727288700 10 meta>> HTTP_X_AMZ_CONTENT_SHA256
2017-05-22 14:29:15.098108 7f7727288700 10 meta>> HTTP_X_AMZ_DATE
2017-05-22 14:29:15.098114 7f7727288700 10 meta>> HTTP_X_AMZ_META_S3CMD_ATTRS
2017-05-22 14:29:15.098116 7f7727288700 10 meta>> HTTP_X_AMZ_STORAGE_CLASS
2017-05-22 14:29:15.098119 7f7727288700 10 x>> x-amz-content-sha256:c6028deecf6fe1f8e4dfdfbfc154912fbd67b67491dd704849a17a759dba2659
2017-05-22 14:29:15.098121 7f7727288700 10 x>> x-amz-date:20170522T142915Z
2017-05-22 14:29:15.098122 7f7727288700 10 x>> x-amz-meta-s3cmd-attrs:uid:1000/gname:ubuntu/uname:ubuntu/gid:1000/mode:33204/mtime:1495453548/atime:1495453557/md5:865817e20f61ef9517802ba191ebaf6d/ctime:1495453548
2017-05-22 14:29:15.098124 7f7727288700 10 x>> x-amz-storage-class:STANDARD
2017-05-22 14:29:15.098143 7f7727288700 20 get_handler handler=22RGWHandler_REST_Obj_S3
2017-05-22 14:29:15.098147 7f7727288700 10 handler=22RGWHandler_REST_Obj_S3
2017-05-22 14:29:15.098149 7f7727288700 2 req 8:0.000154:s3:PUT /test2::getting op 1
2017-05-22 14:29:15.098155 7f7727288700 10 op=21RGWPutObj_ObjStore_S3
2017-05-22 14:29:15.098161 7f7727288700 2 req 8:0.000166:s3:PUT /test2:put_obj:verifying requester
2017-05-22 14:29:15.098176 7f7727288700 10 v4 signature format = e3ab9589f7aeac9d9fd86812d8e92b19fdcc1eb6d4da448f4c4eb39dc40bd1d1
2017-05-22 14:29:15.098185 7f7727288700 10 v4 credential format = 0555b35654ad1656d804/20170522/de/s3/aws4_request
2017-05-22 14:29:15.098186 7f7727288700 10 access key id = 0555b35654ad1656d804
2017-05-22 14:29:15.098188 7f7727288700 10 credential scope = 20170522/de/s3/aws4_request
2017-05-22 14:29:15.098219 7f7727288700 10 canonical headers format = content-length:21
content-type:text/plain
host:test.localhost:8000
x-amz-content-sha256:c6028deecf6fe1f8e4dfdfbfc154912fbd67b67491dd704849a17a759dba2659
x-amz-date:20170522T142915Z
x-amz-meta-s3cmd-attrs:uid:1000/gname:ubuntu/uname:ubuntu/gid:1000/mode:33204/mtime:1495453548/atime:1495453557/md5:865817e20f61ef9517802ba191ebaf6d/ctime:1495453548
x-amz-storage-class:STANDARD

2017-05-22 14:29:15.098226 7f7727288700 10 delaying v4 auth
2017-05-22 14:29:15.098231 7f7727288700 2 req 8:0.000236:s3:PUT /test2:put_obj:normalizing buckets and tenants
2017-05-22 14:29:15.098233 7f7727288700 10 s->object=test2 s->bucket=test
2017-05-22 14:29:15.098236 7f7727288700 2 req 8:0.000241:s3:PUT /test2:put_obj:init permissions
2017-05-22 14:29:15.098261 7f7727288700 15 decode_policy Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>testid</ID><DisplayName>M. Tester</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>testid</ID><DisplayName>M. Tester</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
2017-05-22 14:29:15.098291 7f7727288700 2 req 8:0.000296:s3:PUT /test2:put_obj:recalculating target
2017-05-22 14:29:15.098297 7f7727288700 2 req 8:0.000302:s3:PUT /test2:put_obj:reading permissions
2017-05-22 14:29:15.098300 7f7727288700 2 req 8:0.000305:s3:PUT /test2:put_obj:init op
2017-05-22 14:29:15.098303 7f7727288700 2 req 8:0.000308:s3:PUT /test2:put_obj:verifying op mask
2017-05-22 14:29:15.098304 7f7727288700 20 required_mask= 2 user.op_mask=7
2017-05-22 14:29:15.098305 7f7727288700 2 req 8:0.000310:s3:PUT /test2:put_obj:verifying op permissions
2017-05-22 14:29:15.098308 7f7727288700 20 -- Getting permissions begin with perm_mask=50
2017-05-22 14:29:15.098309 7f7727288700 5 Searching permissions for identity=RGWDummyIdentityApplier(auth_id=testid, perm_mask=15, is_admin=0) mask=50
2017-05-22 14:29:15.098311 7f7727288700 5 Searching permissions for uid=testid
2017-05-22 14:29:15.098312 7f7727288700 5 Found permission: 15
2017-05-22 14:29:15.098313 7f7727288700 5 Searching permissions for group=1 mask=50
2017-05-22 14:29:15.098314 7f7727288700 5 Permissions for group not found
2017-05-22 14:29:15.098315 7f7727288700 5 Searching permissions for group=2 mask=50
2017-05-22 14:29:15.098315 7f7727288700 5 Permissions for group not found
2017-05-22 14:29:15.098316 7f7727288700 5 -- Getting permissions done for identity=RGWDummyIdentityApplier(auth_id=testid, perm_mask=15, is_admin=0), owner=testid, perm=2
2017-05-22 14:29:15.098317 7f7727288700 10 identity=RGWDummyIdentityApplier(auth_id=testid, perm_mask=15, is_admin=0) requested perm (type)=2, policy perm=2, user_perm_mask=2, acl perm=2
2017-05-22 14:29:15.098319 7f7727288700 2 req 8:0.000324:s3:PUT /test2:put_obj:verifying op params
2017-05-22 14:29:15.098321 7f7727288700 2 req 8:0.000325:s3:PUT /test2:put_obj:pre-executing
2017-05-22 14:29:15.098322 7f7727288700 2 req 8:0.000327:s3:PUT /test2:put_obj:executing
2017-05-22 14:29:15.098449 7f7727288700 10 payload request hash = c6028deecf6fe1f8e4dfdfbfc154912fbd67b67491dd704849a17a759dba2659
2017-05-22 14:29:15.098474 7f7727288700 10 canonical request = PUT
/test2

content-length:21
content-type:text/plain
host:test.localhost:8000
x-amz-content-sha256:c6028deecf6fe1f8e4dfdfbfc154912fbd67b67491dd704849a17a759dba2659
x-amz-date:20170522T142915Z
x-amz-meta-s3cmd-attrs:uid:1000/gname:ubuntu/uname:ubuntu/gid:1000/mode:33204/mtime:1495453548/atime:1495453557/md5:865817e20f61ef9517802ba191ebaf6d/ctime:1495453548
x-amz-storage-class:STANDARD

content-length;content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-s3cmd-attrs;x-amz-storage-class
c6028deecf6fe1f8e4dfdfbfc154912fbd67b67491dd704849a17a759dba2659
2017-05-22 14:29:15.098479 7f7727288700 10 canonical request hash = 76528ffd43b2bf169d2586534e6522f256ac97a547595e13ef954097b00b72c7
2017-05-22 14:29:15.098482 7f7727288700 10 string to sign = AWS4-HMAC-SHA256
20170522T142915Z
20170522/de/s3/aws4_request
76528ffd43b2bf169d2586534e6522f256ac97a547595e13ef954097b00b72c7
2017-05-22 14:29:15.098537 7f7727288700 10 date_k = f4dba8a991cd212012ead155d339e97be30af523ba9882a96d3089f934574768
2017-05-22 14:29:15.098559 7f7727288700 10 region_k = 65e7cf50c8ca4f89551691ed1e460763b4b4c5820ab256b25641293a156755ab
2017-05-22 14:29:15.098576 7f7727288700 10 service_k = bb51af694213915d1471b0366912f6362e62dd85fd7b377a4037dc3ff98c3959
2017-05-22 14:29:15.098593 7f7727288700 10 signing_k = b5cfaf088d12b93e4a9189cc6a190da2aa03ba2484145ae9474c23cd380da1fe
2017-05-22 14:29:15.098611 7f7727288700 10 signature_k = e3ab9589f7aeac9d9fd86812d8e92b19fdcc1eb6d4da448f4c4eb39dc40bd1d1
2017-05-22 14:29:15.098616 7f7727288700 10 new signature = e3ab9589f7aeac9d9fd86812d8e92b19fdcc1eb6d4da448f4c4eb39dc40bd1d1
2017-05-22 14:29:15.098617 7f7727288700 10 ----------------------------- Verifying signatures
2017-05-22 14:29:15.098618 7f7727288700 10 Signature = e3ab9589f7aeac9d9fd86812d8e92b19fdcc1eb6d4da448f4c4eb39dc40bd1d1
2017-05-22 14:29:15.098618 7f7727288700 10 New Signature = e3ab9589f7aeac9d9fd86812d8e92b19fdcc1eb6d4da448f4c4eb39dc40bd1d1
2017-05-22 14:29:15.098619 7f7727288700 10 -----------------------------
2017-05-22 14:29:15.098620 7f7727288700 10 v4 auth ok
2017-05-22 14:29:15.098654 7f7727288700 10 x>> x-amz-content-sha256:c6028deecf6fe1f8e4dfdfbfc154912fbd67b67491dd704849a17a759dba2659
2017-05-22 14:29:15.098662 7f7727288700 10 x>> x-amz-date:20170522T142915Z
2017-05-22 14:29:15.098704 7f7727288700 10 x>> x-amz-meta-s3cmd-attrs:uid:1000/gname:ubuntu/uname:ubuntu/gid:1000/mode:33204/mtime:1495453548/atime:1495453557/md5:865817e20f61ef9517802ba191ebaf6d/ctime:1495453548
2017-05-22 14:29:15.098714 7f7727288700 10 x>> x-amz-storage-class:STANDARD
2017-05-22 14:29:15.098746 7f7727288700 20 get_obj_state: rctx=0x7f77272816c0 obj=test:test2 state=0x55a14f962208 s->prefetch_data=0
2017-05-22 14:29:15.098762 7f7727288700 20 get_obj_state: rctx=0x7f77272816c0 obj=test:test2 state=0x55a14f962208 s->prefetch_data=0
2017-05-22 14:29:15.098773 7f7727288700 10 setting object write_tag=5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.8
2017-05-22 14:29:15.098824 7f7727288700 20 reading from default.rgw.meta:root:.bucket.meta.test:5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1
2017-05-22 14:29:15.098837 7f7727288700 20 get_system_obj_state: rctx=0x7f772727ee60 obj=default.rgw.meta:root:.bucket.meta.test:5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1 state=0x55a14f2ee720 s->prefetch_data=0
2017-05-22 14:29:15.098849 7f7727288700 10 cache get: name=default.rgw.meta+root+.bucket.meta.test:5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1 : hit (requested=0x16, cached=0x17)
2017-05-22 14:29:15.098857 7f7727288700 20 get_system_obj_state: s->obj_tag was set empty
2017-05-22 14:29:15.098859 7f7727288700 10 cache get: name=default.rgw.meta+root+.bucket.meta.test:5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1 : hit (requested=0x11, cached=0x17)
2017-05-22 14:29:15.098876 7f7727288700 20 bucket index object: .dir.5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1
2017-05-22 14:29:15.098940 7f7727288700 1 -- 192.168.0.16:0/2247697013 --> 192.168.0.16:6804/20424 -- osd_op(unknown.0.0:841 5.1 5:85126577:::.dir.5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1:head [call rgw.bucket_prepare_op] snapc 0=[] ondisk+write+known_if_redirected e21) v8 -- 0x55a14f92b380 con 0
2017-05-22 14:29:15.103686 7f7744edc700 1 -- 192.168.0.16:0/2247697013 <== osd.1 192.168.0.16:6804/20424 530 ==== osd_op_reply(841 .dir.5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1 [call] v21'4 uv4 ondisk = 0) v8 ==== 192+0+0 (2197582987 0 0) 0x55a14f92b380 con 0x55a14f3db000
2017-05-22 14:29:15.103793 7f7727288700 1 -- 192.168.0.16:0/2247697013 --> 192.168.0.16:6804/20424 -- osd_op(unknown.0.0:842 6.2 6:5a292a74:::5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1_test2:head [create,setxattr user.rgw.idtag (44),writefull 0~21,setxattr user.rgw.manifest (302),setxattr user.rgw.acl (147),setxattr user.rgw.content_type (11),setxattr user.rgw.etag (33),setxattr user.rgw.x-amz-content-sha256 (65),setxattr user.rgw.x-amz-date (17),setxattr user.rgw.x-amz-meta-s3cmd-attrs (143),setxattr user.rgw.x-amz-storage-class (9),call rgw.obj_store_pg_ver,setxattr user.rgw.source_zone (4)] snapc 0=[] ondisk+write+known_if_redirected e21) v8 -- 0x55a14f92b6c0 con 0
2017-05-22 14:29:15.106727 7f7744edc700 1 -- 192.168.0.16:0/2247697013 <== osd.1 192.168.0.16:6804/20424 531 ==== osd_op_reply(842 5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1_test2 [create,setxattr (44),writefull 0~21,setxattr (302),setxattr (147),setxattr (11),setxattr (33),setxattr (65),setxattr (17),setxattr (143),setxattr (9),call,setxattr (4)] v21'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 697+0+0 (1334723329 0 0) 0x55a14f92b380 con 0x55a14f3db000
2017-05-22 14:29:15.106794 7f7727288700 20 get_obj_state: rctx=0x7f77272816c0 obj=test:test2 state=0x55a14f962208 s->prefetch_data=0
2017-05-22 14:29:15.106842 7f7727288700 1 -- 192.168.0.16:0/2247697013 --> 192.168.0.16:6804/20424 -- osd_op(unknown.0.0:843 6.2 6:5a292a74:::5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1_test2:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e21) v8 -- 0x55a14f92ba00 con 0
2017-05-22 14:29:15.107442 7f7744edc700 1 -- 192.168.0.16:0/2247697013 <== osd.1 192.168.0.16:6804/20424 532 ==== osd_op_reply(843 5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1_test2 [getxattrs,stat] v0'0 uv1 ondisk = 0) v8 ==== 235+0+1110 (3755987111 0 4212912290) 0x55a14f92ba00 con 0x55a14f3db000
2017-05-22 14:29:15.107580 7f7727288700 10 manifest: total_size = 21
2017-05-22 14:29:15.107592 7f7727288700 20 get_obj_state: setting s->obj_tag to 5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.7
2017-05-22 14:29:15.107608 7f7727288700 20 get_obj_state: rctx=0x7f77272816c0 obj=test:test2 state=0x55a14f962208 s->prefetch_data=0
2017-05-22 14:29:15.107641 7f7727288700 10 setting object write_tag=5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.8
2017-05-22 14:29:15.107719 7f7727288700 1 -- 192.168.0.16:0/2247697013 --> 192.168.0.16:6804/20424 -- osd_op(unknown.0.0:844 6.2 6:5a292a74:::5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1_test2:head [cmpxattr user.rgw.idtag (44) op 1 mode 1,create,call rgw.obj_remove,setxattr user.rgw.idtag (44),writefull 0~21,setxattr user.rgw.manifest (302),setxattr user.rgw.acl (147),setxattr user.rgw.content_type (11),setxattr user.rgw.etag (33),setxattr user.rgw.x-amz-content-sha256 (65),setxattr user.rgw.x-amz-date (17),setxattr user.rgw.x-amz-meta-s3cmd-attrs (143),setxattr user.rgw.x-amz-storage-class (9),call rgw.obj_store_pg_ver,setxattr user.rgw.source_zone (4)] snapc 0=[] ondisk+write+known_if_redirected e21) v8 -- 0x55a14f92c080 con 0
2017-05-22 14:29:15.112179 7f7744edc700 1 -- 192.168.0.16:0/2247697013 <== osd.1 192.168.0.16:6804/20424 533 ==== osd_op_reply(844 5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1_test2 [cmpxattr (44) op 1 mode 1,create,call,setxattr (44),writefull 0~21,setxattr (302),setxattr (147),setxattr (11),setxattr (33),setxattr (65),setxattr (17),setxattr (143),setxattr (9),call,setxattr (4)] v21'3 uv3 ondisk = 0) v8 ==== 781+0+0 (2854309850 0 0) 0x55a14f92c080 con 0x55a14f3db000
2017-05-22 14:29:15.112538 7f7727288700 1 -- 192.168.0.16:0/2247697013 --> 192.168.0.16:6804/20424 -- osd_op(unknown.0.0:845 5.1 5:85126577:::.dir.5d698ce5-1e38-4ca2-8c34-b508515893bb.4115.1:head [call rgw.bucket_complete_op] snapc 0=[] ondisk+write+known_if_redirected e21) v8 -- 0x55a14f92c700 con 0
2017-05-22 14:29:15.112596 7f7727288700 2 req 8:0.014601:s3:PUT /test2:put_obj:completing
2017-05-22 14:29:15.112650 7f7727288700 2 req 8:0.014655:s3:PUT /test2:put_obj:op status=0
2017-05-22 14:29:15.112657 7f7727288700 2 req 8:0.014662:s3:PUT /test2:put_obj:http status=200
2017-05-22 14:29:15.112666 7f7727288700 1 ====== req done req=0x7f7727282970 op status=0 op_name=put_obj http_status=200 domain=localhost request_uri=/test/test2 duration=0.014672 ======
2017-05-22 14:29:15.112712 7f7727288700 1 civetweb: 0x55a14f4c9000: 127.0.0.1 - - [22/May/2017:14:29:15 +0000] "PUT /test2 HTTP/1.1" 1 206 - -
    (1-1/1)