Actions
Bug #7821
closed'S3ResponseError: 301 Moved Permanently' in rgw-firefly-distro-basic-plana suite
Status:
Duplicate
Priority:
High
Assignee:
-
Target version:
-
% Done:
0%
Source:
other
Tags:
Backport:
Regression:
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-03-21_14:31:01-rgw-firefly-distro-basic-plana/140962/
2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: application/json; charset=UTF-8 2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: Fri, 21 Mar 2014 21:41:56 GMT 2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: /admin/log 2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:boto:Signature: 2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: AWS 1te6NH5mcdcq0Tc5i8i3:4hUjiGX4diyJNdz667pBiknB0EA= 2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:boto:url = 'http://plana59.front.sepia.ceph.com:7281/admin/log?unlock' 2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: params={'locker-id': 'plana57:5152', 'type': 'data', 'id': 127, 'zone-id': u'r1z1'} 2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: headers={'Date': 'Fri, 21 Mar 2014 21:41:56 GMT', 'Content-Length': '0', 'Content-Type': 'application/json; charset=UTF-8', 'Authorization': 'AWS 1te6NH5mcdcq0Tc5i8i3:4hUjiGX4diyJNdz667pBiknB0EA=', 'User-Agent': 'Boto/2.27.0 Python/2.7.3 Linux/3.8.0-34-generic'} 2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: data=None 2014-03-21T14:41:56.103 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): plana59.front.sepia.ceph.com 2014-03-21T14:41:56.149 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:requests.packages.urllib3.connectionpool:"POST /admin/log?unlock&locker-id=plana57%3A5152&type=data&id=127&zone-id=r1z1 HTTP/1.1" 200 None 2014-03-21T14:41:56.149 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:radosgw_agent.worker:finished processing shard 127 2014-03-21T14:41:56.150 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:radosgw_agent.sync:synced item (127, []) successfully 2014-03-21T14:41:56.150 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:radosgw_agent.worker:process 5813 is done. Exiting 2014-03-21T14:41:56.150 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:radosgw_agent.sync:128/128 items processed 2014-03-21T14:41:56.152 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: teuthology.front.sepia.ceph.com - - [21/Mar/2014 14:41:56] "POST /data/incremental HTTP/1.1" 200 0 2014-03-21T14:41:56.153 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: teuthology.front.sepia.ceph.com - - [21/Mar/2014 14:41:56] "POST /data/incremental HTTP/1.1" 200 - 2014-03-21T14:41:56.157 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/teuthology-firefly/teuthology/run_tasks.py", line 31, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/teuthology-firefly/teuthology/run_tasks.py", line 19, in run_one_task return fn(**kwargs) File "/home/teuthworker/teuthology-firefly/teuthology/task/radosgw-admin.py", line 445, in task dest_k = dest_connection.get_bucket(bucket_name + 'data').get_key('tiny_file') File "/usr/lib/python2.7/dist-packages/boto/s3/connection.py", line 370, in get_bucket bucket.get_all_keys(headers, maxkeys=0) File "/usr/lib/python2.7/dist-packages/boto/s3/bucket.py", line 358, in get_all_keys '', headers, **params) File "/usr/lib/python2.7/dist-packages/boto/s3/bucket.py", line 325, in _get_all response.status, response.reason, body) S3ResponseError: S3ResponseError: 301 Moved Permanently 2014-03-21T14:41:56.235 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/inktank/teuthology/search?q=171b63a807d24c37933376aa15d89f67 S3ResponseError: S3ResponseError: 301 Moved Permanently 2014-03-21T14:41:56.235 DEBUG:teuthology.run_tasks:Unwinding manager radosgw-agent 2014-03-21T14:41:56.235 INFO:teuthology.task.radosgw-agent:shutting down sync agent on client.0 2014-03-21T14:41:56.242 DEBUG:teuthology.orchestra.run:Running [10.214.132.21]: 'rm -rf /home/ubuntu/cephtest/radosgw-agent.client.0' 2014-03-21T14:41:56.355 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2014-03-21T14:41:56.355 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/teuthology-firefly/teuthology/contextutil.py", line 29, in nested yield vars File "/home/teuthworker/teuthology-firefly/teuthology/task/rgw.py", line 694, in task yield S3ResponseError: S3ResponseError: 301 Moved Permanently
archive_path: /var/lib/teuthworker/archive/teuthology-2014-03-21_14:31:01-rgw-firefly-distro-basic-plana/140962 description: rgw/singleton/{all/radosgw-admin-multi-region.yaml} email: null job_id: '140962' kernel: &id001 kdb: true sha1: distro last_in_suite: false machine_type: plana name: teuthology-2014-03-21_14:31:01-rgw-firefly-distro-basic-plana nuke-on-error: true os_type: ubuntu overrides: admin_socket: branch: firefly ceph: conf: mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 20 log-whitelist: - slow request sha1: 28d8e7f567fb405945c40e2ae8c964d903438631 ceph-deploy: branch: dev: firefly conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: debug mon: 1 debug ms: 20 debug paxos: 20 osd default pool size: 2 install: ceph: sha1: 28d8e7f567fb405945c40e2ae8c964d903438631 s3tests: branch: master workunit: sha1: 28d8e7f567fb405945c40e2ae8c964d903438631 owner: scheduled_teuthology@teuthology roles: - - mon.a - mds.a - osd.0 - osd.1 - client.0 - - mon.b - mon.c - osd.2 - osd.3 - client.1 targets: ubuntu@plana57.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCjX0wuGXHymrU74OOVo6NtuKIyHCZAxcqQEGKS95e/lhQCXB+3VijZUaL/AcEup+h8FqY5bpK3dnFwdyGxQDUMuLxWdjBQ7IF7KaFsHT94sb38jxk9IzDS5wVZBI+u3RUtxoMhle80Vu5pPIYPwUvh2EAxJjk4HZ6Q8S8YLRRdK4z9L9/1+uXYTeKd08BwbnY7PfPj2HX3E3IrE/bmJUIq1RMB0SqX06rCkjzPQ5p1kT2jx0k8qYP/UeLMidPALnj4kOdpLqq4inLZgb1qyKKAWN7ZlgGwlYDqdP/eHm9mko9hsL7vwdQALr65BMQtkOcIAfQ/m/SzfPYLJtwBkEuP ubuntu@plana59.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaHG83zRXo6ydv6IGWDFTf6YNjWG9M5LRbbYIpPXKOqCg9zfI/4ZjymLpznESFIACVrqe06jqD7uvsQPOlbcm3W/H44su70C21KrzMs77IpskMT7tYgCzY75uxbwg949qYIRf1SEY2RW0Bf2zldbOeKAY/TcnGIkLtc4NCIDPfCxMG0rAJJgUAwbvbKVUqLKe/jcyu3RiiAxV3TGjTAzTz+XHwT46gDXB5Fxt49Sfx+AgpILHk7DvN/HILtU3gRT9ac0D2WlQi1sJLDgjeTAZxyfpRR5iZH4tWYBFIS7C4ugHYye95zUYTc/3Jt364Jl/giUherGjE5od7p65VjxRJ tasks: - internal.lock_machines: - 2 - plana - internal.save_config: null - internal.check_lock: null - internal.connect: null - internal.check_conflict: null - internal.check_ceph_data: null - internal.vm_setup: null - kernel: *id001 - internal.base: null - internal.archive: null - internal.coredump: null - internal.sudo: null - internal.syslog: null - internal.timer: null - chef: null - clock.check: null - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 client.0: rgw gc pool: .rgw.gc.0 rgw log data: true rgw log meta: true rgw region: region0 rgw region root pool: .rgw.region.0 rgw user keys pool: .users.0 rgw user uid pool: .users.uid.0 rgw zone: r0z1 rgw zone root pool: .rgw.zone.0 client.1: rgw gc pool: .rgw.gc.1 rgw log data: false rgw log meta: false rgw region: region1 rgw region root pool: .rgw.region.1 rgw user keys pool: .users.1 rgw user uid pool: .users.uid.1 rgw zone: r1z1 rgw zone root pool: .rgw.zone.1 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: system user: access key: 0te6NH5mcdcq0Tc5i8i2 name: client0-system-user secret key: Oy4IOauQoL18Gp2zM7lC1vLmoawgqcYPbYGcWfXv client.1: system user: access key: 1te6NH5mcdcq0Tc5i8i3 name: client1-system-user secret key: Py4IOauQoL18Gp2zM7lC1vLmoawgqcYPbYGcWfXw regions: region0: api name: api1 is master: true master zone: r0z1 zones: - r0z1 region1: api name: api1 is master: false master zone: r1z1 zones: - r1z1 - radosgw-agent: client.0: dest: client.1 metadata-only: true src: client.0 - radosgw-admin: null teuthology_branch: firefly verbose: true worker_log: /var/lib/teuthworker/archive/worker_logs/worker.plana.11470
description: rgw/singleton/{all/radosgw-admin-multi-region.yaml} duration: 889.1913371086121 failure_reason: 'S3ResponseError: 301 Moved Permanently ' flavor: basic owner: scheduled_teuthology@teuthology sentry_event: http://sentry.ceph.com/inktank/teuthology/search?q=171b63a807d24c37933376aa15d89f67 success: false
Actions