Project

General

Profile

Actions

Bug #7821

closed

'S3ResponseError: 301 Moved Permanently' in rgw-firefly-distro-basic-plana suite

Added by Yuri Weinstein about 10 years ago. Updated about 10 years ago.

Status:
Duplicate
Priority:
High
Assignee:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-03-21_14:31:01-rgw-firefly-distro-basic-plana/140962/

2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: application/json; charset=UTF-8
2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: Fri, 21 Mar 2014 21:41:56 GMT
2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: /admin/log
2014-03-21T14:41:56.101 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:boto:Signature:
2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: AWS 1te6NH5mcdcq0Tc5i8i3:4hUjiGX4diyJNdz667pBiknB0EA=
2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:boto:url = 'http://plana59.front.sepia.ceph.com:7281/admin/log?unlock'
2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: params={'locker-id': 'plana57:5152', 'type': 'data', 'id': 127, 'zone-id': u'r1z1'}
2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: headers={'Date': 'Fri, 21 Mar 2014 21:41:56 GMT', 'Content-Length': '0', 'Content-Type': 'application/json; charset=UTF-8', 'Authorization': 'AWS 1te6NH5mcdcq0Tc5i8i3:4hUjiGX4diyJNdz667pBiknB0EA=', 'User-Agent': 'Boto/2.27.0 Python/2.7.3 Linux/3.8.0-34-generic'}
2014-03-21T14:41:56.102 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: data=None
2014-03-21T14:41:56.103 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): plana59.front.sepia.ceph.com
2014-03-21T14:41:56.149 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:requests.packages.urllib3.connectionpool:"POST /admin/log?unlock&locker-id=plana57%3A5152&type=data&id=127&zone-id=r1z1 HTTP/1.1" 200 None
2014-03-21T14:41:56.149 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:radosgw_agent.worker:finished processing shard 127
2014-03-21T14:41:56.150 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: DEBUG:radosgw_agent.sync:synced item (127, []) successfully
2014-03-21T14:41:56.150 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:radosgw_agent.worker:process 5813 is done. Exiting
2014-03-21T14:41:56.150 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: INFO:radosgw_agent.sync:128/128 items processed
2014-03-21T14:41:56.152 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: teuthology.front.sepia.ceph.com - - [21/Mar/2014 14:41:56] "POST /data/incremental HTTP/1.1" 200 0
2014-03-21T14:41:56.153 INFO:teuthology.task.radosgw-agent.ubuntu@plana57.front.sepia.ceph.com.8000.syncdaemon.err:[10.214.132.21]: teuthology.front.sepia.ceph.com - - [21/Mar/2014 14:41:56] "POST /data/incremental HTTP/1.1" 200 -
2014-03-21T14:41:56.157 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/teuthology-firefly/teuthology/run_tasks.py", line 31, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/teuthology-firefly/teuthology/run_tasks.py", line 19, in run_one_task
    return fn(**kwargs)
  File "/home/teuthworker/teuthology-firefly/teuthology/task/radosgw-admin.py", line 445, in task
    dest_k = dest_connection.get_bucket(bucket_name + 'data').get_key('tiny_file')
  File "/usr/lib/python2.7/dist-packages/boto/s3/connection.py", line 370, in get_bucket
    bucket.get_all_keys(headers, maxkeys=0)
  File "/usr/lib/python2.7/dist-packages/boto/s3/bucket.py", line 358, in get_all_keys
    '', headers, **params)
  File "/usr/lib/python2.7/dist-packages/boto/s3/bucket.py", line 325, in _get_all
    response.status, response.reason, body)
S3ResponseError: S3ResponseError: 301 Moved Permanently

2014-03-21T14:41:56.235 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/inktank/teuthology/search?q=171b63a807d24c37933376aa15d89f67
S3ResponseError: S3ResponseError: 301 Moved Permanently

2014-03-21T14:41:56.235 DEBUG:teuthology.run_tasks:Unwinding manager radosgw-agent
2014-03-21T14:41:56.235 INFO:teuthology.task.radosgw-agent:shutting down sync agent on client.0
2014-03-21T14:41:56.242 DEBUG:teuthology.orchestra.run:Running [10.214.132.21]: 'rm -rf /home/ubuntu/cephtest/radosgw-agent.client.0'
2014-03-21T14:41:56.355 DEBUG:teuthology.run_tasks:Unwinding manager rgw
2014-03-21T14:41:56.355 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/teuthology-firefly/teuthology/contextutil.py", line 29, in nested
    yield vars
  File "/home/teuthworker/teuthology-firefly/teuthology/task/rgw.py", line 694, in task
    yield
S3ResponseError: S3ResponseError: 301 Moved Permanently
archive_path: /var/lib/teuthworker/archive/teuthology-2014-03-21_14:31:01-rgw-firefly-distro-basic-plana/140962
description: rgw/singleton/{all/radosgw-admin-multi-region.yaml}
email: null
job_id: '140962'
kernel: &id001
  kdb: true
  sha1: distro
last_in_suite: false
machine_type: plana
name: teuthology-2014-03-21_14:31:01-rgw-firefly-distro-basic-plana
nuke-on-error: true
os_type: ubuntu
overrides:
  admin_socket:
    branch: firefly
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    log-whitelist:
    - slow request
    sha1: 28d8e7f567fb405945c40e2ae8c964d903438631
  ceph-deploy:
    branch:
      dev: firefly
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 28d8e7f567fb405945c40e2ae8c964d903438631
  s3tests:
    branch: master
  workunit:
    sha1: 28d8e7f567fb405945c40e2ae8c964d903438631
owner: scheduled_teuthology@teuthology
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
  - client.0
- - mon.b
  - mon.c
  - osd.2
  - osd.3
  - client.1
targets:
  ubuntu@plana57.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCjX0wuGXHymrU74OOVo6NtuKIyHCZAxcqQEGKS95e/lhQCXB+3VijZUaL/AcEup+h8FqY5bpK3dnFwdyGxQDUMuLxWdjBQ7IF7KaFsHT94sb38jxk9IzDS5wVZBI+u3RUtxoMhle80Vu5pPIYPwUvh2EAxJjk4HZ6Q8S8YLRRdK4z9L9/1+uXYTeKd08BwbnY7PfPj2HX3E3IrE/bmJUIq1RMB0SqX06rCkjzPQ5p1kT2jx0k8qYP/UeLMidPALnj4kOdpLqq4inLZgb1qyKKAWN7ZlgGwlYDqdP/eHm9mko9hsL7vwdQALr65BMQtkOcIAfQ/m/SzfPYLJtwBkEuP
  ubuntu@plana59.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaHG83zRXo6ydv6IGWDFTf6YNjWG9M5LRbbYIpPXKOqCg9zfI/4ZjymLpznESFIACVrqe06jqD7uvsQPOlbcm3W/H44su70C21KrzMs77IpskMT7tYgCzY75uxbwg949qYIRf1SEY2RW0Bf2zldbOeKAY/TcnGIkLtc4NCIDPfCxMG0rAJJgUAwbvbKVUqLKe/jcyu3RiiAxV3TGjTAzTz+XHwT46gDXB5Fxt49Sfx+AgpILHk7DvN/HILtU3gRT9ac0D2WlQi1sJLDgjeTAZxyfpRR5iZH4tWYBFIS7C4ugHYye95zUYTc/3Jt364Jl/giUherGjE5od7p65VjxRJ
tasks:
- internal.lock_machines:
  - 2
  - plana
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install: null
- ceph:
    conf:
      client:
        debug ms: 1
        rgw gc obj min wait: 15
      client.0:
        rgw gc pool: .rgw.gc.0
        rgw log data: true
        rgw log meta: true
        rgw region: region0
        rgw region root pool: .rgw.region.0
        rgw user keys pool: .users.0
        rgw user uid pool: .users.uid.0
        rgw zone: r0z1
        rgw zone root pool: .rgw.zone.0
      client.1:
        rgw gc pool: .rgw.gc.1
        rgw log data: false
        rgw log meta: false
        rgw region: region1
        rgw region root pool: .rgw.region.1
        rgw user keys pool: .users.1
        rgw user uid pool: .users.uid.1
        rgw zone: r1z1
        rgw zone root pool: .rgw.zone.1
      osd:
        debug ms: 1
        debug objclass: 20
- rgw:
    client.0:
      system user:
        access key: 0te6NH5mcdcq0Tc5i8i2
        name: client0-system-user
        secret key: Oy4IOauQoL18Gp2zM7lC1vLmoawgqcYPbYGcWfXv
    client.1:
      system user:
        access key: 1te6NH5mcdcq0Tc5i8i3
        name: client1-system-user
        secret key: Py4IOauQoL18Gp2zM7lC1vLmoawgqcYPbYGcWfXw
    regions:
      region0:
        api name: api1
        is master: true
        master zone: r0z1
        zones:
        - r0z1
      region1:
        api name: api1
        is master: false
        master zone: r1z1
        zones:
        - r1z1
- radosgw-agent:
    client.0:
      dest: client.1
      metadata-only: true
      src: client.0
- radosgw-admin: null
teuthology_branch: firefly
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.plana.11470
description: rgw/singleton/{all/radosgw-admin-multi-region.yaml}
duration: 889.1913371086121
failure_reason: 'S3ResponseError: 301 Moved Permanently

  '
flavor: basic
owner: scheduled_teuthology@teuthology
sentry_event: http://sentry.ceph.com/inktank/teuthology/search?q=171b63a807d24c37933376aa15d89f67
success: false

Related issues 1 (0 open1 closed)

Is duplicate of rgw - Bug #7818: syncdaemon: error geting op state: list index out of rangeResolvedJosh Durgin03/21/2014

Actions
Actions #1

Updated by Samuel Just about 10 years ago

  • Project changed from Ceph to rgw
Actions #2

Updated by Josh Durgin about 10 years ago

  • Status changed from New to Duplicate
Actions

Also available in: Atom PDF