Project

General

Profile

Actions

Bug #8194

closed

rgw: test_region_copy_object fails with erasure coding

Added by Josh Durgin almost 10 years ago. Updated almost 10 years ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

It looks like this has been failing since we added erasure coding pools, but this is the most recent one:

http://qa-proxy.ceph.com/teuthology/teuthology-2014-04-22_23:01:48-rgw-firefly-distro-basic-plana/210540/

2014-04-23T14:39:55.634 INFO:teuthology.orchestra.run.err:[10.214.132.21]: ======================================================================
2014-04-23T14:39:55.634 INFO:teuthology.orchestra.run.err:[10.214.132.21]: ERROR: s3tests.functional.test_s3.test_region_copy_object
2014-04-23T14:39:55.634 INFO:teuthology.orchestra.run.err:[10.214.132.21]: ----------------------------------------------------------------------
2014-04-23T14:39:55.636 INFO:teuthology.orchestra.run.err:[10.214.132.21]: Traceback (most recent call last):
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:   File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/nose/case.p
y", line 197, in runTest
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:     self.test(*self.arg)
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:   File "/home/ubuntu/cephtest/s3-tests/s3tests/functional/test_s3.py", line 4773, in test_regio
n_copy_object
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:     dest_key = dest_bucket.copy_key('testobj-dest', bucket.name, key.name)
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:   File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/buc
ket.py", line 868, in copy_key
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:     query_args=query_args)
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:   File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/con
nection.py", line 633, in make_request
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:     retry_handler=retry_handler
2014-04-23T14:39:55.637 INFO:teuthology.orchestra.run.err:[10.214.132.21]:   File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/connec
tion.py", line 1046, in make_request
2014-04-23T14:39:55.638 INFO:teuthology.orchestra.run.err:[10.214.132.21]:     retry_handler=retry_handler)
2014-04-23T14:39:55.638 INFO:teuthology.orchestra.run.err:[10.214.132.21]:   File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/connec
tion.py", line 1002, in _mexe
2014-04-23T14:39:55.638 INFO:teuthology.orchestra.run.err:[10.214.132.21]:     raise BotoServerError(response.status, response.reason, body)
2014-04-23T14:39:55.638 INFO:teuthology.orchestra.run.err:[10.214.132.21]: BotoServerError: BotoServerError: 500 Internal Server Error
2014-04-23T14:39:55.638 INFO:teuthology.orchestra.run.err:[10.214.132.21]: None
...
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: Wed, 23 Apr 2014 21:29:20 GMT
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: x-amz-copy-source:test-client.0-efrsppawtr9a0ow-242/testobj
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: x-amz-metadata-directive:COPY
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: x-amz-storage-class:STANDARD
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: /test-client.0-efrsppawtr9a0ow-234/testobj-dest
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: boto: DEBUG: Signature:
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: AWS EMLRBCCZNMPNZCCELZWM:LQhihNUmMssLK++n+zb7RHZL+aY=
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: boto: DEBUG: Received 500 response.  Retrying in 61.2 seconds
2014-04-23T14:39:55.834 INFO:teuthology.orchestra.run.err:[10.214.132.21]: --------------------- >> end captured logging << ---------------------
Actions #1

Updated by Yehuda Sadeh almost 10 years ago

Cross region copy is just too slow due to ec backend. Apache ends up timing out. Need to increase the idle_timeout param in the suite.

Actions #2

Updated by Yehuda Sadeh almost 10 years ago

I pushed an update to the test suite, should be ok now.

Actions #3

Updated by Ian Colle almost 10 years ago

  • Status changed from New to 7
  • Assignee set to Yehuda Sadeh
Actions #4

Updated by Ian Colle almost 10 years ago

  • Status changed from 7 to Resolved
Actions #5

Updated by Yehuda Sadeh almost 10 years ago

commit at ceph-qa-suite:ee69c7a4f3b425377bd20b307d674ecc70904c0b

Actions

Also available in: Atom PDF