Project

General

Profile

Actions

Bug #14350

closed

bucket create failed

Added by 云辉 陈 over 8 years ago. Updated about 6 years ago.

Status:
Can't reproduce
Priority:
Low
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2016-01-08T19:06:07.737 INFO:tasks.rgw.client.0:Started
2016-01-08T19:06:07.737 INFO:tasks.rgw:Starting apache...
2016-01-08T19:06:07.737 INFO:teuthology.orchestra.run.fire003:Running: 'sudo lsb_release is'
2016-01-08T19:06:07.797 DEBUG:teuthology.misc:System to be installed: Ubuntu
2016-01-08T19:06:07.798 INFO:teuthology.orchestra.run.fire003:Running: 'adjust-ulimits daemon-helper kill apache2 -X -f /home/ubuntu/cephtest/apache/apache.client.0.conf'
2016-01-08T19:06:07.804 INFO:teuthology.run_tasks:Running task workunit...
2016-01-08T19:06:07.807 INFO:tasks.workunit:Pulling workunits from ref 39938308d5c626ae4cf9db6ca6a5edfadad1fa63
2016-01-08T19:06:07.807 INFO:tasks.workunit:Making a separate scratch dir for every client...
2016-01-08T19:06:07.807 DEBUG:tasks.workunit:getting remote for 0 role client.0
2016-01-08T19:06:07.807 INFO:teuthology.orchestra.run.fire003:Running: 'stat -
/home/ubuntu/cephtest/mnt.0'
2016-01-08T19:06:07.818 INFO:teuthology.orchestra.run.fire003.stderr:stat: cannot stat 鈥�/home/ubuntu/cephtest/mnt.0鈥�: No such file or directory
2016-01-08T19:06:07.818 INFO:teuthology.orchestra.run.fire003:Running: 'mkdir -- /home/ubuntu/cephtest/mnt.0'
2016-01-08T19:06:07.889 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0
2016-01-08T19:06:07.890 INFO:teuthology.orchestra.run.fire003:Running: 'cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0'
2016-01-08T19:06:07.952 INFO:tasks.rgw.client.0.fire003.stderr:apache2: Syntax error on line 11 of /home/ubuntu/cephtest/apache/apache.client.0.conf: Cannot load /usr/lib/apache2/modules/mod_fastcgi.so into server: /usr/lib/apache2/modules/mod_fastcgi.so: cannot open shared object file: No such file or directory
2016-01-08T19:06:07.963 INFO:teuthology.orchestra.run.fire003:Running: "mkdir -- /home/ubuntu/cephtest/workunit.client.0 && git archive --remote=git://172.16.100.9/ceph.git master:qa/workunits | tar C /home/ubuntu/cephtest/workunit.client.0 -x -f && cd -- /home/ubuntu/cephtest/workunit.client.0 && if test e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0"
2016-01-08T19:06:08.052 INFO:tasks.rgw.client.0.fire003.stderr:daemon-helper: command failed with exit status 1
2016-01-08T19:06:28.138 INFO:tasks.workunit.client.0.fire003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done
2016-01-08T19:06:28.140 INFO:tasks.workunit.client.0.fire003.stdout:make1: Entering directory `/home/ubuntu/cephtest/workunit.client.0/direct_io'
2016-01-08T19:06:28.140 INFO:tasks.workunit.client.0.fire003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test
2016-01-08T19:06:28.834 INFO:tasks.workunit.client.0.fire003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io
2016-01-08T19:06:28.939 INFO:tasks.workunit.client.0.fire003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read
2016-01-08T19:06:28.992 INFO:tasks.workunit.client.0.fire003.stdout:make1: Leaving directory `/home/ubuntu/cephtest/workunit.client.0/direct_io'
2016-01-08T19:06:28.994 INFO:tasks.workunit.client.0.fire003.stdout:make1: Entering directory `/home/ubuntu/cephtest/workunit.client.0/fs'
2016-01-08T19:06:28.995 INFO:tasks.workunit.client.0.fire003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc
2016-01-08T19:06:29.042 INFO:tasks.workunit.client.0.fire003.stdout:make1: Leaving directory `/home/ubuntu/cephtest/workunit.client.0/fs'
2016-01-08T19:06:29.062 INFO:tasks.workunit:Running workunits matching rgw/s3_user_quota.pl on client.0...
2016-01-08T19:06:29.062 INFO:tasks.workunit:Running workunit rgw/s3_user_quota.pl...
2016-01-08T19:06:29.063 INFO:teuthology.orchestra.run.fire003:Running (workunit test rgw/s3_user_quota.pl): 'mkdir -p -
/home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=master TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rgw/s3_user_quota.pl'
2016-01-08T19:07:14.873 INFO:tasks.workunit.client.0.fire003.stderr:bucket buck_2016_00_8_19_07_13 create failed
2016-01-08T19:07:14.876 INFO:tasks.workunit:Stopping ['rgw/s3_user_quota.pl'] on client.0...
2016-01-08T19:07:14.877 INFO:teuthology.orchestra.run.fire003:Running: 'rm rf - /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/workunit.client.0'
2016-01-08T19:07:14.888 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in exit
for result in self:
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
resurrect_traceback(result)
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/ceph-qa-suite_master/tasks/workunit.py", line 362, in _run_tests
label="workunit test {workunit}".format(workunit=workunit)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 156, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
r.wait()
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
label=self.label)
CommandFailedError: Command failed (workunit test rgw/s3_user_quota.pl) on fire003 with status 255: 'mkdir p - /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=master TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h


Files

teuthology.log (308 KB) teuthology.log 云辉 陈, 01/13/2016 02:36 AM
Actions #1

Updated by Abhishek Lekshmanan over 8 years ago

Not completely sure, but in the initialization phase I'm seeing the following line

2016-01-08T19:06:07.952 INFO:tasks.rgw.client.0.fire003.stderr:apache2: Syntax error on line 11 of /home/ubuntu/cephtest/apache/apache.client.0.conf: Cannot load /usr/lib/apache2/modules/mod_fastcgi.so into server: /usr/lib/apache2/modules/mod_fastcgi.so: cannot open shared object file: No such file or directory

which probably means rgw wasn't able to start at all

Actions #2

Updated by Yuri Weinstein about 8 years ago

  • Project changed from 23 to Ceph
Actions #3

Updated by Josh Durgin about 7 years ago

  • Project changed from Ceph to rgw
Actions #4

Updated by Abhishek Lekshmanan over 6 years ago

  • Status changed from New to Need More Info

Any updates on this?

Actions #5

Updated by Abhishek Lekshmanan about 6 years ago

  • Status changed from Need More Info to Can't reproduce

did not see further runs fail due to this, and we don't test apache on teuthology anymore

Actions

Also available in: Atom PDF