Actions
Bug #12549
closedCEPH_QA_SUITE/AARCH64: Command failed (workunit test rados/test_alloc_hint.sh)
Status:
Rejected
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
other
Tags:
aarch64 arm64
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rados
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
The following test fails on AArch64:
rados:objectstore/{alloc-hint.yaml}
Sample Output:
2015-07-24T08:13:57.392 INFO:teuthology.orchestra.run.teuth9:Running (workunit test rados/test_alloc_hint.sh): 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=workunit-fixes-for-aarch64 TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test_alloc_hint.sh' 2015-07-24T08:13:57.532 INFO:tasks.workunit.client.0.teuth9.stderr:+ shopt -s nullglob 2015-07-24T08:13:57.538 INFO:tasks.workunit.client.0.teuth9.stderr:+ EC_K=2 2015-07-24T08:13:57.539 INFO:tasks.workunit.client.0.teuth9.stderr:+ EC_M=1 2015-07-24T08:13:57.540 INFO:tasks.workunit.client.0.teuth9.stderr:+ NUM_OSDS=3 2015-07-24T08:13:57.541 INFO:tasks.workunit.client.0.teuth9.stderr:+ NUM_PG=12 2015-07-24T08:13:57.541 INFO:tasks.workunit.client.0.teuth9.stderr:+ NUM_PGP=12 2015-07-24T08:13:57.545 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.0 filestore_max_alloc_hint_size 2015-07-24T08:13:57.546 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e 2015-07-24T08:13:57.547 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.0 2015-07-24T08:13:57.547 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=filestore_max_alloc_hint_size 2015-07-24T08:13:57.548 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val 2015-07-24T08:13:57.549 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.0 config get --format=xml filestore_max_alloc_hint_size 2015-07-24T08:13:58.435 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get>' 2015-07-24T08:13:58.438 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get>' filestore_max_alloc_hint_size 2015-07-24T08:13:58.439 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get>' 2015-07-24T08:13:58.440 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=filestore_max_alloc_hint_size 2015-07-24T08:13:58.440 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<filestore_max_alloc_hint_size>(.*)</filestore_max_alloc_hint_size>.*' 2015-07-24T08:13:58.441 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get> =~ .*<filestore_max_alloc_hint_size>(.*)</filestore_max_alloc_hint_size>.* ]] 2015-07-24T08:13:58.449 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo 1048576 2015-07-24T08:13:58.449 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=1048576 2015-07-24T08:13:58.450 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo 1048576 2015-07-24T08:13:58.451 INFO:tasks.workunit.client.0.teuth9.stderr:+ LOW_CAP=1048576 2015-07-24T08:13:58.452 INFO:tasks.workunit.client.0.teuth9.stderr:+ HIGH_CAP=10485760 2015-07-24T08:13:58.453 INFO:tasks.workunit.client.0.teuth9.stderr:+ SMALL_HINT=262144 2015-07-24T08:13:58.454 INFO:tasks.workunit.client.0.teuth9.stderr:+ BIG_HINT=6291456 2015-07-24T08:13:58.455 INFO:tasks.workunit.client.0.teuth9.stderr:+ setup_osd_data 2015-07-24T08:13:58.455 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i = 0 )) 2015-07-24T08:13:58.456 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3 )) 2015-07-24T08:13:58.457 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.0 osd_data 2015-07-24T08:13:58.458 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e 2015-07-24T08:13:58.459 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.0 2015-07-24T08:13:58.460 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=osd_data 2015-07-24T08:13:58.461 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val 2015-07-24T08:13:58.462 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.0 config get --format=xml osd_data 2015-07-24T08:13:59.337 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get>' 2015-07-24T08:13:59.340 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get>' osd_data 2015-07-24T08:13:59.341 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get>' 2015-07-24T08:13:59.342 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=osd_data 2015-07-24T08:13:59.342 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<osd_data>(.*)</osd_data>.*' 2015-07-24T08:13:59.343 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get> =~ .*<osd_data>(.*)</osd_data>.* ]] 2015-07-24T08:13:59.348 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo /var/lib/ceph/osd/ceph-0 2015-07-24T08:13:59.349 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=/var/lib/ceph/osd/ceph-0 2015-07-24T08:13:59.350 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo /var/lib/ceph/osd/ceph-0 2015-07-24T08:13:59.350 INFO:tasks.workunit.client.0.teuth9.stderr:+ OSD_DATA[i]=/var/lib/ceph/osd/ceph-0 2015-07-24T08:13:59.351 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i++ )) 2015-07-24T08:13:59.352 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3 )) 2015-07-24T08:13:59.352 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.1 osd_data 2015-07-24T08:13:59.353 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e 2015-07-24T08:13:59.353 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.1 2015-07-24T08:13:59.354 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=osd_data 2015-07-24T08:13:59.355 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val 2015-07-24T08:13:59.356 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.1 config get --format=xml osd_data 2015-07-24T08:14:00.245 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get>' 2015-07-24T08:14:00.248 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get>' osd_data 2015-07-24T08:14:00.248 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get>' 2015-07-24T08:14:00.249 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=osd_data 2015-07-24T08:14:00.250 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<osd_data>(.*)</osd_data>.*' 2015-07-24T08:14:00.251 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get> =~ .*<osd_data>(.*)</osd_data>.* ]] 2015-07-24T08:14:00.257 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo /var/lib/ceph/osd/ceph-1 2015-07-24T08:14:00.258 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=/var/lib/ceph/osd/ceph-1 2015-07-24T08:14:00.259 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo /var/lib/ceph/osd/ceph-1 2015-07-24T08:14:00.259 INFO:tasks.workunit.client.0.teuth9.stderr:+ OSD_DATA[i]=/var/lib/ceph/osd/ceph-1 2015-07-24T08:14:00.260 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i++ )) 2015-07-24T08:14:00.261 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3 )) 2015-07-24T08:14:00.262 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.2 osd_data 2015-07-24T08:14:00.263 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e 2015-07-24T08:14:00.263 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.2 2015-07-24T08:14:00.264 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=osd_data 2015-07-24T08:14:00.265 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val 2015-07-24T08:14:00.266 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.2 config get --format=xml osd_data 2015-07-24T08:14:01.146 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get>' 2015-07-24T08:14:01.150 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get>' osd_data 2015-07-24T08:14:01.150 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get>' 2015-07-24T08:14:01.151 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=osd_data 2015-07-24T08:14:01.152 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<osd_data>(.*)</osd_data>.*' 2015-07-24T08:14:01.153 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get> =~ .*<osd_data>(.*)</osd_data>.* ]] 2015-07-24T08:14:01.157 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo /var/lib/ceph/osd/ceph-2 2015-07-24T08:14:01.158 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=/var/lib/ceph/osd/ceph-2 2015-07-24T08:14:01.159 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo /var/lib/ceph/osd/ceph-2 2015-07-24T08:14:01.159 INFO:tasks.workunit.client.0.teuth9.stderr:+ OSD_DATA[i]=/var/lib/ceph/osd/ceph-2 2015-07-24T08:14:01.160 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i++ )) 2015-07-24T08:14:01.161 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3 )) 2015-07-24T08:14:01.162 INFO:tasks.workunit.client.0.teuth9.stderr:+ POOL=alloc_hint-rep 2015-07-24T08:14:01.163 INFO:tasks.workunit.client.0.teuth9.stderr:+ ceph osd pool create alloc_hint-rep 12 2015-07-24T08:14:04.315 INFO:tasks.workunit.client.0.teuth9.stderr:pool 'alloc_hint-rep' already exists 2015-07-24T08:14:04.366 INFO:tasks.workunit.client.0.teuth9.stderr:+ ceph osd pool set alloc_hint-rep size 3 2015-07-24T08:14:07.721 INFO:tasks.workunit.client.0.teuth9.stderr:set pool 1 size to 3 2015-07-24T08:14:07.775 INFO:tasks.workunit.client.0.teuth9.stderr:+ OBJ=foo 2015-07-24T08:14:07.776 INFO:tasks.workunit.client.0.teuth9.stderr:+ setup_pgid alloc_hint-rep foo 2015-07-24T08:14:07.777 INFO:tasks.workunit.client.0.teuth9.stderr:+ local poolname=alloc_hint-rep 2015-07-24T08:14:07.778 INFO:tasks.workunit.client.0.teuth9.stderr:+ local objname=foo 2015-07-24T08:14:07.779 INFO:tasks.workunit.client.0.teuth9.stderr:+ local pgid 2015-07-24T08:14:07.780 INFO:tasks.workunit.client.0.teuth9.stderr:++ ceph osd map alloc_hint-rep foo --format=xml 2015-07-24T08:14:10.798 INFO:tasks.workunit.client.0.teuth9.stderr:+ pgid='<osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map>' 2015-07-24T08:14:10.801 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_xml_val '<osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map>' pgid 2015-07-24T08:14:10.802 INFO:tasks.workunit.client.0.teuth9.stderr:++ local 'xml=<osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map>' 2015-07-24T08:14:10.803 INFO:tasks.workunit.client.0.teuth9.stderr:++ local tag=pgid 2015-07-24T08:14:10.804 INFO:tasks.workunit.client.0.teuth9.stderr:++ local 'regex=.*<pgid>(.*)</pgid>.*' 2015-07-24T08:14:10.804 INFO:tasks.workunit.client.0.teuth9.stderr:++ [[ ! <osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map> =~ .*<pgid>(.*)</pgid>.* ]] 2015-07-24T08:14:10.807 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo 1.6 2015-07-24T08:14:10.807 INFO:tasks.workunit.client.0.teuth9.stderr:+ pgid=1.6 2015-07-24T08:14:10.808 INFO:tasks.workunit.client.0.teuth9.stderr:+ PGID=1.6 2015-07-24T08:14:10.809 INFO:tasks.workunit.client.0.teuth9.stderr:+ rados -p alloc_hint-rep create foo 2015-07-24T08:14:11.113 INFO:tasks.workunit.client.0.teuth9.stderr:+ rados -p alloc_hint-rep set-alloc-hint foo 262144 262144 2015-07-24T08:14:11.338 INFO:tasks.workunit.client.0.teuth9.stderr:+ expect_alloc_hint_eq 262144 2015-07-24T08:14:11.338 INFO:tasks.workunit.client.0.teuth9.stderr:+ local expected_extsize=262144 2015-07-24T08:14:11.339 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i = 0 )) 2015-07-24T08:14:11.339 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3 )) 2015-07-24T08:14:11.340 INFO:tasks.workunit.client.0.teuth9.stderr:+ sudo ceph daemon osd.0 flush_journal 2015-07-24T08:14:12.179 INFO:tasks.workunit.client.0.teuth9.stdout: 2015-07-24T08:14:12.218 INFO:tasks.workunit.client.0.teuth9.stderr:+ fns=(${OSD_DATA[i]}/current/${PGID}*_head/${OBJ}_*) 2015-07-24T08:14:12.222 INFO:tasks.workunit.client.0.teuth9.stderr:+ local fns 2015-07-24T08:14:12.223 INFO:tasks.workunit.client.0.teuth9.stderr:+ local count=1 2015-07-24T08:14:12.224 INFO:tasks.workunit.client.0.teuth9.stderr:+ '[' 1 -ne 1 ']' 2015-07-24T08:14:12.225 INFO:tasks.workunit.client.0.teuth9.stderr:+ local extsize 2015-07-24T08:14:12.225 INFO:tasks.workunit.client.0.teuth9.stderr:++ sudo xfs_io -c extsize /var/lib/ceph/osd/ceph-0/current/1.6_head/foo__head_7FC1F406__1 2015-07-24T08:14:12.304 INFO:tasks.workunit.client.0.teuth9.stderr:foreign file active, extsize command is for XFS filesystems only 2015-07-24T08:14:12.310 INFO:tasks.workunit.client.0.teuth9.stderr:+ extsize= 2015-07-24T08:14:12.311 INFO:tasks.workunit.client.0.teuth9.stderr:+ local 'extsize_regex=^\[(.*)\] /var/lib/ceph/osd/ceph-0/current/1.6_head/foo__head_7FC1F406__1$' 2015-07-24T08:14:12.311 INFO:tasks.workunit.client.0.teuth9.stderr:+ [[ ! '' =~ ^\[(.*)\] /var/lib/ceph/osd/ceph-0/current/1.6_head/foo__head_7FC1F406__1$ ]] 2015-07-24T08:14:12.315 INFO:tasks.workunit.client.0.teuth9.stderr:+ echo 'extsize doesn'\''t match extsize_regex: ' 2015-07-24T08:14:12.316 INFO:tasks.workunit.client.0.teuth9.stderr:extsize doesn't match extsize_regex: 2015-07-24T08:14:12.317 INFO:tasks.workunit.client.0.teuth9.stderr:+ return 2 2015-07-24T08:14:12.318 INFO:tasks.workunit:Stopping ['rados/test_alloc_hint.sh'] on client.0... 2015-07-24T08:14:12.319 INFO:teuthology.orchestra.run.teuth9:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/workunit.client.0' 2015-07-24T08:14:12.467 ERROR:teuthology.parallel:Exception in parallel execution Traceback (most recent call last): File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__ for result in self: File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next resurrect_traceback(result) File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/ceph-qa-suite_no_valgrind/tasks/workunit.py", line 361, in _run_tests label="workunit test {workunit}".format(workunit=workunit) File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 137, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run r.wait() File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait label=self.label) CommandFailedError: Command failed (workunit test rados/test_alloc_hint.sh) on teuth9 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=workunit-fixes-for-aarch64 TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test_alloc_hint.sh'
Files
Updated by Loïc Dachary about 8 years ago
- Status changed from New to Rejected
This is because the test was run with no spare disks to format as XFS file systems. As a result the local file system (non XFS) was used and the attempt to set extsize failed (foreign file active, extsize command is for XFS filesystems only).
Updated by Loïc Dachary about 8 years ago
- Tags changed from aarch64 to aarch64 arm64
Actions