Project

General

Profile

Actions

Bug #12549

closed

CEPH_QA_SUITE/AARCH64: Command failed (workunit test rados/test_alloc_hint.sh)

Added by Yazen Ghannam over 8 years ago. Updated about 8 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
aarch64 arm64
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rados
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

The following test fails on AArch64:
rados:objectstore/{alloc-hint.yaml}

Sample Output:

2015-07-24T08:13:57.392 INFO:teuthology.orchestra.run.teuth9:Running (workunit test rados/test_alloc_hint.sh): 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=workunit-fixes-for-aarch64 TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test_alloc_hint.sh'
2015-07-24T08:13:57.532 INFO:tasks.workunit.client.0.teuth9.stderr:+ shopt -s nullglob
2015-07-24T08:13:57.538 INFO:tasks.workunit.client.0.teuth9.stderr:+ EC_K=2
2015-07-24T08:13:57.539 INFO:tasks.workunit.client.0.teuth9.stderr:+ EC_M=1
2015-07-24T08:13:57.540 INFO:tasks.workunit.client.0.teuth9.stderr:+ NUM_OSDS=3
2015-07-24T08:13:57.541 INFO:tasks.workunit.client.0.teuth9.stderr:+ NUM_PG=12
2015-07-24T08:13:57.541 INFO:tasks.workunit.client.0.teuth9.stderr:+ NUM_PGP=12
2015-07-24T08:13:57.545 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.0 filestore_max_alloc_hint_size
2015-07-24T08:13:57.546 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e
2015-07-24T08:13:57.547 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.0
2015-07-24T08:13:57.547 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=filestore_max_alloc_hint_size
2015-07-24T08:13:57.548 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val
2015-07-24T08:13:57.549 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.0 config get --format=xml filestore_max_alloc_hint_size
2015-07-24T08:13:58.435 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get>'
2015-07-24T08:13:58.438 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get>' filestore_max_alloc_hint_size
2015-07-24T08:13:58.439 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get>'
2015-07-24T08:13:58.440 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=filestore_max_alloc_hint_size
2015-07-24T08:13:58.440 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<filestore_max_alloc_hint_size>(.*)</filestore_max_alloc_hint_size>.*'
2015-07-24T08:13:58.441 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><filestore_max_alloc_hint_size>1048576</filestore_max_alloc_hint_size></config_get> =~ .*<filestore_max_alloc_hint_size>(.*)</filestore_max_alloc_hint_size>.* ]]
2015-07-24T08:13:58.449 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo 1048576
2015-07-24T08:13:58.449 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=1048576
2015-07-24T08:13:58.450 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo 1048576
2015-07-24T08:13:58.451 INFO:tasks.workunit.client.0.teuth9.stderr:+ LOW_CAP=1048576
2015-07-24T08:13:58.452 INFO:tasks.workunit.client.0.teuth9.stderr:+ HIGH_CAP=10485760
2015-07-24T08:13:58.453 INFO:tasks.workunit.client.0.teuth9.stderr:+ SMALL_HINT=262144
2015-07-24T08:13:58.454 INFO:tasks.workunit.client.0.teuth9.stderr:+ BIG_HINT=6291456
2015-07-24T08:13:58.455 INFO:tasks.workunit.client.0.teuth9.stderr:+ setup_osd_data
2015-07-24T08:13:58.455 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i = 0  ))
2015-07-24T08:13:58.456 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3  ))
2015-07-24T08:13:58.457 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.0 osd_data
2015-07-24T08:13:58.458 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e
2015-07-24T08:13:58.459 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.0
2015-07-24T08:13:58.460 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=osd_data
2015-07-24T08:13:58.461 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val
2015-07-24T08:13:58.462 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.0 config get --format=xml osd_data
2015-07-24T08:13:59.337 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get>'
2015-07-24T08:13:59.340 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get>' osd_data
2015-07-24T08:13:59.341 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get>'
2015-07-24T08:13:59.342 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=osd_data
2015-07-24T08:13:59.342 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<osd_data>(.*)</osd_data>.*'
2015-07-24T08:13:59.343 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><osd_data>/var/lib/ceph/osd/ceph-0</osd_data></config_get> =~ .*<osd_data>(.*)</osd_data>.* ]]
2015-07-24T08:13:59.348 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo /var/lib/ceph/osd/ceph-0
2015-07-24T08:13:59.349 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=/var/lib/ceph/osd/ceph-0
2015-07-24T08:13:59.350 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo /var/lib/ceph/osd/ceph-0
2015-07-24T08:13:59.350 INFO:tasks.workunit.client.0.teuth9.stderr:+ OSD_DATA[i]=/var/lib/ceph/osd/ceph-0
2015-07-24T08:13:59.351 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i++  ))
2015-07-24T08:13:59.352 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3  ))
2015-07-24T08:13:59.352 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.1 osd_data
2015-07-24T08:13:59.353 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e
2015-07-24T08:13:59.353 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.1
2015-07-24T08:13:59.354 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=osd_data
2015-07-24T08:13:59.355 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val
2015-07-24T08:13:59.356 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.1 config get --format=xml osd_data
2015-07-24T08:14:00.245 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get>'
2015-07-24T08:14:00.248 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get>' osd_data
2015-07-24T08:14:00.248 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get>'
2015-07-24T08:14:00.249 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=osd_data
2015-07-24T08:14:00.250 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<osd_data>(.*)</osd_data>.*'
2015-07-24T08:14:00.251 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><osd_data>/var/lib/ceph/osd/ceph-1</osd_data></config_get> =~ .*<osd_data>(.*)</osd_data>.* ]]
2015-07-24T08:14:00.257 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo /var/lib/ceph/osd/ceph-1
2015-07-24T08:14:00.258 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=/var/lib/ceph/osd/ceph-1
2015-07-24T08:14:00.259 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo /var/lib/ceph/osd/ceph-1
2015-07-24T08:14:00.259 INFO:tasks.workunit.client.0.teuth9.stderr:+ OSD_DATA[i]=/var/lib/ceph/osd/ceph-1
2015-07-24T08:14:00.260 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i++  ))
2015-07-24T08:14:00.261 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3  ))
2015-07-24T08:14:00.262 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_conf_val osd.2 osd_data
2015-07-24T08:14:00.263 INFO:tasks.workunit.client.0.teuth9.stderr:++ set -e
2015-07-24T08:14:00.263 INFO:tasks.workunit.client.0.teuth9.stderr:++ local entity=osd.2
2015-07-24T08:14:00.264 INFO:tasks.workunit.client.0.teuth9.stderr:++ local option=osd_data
2015-07-24T08:14:00.265 INFO:tasks.workunit.client.0.teuth9.stderr:++ local val
2015-07-24T08:14:00.266 INFO:tasks.workunit.client.0.teuth9.stderr:+++ sudo ceph daemon osd.2 config get --format=xml osd_data
2015-07-24T08:14:01.146 INFO:tasks.workunit.client.0.teuth9.stderr:++ val='<config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get>'
2015-07-24T08:14:01.150 INFO:tasks.workunit.client.0.teuth9.stderr:+++ get_xml_val '<config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get>' osd_data
2015-07-24T08:14:01.150 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'xml=<config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get>'
2015-07-24T08:14:01.151 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local tag=osd_data
2015-07-24T08:14:01.152 INFO:tasks.workunit.client.0.teuth9.stderr:+++ local 'regex=.*<osd_data>(.*)</osd_data>.*'
2015-07-24T08:14:01.153 INFO:tasks.workunit.client.0.teuth9.stderr:+++ [[ ! <config_get><osd_data>/var/lib/ceph/osd/ceph-2</osd_data></config_get> =~ .*<osd_data>(.*)</osd_data>.* ]]
2015-07-24T08:14:01.157 INFO:tasks.workunit.client.0.teuth9.stderr:+++ echo /var/lib/ceph/osd/ceph-2
2015-07-24T08:14:01.158 INFO:tasks.workunit.client.0.teuth9.stderr:++ val=/var/lib/ceph/osd/ceph-2
2015-07-24T08:14:01.159 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo /var/lib/ceph/osd/ceph-2
2015-07-24T08:14:01.159 INFO:tasks.workunit.client.0.teuth9.stderr:+ OSD_DATA[i]=/var/lib/ceph/osd/ceph-2
2015-07-24T08:14:01.160 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i++  ))
2015-07-24T08:14:01.161 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3  ))
2015-07-24T08:14:01.162 INFO:tasks.workunit.client.0.teuth9.stderr:+ POOL=alloc_hint-rep
2015-07-24T08:14:01.163 INFO:tasks.workunit.client.0.teuth9.stderr:+ ceph osd pool create alloc_hint-rep 12
2015-07-24T08:14:04.315 INFO:tasks.workunit.client.0.teuth9.stderr:pool 'alloc_hint-rep' already exists
2015-07-24T08:14:04.366 INFO:tasks.workunit.client.0.teuth9.stderr:+ ceph osd pool set alloc_hint-rep size 3
2015-07-24T08:14:07.721 INFO:tasks.workunit.client.0.teuth9.stderr:set pool 1 size to 3
2015-07-24T08:14:07.775 INFO:tasks.workunit.client.0.teuth9.stderr:+ OBJ=foo
2015-07-24T08:14:07.776 INFO:tasks.workunit.client.0.teuth9.stderr:+ setup_pgid alloc_hint-rep foo
2015-07-24T08:14:07.777 INFO:tasks.workunit.client.0.teuth9.stderr:+ local poolname=alloc_hint-rep
2015-07-24T08:14:07.778 INFO:tasks.workunit.client.0.teuth9.stderr:+ local objname=foo
2015-07-24T08:14:07.779 INFO:tasks.workunit.client.0.teuth9.stderr:+ local pgid
2015-07-24T08:14:07.780 INFO:tasks.workunit.client.0.teuth9.stderr:++ ceph osd map alloc_hint-rep foo --format=xml
2015-07-24T08:14:10.798 INFO:tasks.workunit.client.0.teuth9.stderr:+ pgid='<osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map>'
2015-07-24T08:14:10.801 INFO:tasks.workunit.client.0.teuth9.stderr:++ get_xml_val '<osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map>' pgid
2015-07-24T08:14:10.802 INFO:tasks.workunit.client.0.teuth9.stderr:++ local 'xml=<osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map>'
2015-07-24T08:14:10.803 INFO:tasks.workunit.client.0.teuth9.stderr:++ local tag=pgid
2015-07-24T08:14:10.804 INFO:tasks.workunit.client.0.teuth9.stderr:++ local 'regex=.*<pgid>(.*)</pgid>.*'
2015-07-24T08:14:10.804 INFO:tasks.workunit.client.0.teuth9.stderr:++ [[ ! <osd_map><epoch>8</epoch><pool>alloc_hint-rep</pool><pool_id>1</pool_id><objname>foo</objname><raw_pgid>1.7fc1f406</raw_pgid><pgid>1.6</pgid><up><osd>1</osd><osd>0</osd><osd>2</osd></up><up_primary>1</up_primary><acting><osd>1</osd><osd>0</osd><osd>2</osd></acting><acting_primary>1</acting_primary></osd_map> =~ .*<pgid>(.*)</pgid>.* ]]
2015-07-24T08:14:10.807 INFO:tasks.workunit.client.0.teuth9.stderr:++ echo 1.6
2015-07-24T08:14:10.807 INFO:tasks.workunit.client.0.teuth9.stderr:+ pgid=1.6
2015-07-24T08:14:10.808 INFO:tasks.workunit.client.0.teuth9.stderr:+ PGID=1.6
2015-07-24T08:14:10.809 INFO:tasks.workunit.client.0.teuth9.stderr:+ rados -p alloc_hint-rep create foo
2015-07-24T08:14:11.113 INFO:tasks.workunit.client.0.teuth9.stderr:+ rados -p alloc_hint-rep set-alloc-hint foo 262144 262144
2015-07-24T08:14:11.338 INFO:tasks.workunit.client.0.teuth9.stderr:+ expect_alloc_hint_eq 262144
2015-07-24T08:14:11.338 INFO:tasks.workunit.client.0.teuth9.stderr:+ local expected_extsize=262144
2015-07-24T08:14:11.339 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i = 0  ))
2015-07-24T08:14:11.339 INFO:tasks.workunit.client.0.teuth9.stderr:+ (( i < 3  ))
2015-07-24T08:14:11.340 INFO:tasks.workunit.client.0.teuth9.stderr:+ sudo ceph daemon osd.0 flush_journal
2015-07-24T08:14:12.179 INFO:tasks.workunit.client.0.teuth9.stdout:
2015-07-24T08:14:12.218 INFO:tasks.workunit.client.0.teuth9.stderr:+ fns=(${OSD_DATA[i]}/current/${PGID}*_head/${OBJ}_*)
2015-07-24T08:14:12.222 INFO:tasks.workunit.client.0.teuth9.stderr:+ local fns
2015-07-24T08:14:12.223 INFO:tasks.workunit.client.0.teuth9.stderr:+ local count=1
2015-07-24T08:14:12.224 INFO:tasks.workunit.client.0.teuth9.stderr:+ '[' 1 -ne 1 ']'
2015-07-24T08:14:12.225 INFO:tasks.workunit.client.0.teuth9.stderr:+ local extsize
2015-07-24T08:14:12.225 INFO:tasks.workunit.client.0.teuth9.stderr:++ sudo xfs_io -c extsize /var/lib/ceph/osd/ceph-0/current/1.6_head/foo__head_7FC1F406__1
2015-07-24T08:14:12.304 INFO:tasks.workunit.client.0.teuth9.stderr:foreign file active, extsize command is for XFS filesystems only
2015-07-24T08:14:12.310 INFO:tasks.workunit.client.0.teuth9.stderr:+ extsize=
2015-07-24T08:14:12.311 INFO:tasks.workunit.client.0.teuth9.stderr:+ local 'extsize_regex=^\[(.*)\] /var/lib/ceph/osd/ceph-0/current/1.6_head/foo__head_7FC1F406__1$'
2015-07-24T08:14:12.311 INFO:tasks.workunit.client.0.teuth9.stderr:+ [[ ! '' =~ ^\[(.*)\] /var/lib/ceph/osd/ceph-0/current/1.6_head/foo__head_7FC1F406__1$ ]]
2015-07-24T08:14:12.315 INFO:tasks.workunit.client.0.teuth9.stderr:+ echo 'extsize doesn'\''t match extsize_regex: '
2015-07-24T08:14:12.316 INFO:tasks.workunit.client.0.teuth9.stderr:extsize doesn't match extsize_regex:
2015-07-24T08:14:12.317 INFO:tasks.workunit.client.0.teuth9.stderr:+ return 2
2015-07-24T08:14:12.318 INFO:tasks.workunit:Stopping ['rados/test_alloc_hint.sh'] on client.0...
2015-07-24T08:14:12.319 INFO:teuthology.orchestra.run.teuth9:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/workunit.client.0'
2015-07-24T08:14:12.467 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/ceph-qa-suite_no_valgrind/tasks/workunit.py", line 361, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 137, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed (workunit test rados/test_alloc_hint.sh) on teuth9 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=workunit-fixes-for-aarch64 TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test_alloc_hint.sh'


Files

Actions #1

Updated by Loïc Dachary about 8 years ago

  • Status changed from New to Rejected

This is because the test was run with no spare disks to format as XFS file systems. As a result the local file system (non XFS) was used and the attempt to set extsize failed (foreign file active, extsize command is for XFS filesystems only).

Actions #2

Updated by Loïc Dachary about 8 years ago

  • Tags changed from aarch64 to aarch64 arm64
Actions

Also available in: Atom PDF