Project

General

Profile

Actions
Copy link

Bug #5220

closed

test_ls_snaps segfaults on the arm test setup

Added by Tamilarasi muthamizhan almost 11 years ago. Updated over 10 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Josh Durgin
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Test setup: Tala002, Tala003, Tala004

this happens when trying to run rbd/workloads/c_api_tests.yaml on the arm test setup. however it worked fine for the python api tests.

tamil@ubuntu:~/arm/teuthology$ cat rbd.yaml
roles:
- [mon.a, mds.a, osd.0, osd.1]
- [mon.b, mon.c, osd.2, osd.3]
- [client.0]

targets:
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDTZjCkqH+O6LyZI2jmMLAVzUhL4jGKpJ5PQsUMLEB3BCLRWYEFSgbvj8p2EMDIbJapEuxXnUCf+F7s9kLtdcDvfTg8jadq5Z+ymxp042bQHHopbL6rRjO6SoSbQyYKZHQwbqV1Mk/PooOuBwzgv6DpBj7qvhxz93p6FAzvB774dUik7ToVc96t80KADQIa3iNAfGA03L01/mY+vZgrexMy6HZzLjjzXJBsfycZOEzmRfk0OPYaBUjFlKvtUC6BPDIyGt5BKSVYNSyR+t5BN+MMTYbTE9ANVhAQ9YQTQn9CU0yplLFpsZPxF2aA7m3zlHhWkT9rXHJGVOIeFmxT/1n5
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtZiZ63/3h4bMjKN0yrFVSKQX+XKZxQ8BXCJfsneC7MhgOiE2GzeuZPxKbad0gVrvaSoiKLoqJFJtrj/2v0lLln3BsGU0M2Uyl5sg8pPSbsca1dgEb2ebwir7hfZDnjLh24yqMKDo7M3IpL0A6iNT0cHU5eKVJrOWJP9sjkqG5XutZzTdryeTWO8OQ8ErblFPMIpY6/GqalihzhFdH5QCs5WgnYuApLkW8o04vHLW2fzT6cv5ZoODpZNSJtaeur7YT/ZChMAgWB9MRuWFLgJ4dC6pcFcu72OrDsCamp1eADkOnbLoSbW8tpgTRn3McvWTHtMUDKHseLuHsuz9mrTFd
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4XQUem3ze9TfBfsJ3pL8kPm+Y98TEJDQ76rOcdjMR4Rs8mte1Q1B93hT0CI8uRjFcv9uiKaOlweiqKXSx6N/20dsPQ2LN54FtXLB346vsxDmZH0RRzg7KfHja/AilEW3pN3nlLlYkCN/9yWuId3g1sN1L6Shylyc96OL2b++O5fZhZnzbbaHSvyngU73GY/sfRWWA6bB6suXRe/QMbHA/ge/+EvcjJ74nZynenujAchjcVmY6xzpXsXYtSSpYcdgkVh+7P1H0KkfWJwH8aRvsni7TE/6Zp8AtaROelCW1v5vMaLAUjjFtz2nVy2KSViktX3jIpwHDXoFd3eJumXxT

overrides:
workunit:
branch: cuttlefish
tasks:
#- chef:
- install:
branch: cuttlefish
- ceph:
- workunit:
clients:
client.0:
- rbd/test_librbd.sh
env:
RBD_FEATURES: "1"

2013-05-31T13:54:41.058 INFO:teuthology.task.workunit.client.0.err:test/librbd/test_librbd.cc: In function 'int test_ls_snaps(rbd_image_t, int, ...)' thread b6fe2000 time 2013-05-31 13:54:41.170073
2013-05-31T13:54:41.058 INFO:teuthology.task.workunit.client.0.err:test/librbd/test_librbd.cc: 454: FAILED assert((int)snaps[j].size == expected_size)
2013-05-31T13:54:41.071 INFO:teuthology.task.workunit.client.0.err: ceph version 0.61.2-30-g131dca7 (131dca7d10d5b0b7dca5c5cbe9b0b54938805015)
2013-05-31T13:54:41.072 INFO:teuthology.task.workunit.client.0.err: 1: (test_ls_snaps(void*, int, ...)+0x117) [0x25d38]
2013-05-31T13:54:41.072 INFO:teuthology.task.workunit.client.0.err: 2: (LibRBD_TestCreateLsDeleteSnap_Test::TestBody()+0x301) [0x2b036]
2013-05-31T13:54:41.072 INFO:teuthology.task.workunit.client.0.err: 3: (testing::Test::Run()+0x55) [0x47d8a]
2013-05-31T13:54:41.073 INFO:teuthology.task.workunit.client.0.err: 4: (testing::internal::TestInfoImpl::Run()+0x9b) [0x47e28]
2013-05-31T13:54:41.073 INFO:teuthology.task.workunit.client.0.err: 5: (testing::TestCase::Run()+0x67) [0x47e94]
2013-05-31T13:54:41.073 INFO:teuthology.task.workunit.client.0.err: 6: (testing::internal::UnitTestImpl::RunAllTests()+0x13d) [0x48012]
2013-05-31T13:54:41.073 INFO:teuthology.task.workunit.client.0.err: 7: (main()+0x2f) [0x2566c]
2013-05-31T13:54:41.074 INFO:teuthology.task.workunit.client.0.err: 8: (__libc_start_main()+0x99) [0xb6681f42]
2013-05-31T13:54:41.074 INFO:teuthology.task.workunit.client.0.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-05-31T13:54:41.074 INFO:teuthology.task.workunit.client.0.err:terminate called after throwing an instance of 'ceph::FailedAssertion'
2013-05-31T13:54:41.096 INFO:teuthology.task.workunit.client.0.err:Aborted (core dumped)
2013-05-31T13:54:41.098 INFO:teuthology.task.workunit:Stopping rbd/test_librbd.sh on client.0...
2013-05-31T13:54:41.098 DEBUG:teuthology.orchestra.run:Running [10.214.143.4]: 'rm -rf -- /home/ubuntu/cephtest/ta1305311352/workunits.list /home/ubuntu/cephtest/ta1305311352/workunit.client.0'
2013-05-31T13:54:41.124 ERROR:teuthology.run_tasks:Saw exception from tasks
Traceback (most recent call last):
  File "/home/tamil/arm/teuthology/teuthology/run_tasks.py", line 25, in run_tasks
    manager = _run_one_task(taskname, ctx=ctx, config=config)
  File "/home/tamil/arm/teuthology/teuthology/run_tasks.py", line 14, in _run_one_task
    return fn(**kwargs)
  File "/home/tamil/arm/teuthology/teuthology/task/workunit.py", line 90, in task
    all_spec = True
  File "/home/tamil/arm/teuthology/teuthology/parallel.py", line 83, in __exit__
    for result in self:
  File "/home/tamil/arm/teuthology/teuthology/parallel.py", line 100, in next
    resurrect_traceback(result)
  File "/home/tamil/arm/teuthology/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/tamil/arm/teuthology/teuthology/task/workunit.py", line 300, in _run_tests
    args=args,
  File "/home/tamil/arm/teuthology/teuthology/orchestra/remote.py", line 42, in run
    r = self._runner(client=self.ssh, **kwargs)
  File "/home/tamil/arm/teuthology/teuthology/orchestra/run.py", line 266, in run
    r.exitstatus = _check_status(r.exitstatus)
  File "/home/tamil/arm/teuthology/teuthology/orchestra/run.py", line 262, in _check_status
    raise CommandFailedError(command=r.command, exitstatus=status, node=host)
CommandFailedError: Command failed on 10.214.143.4 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/ta1305311352/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/ta1305311352/mnt.0/client.0/tmp && CEPH_REF=cuttlefish TESTDIR="/home/ubuntu/cephtest/ta1305311352" CEPH_ID="0" PYTHONPATH="$PYTHONPATH:/home/ubuntu/cephtest/ta1305311352/binary/usr/local/lib/python2.7/dist-packages:/home/ubuntu/cephtest/ta1305311352/binary/usr/local/lib/python2.6/dist-packages" RBD_FEATURES=1 /home/ubuntu/cephtest/ta1305311352/enable-coredump ceph-coverage /home/ubuntu/cephtest/ta1305311352/archive/coverage /home/ubuntu/cephtest/ta1305311352/workunit.client.0/rbd/test_librbd.sh'

The logs are copied to :/home/ubuntu/arm_testing_log_rbd_c_api

Actions
Copy link
 #1

Updated by Tamilarasi muthamizhan almost 11 years ago

recopying the yaml

tamil@ubuntu:~/arm/teuthology$ cat rbd.yaml 
roles:
- [mon.a, mds.a, osd.0, osd.1]
- [mon.b, mon.c, osd.2, osd.3]
- [client.0]

targets:
  ubuntu@tala002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDTZjCkqH+O6LyZI2jmMLAVzUhL4jGKpJ5PQsUMLEB3BCLRWYEFSgbvj8p2EMDIbJapEuxXnUCf+F7s9kLtdcDvfTg8jadq5Z+ymxp042bQHHopbL6rRjO6SoSbQyYKZHQwbqV1Mk/PooOuBwzgv6DpBj7qvhxz93p6FAzvB774dUik7ToVc96t80KADQIa3iNAfGA03L01/mY+vZgrexMy6HZzLjjzXJBsfycZOEzmRfk0OPYaBUjFlKvtUC6BPDIyGt5BKSVYNSyR+t5BN+MMTYbTE9ANVhAQ9YQTQn9CU0yplLFpsZPxF2aA7m3zlHhWkT9rXHJGVOIeFmxT/1n5
  ubuntu@tala003.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtZiZ63/3h4bMjKN0yrFVSKQX+XKZxQ8BXCJfsneC7MhgOiE2GzeuZPxKbad0gVrvaSoiKLoqJFJtrj/2v0lLln3BsGU0M2Uyl5sg8pPSbsca1dgEb2ebwir7hfZDnjLh24yqMKDo7M3IpL0A6iNT0cHU5eKVJrOWJP9sjkqG5XutZzTdryeTWO8OQ8ErblFPMIpY6/GqalihzhFdH5QCs5WgnYuApLkW8o04vHLW2fzT6cv5ZoODpZNSJtaeur7YT/ZChMAgWB9MRuWFLgJ4dC6pcFcu72OrDsCamp1eADkOnbLoSbW8tpgTRn3McvWTHtMUDKHseLuHsuz9mrTFd
  ubuntu@tala004.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4XQUem3ze9TfBfsJ3pL8kPm+Y98TEJDQ76rOcdjMR4Rs8mte1Q1B93hT0CI8uRjFcv9uiKaOlweiqKXSx6N/20dsPQ2LN54FtXLB346vsxDmZH0RRzg7KfHja/AilEW3pN3nlLlYkCN/9yWuId3g1sN1L6Shylyc96OL2b++O5fZhZnzbbaHSvyngU73GY/sfRWWA6bB6suXRe/QMbHA/ge/+EvcjJ74nZynenujAchjcVmY6xzpXsXYtSSpYcdgkVh+7P1H0KkfWJwH8aRvsni7TE/6Zp8AtaROelCW1v5vMaLAUjjFtz2nVy2KSViktX3jIpwHDXoFd3eJumXxT

overrides:
   workunit:
      branch: cuttlefish 
tasks:
#- chef:
- install:
     branch: cuttlefish
- ceph:
- workunit:
    clients:
      client.0:
        - rbd/test_librbd.sh
    env:
      RBD_FEATURES: "1"
Actions
Copy link
 #2

Updated by Josh Durgin almost 11 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #3

Updated by Ian Colle almost 11 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link
 #4

Updated by Tamilarasi muthamizhan over 10 years ago

  • Status changed from Resolved to In Progress

hitting this again on dumpling but when tried with rbd old format. hence, reopening the bug


roles:
- [mon.a, mds.a, osd.0, osd.1]
- [mon.b, mon.c, mds.a, osd.2, osd.3]
- [client.0]

targets:
  ubuntu@saya010.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDbVFqEuXDrywn3+LgPg3sh3lBakX1+/K8j7Dyy2WL5qUZMUSRji2wbb6FLXT0uRMjZnTmIqsfMEZhe8LB6tDTFUNQvjLW90Tk51N2WlEaGFTzUBQI/6DexfczwbtKh8efayYe3J8xMZHfog2tb6I8Vju17j+Q9holY+V20rGoghTE42MstoDRI2s69ragWU9h7BtPCkl9ihzkgukNBSQSOHKusaA0HG24yjRVZ16bYsFCNn31WXciPataPklu7UysHN7pxUQQq+AjYR90CwVVHJ6r2gkztQgUDkmOuBKiYs4YQYPYIvXwfJpZ2jhQqU2EB8OAyf0DO57Q//KHF0rz
  ubuntu@saya013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6DfBGLoY4dnBVp4QzyYofY3X8BTeORKTfrYghLbtSAHK6ZBOy3LlsIHHEN3mz73Q0OAXfMSpnIWTvn3Jsa/4zqGWOB1JbcQ7M+pagHI71WqbhQLwD0SvniiaU2qWM/5b92vsBGejNAMgM7zshr7mjOmfl9YPMFwl44sZRabO8brvbOWwbIaOcTJLYusEOlj5K6bO86kZaVSkuX378JUvnGewfR81Jdgh9x08KfiUXysBEt54hJlaIqdxC87grm3uM1W2FNWIJSaPjn4A8a7GKpXnoIyhFRry0feybaL5i5ZXizmUSoMaz9NyAKEwS7g+ZWGg5knOZRrkQZChnQdMV
  ubuntu@saya014.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzBXZ4f16QStqIMoM+mhX5bbVlpQtyjGC5b1QGP6/r4SUcaRWfle3P64SSavWBXsq4pZNMRpbEVynTSV/+OFBsuIhJ1iUIsb/TLIjHL+z6BBMyfb5YqJfpltGmruJNPmoMxdhouLDqz4x6jyl3bzFu5Xrxe04A3KVIhSDPqJI9/GNyRd5e7ylc9JLaeF4eEpUIwIkh594+G+HuQ0Ve+ISLnaUrWsa17qUeiKLVgxTmXvmo5CmAMNTwvBAMf/nHa2Rm8Rvad9U82CCXbEzcIIGNJtlGw7C6fzqxXPPSnQVyYrk5DdOkH9ggoOPftqHpIvMpp/iU7avBNZvj7bS2+y5N

tasks:
#- chef:
- install:
    branch: dumpling  
- ceph:
- workunit:
    clients:
      client.0:
        - rbd/test_librbd.sh

2013-08-16T16:18:18.485 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]: test/librbd/test_librbd.cc: In function 'int test_ls_snaps(rbd_image_t, int, ...)' thread b6fc1000 time 2013-08-16 18:18:22.061329
2013-08-16T16:18:18.485 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]: test/librbd/test_librbd.cc: 459: FAILED assert(found)
2013-08-16T16:18:18.495 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  ceph version 0.67-8-g1aa0191 (1aa01910957e967e87e46b86f1e67844148703e3)
2013-08-16T16:18:18.495 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  1: (test_ls_snaps(void*, int, ...)+0xab) [0x25cec]
2013-08-16T16:18:18.496 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  2: (LibRBD_TestIOToSnapshot_Test::TestBody()+0x661) [0x2f2c2]
2013-08-16T16:18:18.496 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  3: (testing::Test::Run()+0x55) [0x47df2]
2013-08-16T16:18:18.496 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  4: (testing::internal::TestInfoImpl::Run()+0x9b) [0x47e90]
2013-08-16T16:18:18.497 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  5: (testing::TestCase::Run()+0x67) [0x47efc]
2013-08-16T16:18:18.497 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  6: (testing::internal::UnitTestImpl::RunAllTests()+0x13d) [0x4807a]
2013-08-16T16:18:18.497 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  7: (main()+0x2f) [0x2568c]
2013-08-16T16:18:18.497 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  8: (__libc_start_main()+0x99) [0xb6586f42]
2013-08-16T16:18:18.498 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]:  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2013-08-16T16:18:18.498 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]: terminate called after throwing an instance of 'ceph::FailedAssertion'
2013-08-16T16:18:18.520 INFO:teuthology.task.workunit.client.0.err:[10.214.143.110]: Aborted (core dumped)
2013-08-16T16:18:18.522 INFO:teuthology.task.workunit:Stopping rbd/test_librbd.sh on client.0...
Actions
Copy link
 #5

Updated by Tamilarasi muthamizhan over 10 years ago

teuthology logs are copied to ubuntu@mira025:/home/ubuntu/rbd_api_old

Actions
Copy link
 #6

Updated by Sage Weil over 10 years ago

  • Status changed from In Progress to 12
  • Assignee deleted (Josh Durgin)
Actions
Copy link
 #7

Updated by Sage Weil over 10 years ago

  • Assignee set to Tamilarasi muthamizhan
Actions
Copy link
 #8

Updated by Tamilarasi muthamizhan over 10 years ago

  • Assignee changed from Tamilarasi muthamizhan to Josh Durgin

config file used:

roles:
- - mon.a
  - osd.0
  - osd.1
  - mds.a
- - mon.b
  - mon.c
  - osd.2
  - osd.3
  - client.0
targets:
  ubuntu@saya001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDbFBp+ymIHye3nVb1/wJNgrvPj8Tpe9MUSN3PLlUCHqJv0G7JDOBBIeY04548QATRRE/HSqySldNtpExzdU8GS4RXMuWu1UbcBw7uxgYnZhdhkTFr5sFI6y3F/jHBOuqQ31xuy0XNEwkgDyHO8CJmy4kPTfH4ViapmwFf6wFAR/0fCi71437odIMDT2Cu5qkNp4UkpJ7aMOJ0mDZvyEfH9hpFWpK5ainnvUZ09KtP7mfrrpgOnrr+LHIerlKslzJ4flBXxmQDVCtvTBIYmVyR0SJtVHQ0ztKQLVrfjJzkdF60Jxf9UGI0y0Q+wHgoIOLHmIn/wJGmDsMphizb12m0r
  ubuntu@saya002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCrt00i+TtqPgLQDb6odDTfh7OqgBdjLJm1GFeOwN0xkDarJSOi4BAj65iD6cFVdKbhlj05v9a7xg3Pu944/Ki69rfC8m0hlO5JL58+GTPey2L8ZMRCPq+kLR9BQ4xxF2e2FFMmn2yeAMPbcg/Eif4AF/OgtTr5Hdw324GlkFNOJXR2Va7gnT4Hzq4Z48R74dMZcuXHjE5LFG1005q32Z6TxF4z1kq7berqV/ULaEaYKP/rvVZkOLE604CKSlh2WHul7+NI+Dsut1FVKNVETPWBQRwFqq5Q2ul9+7MQL7qajl2aS1jRlEz25V326Pp/Ar4Aq7L6q3twTOFIlSJhUlJ1
tasks:
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- install:
    branch: master
- ceph: null
- workunit:
    clients:
      client.0:
      - rbd/test_librbd.sh

retested and the test hangs on master

2013-10-16T13:40:00.279 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: [ RUN      ] LibRBD.TestCopyPP
2013-10-16T13:40:01.398 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: using old format
2013-10-16T13:40:03.930 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: num images is: 1
2013-10-16T13:40:03.931 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected: 1
2013-10-16T13:40:03.931 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: image: testimg
2013-10-16T13:40:03.931 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected = testimg
2013-10-16T13:40:04.559 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: num images is: 2
2013-10-16T13:40:04.559 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected: 2
2013-10-16T13:40:04.559 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: image: testimg
2013-10-16T13:40:04.562 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: image: testimg2
2013-10-16T13:40:04.562 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected = testimg
2013-10-16T13:40:04.562 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected = testimg2
2013-10-16T13:40:04.977 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: 0.00% done
2013-10-16T13:40:04.978 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: 100.00% done
2013-10-16T13:40:04.978 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: num images is: 3
2013-10-16T13:40:04.978 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected: 3
2013-10-16T13:40:04.978 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: image: testimg
2013-10-16T13:40:04.978 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: image: testimg2
2013-10-16T13:40:04.979 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: image: testimg3
2013-10-16T13:40:04.979 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected = testimg
2013-10-16T13:40:04.979 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected = testimg2
2013-10-16T13:40:04.979 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: expected = testimg3
2013-10-16T13:40:05.497 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: [       OK ] LibRBD.TestCopyPP (5110 ms)
2013-10-16T13:40:05.497 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: [ RUN      ] LibRBD.TestCreateLsDeleteSnap
2013-10-16T13:40:06.655 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: using old format
2013-10-16T13:40:11.035 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]: *** glibc detected *** ceph_test_librbd: corrupted double-linked list: 0x00fd7680 ***

on dumpling, it errors as shown below,

2013-10-16T14:09:30.498 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: (30) Read-only file system
2013-10-16T14:09:30.499 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: read: 80
2013-10-16T14:09:30.499 INFO:teuthology.task.workunit.client.0.out:[10.214.143.101]: read: 80
2013-10-16T14:09:30.499 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]: ./include/xlist.h: In function 'void xlist<T>::remove(xlist<T>::item*) [with T = Objecter::LingerOp*]' thread b6fa2000 time 2013-10-16 16:09:21.469043
2013-10-16T14:09:30.499 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]: ./include/xlist.h: 132: FAILED assert((bool)_front == (bool)_size)
2013-10-16T14:09:30.500 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  ceph version 0.67.4-10-g7d99940 (7d99940467019bda74da83f3f1ebc2da46bd6967)
2013-10-16T14:09:30.507 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  1: (xlist<Objecter::LingerOp*>::remove(xlist<Objecter::LingerOp*>::item*)+0x61) [0xb693d8da]
2013-10-16T14:09:30.507 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  2: (Objecter::unregister_linger(unsigned long long)+0x35) [0xb6930fea]
2013-10-16T14:09:30.507 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  3: (librados::RadosClient::unregister_watcher(unsigned long long)+0x195) [0xb69217ea]
2013-10-16T14:09:30.507 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  4: (librados::IoCtxImpl::notify(object_t const&, unsigned long long, ceph::buffer::list&)+0x33f) [0xb692a958]
2013-10-16T14:09:30.508 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  5: (librados::IoCtx::notify(std::string const&, unsigned long long, ceph::buffer::list&)+0x27) [0xb6912f1c]
2013-10-16T14:09:30.508 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  6: (librbd::notify_change(librados::IoCtx&, std::string const&, unsigned long long*, librbd::ImageCtx*)+0x7d) [0xb6f36c3a]
2013-10-16T14:09:30.510 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  7: (librbd::snap_rollback(librbd::ImageCtx*, char const*, librbd::ProgressContext&)+0x27f) [0xb6f3e188]
2013-10-16T14:09:30.510 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  8: (rbd_snap_rollback()+0x1b) [0xb6f28bc8]
2013-10-16T14:09:30.510 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  9: (LibRBD_TestIOToSnapshot_Test::TestBody()+0x971) [0x2f5d2]
2013-10-16T14:09:30.510 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  10: (testing::Test::Run()+0x55) [0x47df2]
2013-10-16T14:09:30.510 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  11: (testing::internal::TestInfoImpl::Run()+0x9b) [0x47e90]
2013-10-16T14:09:30.510 INFO:teuthology.task.workunit.client.0.err:[10.214.143.101]:  12: (testing::TestCase::Run()+0x67) [0x47efc]
Actions
Copy link
 #9

Updated by Josh Durgin over 10 years ago

  • Project changed from Ceph to rbd
  • Category deleted (librbd)
Actions
Copy link
 #10

Updated by Sage Weil over 10 years ago

  • Status changed from 12 to Fix Under Review

wip-test-librbd fixes heap corruption in this code

Actions
Copy link
 #11

Updated by Sage Weil over 10 years ago

  • Status changed from Fix Under Review to Resolved
Actions
Copy link

Also available in: Atom PDF