Project

General

Profile

Bug #17809

"symbol lookup error: ceph_test_librbd_api: undefined symbol" in upgrade:client-upgrade-master-distro-basic-smithi

Added by Yuri Weinstein about 6 years ago. Updated about 6 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
librados
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/client-upgrade
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2016-11-06_11:45:02-upgrade:client-upgrade-master-distro-basic-smithi/
Job: 528085
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2016-11-06_11:45:02-upgrade:client-upgrade-master-distro-basic-smithi/528085/teuthology.log

2016-11-07T10:57:54.762 INFO:tasks.workunit:Running workunit rbd/test_librbd_api.sh...
2016-11-07T10:57:54.763 INFO:teuthology.orchestra.run.smithi096:Running (workunit test rbd/test_librbd_api.sh): 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=hammer TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin RBD_FEATURES=13 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/test_librbd_api.sh'
2016-11-07T10:57:54.842 INFO:tasks.workunit.client.0.smithi096.stderr:ceph_test_librbd_api: symbol lookup error: ceph_test_librbd_api: undefined symbol: _ZN4ceph6buffer4list8iterator7advanceEi
2016-11-07T10:57:54.844 INFO:tasks.workunit:Stopping ['rbd/test_librbd_api.sh'] on client.0...
2016-11-07T10:57:54.844 INFO:teuthology.orchestra.run.smithi096:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/workunit.client.0 /home/ubuntu/cephtest/clone.client.0'
2016-11-07T10:57:55.007 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 83, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/ceph-qa-suite_master/tasks/workunit.py", line 404, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 192, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 403, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 166, in wait
    label=self.label)
CommandFailedError: Command failed (workunit test rbd/test_librbd_api.sh) on smithi096 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=hammer TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin RBD_FEATURES=13 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/test_librbd_api.sh'

History

#1 Updated by Mykola Golub about 6 years ago

#2 Updated by Kefu Chai about 6 years ago

  • Category set to librados
  • Assignee set to Kefu Chai

#3 Updated by Kefu Chai about 6 years ago

talked with josh and sage offline, and per the commends0,

we don't need to worry about ABI changes with buffer.h. Or at least agree to ignore them between major updates (i.e., don't backport this to jewel).

we can fix this issue by removing the upgrade test: where the hammer librbd is supposed to work with latest librados/librbd.

---
[0] https://github.com/ceph/ceph/pull/9395#issuecomment-224278945

#4 Updated by Jason Dillaman about 6 years ago

@Kefu: that is actually not what the test is verifying. It was verifying that a client compiled and linked against an older librbd/librados would still function w/ new librbd/librados libraries. There isn't a mismatch between librbd/librados versions.

#5 Updated by Kefu Chai about 6 years ago

@jason

i knew. but if we do the versioning right, the librbd/librados client won't be able to find librados.so.2 at all. which is a better error message.

#6 Updated by Kefu Chai about 6 years ago

  • Status changed from New to Fix Under Review

#7 Updated by Kefu Chai about 6 years ago

  • Status changed from Fix Under Review to Resolved

#8 Updated by Yuri Weinstein about 6 years ago

  • Status changed from Resolved to New

Kefu, can you take a look at this one maybe related issue?

http://qa-proxy.ceph.com/teuthology/yuriw-2016-11-22_19:46:31-upgrade:client-upgrade-master-distro-basic-smithi/570149/teuthology.log

2016-11-22T19:55:02.753 INFO:teuthology.orchestra.run.smithi025:Running (workunit test rbd/test_librbd_api.sh): 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=kraken TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin RBD_FEATURES=13 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/test_librbd_api.sh'
2016-11-22T19:55:02.815 INFO:tasks.workunit.client.0.smithi025.stderr:ceph_test_librbd_api: symbol lookup error: ceph_test_librbd_api: undefined symbol: _ZN4ceph6buffer4list8iterator4copyEjRNS0_3ptrE
2016-11-22T19:55:02.816 INFO:tasks.workunit:Stopping ['rbd/test_librbd_api.sh'] on client.0...
2016-11-22T19:55:02.816 INFO:teuthology.orchestra.run.smithi025:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/workunit.client.0 /home/ubuntu/cephtest/clone.client.0'
2016-11-22T19:55:02.946 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 83, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/ceph-qa-suite_master/tasks/workunit.py", line 404, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 192, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 403, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 166, in wait
    label=self.label)
CommandFailedError: Command failed (workunit test rbd/test_librbd_api.sh) on smithi025 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=kraken TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin RBD_FEATURES=13 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/test_librbd_api.sh'

#9 Updated by Kefu Chai about 6 years ago

  • Status changed from New to Fix Under Review

#10 Updated by Sage Weil about 6 years ago

  • Status changed from Fix Under Review to Resolved

Also available in: Atom PDF