Actions
Bug #9381
closed"jerasure load dlopen(/usr/lib64/ceph/erasure-code/libec_lrc.so)" error in upgrade:dumpling-firefly-x-master-distro-basic-vps suite
% Done:
100%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Per Josh analysis:
"looking at one of the ones that timed out waiting to be healthy: http://pulpito.ceph.com/teuthology-2014-09-06_17:08:01-upgrade:dumpling-firefly-x-master-distro-basic-vps/470461/ teuthology.log reports that 1 mon is down 2:28 and it's mon.a 2:29 the end of mon.a's log has an error: -1 load: jerasure load dlopen(/usr/lib64/ceph/erasure-code/libec_lrc.so): /usr/lib64/ceph/erasure-code/libec_lrc.so: cannot open shared object file: No such file or directory 2:29 no crash, but maybe that failure caused the mon to exit"
Error from vpm019/log/ceph-mon.a.log.gz :
vpm019/log/ceph-mon.a.log.gz:75490040-2014-09-06 21:16:11.934638 7f532445e700 15 mon.a@0(leader).mds e10 _note_beacon mdsbeacon(4500/a up:active seq 89 v10) v2 noting time
vpm019/log/ceph-mon.a.log.gz:75490174-2014-09-06 21:16:11.934646 7f532445e700 1 -- 10.214.138.58:6789/0 --> 10.214.138.58:6808/19385 -- mdsbeacon(4500/a up:active seq 89 v10) v2 -- ?+0 0x1e0b9c0 con 0x1d9d960
vpm019/log/ceph-mon.a.log.gz:75490346-2014-09-06 21:16:19.749711 7f37967407a0 0 ceph version 0.84-1029-g7d8fe2d (7d8fe2d994a673f2187bf99ac8e20df6a0cd2514), process ceph-mon, pid 20161
vpm019/log/ceph-mon.a.log.gz:75490493:2014-09-06 21:16:19.992684 7f37967407a0 -1 load: jerasure load dlopen(/usr/lib64/ceph/erasure-code/libec_lrc.so): /usr/lib64/ceph/erasure-code/libec_lrc.so: cannot open shared object file: No such file or directory
^C
teuthology@teuthology:/a/teuthology-2014-09-06_17:08:01-upgrade:dumpling-firefly-x-master-distro-basic-vps/470461/remote$ zgrep "cannot open shared object file" vpm019/log/ceph-mon.a.log.gz -a20
vpm019/log/ceph-mon.a.log.gz:2014-09-06 21:16:11.743071 7f532445e700 1 mon.a@0(leader).paxos(paxos active c 4268..4827) is_readable now=2014-09-06 21:16:11.743072 lease_expire=2014-09-06 21:16:16.739306 has v0 lc 4827
vpm019/log/ceph-mon.a.log.gz:2014-09-06 21:16:11.743083 7f532445e700 10 mon.a@0(leader).osd e1292 preprocess_query mon_command({"prefix": "osd pool create", "pool": "test-rados-api-vpm050-10162-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile"} v 0) v1 from client.4681 10.214.138.113:0/59010162
vpm019/log/ceph-mon.a.log.gz:2014-09-06 21:16:11.743142 7f532445e700 7 mon.a@0(leader).osd e1292 prepare_update mon_command({"prefix": "osd pool create", "pool": "test-rados-api-vpm050-10162-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile"} v 0) v1 from client.4681 10.214.138.113:0/59010162
vpm019/log/ceph-mon.a.log.gz:2014-09-06 21:16:11.743258 7f532445e700 1 mon.a@0(leader).osd e1292 implicitly use ruleset named after the pool: test-rados-api-vpm050-10162-59
vpm019/log/ceph-mon.a.log.gz:2014-09-06 21:16:11.743496 7f532445e700 10 mon.a@0(leader).osd e1292 should_propose
Actions