Bug #50384
closedpacific ceph-mon: mon initial failed on aarch64
100%
Description
OS: centos8.1, 4.18.0, selinux is disabled
ceph: pacific 16.2.0 aarch64
platform: Kunpeng920 5250@2.6GHz
rpm binary install and deploy, mon initial failed on aarch64
err log:
#ceph-deploy mon create-initial
[ceph2][INFO ] Running command: systemctl enable ceph.target
[ceph2][INFO ] Running command: systemctl enable ceph-mon@ceph2
[ceph2][INFO ] Running command: systemctl start ceph-mon@ceph2
[ceph2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] b'admin_socket: exception getting command descriptions: [Errno 2] No such file or directory'
[ceph2][WARNIN] monitor: mon.ceph2, might not be running yet
[ceph2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] b'admin_socket: exception getting command descriptions: [Errno 2] No such file or directory'
[ceph2][WARNIN] monitor ceph2 does not exist in monmap
[ceph_deploy.mon][INFO ] processing monitor mon.ceph2
[ceph2][DEBUG ] connected to host: ceph2
[ceph2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] b'admin_socket: exception getting command descriptions: [Errno 2] No such file or directory'
[ceph_deploy.mon][WARNIN] mon.ceph2 monitor is not yet in quorum, tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[ceph2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] b'admin_socket: exception getting command descriptions: [Errno 2] No such file or directory'
[ceph_deploy.mon][WARNIN] mon.ceph2 monitor is not yet in quorum, tries left: 4
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] b'admin_socket: exception getting command descriptions: [Errno 2] No such file or directory'
[ceph_deploy.mon][WARNIN] mon.ceph2 monitor is not yet in quorum, tries left: 3
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[ceph2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] b'admin_socket: exception getting command descriptions: [Errno 2] No such file or directory'
[ceph_deploy.mon][WARNIN] mon.ceph2 monitor is not yet in quorum, tries left: 2
[ceph_deploy.mon][WARNIN] waiting 15 seconds before retrying
[ceph2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph2.asok mon_status
[ceph2][ERROR ] b'admin_socket: exception getting command descriptions: [Errno 2] No such file or directory'
[ceph_deploy.mon][WARNIN] mon.ceph2 monitor is not yet in quorum, tries left: 1
[ceph_deploy.mon][WARNIN] waiting 20 seconds before retrying
cat ceph-mon.ceph2.log show as:
2021-04-15T03:29:05.758-0400 ffff96540040 0 pidfile_write: ignore empty --pid-file
2021-04-15T03:29:05.758-0400 ffff96540040 -1 load: jerasure load: lrc load dlopen(/usr/lib64/ceph/erasure-code/libec_isa.so): /usr/lib64/ceph/erasure-code/libec_isa.so: cannot restore segment prot after reloc: Operation not permitted
2021-04-15T03:29:16.527-0400 ffff87410040 0 set uid:gid to 167:167 (ceph:ceph)
2021-04-15T03:29:16.527-0400 ffff87410040 0 ceph version 2565a0 (c2565a0c0faf2a3b54dc1f75b46fe4a87e0326b1) quincy (dev), process ceph-mon, pid 682001
2021-04-15T03:29:16.527-0400 ffff87410040 0 pidfile_write: ignore empty --pid-file
2021-04-15T03:29:16.527-0400 ffff87410040 -1 load: jerasure load: lrc load dlopen(/usr/lib64/ceph/erasure-code/libec_isa.so): /usr/lib64/ceph/erasure-code/libec_isa.so: cannot restore segment prot after reloc: Operation not permitted
2021-04-15T03:29:27.317-0400 ffff7f360040 0 set uid:gid to 167:167 (ceph:ceph)
2021-04-15T03:29:27.317-0400 ffff7f360040 0 ceph version 2565a0 (c2565a0c0faf2a3b54dc1f75b46fe4a87e0326b1) quincy (dev), process ceph-mon, pid 682009
2021-04-15T03:29:27.317-0400 ffff7f360040 0 pidfile_write: ignore empty --pid-file
2021-04-15T03:29:27.317-0400 ffff7f360040 -1 load: jerasure load: lrc load dlopen(/usr/lib64/ceph/erasure-code/libec_isa.so): /usr/lib64/ceph/erasure-code/libec_isa.so: cannot restore segment prot after reloc: Operation not permitted
2021-04-15T04:12:16.775-0400 ffff8a2e0040 0 set uid:gid to 167:167 (ceph:ceph)
2021-04-15T04:12:16.775-0400 ffff8a2e0040 0 ceph version 2565a0 (c2565a0c0faf2a3b54dc1f75b46fe4a87e0326b1) quincy (dev), process ceph-mon, pid 682890
2021-04-15T04:12:16.775-0400 ffff8a2e0040 0 pidfile_write: ignore empty --pid-file
2021-04-15T04:12:16.785-0400 ffff8a2e0040 -1 load: jerasure load: lrc load dlopen(/usr/lib64/ceph/erasure-code/libec_isa.so): /usr/lib64/ceph/erasure-code/libec_isa.so: cannot restore segment prot after reloc: Operation not permitted
Updated by Zhiwei Dai about 3 years ago
as bug #48681 recording,
https://tracker.ceph.com/issues/48681#note-14 rosin luo wrote:
this bug has been solved as https://github.com/intel/isa-l/pull/172 merged. It need to wait isa-l release an new version and then update ceph/isa-l.
it's useful to fix my mon initial failed. Maybe we need to update isa-l repo tag for master and backport to pacific 16.2.1 and Quincy
Updated by Loïc Dachary almost 3 years ago
- Target version changed from v16.2.1 to v16.2.2
Updated by Sage Weil almost 3 years ago
- Status changed from New to Fix Under Review
- Pull request ID set to 41306
Updated by Kefu Chai almost 3 years ago
- Status changed from Fix Under Review to Resolved
Updated by Kefu Chai almost 3 years ago
- Status changed from Resolved to Pending Backport
- Backport set to pacific
Updated by Backport Bot almost 3 years ago
- Copied to Backport #50831: pacific: pacific ceph-mon: mon initial failed on aarch64 added
Updated by Konstantin Shalygin 3 months ago
- Status changed from Pending Backport to Resolved
- Target version deleted (
v16.2.15) - % Done changed from 0 to 100
- Source set to Community (user)