Project

General

Profile

Bug #22659 » ceph_mon_daemon_crash_console_log.txt

Console log showing the ceph mon daemon is failed and ceph is hunting for new mon - Debashis Mondal, 01/11/2018 07:29 AM

 

[root@ceph-server ~]# ceph osd pool create cold-storage 16 16
pool 'cold-storage' created
[root@ceph-server ~]# ceph osd pool create hot-storage 16 16
pool 'hot-storage' created
[root@ceph-server ~]# ceph osd tier add cold-storage hot-storage
pool 'hot-storage' is now (or already was) a tier of 'cold-storage'
[root@ceph-server ~]# ceph osd tier cache-mode hot-storage writeback
set cache-mode for pool 'hot-storage' to writeback
[root@ceph-server ~]# ceph osd tier set-overlay cold-storage hot-storage
overlay for 'cold-storage' is now (or already was) 'hot-storage'
[root@ceph-server ~]#
[root@ceph-server ~]# ceph osd pool set hot-storage hit_set_count -1
2017-11-23 17:54:27.166095 7f1f8d636700 0 monclient: hunting for new mon
2017-11-23 17:54:27.169299 7f1f8c432700 0 -- 10.0.1.140:0/4073771374 >> 10.0.1.140:6789/0 pipe(0x7f1f7800caa0 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7f1f7800ddb0).fault
2017-11-23 17:54:29.311468 7f1f8c533700 0 -- 10.0.1.140:0/4073771374 >> 10.0.1.140:6789/0 pipe(0x7f1f70000c80 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7f1f70001f90).fault




[root@ceph-server ~]# systemctl start ceph-mon@ceph-server
Job for ceph-mon@ceph-server.service failed because start of the service was attempted too often. See "systemctl status ceph-mon@ceph-server.service" and "journalctl -xe" for details.
To force a start use "systemctl reset-failed ceph-mon@ceph-server.service" followed by "systemctl start ceph-mon@ceph-server.service" again.
You have new mail in /var/spool/mail/root
[root@ceph-server ~]# systemctl reset-failed ceph-mon@ceph-server.service
[root@ceph-server ~]# systemctl start ceph-mon@ceph-server.service
[root@ceph-server ~]# systemctl start ceph-mon@ceph-server.service
Job for ceph-mon@ceph-server.service failed because start of the service was attempted too often. See "systemctl status ceph-mon@ceph-server.service" and "journalctl -xe" for details.
To force a start use "systemctl reset-failed ceph-mon@ceph-server.service" followed by "systemctl start ceph-mon@ceph-server.service" again.
You have new mail in /var/spool/mail/root
[root@ceph-server ~]# systemctl reset-failed ceph-mon@ceph-server.service
[root@ceph-server ~]# systemctl start ceph-mon@ceph-server.service
[root@ceph-server ~]# systemctl start ceph-mon@ceph-server.service
You have new mail in /var/spool/mail/root
[root@ceph-server ~]# vim /var/log/messages
[root@ceph-server ~]# systemctl | grep ceph-mon
ceph-mon@ceph-server.service loaded activating auto-restart Ceph cluster monitor daemon
ceph-mon.target loaded active active ceph target allowing to start/stop all ceph-mon@.service instances at once
[root@ceph-server ~]# systemctl | grep ceph-mon
? ceph-mon@ceph-server.service loaded failed failed Ceph cluster monitor daemon
ceph-mon.target loaded active active ceph target allowing to start/stop all ceph-mon@.service instances at once
You have new mail in /var/spool/mail/root
[root@ceph-server ~]#
(1-1/2)