Project

General

Profile

Bug #4035 » ceph-mds.a.copy.log

Ken Franklin, 02/06/2013 11:01 AM

 
2013-02-06 12:16:01.925620 7fa3359ea700 0 mds.-1.0 ms_handle_connect on 192.168.6.131:6789/0
2013-02-06 12:16:01.980225 7fa3359ea700 1 mds.0.1 handle_mds_map i am now mds.0.1
2013-02-06 12:16:01.980229 7fa3359ea700 1 mds.0.1 handle_mds_map state change up:boot --> up:creating
2013-02-06 12:16:01.987413 7fa3359ea700 0 mds.0.cache creating system inode with ino:1
2013-02-06 12:16:01.988668 7fa3359ea700 0 mds.0.cache creating system inode with ino:2
2013-02-06 12:16:01.989497 7fa3359ea700 0 mds.0.cache creating system inode with ino:100
2013-02-06 12:16:01.989541 7fa3359ea700 0 mds.0.cache creating system inode with ino:600
2013-02-06 12:16:01.989848 7fa3359ea700 0 mds.0.cache creating system inode with ino:601
2013-02-06 12:16:01.990164 7fa3359ea700 0 mds.0.cache creating system inode with ino:602
2013-02-06 12:16:01.990420 7fa3359ea700 0 mds.0.cache creating system inode with ino:603
2013-02-06 12:16:01.990825 7fa3359ea700 0 mds.0.cache creating system inode with ino:604
2013-02-06 12:16:01.991161 7fa3359ea700 0 mds.0.cache creating system inode with ino:605
2013-02-06 12:16:01.991532 7fa3359ea700 0 mds.0.cache creating system inode with ino:606
2013-02-06 12:16:01.991753 7fa3359ea700 0 mds.0.cache creating system inode with ino:607
2013-02-06 12:16:01.992021 7fa3359ea700 0 mds.0.cache creating system inode with ino:608
2013-02-06 12:16:01.992353 7fa3359ea700 0 mds.0.cache creating system inode with ino:609
2013-02-06 12:16:01.992615 7fa3359ea700 0 mds.0.cache creating system inode with ino:200
2013-02-06 12:16:09.898394 7fa3359ea700 0 mds.0.1 ms_handle_connect on 192.168.6.131:6801/32922
2013-02-06 12:16:12.833840 7fa3359ea700 1 mds.0.1 creating_done
2013-02-06 12:16:12.878437 7fa3359ea700 1 mds.0.1 handle_mds_map i am now mds.0.1
2013-02-06 12:16:12.878441 7fa3359ea700 1 mds.0.1 handle_mds_map state change up:creating --> up:active
2013-02-06 12:16:12.878451 7fa3359ea700 1 mds.0.1 active_start
2013-02-06 12:16:26.958962 7fa3359ea700 0 mds.0.1 ms_handle_connect on 192.168.6.131:6804/33151
2013-02-06 12:38:05.770249 7fa32ebf9700 0 -- 192.168.6.131:6800/32700 >> 192.168.6.131:0/33646 pipe(0x7fa31c00ec20 sd=19 :6800 s=2 pgs=2 cs=1 l=0).fault, server, going to standby
2013-02-06 12:38:05.897543 7fa32e9f7700 0 -- 192.168.6.131:6800/32700 >> 192.168.6.131:0/35572 pipe(0x7fa31c01f120 sd=20 :6800 s=2 pgs=2 cs=1 l=0).fault, server, going to standby
2013-02-06 12:42:19.531896 7fa3359ea700 0 monclient: hunting for new mon
2013-02-06 12:42:19.599668 7fa3361eb700 -1 mds.0.1 *** got signal Terminated ***
2013-02-06 12:42:19.599685 7fa3361eb700 1 mds.0.1 suicide. wanted down:dne, now up:active
2013-02-06 12:42:19.608057 7fa3341e7700 0 -- 192.168.6.131:6800/32700 >> 192.168.6.131:6789/0 pipe(0x7fa32006f850 sd=16 :0 s=1 pgs=0 cs=0 l=1).fault
2013-02-06 12:42:20.213582 7fa3359ea700 0 mds.0.1 ms_handle_reset on 192.168.6.131:6789/0
2013-02-06 12:42:20.459964 7fa33ab07780 0 stopped.
2013-02-06 13:14:48.081066 7f6168c27700 0 mds.-1.0 ms_handle_connect on 192.168.6.131:6789/0
2013-02-06 13:14:48.175121 7f6168c27700 1 mds.0.2 handle_mds_map i am now mds.0.2
2013-02-06 13:14:48.175125 7f6168c27700 1 mds.0.2 handle_mds_map state change up:boot --> up:replay
2013-02-06 13:14:48.175129 7f6168c27700 1 mds.0.2 replay_start
2013-02-06 13:14:48.180515 7f6168c27700 1 mds.0.2 recovery set is
2013-02-06 13:14:48.180530 7f6168c27700 1 mds.0.2 need osdmap epoch 32, have 32
2013-02-06 13:14:48.181876 7f6168224700 0 -- 192.168.6.131:6800/9278 >> 192.168.6.131:6804/33151 pipe(0x7f6154008a90 sd=17 :0 s=1 pgs=0 cs=0 l=1).fault
2013-02-06 13:14:48.182217 7f6168325700 0 -- 192.168.6.131:6800/9278 >> 192.168.6.131:6801/32922 pipe(0x7f61540067b0 sd=18 :0 s=1 pgs=0 cs=0 l=1).fault
2013-02-06 13:15:09.047708 7f6168c27700 0 mds.0.2 ms_handle_connect on 192.168.6.131:6801/9838
2013-02-06 13:15:23.088803 7f6168c27700 0 mds.0.2 ms_handle_connect on 192.168.6.131:6804/10385
2013-02-06 13:15:24.554465 7f6168c27700 0 mds.0.cache creating system inode with ino:100
2013-02-06 13:15:24.572618 7f6168c27700 0 mds.0.cache creating system inode with ino:1
2013-02-06 13:15:26.640693 7f6161efa700 1 mds.0.2 replay_done
2013-02-06 13:15:26.640728 7f6161efa700 1 mds.0.2 making mds journal writeable
2013-02-06 13:15:26.756115 7f6168c27700 1 mds.0.2 handle_mds_map i am now mds.0.2
2013-02-06 13:15:26.756118 7f6168c27700 1 mds.0.2 handle_mds_map state change up:replay --> up:reconnect
2013-02-06 13:15:26.756230 7f6168c27700 1 mds.0.2 reconnect_start
2013-02-06 13:15:26.756237 7f6168c27700 1 mds.0.2 reopen_log
2013-02-06 13:15:26.756250 7f6168c27700 1 mds.0.server reconnect_clients -- 1 sessions
2013-02-06 13:16:13.090670 7f61627fc700 1 mds.0.server reconnect gave up on client.4105 192.168.6.131:0/35595
2013-02-06 13:16:13.090727 7f61627fc700 1 mds.0.2 reconnect_done
2013-02-06 13:16:13.095957 7f6168c27700 1 mds.0.2 handle_mds_map i am now mds.0.2
2013-02-06 13:16:13.095997 7f6168c27700 1 mds.0.2 handle_mds_map state change up:reconnect --> up:rejoin
2013-02-06 13:16:13.096026 7f6168c27700 1 mds.0.2 rejoin_joint_start
2013-02-06 13:16:13.097825 7f6168c27700 1 mds.0.2 rejoin_done
2013-02-06 13:16:13.107504 7f6168c27700 1 mds.0.2 handle_mds_map i am now mds.0.2
2013-02-06 13:16:13.107585 7f6168c27700 1 mds.0.2 handle_mds_map state change up:rejoin --> up:active
2013-02-06 13:16:13.107619 7f6168c27700 1 mds.0.2 recovery_done -- successful recovery!
2013-02-06 13:16:13.110906 7f6168c27700 1 mds.0.2 active_start
2013-02-06 13:16:13.110954 7f6168c27700 1 mds.0.2 cluster recovered.
2013-02-06 13:20:28.156477 7f61627fc700 0 log [INF] : closing stale session client.4105 192.168.6.131:0/35595 after 301.463066
2013-02-06 13:22:37.515728 7f61616f9700 0 -- 192.168.6.131:6800/9278 >> 192.168.6.131:0/11992 pipe(0x7f615000a3b0 sd=19 :6800 s=2 pgs=2 cs=1 l=0).fault, server, going to standby
2013-02-06 13:29:40.087174 7f61614f7700 0 -- 192.168.6.131:6800/9278 >> 192.168.6.131:0/12015 pipe(0x7f615000a980 sd=20 :6800 s=2 pgs=2 cs=1 l=0).fault, server, going to standby
2013-02-06 13:29:40.196291 7f61612f5700 0 -- 192.168.6.131:6800/9278 >> 192.168.6.131:0/14852 pipe(0x7f6150009970 sd=21 :6800 s=2 pgs=2 cs=1 l=0).fault, server, going to standby
2013-02-06 13:30:06.028081 7f6168c27700 0 mds.0.2 handle_mds_beacon no longer laggy
2013-02-06 13:30:10.512989 7f6168c27700 0 mds.0.2 handle_mds_beacon no longer laggy
2013-02-06 13:30:23.321891 7f6168c27700 0 mds.0.2 handle_mds_beacon no longer laggy
(1-1/2)