Project

General

Profile

Bug #50083 » ceph-mds-albacore_sc0.log

Logs from ceph MDS daemon (containerised) - David Piper, 03/31/2021 01:56 PM

 
Mar 31 11:44:10 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:44:10.536 7fce29a13700 0 --1- [v2:10.225.41.221:6800/3150826672,v1:10.225.41.221:6801/3150826672] >> v1:10.225.28.37:0/4119322112 conn(0x556fe90af800 0x556fe8c41000 :6801 s=OPENED pgs=2 cs=1 l=0).fault server, going to standby
Mar 31 11:47:20 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:47:20.527 7fce2477f700 0 log_channel(cluster) log [WRN] : evicting unresponsive client svr01:albacore (4424404), after 303.353 seconds
Mar 31 11:53:53 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:53:53.171 7fce29a13700 0 --1- [v2:10.225.41.221:6800/3150826672,v1:10.225.41.221:6801/3150826672] >> v1:10.225.28.22:0/2232056148 conn(0x556fe8fb4c00 0x556fe9744000 :6801 s=OPENED pgs=2 cs=1 l=0).fault server, going to standby
Mar 31 11:56:45 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:56:45.617 7fce2477f700 0 log_channel(cluster) log [WRN] : evicting unresponsive client svr02:albacore (4424426), after 304.659 seconds
Mar 31 11:58:35 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:58:35.629 7fce2477f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 34.517338 secs
Mar 31 11:58:35 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:58:35.629 7fce2477f700 0 log_channel(cluster) log [WRN] : slow request 34.517337 seconds old, received at 2021-03-31 11:58:01.102495: client_request(client.4731880:33 setattr size=0 mtime=2021-03-31 11:58:01.100462 #0x1000002b319 2021-03-31 11:58:01.100462 caller_uid=103, caller_gid=101{101,}) currently failed to xlock, waiting
Mar 31 11:58:35 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:58:35.922 7fce26f84700 1 mds.albacore_sc0 Updating MDS map to version 67 from mon.2
Mar 31 11:58:40 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:58:40.618 7fce2477f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 0 included below; oldest blocked for > 39.517429 secs
Mar 31 11:58:45 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:58:45.619 7fce2477f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 0 included below; oldest blocked for > 44.517519 secs
Mar 31 11:58:50 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:58:50.619 7fce2477f700 0 log_channel(cluster) log [WRN] : 1 slow requests, 0 included below; oldest blocked for > 49.517608 secs
Mar 31 11:58:55 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:58:55.832 7fce26f84700 1 mds.albacore_sc0 Updating MDS map to version 68 from mon.2
Mar 31 11:59:44 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 11:59:44.275 7fce29a13700 0 --1- [v2:10.225.41.221:6800/3150826672,v1:10.225.41.221:6801/3150826672] >> v1:10.225.28.22:0/2368795641 conn(0x557034ffc000 0x556fe8ba5800 :6801 s=OPENED pgs=2 cs=1 l=0).fault server, going to standby
Mar 31 12:02:50 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 12:02:50.623 7fce2477f700 0 log_channel(cluster) log [WRN] : evicting unresponsive client svr02:albacore (4738916), after 303.003 seconds
Mar 31 12:05:48 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 12:05:48.299 7fce29a13700 0 --1- [v2:10.225.41.221:6800/3150826672,v1:10.225.41.221:6801/3150826672] >> v1:10.225.28.22:0/2446395468 conn(0x556fe8df5000 0x557038cbc000 :6801 s=OPENED pgs=2 cs=1 l=0).fault server, going to standby
Mar 31 12:09:05 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 12:09:05.633 7fce2477f700 0 log_channel(cluster) log [WRN] : evicting unresponsive client svr02:albacore (4733595), after 300.722 seconds
Mar 31 13:32:01 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:01.455 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (starting...)
Mar 31 13:32:01 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:01.455 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (complete)
Mar 31 13:32:13 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:13.099 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (starting...)
Mar 31 13:32:13 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:13.099 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (complete)
Mar 31 13:32:14 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:14.286 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (starting...)
Mar 31 13:32:14 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:14.286 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (complete)
Mar 31 13:32:16 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:16.280 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (starting...)
Mar 31 13:32:16 albacore_sc0 container_name/ceph-mds-albacore_sc0[895]: 2021-03-31 13:32:16.280 7fce28210700 1 mds.albacore_sc0 asok_command: dump_ops_in_flight (complete)
(1-1/4)