Jun 20 23:53:37 scale-192-168-98-110 kernel: imklog 4.6.2, log source = /proc/kmsg started. Jun 20 23:53:37 scale-192-168-98-110 rsyslogd: [origin software="rsyslogd" swVersion="4.6.2" x-pid="8759" x-info="http://www.rsyslog.com"] (re)start Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 2 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:1049 : send_renew_caps to mds0 (up:active) Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88003c1a5680 front 28 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff88003c1a5680 to mds0 22=client_session len 28+0+0 ----- Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 20 nref 1 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff88003c1a5680 seq 8 type 22 len 28+0+0 0 pgs Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 3054507971 data_crc 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 95 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 95 left Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 20, queueing work Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (3) Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1401 : got ack for seq 8 type 22 at ffff88003c1a5680 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88003c1a5680 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88003c1a5680 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff8800382af840 msg (null) Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 22 front 28 data 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88003c1a5680 front 28 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff88003c1a5680 28 (3730585014) + 0 (0) + 0 (0) Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff88003c1a5680 8 from mds0 22=client_session len 28+0 (3730585014 0 0) ===== Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:2269 : handle_session mds0 renewcaps ffff8800382af800 state open seq 25 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:1086 : renewed_caps mds0 ttl now 4314762020, was fresh, now stale Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88003c1a5680 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88003c1a5680 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:569 : prepare_write_ack ffff8800382af840 7 -> 8 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 9 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 9 left Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:37 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:53:37 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: osd_client.c:1138 : osds timeout Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: osd_client.c:707 : __remove_old_osds ffff8800121425a8 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 2 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff8800382af840 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 28 nref 1 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff8800382af840 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 1 left Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:42 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:53:42 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:2924 : check_delayed_caps on ffff880021111300 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021111300 cap ffff88000fa2cca8 issued pAsLsXsFsx Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:1518 : check_caps ffff880021111300 file_want - used - dirty - flushing - issued pAsLsXsFsx revoking - retain pAsLsXsFscr NODELAY Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:1567 : mds0 cap ffff88000fa2cca8 issued pAsLsXsFsx implemented pAsLsXsFsx revoking - Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:1101 : __send_cap ffff880021111300 cap ffff88000fa2cca8 session ffff8800382af800 pAsLsXsFsx -> pAsLsXsFs (revoking -) Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:946 : send_cap_msg update 4a2a 10000000000 caps pAsLsXsFs wanted - dirty - seq 1/1 mseq 0 follows 0 size 0/0 xattr_ver 0 xattr_len 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88001a713300 front 176 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff88001a713300 to mds0 784=client_caps len 176+0+0 ----- Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (3) Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021111300 cap ffff88000fa2cca8 issued pAsLsXsFs Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: caps.c:1518 : check_caps ffff880021111300 file_want - used - dirty - flushing - issued pAsLsXsFs revoking - retain pAsLsXsFscr NODELAY Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 3 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 28 nref 1 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff88001a713300 seq 9 type 784 len 176+0+0 0 pgs Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 4043077026 data_crc 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 243 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 243 left Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 1 left Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 4, queueing work Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (3) Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1401 : got ack for seq 9 type 784 at ffff88001a713300 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88001a713300 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88001a713300 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:47 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:53:47 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 2 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff8800382af840 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 28 nref 1 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff8800382af840 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 1 left Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:52 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:53:52 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: mon_client.c:698 : monc delayed_work Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff88003a405800 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:393 : con_get ffff88003a405800 nref = 1 -> 2 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff88003a405800 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: mon_client.c:190 : __send_subscribe sub_sent=0 exp=0 want_osd=0 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: mon_client.c:179 : __schedule_delayed after 20000 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff88003a405800 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff88003a405800 ret 0 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff88003a405800 state 29 nref 2 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff88003a405800 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff88003a405800 1 left Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff88003a405800 0 left in 0 kvecs ret = 1 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff88003a405800 ret 0 Jun 20 23:53:53 scale-192-168-98-110 kernel: libceph: messenger.c:402 : con_put ffff88003a405800 nref = 2 -> 1 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 2 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:1049 : send_renew_caps to mds0 (up:active) Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88001a713300 front 28 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff88001a713300 to mds0 22=client_session len 28+0+0 ----- Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 20 nref 1 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff88001a713300 seq 10 type 22 len 28+0+0 0 pgs Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 395421064 data_crc 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 95 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 95 left Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 20, queueing work Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (3) Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1401 : got ack for seq 10 type 22 at ffff88001a713300 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88001a713300 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88001a713300 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff8800382af840 msg (null) Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 22 front 28 data 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88001a713300 front 28 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff88001a713300 28 (358614229) + 0 (0) + 0 (0) Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff88001a713300 9 from mds0 22=client_session len 28+0 (358614229 0 0) ===== Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:2269 : handle_session mds0 renewcaps ffff8800382af800 state open seq 26 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:1086 : renewed_caps mds0 ttl now 4314782020, was fresh, now stale Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88001a713300 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88001a713300 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:569 : prepare_write_ack ffff8800382af840 8 -> 9 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 9 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 9 left Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:53:57 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: osd_client.c:1138 : osds timeout Jun 20 23:53:57 scale-192-168-98-110 kernel: libceph: osd_client.c:707 : __remove_old_osds ffff8800121425a8 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 2 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff8800382af840 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 28 nref 1 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff8800382af840 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 1 left Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:02 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:54:02 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask pAsLsXsFs mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask pAsLsXsFs) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask pAsLsXsFs mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask pAsLsXsFs) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: super.c:62 : statfs Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88003a560f00 front 34 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c599c0 front 1024 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff88003a560f00 to mon2 13=statfs len 34+0+0 ----- Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:393 : con_get ffff88003a405800 nref = 1 -> 2 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff88003a405800 ret 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff88003a405800 state 21 nref 2 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff88003a560f00 seq 5 type 13 len 34+0+0 0 pgs Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 1357752027 data_crc 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 101 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff88003a405800 101 left Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff88003a405800 0 left in 0 kvecs ret = 1 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff88003a405800 state = 21, queueing work Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:393 : con_get ffff88003a405800 nref = 2 -> 3 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff88003a405800 ret 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:402 : con_put ffff88003a405800 nref = 3 -> 2 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff88003a405800 msg (null) Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 14 front 56 data 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: mon_client.c:441 : get_generic_reply 5 got ffff880019c599c0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff880019c599c0 56 (1025501001) + 0 (0) + 0 (0) Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff880019c599c0 11 from mon2 14=statfs_reply len 56+0 (1025501001 0 0) ===== Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: mon_client.c:491 : handle_statfs_reply ffff880019c599c0 tid 5 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff88003a405800 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c599c0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c599c0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88003a560f00 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88003a560f00 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021111da0 mask pAsLsXsFs mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021111da0 cap ffff8800210647a8 issued pAsLsXsFs (mask pAsLsXsFs) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021111da0 cap ffff8800210647a8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: export.c:148 : __cfh_to_dentry 10000001a97 (1/317bf6c3) Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff88003a405800 ret 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff88003a405800 state 5 nref 2 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:569 : prepare_write_ack ffff88003a405800 10 -> 11 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 9 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff88003a405800 9 left Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff88003a405800 0 left in 0 kvecs ret = 1 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff88003a405800 ret 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:402 : con_put ffff88003a405800 nref = 2 -> 1 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: export.c:188 : __cfh_to_dentry 10000001a97 ffff88000fa2dda0 dentry ffff88003bdc62c0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask pAsLsXsFs mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask pAsLsXsFs) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: export.c:148 : __cfh_to_dentry 10000001a97 (1/317bf6c3) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: export.c:188 : __cfh_to_dentry 10000001a97 ffff88000fa2dda0 dentry ffff88003bdc62c0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: dir.c:557 : lookup ffff88000fa2dda0 dentry ffff88000fb3acc0 'testfoo3' Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: dir.c:1173 : dentry_lru_add ffff88003ad17690 ffff88000fb3acc0 'testfoo3' Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: dir.c:581 : dir ffff88000fa2dda0 flags are 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:1913 : do_request on ffff88003bb19800 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:160 : reserve caps ctx=ffff88003bb19ad8 need=2 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:199 : reserve caps ctx=ffff88003bb19ad8 1036 = 11 used + 2 resv + 1023 avail Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:571 : __register_request ffff88003bb19800 tid 14 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:679 : __choose_mds ffff88000fa2dda0 is_hash=1 (1449533706) mode 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:218 : choose_frag(5666210a) = 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:737 : choose_mds ffff88000fa2dda0 10000001a97.fffffffffffffffe mds0 (auth cap ffff88000fa2cda8) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 2 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:1824 : do_request mds0 session ffff8800382af800 state open Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:1727 : prepare_send_request ffff88003bb19800 tid 14 lookup (attempt 1) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:1573 : dentry ffff88000fb3acc0 10000001a97/testfoo3 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88003a560f00 front 122 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:1778 : r_locked_dir = ffff88000fa2dda0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff88003a560f00 to mds0 24=client_request len 122+0+0 ----- Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 4 -> 5 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (5) Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 5 -> 4 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:1939 : do_request waiting Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 20 nref 1 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff88003a560f00 seq 11 type 24 len 122+0+0 0 pgs Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 2026705868 data_crc 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 189 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 189 left Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 4, queueing work Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 4 -> 5 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (5) Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (4) Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 5 -> 4 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1401 : got ack for seq 11 type 24 at ffff88003a560f00 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff8800382af840 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff8800382af840 msg (null) Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 26 front 346 data 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c59600 front 346 Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff880019c59600 346 (2088725511) + 0 (0) + 0 (0) Jun 20 23:54:06 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff880019c59600 10 from mds0 26=client_reply len 346+0 (2088725511 0 0) ===== Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:2033 : handle_reply ffff88003bb19800 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:592 : __unregister_request ffff88003bb19800 tid 14 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:2126 : handle_reply tid 14 result -2 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: snap.c:616 : update_snap_trace deletion=0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: snap.c:150 : lookup_snap_realm 1 ffff880028c0ca80 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: snap.c:673 : update_snap_trace 1 ffff880028c0ca80 seq 1 unchanged Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: snap.c:677 : done with 1 ffff880028c0ca80, invalidated=0, ffff88003985f15a ffff88003985f15a Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:940 : fill_trace ffff88003bb19800 is_dentry 1 is_target 0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:572 : fill_inode ffff88000fa2dda0 ino 10000001a97.fffffffffffffffe v 9306 had 9218 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:616 : ffff88000fa2dda0 mode 040755 uid.gid 1015.1015 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:527 : add_cap ffff88000fa2dda0 mds0 cap 4a2c pAsLsXsFs seq 3 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:618 : add_cap inode ffff88000fa2dda0 (10000001a97.fffffffffffffffe) cap ffff88000fa2cda8 pAsLsXsFs now pAsLsXsFs seq 3 mds0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1068 : fill_trace null dentry Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1073 : d_instantiate ffff88000fb3acc0 NULL Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:809 : update_dentry_lease ffff88000fb3acc0 mask 0 duration 0 ms ttl 4314731421 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: inode.c:1179 : fill_trace done err=0 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:212 : unreserve caps ctx=ffff88003bb19ad8 count=2 Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: caps.c:221 : unreserve caps 1036 = 11 used + 0 resv + 1025 avail Jun 20 23:54:06 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1948 : do_request waited, got 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1976 : do_request ffff88003bb19800 done, result -2 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88003a560f00 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88003a560f00 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c59600 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c59600 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2199 : put_cap_refs ffff88000fa2dda0 had p Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:212 : unreserve caps ctx=ffff88003bb19ad8 count=0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: dir.c:610 : lookup result= (null) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask pAsLsXsFs mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask pAsLsXsFs) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask pAsLsXsFs mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask pAsLsXsFs) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: hpet1: lost 1 rtc interrupts Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: export.c:148 : __cfh_to_dentry 10000001a97 (1/317bf6c3) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: export.c:188 : __cfh_to_dentry 10000001a97 ffff88000fa2dda0 dentry ffff88003bdc62c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: dir.c:1009 : d_revalidate ffff88000fb3acc0 'testfoo3' inode (null) offset 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: dir.c:972 : dentry_lease_is_valid - dentry ffff88000fb3acc0 = 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask Fs) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: dir.c:991 : dir_lease_is_valid dir ffff88000fa2dda0 v3 dentry ffff88000fb3acc0 v3 = 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: dir.c:1189 : dentry_lru_touch ffff88003ad17690 ffff88000fb3acc0 'testfoo3' (offset 0) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask As mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFs (mask As) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: dir.c:675 : create in dir ffff88000fa2dda0 dentry ffff88000fb3acc0 name 'testfoo3' Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: dir.c:649 : mknod in dir ffff88000fa2dda0 dentry ffff88000fb3acc0 mode 0100644 rdev 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1913 : do_request on ffff88003abe4000 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:160 : reserve caps ctx=ffff88003abe42d8 need=2 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:199 : reserve caps ctx=ffff88003abe42d8 1036 = 11 used + 2 resv + 1023 avail Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:571 : __register_request ffff88003abe4000 tid 15 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:679 : __choose_mds ffff88000fa2dda0 is_hash=1 (1449533706) mode 2 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:218 : choose_frag(5666210a) = 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:737 : choose_mds ffff88000fa2dda0 10000001a97.fffffffffffffffe mds0 (auth cap ffff88000fa2cda8) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 4 -> 5 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1824 : do_request mds0 session ffff8800382af800 state open Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1727 : prepare_send_request ffff88003abe4000 tid 15 mknod (attempt 1) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1573 : dentry ffff88000fb3acc0 10000001a97/testfoo3 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff88003a560f00 front 174 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:3000 : encode_inode_release ffff88000fa2dda0 mds0 used|dirty p drop Fs unless Fx Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:3015 : encode_inode_release ffff88000fa2dda0 cap ffff88000fa2cda8 pAsLsXsFs -> pAsLsXs Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1778 : r_locked_dir = ffff88000fa2dda0 Jun 20 23:54:07 scale-192-168-98-110 kernel: hpet1: lost 3 rtc interrupts Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:569 : prepare_write_ack ffff8800382af840 9 -> 10 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 9 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 9 left Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (4) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff88003a560f00 to mds0 24=client_request len 166+0+0 ----- Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 5 -> 6 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (6) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 6 -> 5 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1939 : do_request waiting Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 5 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 20 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff88003a560f00 seq 12 type 24 len 166+0+0 0 pgs Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 3407722238 data_crc 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 233 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 233 left Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 4, queueing work Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 4 -> 5 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (5) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (4) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 5 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1401 : got ack for seq 12 type 24 at ffff88003a560f00 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff8800382af840 msg (null) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 26 front 583 data 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c59cc0 front 583 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff880019c59cc0 583 (1694412203) + 0 (0) + 0 (0) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff880019c59cc0 11 from mds0 26=client_reply len 583+0 (1694412203 0 0) ===== Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:2033 : handle_reply ffff88003abe4000 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:2126 : handle_reply tid 15 result 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: snap.c:616 : update_snap_trace deletion=0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: snap.c:150 : lookup_snap_realm 1 ffff880028c0ca80 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: snap.c:673 : update_snap_trace 1 ffff880028c0ca80 seq 1 unchanged Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: snap.c:677 : done with 1 ffff880028c0ca80, invalidated=0, ffff88001a73ee47 ffff88001a73ee47 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:940 : fill_trace ffff88003abe4000 is_dentry 1 is_target 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:572 : fill_inode ffff88000fa2dda0 ino 10000001a97.fffffffffffffffe v 9307 had 9306 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXs Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:616 : ffff88000fa2dda0 mode 040755 uid.gid 1015.1015 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:527 : add_cap ffff88000fa2dda0 mds0 cap 4a2c pAsLsXsFsx seq 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXs Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:498 : marking ffff88000fa2dda0 NOT complete Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:607 : issued pAsLsXsFsx, mds wanted -, actual p, queueing Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:410 : __cap_set_timeouts ffff88000fa2dda0 min 5314 max 60314 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:426 : __cap_delay_requeue ffff88000fa2dda0 flags 0 at 4314792000 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:618 : add_cap inode ffff88000fa2dda0 (10000001a97.fffffffffffffffe) cap ffff88000fa2cda8 pAsLsXsFsx now pAsLsXsFsx seq 4 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:299 : alloc_inode ffff880021208300 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:56 : get_inode created new inode ffff880021208300 100000042ca.fffffffffffffffe ino 100000042ca Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:61 : get_inode on 1099511644874=100000042ca.fffffffffffffffe got ffff880021208300 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:907 : dn ffff88000fb3acc0 attached to ffff880021208300 ino 100000042ca.fffffffffffffffe Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:809 : update_dentry_lease ffff88000fb3acc0 mask 0 duration 0 ms ttl 4314731533 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1119 : final dn ffff88000fb3acc0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:572 : fill_inode ffff880021208300 ino 100000042ca.fffffffffffffffe v 9638 had 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:616 : ffff880021208300 mode 0100644 uid.gid 1015.1015 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:449 : size 0 -> 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:455 : truncate_seq 0 -> 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:477 : truncate_size 0 -> 18446744073709551615 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:638 : max_size 0 -> 4194304 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:527 : add_cap ffff880021208300 mds0 cap 4a5b pAsxLsXsxFsxcrwb seq 2 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:248 : get_cap ctx=ffff88003abe42d8 (2) 1036 = 11 used + 2 resv + 1023 avail Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: snap.c:150 : lookup_snap_realm 1 ffff880028c0ca80 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: snap.c:66 : get_realm ffff880028c0ca80 11 -> 12 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021208300 cap ffff88000fa2c228 issued - Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:607 : issued pAsxLsXsxFsxcrwb, mds wanted -, actual -, queueing Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:410 : __cap_set_timeouts ffff880021208300 min 5284 max 60284 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:426 : __cap_delay_requeue ffff880021208300 flags 0 at 4314792000 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:618 : add_cap inode ffff880021208300 (100000042ca.fffffffffffffffe) cap ffff88000fa2c228 pAsxLsXsxFsxcrwb now pAsxLsXsxFsxcrwb seq 2 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1179 : fill_trace done err=0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:212 : unreserve caps ctx=ffff88003abe42d8 count=1 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:221 : unreserve caps 1036 = 12 used + 0 resv + 1024 avail Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1948 : do_request waited, got 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1976 : do_request ffff88003abe4000 done, result 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: export.c:59 : encode_fh ffff88000fb3acc0 connectable Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff88000fa2dda0 mask pAsLsXsFs mode 040755 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff88000fa2dda0 cap ffff88000fa2cda8 issued pAsLsXsFsx (mask pAsLsXsFs) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff88000fa2dda0 cap ffff88000fa2cda8 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021208300 mask pAsLsXsFs mode 0100644 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021208300 cap ffff88000fa2c228 issued pAsxLsXsxFsxcrwb (mask pAsLsXsFs) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021208300 cap ffff88000fa2c228 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: export.c:148 : __cfh_to_dentry 100000042ca (10000001a97/7797581f) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: export.c:188 : __cfh_to_dentry 100000042ca ffff880021208300 dentry ffff88000fb3acc0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1502 : __do_pending_vmtruncate ffff880021208300 none pending Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021208300 cap ffff88000fa2c228 issued pAsxLsXsxFsxcrwb Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1589 : setattr ffff880021208300 issued pAsxLsXsxFsxcrwb Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1634 : setattr ffff880021208300 atime 1308614047.381249000 -> 1308614047.226531462 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1656 : setattr ffff880021208300 mtime 1308614047.381249000 -> 1308614047.226531462 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1708 : setattr ffff880021208300 ctime 1308614047.381249000 -> 1308614047.226531462 (ignored) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1349 : __mark_dirty_caps ffff880021208300 Fx dirty - -> Fx Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1356 : inode ffff880021208300 now dirty snapc ffff88000fc39ce0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:410 : __cap_set_timeouts ffff880021208300 min 5254 max 60254 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:426 : __cap_delay_requeue ffff880021208300 flags 0 at 4314791997 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1749 : setattr ffff880021208300 result=0 (Fx locally, 0 remote) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:212 : unreserve caps ctx=ffff88003bb19ad8 count=0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1502 : __do_pending_vmtruncate ffff880021208300 none pending Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021208300 mask pAsLsXsFs mode 0100644 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021208300 cap ffff88000fa2c228 issued pAsxLsXsxFsxcrwb (mask pAsLsXsFs) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021208300 cap ffff88000fa2c228 mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1861 : write_inode ffff880021208300 wait=1 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1394 : __mark_caps_flushing flushing Fx, flushing_caps - -> Fx Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1397 : inode ffff880021208300 now !dirty Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1407 : inode ffff880021208300 now flushing seq 2 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1101 : __send_cap ffff880021208300 cap ffff88000fa2c228 session ffff8800382af800 pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb (revoking -) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1113 : delaying issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb, wanted - -> - on send Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1144 : cap_flush_tid 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:946 : send_cap_msg flush 4a5b 100000042ca caps pAsxLsXsxFsxcrwb wanted - dirty Fx seq 2/2 mseq 0 follows 1 size 0/0 xattr_ver 0 xattr_len 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c599c0 front 176 Jun 20 23:54:07 scale-192-168-98-110 kernel: hpet1: lost 2 rtc interrupts Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:569 : prepare_write_ack ffff8800382af840 10 -> 11 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 9 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 9 left Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (3) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff880019c599c0 to mds0 784=client_caps len 176+0+0 ----- Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:410 : __cap_set_timeouts ffff880021208300 min 5200 max 60200 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:426 : __cap_delay_requeue ffff880021208300 flags 0 at 4314792000 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 20 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff880019c599c0 seq 13 type 784 len 176+0+0 0 pgs Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 3874034482 data_crc 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 243 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 243 left Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (3) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 4, queueing work Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1401 : got ack for seq 13 type 784 at ffff880019c599c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c599c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c599c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff8800382af840 msg (null) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 784 front 180 data 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c599c0 front 180 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff880019c599c0 180 (1795789607) + 0 (0) + 0 (0) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff880019c599c0 12 from mds0 784=client_caps len 180+0 (1795789607 0 0) ===== Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2780 : handle_caps from mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2814 : mds0 seq 3 cap seq 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2819 : op revoke ino 100000042ca.fffffffffffffffe inode ffff880021208300 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2322 : handle_cap_grant inode ffff880021208300 cap ffff88000fa2c228 mds0 seq 3 pAsLsXsFsxcrwb Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2324 : size 0 max_size 4194304, i_size 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021208300 cap ffff88000fa2c228 issued pAsxLsXsxFsxcrwb Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021208300 cap ffff88000fa2c228 issued pAsxLsXsxFsxcrwb Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: inode.c:498 : ctime 1308614047.226531462 -> 1308614047.381249000 inc w/ cap Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2409 : my wanted = -, used = -, dirty Fx Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2429 : revocation: pAsxLsXsxFsxcrwb -> pAsLsXsFsxcrwb (revoking AxXx) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021208300 cap ffff88000fa2c228 issued pAsLsXsFsxcrwb Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1518 : check_caps ffff880021208300 file_want - used - dirty - flushing Fx issued pAsLsXsFsxcrwb revoking AxXx retain pAsLsXsFs AUTHONLY NODELAY Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1567 : mds0 cap ffff88000fa2c228 issued pAsLsXsFsxcrwb implemented pAsxLsXsxFsxcrwb revoking AxXx Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1595 : completed revocation of AxXx Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1101 : __send_cap ffff880021208300 cap ffff88000fa2c228 session ffff8800382af800 pAsxLsXsxFsxcrwb -> pAsLsXsFs (revoking AxXx) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1113 : delaying issued pAsLsXsFsxcrwb -> pAsLsXsFs, wanted - -> - on send Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:946 : send_cap_msg update 4a5b 100000042ca caps pAsLsXsFsxcrwb wanted - dirty - seq 3/2 mseq 0 follows 0 size 0/0 xattr_ver 0 xattr_len 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c593c0 front 176 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2202 : ----- ffff880019c593c0 to mds0 784=client_caps len 176+0+0 ----- Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 4 -> 5 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (5) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:678 : __ceph_caps_issued ffff880021208300 cap ffff88000fa2c228 issued pAsLsXsFsxcrwb Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:1518 : check_caps ffff880021208300 file_want - used - dirty - flushing Fx issued pAsLsXsFsxcrwb revoking - retain pAsLsXsFs AUTHONLY NODELAY Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:410 : __cap_set_timeouts ffff880021208300 min 5199 max 60199 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:426 : __cap_delay_requeue ffff880021208300 flags 0 at 4314792000 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c599c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c599c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 20 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:510 : prepare_write_message ffff880019c593c0 seq 14 type 784 len 176+0+0 0 pgs Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:542 : prepare_write_message front_crc 3884515249 data_crc 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:452 : prepare_write_message_footer ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 252 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 252 left Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (4) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 5 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (3) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 4, queueing work Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 8 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:943 : prepare_read_ack ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1401 : got ack for seq 14 type 784 at ffff880019c593c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c593c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c593c0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (3) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 3 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 4 -> 5 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (5) Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 5 -> 4 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 28 nref 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff8800382af840 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 1 left Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:07 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (3) Jun 20 23:54:07 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 4, queueing work Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:133 : ceph_data_ready on ffff8800382af840 state = 4, queueing work Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 4 -> 5 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (5) Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1956 : queue_con ffff8800382af840 - already queued Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (4) Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 5 -> 4 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff8800382af840 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff8800382af840 msg (null) Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 26 front 27 data 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c593c0 front 27 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff880019c593c0 27 (2384479519) + 0 (0) + 0 (0) Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff880019c593c0 13 from mds0 26=client_reply len 27+0 (2384479519 0 0) ===== Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:2033 : handle_reply ffff88003abe4000 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:592 : __unregister_request ffff88003abe4000 tid 15 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:2112 : got safe reply 15, mds0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff88003a560f00 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff88003a560f00 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c59cc0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c59cc0 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:2199 : put_cap_refs ffff88000fa2dda0 had p Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:212 : unreserve caps ctx=ffff88003abe42d8 count=0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c593c0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c593c0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1884 : try_read got tag 7 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:959 : prepare_read_message ffff8800382af840 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1521 : read_partial_message con ffff8800382af840 msg (null) Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1574 : got hdr type 784 front 180 data 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2346 : ceph_msg_new ffff880019c593c0 front 180 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1658 : read_partial_message got msg ffff880019c593c0 180 (1842958555) + 0 (0) + 0 (0) Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1708 : ===== ffff880019c593c0 14 from mds0 784=client_caps len 180+0 (1842958555 0 0) ===== Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:2780 : handle_caps from mds0 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:2814 : mds0 seq 4 cap seq 2 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:2819 : op flush_ack ino 100000042ca.fffffffffffffffe inode ffff880021208300 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:2505 : handle_cap_flush_ack inode ffff880021208300 mds0 seq 2 on Fx cleaned Fx, flushing Fx -> - Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:2523 : inode ffff880021208300 now !flushing Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:2526 : inode ffff880021208300 now clean Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2444 : ceph_msg_put last one on ffff880019c593c0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:2429 : msg_kfree ffff880019c593c0 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: export.c:148 : __cfh_to_dentry 100000042ca (10000001a97/7797581f) Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: export.c:188 : __cfh_to_dentry 100000042ca ffff880021208300 dentry ffff88000fb3acc0 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021208300 mask As mode 0100644 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021208300 cap ffff88000fa2c228 issued pAsLsXsFsxcrwb (mask As) Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021208300 cap ffff88000fa2c228 mds0 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: inode.c:1776 : do_getattr inode ffff880021208300 mask pAsLsXsFs mode 0100644 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:753 : __ceph_caps_issued_mask ffff880021208300 cap ffff88000fa2c228 issued pAsLsXsFsxcrwb (mask pAsLsXsFs) Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: caps.c:717 : __touch_cap ffff880021208300 cap ffff88000fa2c228 mds0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:949 : prepare_read_tag ffff8800382af840 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 4 nref 1 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:569 : prepare_write_ack ffff8800382af840 12 -> 14 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 9 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 9 left Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:11 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:54:11 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:2919 : mdsc delayed_work Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: caps.c:2911 : check_delayed_caps Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:355 : lookup_mds_session ffff8800382af800 2 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 2 -> 3 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff8800382af840 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:322 : mdsc get_session ffff8800382af800 3 -> 4 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:3299 : mdsc con_get ffff8800382af800 ok (4) Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff8800382af840 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:1212 : add_cap_releases ffff8800382af800 mds0 extra 680 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:1318 : send_cap_releases mds0 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 4 -> 3 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff8800382af840 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff8800382af840 ret 0 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff8800382af840 state 28 nref 1 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff8800382af840 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff8800382af840 1 left Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff8800382af840 0 left in 0 kvecs ret = 1 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff8800382af840 ret 0 Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:3310 : mdsc con_put ffff8800382af800 (2) Jun 20 23:54:12 scale-192-168-98-110 kernel: ceph: mds_client.c:333 : mdsc put_session ffff8800382af800 3 -> 2 Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: osd_client.c:1138 : osds timeout Jun 20 23:54:12 scale-192-168-98-110 kernel: libceph: osd_client.c:707 : __remove_old_osds ffff8800121425a8 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: mon_client.c:698 : monc delayed_work Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:2273 : con_keepalive ffff88003a405800 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:393 : con_get ffff88003a405800 nref = 1 -> 2 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1959 : queue_con ffff88003a405800 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: mon_client.c:190 : __send_subscribe sub_sent=0 exp=0 want_osd=0 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: mon_client.c:179 : __schedule_delayed after 20000 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1826 : try_read start on ffff88003a405800 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1830 : try_read tag 1 in_base_pos 0 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1927 : try_read done on ffff88003a405800 ret 0 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1726 : try_write start ffff88003a405800 state 29 nref 2 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 0 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:589 : prepare_write_keepalive ffff88003a405800 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1729 : try_write out_kvec_bytes 1 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:708 : write_partial_kvec ffff88003a405800 1 left Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:736 : write_partial_kvec ffff88003a405800 0 left in 0 kvecs ret = 1 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1804 : try_write nothing else to write. Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:1807 : try_write done on ffff88003a405800 ret 0 Jun 20 23:54:13 scale-192-168-98-110 kernel: libceph: messenger.c:402 : con_put ffff88003a405800 nref = 2 -> 1