client.admin.log - CephFS - Ceph

Bug #3301 » client.admin.log

A less confusing log of chmod issue #2 - Sam Lang, 10/16/2012 10:19 AM

 -10-16 10:41:36.397409 7f6a56cae780  0 ceph version  (commit:), process ceph-fuse, pid 15222
 -10-16 10:41:36.399364 7f6a5210b700 10 client.-1 ms_handle_connect on 127.0.0.1:6789/0
 -10-16 10:41:36.401927 7f6a56cae780  2 client.4107 mounted: have osdmap 0 and mdsmap 0
 -10-16 10:41:36.401997 7f6a56cae780 10 client.4107 did not get mds through better means, so chose random mds -1
 -10-16 10:41:36.402026 7f6a56cae780 20 client.4107 mds is -1
 -10-16 10:41:36.402049 7f6a56cae780 10 client.4107  target mds.-1 not active, waiting for new mdsmap
 -10-16 10:41:36.403310 7f6a5210b700  1 client.4107 handle_mds_map epoch 19
 -10-16 10:41:36.403501 7f6a56cae780 10 client.4107 did not get mds through better means, so chose random mds 0
 -10-16 10:41:36.403505 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:41:36.403522 7f6a56cae780 10 client.4107 opening session to mds.0
 -10-16 10:41:36.403615 7f6a56cae780 10 client.4107 waiting for session to mds.0 to open
 -10-16 10:41:36.404224 7f6a5210b700 10 client.4107 ms_handle_connect on 127.0.0.1:6803/14139
 -10-16 10:41:36.411255 7f6a5210b700 10 client.4107 handle_client_session client_session(open) v1 from mds.0
 -10-16 10:41:36.411298 7f6a5210b700 10 client.4107 renew_caps mds.0
 -10-16 10:41:36.411370 7f6a5210b700 10 client.4107 connect_mds_targets for mds.0
 -10-16 10:41:36.411435 7f6a56cae780 10 client.4107 send_request rebuilding request 1 for mds.0
 -10-16 10:41:36.411476 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x3273000, mds: 0)
 -10-16 10:41:36.411502 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:41:36.411501
 -10-16 10:41:36.411540 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:1 getattr pAsLsXsFs #1) v1 to mds.0
 -10-16 10:41:36.411629 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81bbb0
 -10-16 10:41:36.411788 7f6a5210b700 10 client.4107 handle_client_session client_session(renewcaps seq 1) v1 from mds.0
 -10-16 10:41:36.413979 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 1
 -10-16 10:41:36.414005 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:36.411501 mds.0 is_target=1 is_dentry=0
 -10-16 10:41:36.414021 7f6a5210b700 10 client.4107  features 0x7fffff
 -10-16 10:41:36.414029 7f6a5210b700 10 client.4107 update_snap_trace len 48
 -10-16 10:41:36.414068 7f6a5210b700 10 client.4107 update_snap_trace snaprealm(1 nref=2 c=0 seq=0 parent=0 my_snaps=[] cached_snapc=0=[]) seq 1 > 0
 -10-16 10:41:36.414088 7f6a5210b700 10 client.4107  flushing caps on snaprealm(1 nref=2 c=0 seq=0 parent=0 my_snaps=[] cached_snapc=0=[])
 -10-16 10:41:36.414107 7f6a5210b700 10 client.4107 invalidate_snaprealm_and_children snaprealm(1 nref=2 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=0=[])
 -10-16 10:41:36.414119 7f6a5210b700 15 client.4107 update_snap_trace snaprealm(1 nref=2 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=0=[]) self|parent updated
 -10-16 10:41:36.414127 7f6a5210b700 15 client.4107   snapc 1=[]
 -10-16 10:41:36.414142 7f6a5210b700 10 client.4107  hrm  is_target=1 is_dentry=0
 -10-16 10:41:36.414197 7f6a5210b700 12 client.4107 add_update_inode adding 1.head(ref=1 cap_refs={} open={} mode=40000 size=0 mtime=0.000000 caps=- 0x3248d80) caps pAsLsXsFs
 -10-16 10:41:36.414244 7f6a5210b700 20 client.4107  dir hash is 2
 -10-16 10:41:36.414252 7f6a5210b700 10 client.4107 update_inode_file_bits 1.head(ref=1 cap_refs={} open={} mode=40755 size=0 mtime=0.000000 caps=- 0x3248d80) - mtime 2012-10-16 09:54:58.571539
 -10-16 10:41:36.414289 7f6a5210b700 15 client.4107 add_update_cap first one, opened snaprealm 0x327ac30
 -10-16 10:41:36.414318 7f6a5210b700 10 client.4107 add_update_cap issued - -> pAsLsXsFs from mds.0 on 1.head(ref=1 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:36.414364 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81bbb0
 -10-16 10:41:36.414374 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 1 0x7f6a5210a6d0
 -10-16 10:41:36.414386 7f6a56cae780 20 client.4107 sendrecv kickback on tid 1 0x7f6a5210a6d0
 -10-16 10:41:36.414397 7f6a56cae780 20 client.4107 lat 0.002894
 -10-16 10:41:36.414426 7f6a56cae780 10 client.4107 root getattr result=0
 -10-16 10:41:36.414431 7f6a56cae780 20 client.4107 _ll_get 0x3248d80 1 -> 1
 -10-16 10:41:36.417383 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:36.417430 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:36.417440 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:36.417457 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:36.417516 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:36.417538 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:36.417545 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:36.417559 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:36.417594 7f6a56cae780  3 client.4107 ll_lookup 1.head .Trash
 -10-16 10:41:36.417631 7f6a56cae780 10 client.4107 _lookup on #1/.Trash
 -10-16 10:41:36.417644 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:36.417664 7f6a56cae780 20 client.4107 choose_target_mds inode dir hash is 2 on .Trash => 571883718
 -10-16 10:41:36.417667 7f6a56cae780 20 client.4107 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) is_hash=1 hash=571883718
 -10-16 10:41:36.417685 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:36.417695 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:41:36.417712 7f6a56cae780 10 client.4107 send_request rebuilding request 2 for mds.0
 -10-16 10:41:36.417727 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x3273580, mds: 0)
 -10-16 10:41:36.417732 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:41:36.417732
 -10-16 10:41:36.417744 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:2 lookup #1/.Trash) v1 to mds.0
 -10-16 10:41:36.417799 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b3c0
 -10-16 10:41:36.418577 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 2
 -10-16 10:41:36.418585 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:36.417732 mds.0 is_target=0 is_dentry=0
 -10-16 10:41:36.418594 7f6a5210b700 10 client.4107 insert_trace -- no trace
 -10-16 10:41:36.418598 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b3c0
 -10-16 10:41:36.418602 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 2 0x7f6a5210a6d0
 -10-16 10:41:36.418613 7f6a56cae780 20 client.4107 sendrecv kickback on tid 2 0x7f6a5210a6d0
 -10-16 10:41:36.418624 7f6a56cae780 20 client.4107 lat 0.000890
 -10-16 10:41:36.418657 7f6a56cae780 10 client.4107 _lookup res is -2
 -10-16 10:41:36.418661 7f6a56cae780 10 client.4107 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) .Trash = -2
 -10-16 10:41:36.418681 7f6a56cae780  3 client.4107 ll_lookup 1.head .Trash -> -2 (0)
 -10-16 10:41:36.418786 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:36.418800 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:36.418807 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:36.418821 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:36.418855 7f6a56cae780  3 client.4107 ll_lookup 1.head .Trash-1000
 -10-16 10:41:36.418871 7f6a56cae780 10 client.4107 _lookup on #1/.Trash-1000
 -10-16 10:41:36.418878 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:36.418892 7f6a56cae780 20 client.4107 choose_target_mds inode dir hash is 2 on .Trash-1000 => 792943375
 -10-16 10:41:36.418895 7f6a56cae780 20 client.4107 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) is_hash=1 hash=792943375
 -10-16 10:41:36.418906 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:36.418916 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:41:36.418922 7f6a56cae780 10 client.4107 send_request rebuilding request 3 for mds.0
 -10-16 10:41:36.418929 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x32732c0, mds: 0)
 -10-16 10:41:36.418932 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:41:36.418932
 -10-16 10:41:36.418938 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:3 lookup #1/.Trash-1000) v1 to mds.0
 -10-16 10:41:36.418964 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b3c0
 -10-16 10:41:36.419573 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 3
 -10-16 10:41:36.419580 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:36.418932 mds.0 is_target=0 is_dentry=0
 -10-16 10:41:36.419589 7f6a5210b700 10 client.4107 insert_trace -- no trace
 -10-16 10:41:36.419592 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b3c0
 -10-16 10:41:36.419596 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 3 0x7f6a5210a6d0
 -10-16 10:41:36.419604 7f6a56cae780 20 client.4107 sendrecv kickback on tid 3 0x7f6a5210a6d0
 -10-16 10:41:36.419612 7f6a56cae780 20 client.4107 lat 0.000679
 -10-16 10:41:36.419627 7f6a56cae780 10 client.4107 _lookup res is -2
 -10-16 10:41:36.419631 7f6a56cae780 10 client.4107 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) .Trash-1000 = -2
 -10-16 10:41:36.419655 7f6a56cae780  3 client.4107 ll_lookup 1.head .Trash-1000 -> -2 (0)
 -10-16 10:41:37.402163 7f6a5310d700 10 client.4107 renew_caps()
 -10-16 10:41:37.402235 7f6a5310d700 15 client.4107 renew_caps requesting from mds.0
 -10-16 10:41:37.402261 7f6a5310d700 10 client.4107 renew_caps mds.0
 -10-16 10:41:37.404168 7f6a5210b700 10 client.4107 handle_client_session client_session(renewcaps seq 2) v1 from mds.0
 -10-16 10:41:39.725468 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:39.725546 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:39.725576 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:39.725634 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:39.725747 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:39.725774 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:39.725794 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:39.725853 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:51.517022 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:51.517243 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:51.517358 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:51.517534 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:51.517732 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:51.517770 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:51.517791 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:51.517839 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:51.517934 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:41:51.518034 7f6a56cae780 10 client.4107 _lookup on #1/fbz
 -10-16 10:41:51.518078 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:51.518171 7f6a56cae780 20 client.4107 choose_target_mds inode dir hash is 2 on fbz => 1573023337
 -10-16 10:41:51.518186 7f6a56cae780 20 client.4107 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) is_hash=1 hash=1573023337
 -10-16 10:41:51.518261 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:51.518331 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:41:51.518368 7f6a56cae780 10 client.4107 send_request rebuilding request 4 for mds.0
 -10-16 10:41:51.518416 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x3273840, mds: 0)
 -10-16 10:41:51.518446 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:41:51.518444
 -10-16 10:41:51.518481 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:4 lookup #1/fbz) v1 to mds.0
 -10-16 10:41:51.518656 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b3c0
 -10-16 10:41:51.519889 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 4
 -10-16 10:41:51.519897 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:51.518444 mds.0 is_target=0 is_dentry=1
 -10-16 10:41:51.519906 7f6a5210b700 10 client.4107  features 0x7fffff
 -10-16 10:41:51.519913 7f6a5210b700 10 client.4107 update_snap_trace len 48
 -10-16 10:41:51.519928 7f6a5210b700 10 client.4107 update_snap_trace snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 10:41:51.519943 7f6a5210b700 10 client.4107  hrm  is_target=0 is_dentry=1
 -10-16 10:41:51.519978 7f6a5210b700 12 client.4107 add_update_inode had 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) caps pAsLsXsFs
 -10-16 10:41:51.520014 7f6a5210b700 10 client.4107 add_update_cap issued pAsLsXsFs -> pAsLsXsFs from mds.0 on 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:51.520045 7f6a5210b700 20 client.4107 got dirfrag map for 1 frag * to mds 0
 -10-16 10:41:51.520081 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b3c0
 -10-16 10:41:51.520089 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 4 0x7f6a5210a6d0
 -10-16 10:41:51.520097 7f6a56cae780 20 client.4107 sendrecv kickback on tid 4 0x7f6a5210a6d0
 -10-16 10:41:51.520102 7f6a56cae780 20 client.4107 lat 0.001657
 -10-16 10:41:51.520114 7f6a56cae780 10 client.4107 _lookup res is -2
 -10-16 10:41:51.520120 7f6a56cae780 10 client.4107 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = -2
 -10-16 10:41:51.520142 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> -2 (0)
 -10-16 10:41:51.520185 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:51.520194 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:51.520199 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 09:54:58.571539 ctime 2012-10-16 09:54:58.571539
 -10-16 10:41:51.520213 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:51.520249 7f6a56cae780  3 client.4107 ll_create 1.head fbz 0100644 33345, uid 0, gid 0
 -10-16 10:41:51.520263 7f6a56cae780  3 client.4107 _mknod(1 fbz, 0100644, 0, uid 0, gid 0)
 -10-16 10:41:51.520288 7f6a56cae780 20 client.4107 get_or_create 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) name fbz
 -10-16 10:41:51.520348 7f6a56cae780 15 client.4107 link dir 0x3248d80 'fbz' to inode 0 dn 0x32809a0 (new dn)
 -10-16 10:41:51.520360 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:51.520382 7f6a56cae780 20 client.4107 choose_target_mds inode dir hash is 2 on fbz => 1573023337
 -10-16 10:41:51.520387 7f6a56cae780 20 client.4107 choose_target_mds 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) is_hash=1 hash=1573023337
 -10-16 10:41:51.520408 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:51.520431 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:41:51.520440 7f6a56cae780 10 client.4107 send_request rebuilding request 5 for mds.0
 -10-16 10:41:51.520453 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x3273580, mds: 0)
 -10-16 10:41:51.520460 7f6a56cae780 20 client.4107 encode_dentry_release enter(dn:0x32809a0)
 -10-16 10:41:51.520463 7f6a56cae780 20 client.4107 encode_inode_release enter(in:1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80), req:0x3273580 mds:0, drop:256, unless:512, have:, force:1)
 -10-16 10:41:51.520493 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:41:51.520492
 -10-16 10:41:51.520503 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:5 mknod #1/fbz) v1 to mds.0
 -10-16 10:41:51.520544 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b660
 -10-16 10:41:51.537875 7f6a5210b700 10 client.4107  mds.0 seq now 1
 -10-16 10:41:51.537884 7f6a5210b700  5 client.4107 handle_caps don't have vino 10000000003.head, dropping
 -10-16 10:41:51.538712 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 5
 -10-16 10:41:51.538724 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:51.520492 mds.0 is_target=1 is_dentry=1
 -10-16 10:41:51.538734 7f6a5210b700 10 client.4107  features 0x7fffff
 -10-16 10:41:51.538738 7f6a5210b700 10 client.4107 update_snap_trace len 48
 -10-16 10:41:51.538750 7f6a5210b700 10 client.4107 update_snap_trace snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 10:41:51.538764 7f6a5210b700 10 client.4107  hrm  is_target=1 is_dentry=1
 -10-16 10:41:51.538819 7f6a5210b700 12 client.4107 add_update_inode adding 10000000003.head(ref=0 cap_refs={} open={} mode=100000 size=0 mtime=0.000000 caps=- objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x3249680) caps pAsxLsXsxFsxcrwb
 -10-16 10:41:51.538846 7f6a5210b700 10 client.4107 update_inode_file_bits 10000000003.head(ref=0 cap_refs={} open={} mode=100644 size=0 mtime=0.000000 caps=- objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x3249680) - mtime 2012-10-16 10:41:51.525231
 -10-16 10:41:51.538869 7f6a5210b700 15 client.4107 add_update_cap first one, opened snaprealm 0x327ac30
 -10-16 10:41:51.538881 7f6a5210b700 10 client.4107 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 10000000003.head(ref=0 cap_refs={} open={} mode=100644 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x3249680)
 -10-16 10:41:51.538910 7f6a5210b700 12 client.4107 add_update_inode had 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXs(0=pAsLsXs) 0x3248d80) caps pAsLsXs
 -10-16 10:41:51.538931 7f6a5210b700 20 client.4107  dir hash is 2
 -10-16 10:41:51.538934 7f6a5210b700 10 client.4107 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 09:54:58.571539 caps=pAsLsXs(0=pAsLsXs) 0x3248d80) pAsLsXs mtime 2012-10-16 10:41:51.525231
 -10-16 10:41:51.538961 7f6a5210b700 10 client.4107 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs) 0x3248d80)
 -10-16 10:41:51.538983 7f6a5210b700 20 client.4107 got dirfrag map for 1 frag * to mds 0
 -10-16 10:41:51.539004 7f6a5210b700 12 client.4107 insert_dentry_inode 'fbz' vino 10000000003.head in dir 1.head dn 0x32809a0
 -10-16 10:41:51.539011 7f6a5210b700 15 client.4107 link dir 0x3248d80 'fbz' to inode 0x3249680 dn 0x32809a0 (old dn)
 -10-16 10:41:51.539019 7f6a5210b700 20 client.4107 link  inode 0x3249680 parents now 0x32809a0
 -10-16 10:41:51.539030 7f6a5210b700 15 client.4107  setting dn offset to 2
 -10-16 10:41:51.539034 7f6a5210b700 10 client.4107 got dentry lease on fbz dur 30000ms ttl 2012-10-16 10:42:21.520492
 -10-16 10:41:51.539056 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b660
 -10-16 10:41:51.539063 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 5 0x7f6a5210a6d0
 -10-16 10:41:51.539074 7f6a56cae780 20 client.4107 sendrecv kickback on tid 5 0x7f6a5210a6d0
 -10-16 10:41:51.539081 7f6a56cae780 20 client.4107 lat 0.018588
 -10-16 10:41:51.539091 7f6a56cae780 20 client.4107 trim_cache size 1 max 16384
 -10-16 10:41:51.539096 7f6a56cae780  3 client.4107 mknod(#1/fbz, 0100644) = 0
 -10-16 10:41:51.539127 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 10000000003.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.539147 7f6a56cae780 20 client.4107 choose_target_mds 10000000003.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) is_hash=0 hash=0
 -10-16 10:41:51.539164 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 10000000003.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.539178 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:41:51.539187 7f6a56cae780 10 client.4107 send_request rebuilding request 6 for mds.0
 -10-16 10:41:51.539195 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x3273000, mds: 0)
 -10-16 10:41:51.539199 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:41:51.539198
 -10-16 10:41:51.539204 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:6 open #10000000003) v1 to mds.0
 -10-16 10:41:51.539245 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b790
 -10-16 10:41:51.540946 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:0 tid 6
 -10-16 10:41:51.540953 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:51.539198 mds.0 is_target=1 is_dentry=0
 -10-16 10:41:51.540961 7f6a5210b700 10 client.4107  features 0x7fffff
 -10-16 10:41:51.540964 7f6a5210b700 10 client.4107 update_snap_trace len 48
 -10-16 10:41:51.540972 7f6a5210b700 10 client.4107 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 10:41:51.540984 7f6a5210b700 10 client.4107  hrm  is_target=1 is_dentry=0
 -10-16 10:41:51.540998 7f6a5210b700 12 client.4107 add_update_inode had 10000000003.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) caps pAsxLsXsxFsxcrwb
 -10-16 10:41:51.541031 7f6a5210b700 10 client.4107 update_inode_file_bits 10000000003.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) pAsxLsXsxFsxcrwb mtime 2012-10-16 10:41:51.539972
 -10-16 10:41:51.541067 7f6a5210b700 10 client.4107 add_update_cap issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 10000000003.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.539972 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.541094 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b790
 -10-16 10:41:51.541099 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 6 0x7f6a5210a6d0
 -10-16 10:41:51.541115 7f6a56cae780 20 client.4107 sendrecv kickback on tid 6 0x7f6a5210a6d0
 -10-16 10:41:51.541122 7f6a56cae780 20 client.4107 lat 0.001922
 -10-16 10:41:51.541137 7f6a56cae780 10 client.4107 _create_fh 10000000003 mode 2
 -10-16 10:41:51.541142 7f6a56cae780 20 client.4107 trim_cache size 1 max 16384
 -10-16 10:41:51.541146 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100644 mtime 2012-10-16 10:41:51.539972 ctime 2012-10-16 10:41:51.539972
 -10-16 10:41:51.541162 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 1
 -10-16 10:41:51.541167 7f6a56cae780  3 client.4107 ll_create 1.head fbz 0100644 33345 = 0 (0x3244320 10000000003)
 -10-16 10:41:51.541221 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head
 -10-16 10:41:51.541231 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:51.541238 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100644 mtime 2012-10-16 10:41:51.539972 ctime 2012-10-16 10:41:51.539972
 -10-16 10:41:51.541250 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head = 0
 -10-16 10:41:51.541303 7f6a56cae780  3 client.4107 ll_getxattr 10000000003.head security.capability size 0
 -10-16 10:41:51.541313 7f6a56cae780 10 client.4107 _getattr mask Xs issued=1
 -10-16 10:41:51.541319 7f6a56cae780  3 client.4107 _getxattr(10000000003, "security.capability", 0) = -61
 -10-16 10:41:51.541339 7f6a56cae780  3 client.4107 ll_write 0x3244320 10000000003 0~4
 -10-16 10:41:51.541351 7f6a56cae780 10 client.4107 cur file size is 0
 -10-16 10:41:51.541361 7f6a56cae780 10 client.4107 wanted_max_size 0 -> 4
 -10-16 10:41:51.541371 7f6a56cae780 10 client.4107 check_caps on 10000000003.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.539972 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) wanted pAsxXsxFxwb used - is_delayed=0
 -10-16 10:41:51.541401 7f6a56cae780 10 client.4107 cap_delay_requeue on 10000000003.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.539972 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.541426 7f6a56cae780 10 client.4107  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 10:41:51.541436 7f6a56cae780 10 client.4107 delaying cap release
 -10-16 10:41:51.541440 7f6a56cae780 10 client.4107 get_caps 10000000003.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.539972 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) have pAsxLsXsxFsxcrwb need Fw want Fb but not Fb revoking -
 -10-16 10:41:51.541472 7f6a56cae780 10 client.4107  snaprealm snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[])
 -10-16 10:41:51.541484 7f6a56cae780  5 client.4107 get_cap_ref got first FILE_BUFFER ref on 10000000003.head(ref=3 cap_refs={4096=1,8192=0} open={2=1} mode=100644 size=0 mtime=2012-10-16 10:41:51.539972 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.541743 7f6a56cae780 10 client.4107 mark_caps_dirty 10000000003.head(ref=4 cap_refs={4096=1,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 10:41:51.539972 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 4] parents=0x32809a0 0x3249680) - -> Fw
 -10-16 10:41:51.541782 7f6a56cae780  7 client.4107 wrote to 4, extending file size
 -10-16 10:41:51.541793 7f6a56cae780 10 client.4107 mark_caps_dirty 10000000003.head(ref=5 cap_refs={4096=1,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 4] parents=0x32809a0 0x3249680) Fw -> Fw
 -10-16 10:41:51.541851 7f6a56cae780  3 client.4107 ll_write 0x3244320 0~4 = 4
 -10-16 10:41:51.541880 7f6a56cae780  3 client.4107 ll_release 0x3244320 10000000003
 -10-16 10:41:51.541885 7f6a56cae780  5 client.4107 _release_fh 0x3244320 mode 2 on 10000000003.head(ref=5 cap_refs={4096=0,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 4] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.541914 7f6a56cae780 10 client.4107 _flush 10000000003.head(ref=5 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 4] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.542253 7f6a56cae780 10 client.4107 check_caps on 10000000003.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 4] parents=0x32809a0 0x3249680) wanted Fxb used Fb is_delayed=0
 -10-16 10:41:51.542277 7f6a56cae780 10 client.4107 cap_delay_requeue on 10000000003.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 4] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.542312 7f6a56cae780 10 client.4107  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 10:41:51.542327 7f6a56cae780 10 client.4107 delaying cap release
 -10-16 10:41:51.542330 7f6a56cae780 10 client.4107 put_inode on 10000000003.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 4] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.543109 7f6a5210b700 10 client.4107 ms_handle_connect on 127.0.0.1:6800/14116
 -10-16 10:41:51.549187 7f6a5210b700 10 client.4107 put_inode on 10000000003.head(ref=5 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.549301 7f6a5210b700 10 client.4107 _flushed 10000000003.head(ref=4 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.549381 7f6a5210b700 10 client.4107 _invalidate_inode_cache 10000000003.head(ref=4 cap_refs={1024=0,4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 1 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.549536 7f6a5210b700 10 client.4107 check_caps on 10000000003.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) wanted - used - is_delayed=0
 -10-16 10:41:51.549620 7f6a5210b700 10 client.4107 cap_delay_requeue on 10000000003.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.549687 7f6a5210b700 10 client.4107  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 10:41:51.549711 7f6a5210b700 10 client.4107 delaying cap release
 -10-16 10:41:51.549720 7f6a5210b700  5 client.4107 put_cap_ref dropped last FILE_BUFFER ref on 10000000003.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:51.549786 7f6a5210b700 10 client.4107 put_inode on 10000000003.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:54.734295 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 6
 -10-16 10:41:54.734330 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:51.539198 mds.0 is_target=0 is_dentry=0
 -10-16 10:41:54.734358 7f6a5210b700 10 client.4107 insert_trace -- no trace
 -10-16 10:41:54.735284 7f6a5210b700 10 client.4107  mds.0 seq now 2
 -10-16 10:41:54.735310 7f6a5210b700  5 client.4107 handle_cap_grant on in 10000000003 mds.0 seq 3 caps now pAsxLsXsxFsxcrwb was pAsxLsXsxFsxcrwb
 -10-16 10:41:54.735325 7f6a5210b700 10 client.4107 update_inode_file_bits 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) pAsxLsXsxFsxcrwb mtime 2012-10-16 10:41:51.539972
 -10-16 10:41:54.735360 7f6a5210b700 10 client.4107   caps unchanged at pAsxLsXsxFsxcrwb
 -10-16 10:41:54.784662 7f6a5210b700  1 client.4107 handle_mds_map epoch 20
 -10-16 10:41:56.447529 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:56.447602 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=0
 -10-16 10:41:56.447670 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs) 0x3248d80)
 -10-16 10:41:56.447727 7f6a56cae780 20 client.4107 choose_target_mds 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs) 0x3248d80) is_hash=0 hash=0
 -10-16 10:41:56.447772 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs) 0x3248d80)
 -10-16 10:41:56.447809 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:41:56.447833 7f6a56cae780 10 client.4107 send_request rebuilding request 7 for mds.0
 -10-16 10:41:56.447862 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x3273b00, mds: 0)
 -10-16 10:41:56.447872 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:41:56.447870
 -10-16 10:41:56.447891 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:7 getattr pAsLsXsFs #1) v1 to mds.0
 -10-16 10:41:56.448042 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b710
 -10-16 10:41:56.459369 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 7
 -10-16 10:41:56.459473 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:41:56.447870 mds.0 is_target=1 is_dentry=0
 -10-16 10:41:56.459583 7f6a5210b700 10 client.4107  features 0x7fffff
 -10-16 10:41:56.459666 7f6a5210b700 10 client.4107 update_snap_trace len 48
 -10-16 10:41:56.459768 7f6a5210b700 10 client.4107 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 10:41:56.459891 7f6a5210b700 10 client.4107  hrm  is_target=1 is_dentry=0
 -10-16 10:41:56.460016 7f6a5210b700 12 client.4107 add_update_inode had 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs) 0x3248d80) caps pAsLsXsFs
 -10-16 10:41:56.460190 7f6a5210b700 20 client.4107  dir hash is 2
 -10-16 10:41:56.460269 7f6a5210b700 10 client.4107 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs) 0x3248d80) pAsLsXs mtime 2012-10-16 10:41:51.525231
 -10-16 10:41:56.460455 7f6a5210b700 10 client.4107 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:41:56.460631 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b710
 -10-16 10:41:56.460720 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 7 0x7f6a5210a6d0
 -10-16 10:41:56.460850 7f6a56cae780 20 client.4107 sendrecv kickback on tid 7 0x7f6a5210a6d0
 -10-16 10:41:56.460882 7f6a56cae780 20 client.4107 lat 0.013008
 -10-16 10:41:56.460923 7f6a56cae780 10 client.4107 _getattr result=0
 -10-16 10:41:56.460939 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:41:56.460989 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:56.461285 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:41:56.461337 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:41:56.461389 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:56.461547 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100644 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:51.539972
 -10-16 10:41:56.461592 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 2
 -10-16 10:41:56.461603 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:41:56.461704 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head
 -10-16 10:41:56.461737 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:56.461756 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100644 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:51.539972
 -10-16 10:41:56.461810 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head = 0
 -10-16 10:41:56.461914 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:41:56.461944 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:41:56.461962 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:41:56.462002 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:41:56.462075 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:41:56.462106 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:41:56.462146 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:56.462286 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100644 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:51.539972
 -10-16 10:41:56.462332 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 3
 -10-16 10:41:56.462368 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:41:56.462458 7f6a56cae780  3 client.4107 ll_setattr 10000000003.head mask 1
 -10-16 10:41:56.462493 7f6a56cae780 10 client.4107 _setattr mask 1 issued pAsxLsXsxFsxcrwb
 -10-16 10:41:56.462512 7f6a56cae780 10 client.4107 mark_caps_dirty 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) Fw -> AxFw
 -10-16 10:41:56.462592 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:56.462511
 -10-16 10:41:56.462624 7f6a56cae780  3 client.4107 ll_setattr 10000000003.head = 0
 -10-16 10:41:57.405060 7f6a5310d700 10 client.4107 renew_caps()
 -10-16 10:41:57.405110 7f6a5310d700 15 client.4107 renew_caps requesting from mds.0
 -10-16 10:41:57.405145 7f6a5310d700 10 client.4107 renew_caps mds.0
 -10-16 10:41:57.405421 7f6a5310d700 10 client.4107 check_caps on 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=AxFw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) wanted - used - is_delayed=1
 -10-16 10:41:57.405593 7f6a5310d700 10 client.4107  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 10:41:57.405663 7f6a5310d700 10 client.4107 mark_caps_flushing AxFw 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=AxFw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:41:57.405889 7f6a5310d700 10 client.4107 send_cap 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=AxFw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) mds.0 seq 3 used - want - flush AxFw retain pAsLsXsFs held pAsxLsXsxFsxcrwb revoking - dropping AxXxFxcrwb
 -10-16 10:41:57.406188 7f6a5310d700 15 client.4107 auth cap, setting max_size = 4
 -10-16 10:41:57.407506 7f6a5210b700 10 client.4107 handle_client_session client_session(renewcaps seq 3) v1 from mds.0
 -10-16 10:41:59.733512 7f6a5210b700 10 client.4107  mds.0 seq now 3
 -10-16 10:41:59.733568 7f6a5210b700  5 client.4107 handle_cap_flush_ack mds.0 cleaned AxFw on 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) flushing_caps=AxFw objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) with AxFw
 -10-16 10:41:59.733695 7f6a5210b700  5 client.4107   flushing_caps AxFw -> -
 -10-16 10:41:59.733713 7f6a5210b700 10 client.4107  10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) !flushing
 -10-16 10:41:59.733801 7f6a5210b700 10 client.4107 put_inode on 10000000003.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:00.445332 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:00.445398 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:00.445421 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:00.445459 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:00.445546 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:00.445570 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:00.445583 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:00.445609 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:00.445683 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:42:00.445718 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:42:00.445754 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:00.445866 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:56.462511
 -10-16 10:42:00.445895 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 4
 -10-16 10:42:00.445908 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:42:00.445985 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head
 -10-16 10:42:00.446009 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:00.446022 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:56.462511
 -10-16 10:42:00.446056 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head = 0
 -10-16 10:42:00.446154 7f6a56cae780  3 client.4107 ll_open 10000000003.head 33793
 -10-16 10:42:00.446184 7f6a56cae780  3 client.4107 ll_open 10000000003.head 33793 = -13 (0)
 -10-16 10:42:06.607230 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:06.607296 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:06.607319 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:06.607384 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:06.607475 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:42:06.607509 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:42:06.607545 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:06.607644 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:56.462511
 -10-16 10:42:06.607669 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 5
 -10-16 10:42:06.607676 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:42:06.607772 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head
 -10-16 10:42:06.607795 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:06.607817 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:56.462511
 -10-16 10:42:06.607845 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head = 0
 -10-16 10:42:06.607987 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:06.608026 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:06.608044 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:06.608094 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:06.608166 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:42:06.608194 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:42:06.608226 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:06.608327 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:41:56.462511
 -10-16 10:42:06.608352 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 6
 -10-16 10:42:06.608359 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:42:06.608459 7f6a56cae780  3 client.4107 ll_setattr 10000000003.head mask 1
 -10-16 10:42:06.608487 7f6a56cae780 10 client.4107 _setattr mask 1 issued pAsLsXsFs
 -10-16 10:42:06.608554 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:06.608621 7f6a56cae780 20 client.4107 choose_target_mds 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) is_hash=0 hash=0
 -10-16 10:42:06.608677 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:06.608727 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:42:06.608749 7f6a56cae780 10 client.4107 send_request rebuilding request 8 for mds.0
 -10-16 10:42:06.608787 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x32732c0, mds: 0)
 -10-16 10:42:06.608794 7f6a56cae780 20 client.4107 encode_inode_release enter(in:10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680), req:0x32732c0 mds:0, drop:4, unless:0, have:, force:0)
 -10-16 10:42:06.608872 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:42:06.608871
 -10-16 10:42:06.608897 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:8 setattr mode=064331882 #10000000003) v1 to mds.0
 -10-16 10:42:06.609021 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b6b0
 -10-16 10:42:06.617586 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:0 tid 8
 -10-16 10:42:06.617612 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:42:06.608871 mds.0 is_target=1 is_dentry=0
 -10-16 10:42:06.617642 7f6a5210b700 10 client.4107  features 0x7fffff
 -10-16 10:42:06.617653 7f6a5210b700 10 client.4107 update_snap_trace len 48
 -10-16 10:42:06.617687 7f6a5210b700 10 client.4107 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 10:42:06.617729 7f6a5210b700 10 client.4107  hrm  is_target=1 is_dentry=0
 -10-16 10:42:06.617783 7f6a5210b700 12 client.4107 add_update_inode had 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFs(0=pLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) caps pLsXsFscr
 -10-16 10:42:06.617897 7f6a5210b700 10 client.4107 update_inode_file_bits 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFs(0=pLsXsFs) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) pAxLsXsxFsxcrwb mtime 2012-10-16 10:41:51.541792
 -10-16 10:42:06.618018 7f6a5210b700 10 client.4107 add_update_cap issued pLsXsFs -> pLsXsFscr from mds.0 on 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:06.618089 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b6b0
 -10-16 10:42:06.618103 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 8 0x7f6a5210a6d0
 -10-16 10:42:06.618131 7f6a56cae780 20 client.4107 sendrecv kickback on tid 8 0x7f6a5210a6d0
 -10-16 10:42:06.618159 7f6a56cae780 20 client.4107 lat 0.009284
 -10-16 10:42:06.618203 7f6a56cae780 10 client.4107 _setattr result=0
 -10-16 10:42:06.618217 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:42:06.613066
 -10-16 10:42:06.618271 7f6a56cae780  3 client.4107 ll_setattr 10000000003.head = 0
 -10-16 10:42:09.736239 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 8
 -10-16 10:42:09.736255 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:42:06.608871 mds.0 is_target=0 is_dentry=0
 -10-16 10:42:09.736280 7f6a5210b700 10 client.4107 insert_trace -- no trace
 -10-16 10:42:10.864366 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:10.864430 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:10.864453 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:10.864490 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:10.864627 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:42:10.864669 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:42:10.864708 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:10.864807 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:42:06.613066
 -10-16 10:42:10.864857 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 7
 -10-16 10:42:10.864865 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:42:10.864946 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head
 -10-16 10:42:10.864970 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=0
 -10-16 10:42:10.865035 7f6a56cae780 20 client.4107 choose_target_mds starting with req->inode 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:10.865098 7f6a56cae780 20 client.4107 choose_target_mds 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) is_hash=0 hash=0
 -10-16 10:42:10.865156 7f6a56cae780 10 client.4107 choose_target_mds from caps on inode 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:10.865220 7f6a56cae780 20 client.4107 mds is 0
 -10-16 10:42:10.865267 7f6a56cae780 10 client.4107 send_request rebuilding request 9 for mds.0
 -10-16 10:42:10.865299 7f6a56cae780 20 client.4107 encode_cap_releases enter (req: 0x32748c0, mds: 0)
 -10-16 10:42:10.865311 7f6a56cae780 20 client.4107 send_request set sent_stamp to 2012-10-16 10:42:10.865308
 -10-16 10:42:10.865331 7f6a56cae780 10 client.4107 send_request client_request(unknown.0:9 getattr pAsLsXsFs #10000000003) v1 to mds.0
 -10-16 10:42:10.865465 7f6a56cae780 20 client.4107 awaiting reply|forward|kick on 0x7ffffa81b710
 -10-16 10:42:10.870294 7f6a5210b700 20 client.4107 handle_client_reply got a reply. Safe:1 tid 9
 -10-16 10:42:10.870319 7f6a5210b700 10 client.4107 insert_trace from 2012-10-16 10:42:10.865308 mds.0 is_target=1 is_dentry=0
 -10-16 10:42:10.870351 7f6a5210b700 10 client.4107  features 0x7fffff
 -10-16 10:42:10.870359 7f6a5210b700 10 client.4107 update_snap_trace len 48
 -10-16 10:42:10.870385 7f6a5210b700 10 client.4107 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 10:42:10.870413 7f6a5210b700 10 client.4107  hrm  is_target=1 is_dentry=0
 -10-16 10:42:10.870457 7f6a5210b700 12 client.4107 add_update_inode had 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) caps pAsLsXsFscr
 -10-16 10:42:10.870561 7f6a5210b700 10 client.4107 update_inode_file_bits 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) pAxLsXsxFsxcrwb mtime 2012-10-16 10:41:51.541792
 -10-16 10:42:10.870689 7f6a5210b700 10 client.4107 add_update_cap issued pLsXsFscr -> pAsLsXsFscr from mds.0 on 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:10.870803 7f6a5210b700 20 client.4107 handle_client_reply signalling caller 0x7ffffa81b710
 -10-16 10:42:10.870823 7f6a5210b700 20 client.4107 handle_client_reply awaiting kickback on tid 9 0x7f6a5210a6d0
 -10-16 10:42:10.870850 7f6a56cae780 20 client.4107 sendrecv kickback on tid 9 0x7f6a5210a6d0
 -10-16 10:42:10.870864 7f6a56cae780 20 client.4107 lat 0.005552
 -10-16 10:42:10.870899 7f6a56cae780 10 client.4107 _getattr result=0
 -10-16 10:42:10.870911 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:42:06.613066
 -10-16 10:42:10.870940 7f6a56cae780  3 client.4107 ll_getattr 10000000003.head = 0
 -10-16 10:42:10.871111 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:10.871141 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:10.871168 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:10.871205 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:10.871270 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:42:10.871297 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:42:10.871328 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:10.871421 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:42:06.613066
 -10-16 10:42:10.871447 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 8
 -10-16 10:42:10.871455 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:42:10.871517 7f6a56cae780  3 client.4107 ll_getxattr 10000000003.head security.selinux size 255
 -10-16 10:42:10.871538 7f6a56cae780 10 client.4107 _getattr mask Xs issued=1
 -10-16 10:42:10.871550 7f6a56cae780  3 client.4107 _getxattr(10000000003, "security.selinux", 255) = -61
 -10-16 10:42:10.871628 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:10.871644 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:10.871656 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:10.871683 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:10.871733 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:42:10.871758 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:42:10.871798 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:10.871925 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:42:06.613066
 -10-16 10:42:10.871950 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 9
 -10-16 10:42:10.871959 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:42:10.872016 7f6a56cae780  3 client.4107 ll_getxattr 10000000003.head system.posix_acl_access size 0
 -10-16 10:42:10.872037 7f6a56cae780 10 client.4107 _getattr mask Xs issued=1
 -10-16 10:42:10.872048 7f6a56cae780  3 client.4107 _getxattr(10000000003, "system.posix_acl_access", 0) = -61
 -10-16 10:42:10.872100 7f6a56cae780  3 client.4107 ll_getattr 1.head
 -10-16 10:42:10.872115 7f6a56cae780 10 client.4107 _getattr mask pAsLsXsFs issued=1
 -10-16 10:42:10.872126 7f6a56cae780 10 client.4107 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 10:42:10.872152 7f6a56cae780  3 client.4107 ll_getattr 1.head = 0
 -10-16 10:42:10.872218 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz
 -10-16 10:42:10.872251 7f6a56cae780 20 client.4107 _lookup have dn fbz mds.0 ttl 2012-10-16 10:42:21.520492 seq 2
 -10-16 10:42:10.872290 7f6a56cae780 10 client.4107 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) fbz = 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:10.872425 7f6a56cae780 10 client.4107 fill_stat on 10000000003 snap/devhead mode 0100400 mtime 2012-10-16 10:41:51.541792 ctime 2012-10-16 10:42:06.613066
 -10-16 10:42:10.872473 7f6a56cae780 20 client.4107 _ll_get 0x3249680 10000000003 -> 10
 -10-16 10:42:10.872484 7f6a56cae780  3 client.4107 ll_lookup 1.head fbz -> 0 (10000000003)
 -10-16 10:42:10.875176 7f6a56cae780  3 client.4107 ll_getxattr 10000000003.head system.posix_acl_default size 0
 -10-16 10:42:10.875222 7f6a56cae780 10 client.4107 _getattr mask Xs issued=1
 -10-16 10:42:10.875264 7f6a56cae780  3 client.4107 _getxattr(10000000003, "system.posix_acl_default", 0) = -61
 -10-16 10:42:17.407947 7f6a5310d700 10 client.4107 renew_caps()
 -10-16 10:42:17.407994 7f6a5310d700 15 client.4107 renew_caps requesting from mds.0
 -10-16 10:42:17.408056 7f6a5310d700 10 client.4107 renew_caps mds.0
 -10-16 10:42:17.409858 7f6a5210b700 10 client.4107 handle_client_session client_session(renewcaps seq 4) v1 from mds.0
 -10-16 10:42:17.560499 7f6a56cae780  3 client.4107 ll_forget 10000000003.head 10
 -10-16 10:42:17.560571 7f6a56cae780 20 client.4107 _ll_put 0x3249680 10000000003 10 -> 0
 -10-16 10:42:17.560591 7f6a56cae780 10 client.4107 put_inode on 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:17.561380 7f6a56cae780  3 client.4107 ll_forget 1.head 1
 -10-16 10:42:17.562658 7f6a56cae780  2 client.4107 unmounting
 -10-16 10:42:17.562706 7f6a56cae780 10 client.4107 put_inode on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:42:17.562784 7f6a56cae780 10 client.4107 _ll_drop_pins
 -10-16 10:42:17.562823 7f6a56cae780 20 client.4107 _ll_put 0x3248d80 1 1 -> 0
 -10-16 10:42:17.562830 7f6a56cae780 10 client.4107 put_inode on 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:42:17.562920 7f6a56cae780 10 client.4107 _flush 1.head(ref=2 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:42:17.562989 7f6a56cae780 10 client.4107  nothing to flush
 -10-16 10:42:17.562994 7f6a56cae780 10 client.4107 put_inode on 1.head(ref=2 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80)
 -10-16 10:42:17.563037 7f6a56cae780 10 client.4107 _flush 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:17.563164 7f6a56cae780 10 client.4107  nothing to flush
 -10-16 10:42:17.563170 7f6a56cae780 10 client.4107 put_inode on 10000000003.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680)
 -10-16 10:42:17.563219 7f6a56cae780 10 client.4107 flush_caps
 -10-16 10:42:17.563230 7f6a56cae780 10 client.4107 check_caps on 1.head(ref=1 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) wanted - used - is_delayed=1
 -10-16 10:42:17.563273 7f6a56cae780 10 client.4107  cap mds.0 issued pAsLsXsFs implemented pAsLsXsFs revoking -
 -10-16 10:42:17.563293 7f6a56cae780 10 client.4107 send_cap 1.head(ref=1 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs) 0x3248d80) mds.0 seq 4 used - want - flush - retain p held pAsLsXsFs revoking - dropping AsLsXsFs
 -10-16 10:42:17.563357 7f6a56cae780 15 client.4107 auth cap, setting max_size = 0
 -10-16 10:42:17.563490 7f6a56cae780 10 client.4107 check_caps on 10000000003.head(ref=1 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) wanted - used - is_delayed=1
 -10-16 10:42:17.563574 7f6a56cae780 10 client.4107  cap mds.0 issued pAsLsXsFscr implemented pAsxLsXsxFsxcrwb revoking AxXxFxwb
 -10-16 10:42:17.563602 7f6a56cae780 10 client.4107 completed revocation of AxXxFxwb
 -10-16 10:42:17.563614 7f6a56cae780 10 client.4107 send_cap 10000000003.head(ref=1 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x32809a0 0x3249680) mds.0 seq 5 used - want - flush - retain p held pAsxLsXsxFsxcrwb revoking AxXxFxwb dropping AsLsXsFscr
 -10-16 10:42:17.563703 7f6a56cae780 15 client.4107 auth cap, setting max_size = 4
 -10-16 10:42:17.563780 7f6a56cae780 10 client.4107 wait_sync_caps want 1 (last is 1, 0 total flushing)
 -10-16 10:42:17.563792 7f6a56cae780 20 client.4107 trim_cache size 1 max 0
 -10-16 10:42:17.563800 7f6a56cae780 15 client.4107 trim_dentry unlinking dn fbz in dir 1
 -10-16 10:42:17.563808 7f6a56cae780 15 client.4107 unlink dir 0x3248d80 'fbz' dn 0x32809a0 inode 0x3249680
 -10-16 10:42:17.563828 7f6a56cae780 20 client.4107 unlink  inode 0x3249680 parents now
 -10-16 10:42:17.563834 7f6a56cae780 10 client.4107 put_inode on 10000000003.head(ref=1 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=p(0=p) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x3249680)
 -10-16 10:42:17.563877 7f6a56cae780 10 client.4107 remove_cap mds.0 on 10000000003.head(ref=0 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=p(0=p) objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x3249680)
 -10-16 10:42:17.563961 7f6a56cae780 15 client.4107 remove_cap last one, closing snaprealm 0x327ac30
 -10-16 10:42:17.563969 7f6a56cae780 10 client.4107 put_inode deleting 10000000003.head(ref=0 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 10:41:51.541792 caps=- objectset[10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x3249680)
 -10-16 10:42:17.564059 7f6a56cae780 15 client.4107 close_dir dir 0x3280a10 on 0x3248d80
 -10-16 10:42:17.564085 7f6a56cae780 10 client.4107 put_inode on 1.head(ref=1 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=p(0=p) 0x3248d80)
 -10-16 10:42:17.564134 7f6a56cae780 10 client.4107 remove_cap mds.0 on 1.head(ref=0 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=p(0=p) 0x3248d80)
 -10-16 10:42:17.564210 7f6a56cae780 15 client.4107 remove_cap last one, closing snaprealm 0x327ac30
 -10-16 10:42:17.564217 7f6a56cae780 10 client.4107 put_inode deleting 1.head(ref=0 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=- 0x3248d80)
 -10-16 10:42:17.564266 7f6a56cae780  2 client.4107 sending client_session close to mds.0 seq 3
 -10-16 10:42:17.564340 7f6a56cae780  2 client.4107 waiting for 1 mds sessions to close
 -10-16 10:42:17.591555 7f6a5210b700 10 client.4107 handle_client_session client_session(close) v1 from mds.0
 -10-16 10:42:17.591599 7f6a5210b700 10 client.4107 kick_requests for mds.0
 -10-16 10:42:17.591676 7f6a5210b700 10 client.4107 unmounting: trim pass, size was 0+0
 -10-16 10:42:17.591692 7f6a5210b700 20 client.4107 trim_cache size 0 max 0
 -10-16 10:42:17.591702 7f6a5210b700 10 client.4107 unmounting: trim pass, cache now empty, waking unmount()
 -10-16 10:42:17.591826 7f6a56cae780  2 client.4107 unmounted.
 -10-16 10:42:17.591858 7f6a56cae780  1 client.4107 shutdown
 -10-16 10:42:17.594101 7f6a56cae780 20 client.4107 trim_cache size 0 max 0
 -10-16 11:05:07.225450 7ffff7fd3780  0 ceph version  (commit:), process ceph-fuse, pid 15600
 -10-16 11:05:07.238670 7ffff3431700 10 client.-1 ms_handle_connect on 127.0.0.1:6789/0
 -10-16 11:05:07.242366 7ffff7fd3780  2 client.4110 mounted: have osdmap 0 and mdsmap 0
 -10-16 11:05:07.242415 7ffff7fd3780 10 client.4110 did not get mds through better means, so chose random mds -1
 -10-16 11:05:07.242421 7ffff7fd3780 20 client.4110 mds is -1
 -10-16 11:05:07.242424 7ffff7fd3780 10 client.4110  target mds.-1 not active, waiting for new mdsmap
 -10-16 11:05:07.243728 7ffff3431700  1 client.4110 handle_mds_map epoch 21
 -10-16 11:05:07.243877 7ffff7fd3780 10 client.4110 did not get mds through better means, so chose random mds 1
 -10-16 11:05:07.243882 7ffff7fd3780 20 client.4110 mds is 1
 -10-16 11:05:07.243896 7ffff7fd3780 10 client.4110 opening session to mds.1
 -10-16 11:05:07.244560 7ffff7fd3780 10 client.4110 waiting for session to mds.1 to open
 -10-16 11:05:07.245441 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6804/14221
 -10-16 11:05:07.256154 7ffff3431700 10 client.4110 handle_client_session client_session(open) v1 from mds.1
 -10-16 11:05:07.256172 7ffff3431700 10 client.4110 renew_caps mds.1
 -10-16 11:05:07.256221 7ffff3431700 10 client.4110 connect_mds_targets for mds.1
 -10-16 11:05:07.256285 7ffff7fd3780 10 client.4110 send_request rebuilding request 1 for mds.1
 -10-16 11:05:07.256308 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b8000, mds: 1)
 -10-16 11:05:07.256315 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:07.256314
 -10-16 11:05:07.256337 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:1 getattr pAsLsXsFs #1) v1 to mds.1
 -10-16 11:05:07.256394 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd990
 -10-16 11:05:07.256931 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 1) v1 from mds.1
 -10-16 11:05:07.257186 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 1
 -10-16 11:05:07.257196 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:07.256314 mds.1 is_target=1 is_dentry=0
 -10-16 11:05:07.257203 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:05:07.257207 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:05:07.257220 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=2 c=0 seq=0 parent=0 my_snaps=[] cached_snapc=0=[]) seq 1 > 0
 -10-16 11:05:07.257231 7ffff3431700 10 client.4110  flushing caps on snaprealm(1 nref=2 c=0 seq=0 parent=0 my_snaps=[] cached_snapc=0=[])
 -10-16 11:05:07.257242 7ffff3431700 10 client.4110 invalidate_snaprealm_and_children snaprealm(1 nref=2 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=0=[])
 -10-16 11:05:07.257249 7ffff3431700 15 client.4110 update_snap_trace snaprealm(1 nref=2 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=0=[]) self|parent updated
 -10-16 11:05:07.257253 7ffff3431700 15 client.4110   snapc 1=[]
 -10-16 11:05:07.257261 7ffff3431700 10 client.4110  hrm  is_target=1 is_dentry=0
 -10-16 11:05:07.257286 7ffff3431700 12 client.4110 add_update_inode adding 1.head(ref=1 cap_refs={} open={} mode=40000 size=0 mtime=0.000000 caps=- 0x198dd80) caps pAsLsXsFs
 -10-16 11:05:07.257301 7ffff3431700 20 client.4110  dir hash is 2
 -10-16 11:05:07.257304 7ffff3431700 10 client.4110 update_inode_file_bits 1.head(ref=1 cap_refs={} open={} mode=40755 size=0 mtime=0.000000 caps=- 0x198dd80) - mtime 2012-10-16 10:41:51.525231
 -10-16 11:05:07.257319 7ffff3431700 15 client.4110 add_update_cap first one, opened snaprealm 0x19bec30
 -10-16 11:05:07.257328 7ffff3431700 10 client.4110 add_update_cap issued - -> pAsLsXsFs from mds.1 on 1.head(ref=1 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:07.257345 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd990
 -10-16 11:05:07.257348 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 1 0x7ffff34306d0
 -10-16 11:05:07.257355 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 1 0x7ffff34306d0
 -10-16 11:05:07.257361 7ffff7fd3780 20 client.4110 lat 0.001046
 -10-16 11:05:07.257375 7ffff7fd3780 10 client.4110 root getattr result=0
 -10-16 11:05:07.257380 7ffff7fd3780 20 client.4110 _ll_get 0x198dd80 1 -> 1
 -10-16 11:05:07.260275 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:07.260322 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:07.260333 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 09:49:34.805435
 -10-16 11:05:07.260355 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:07.260407 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:07.260422 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:07.260428 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 09:49:34.805435
 -10-16 11:05:07.260440 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:07.260461 7ffff7fd3780  3 client.4110 ll_lookup 1.head .Trash
 -10-16 11:05:07.260505 7ffff7fd3780 10 client.4110 _lookup on #1/.Trash
 -10-16 11:05:07.260526 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:07.260549 7ffff7fd3780 20 client.4110 choose_target_mds inode dir hash is 2 on .Trash => 571883718
 -10-16 11:05:07.260553 7ffff7fd3780 20 client.4110 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80) is_hash=1 hash=571883718
 -10-16 11:05:07.260578 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:07.260596 7ffff7fd3780 20 client.4110 mds is 1
 -10-16 11:05:07.260617 7ffff7fd3780 10 client.4110 send_request rebuilding request 2 for mds.1
 -10-16 11:05:07.260641 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b8580, mds: 1)
 -10-16 11:05:07.260647 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:07.260647
 -10-16 11:05:07.260662 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:2 lookup #1/.Trash) v1 to mds.1
 -10-16 11:05:07.260734 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd1a0
 -10-16 11:05:07.262262 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 2
 -10-16 11:05:07.262267 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:07.260647 mds.1 is_target=0 is_dentry=0
 -10-16 11:05:07.262274 7ffff3431700 10 client.4110 insert_trace -- no trace
 -10-16 11:05:07.262277 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd1a0
 -10-16 11:05:07.262279 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 2 0x7ffff34306d0
 -10-16 11:05:07.262286 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 2 0x7ffff34306d0
 -10-16 11:05:07.262292 7ffff7fd3780 20 client.4110 lat 0.001644
 -10-16 11:05:07.262306 7ffff7fd3780 10 client.4110 _lookup res is -2
 -10-16 11:05:07.262311 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80) .Trash = -2
 -10-16 11:05:07.262331 7ffff7fd3780  3 client.4110 ll_lookup 1.head .Trash -> -2 (0)
 -10-16 11:05:07.262416 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:07.262426 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:07.262431 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 09:49:34.805435
 -10-16 11:05:07.262444 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:07.262464 7ffff7fd3780  3 client.4110 ll_lookup 1.head .Trash-1000
 -10-16 11:05:07.262486 7ffff7fd3780 10 client.4110 _lookup on #1/.Trash-1000
 -10-16 11:05:07.262496 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:07.262516 7ffff7fd3780 20 client.4110 choose_target_mds inode dir hash is 2 on .Trash-1000 => 792943375
 -10-16 11:05:07.262520 7ffff7fd3780 20 client.4110 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80) is_hash=1 hash=792943375
 -10-16 11:05:07.262538 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:07.262554 7ffff7fd3780 20 client.4110 mds is 1
 -10-16 11:05:07.262562 7ffff7fd3780 10 client.4110 send_request rebuilding request 3 for mds.1
 -10-16 11:05:07.262574 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b82c0, mds: 1)
 -10-16 11:05:07.262579 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:07.262578
 -10-16 11:05:07.262587 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:3 lookup #1/.Trash-1000) v1 to mds.1
 -10-16 11:05:07.262626 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd1a0
 -10-16 11:05:07.262941 7ffff3431700 10 client.4110 handle_client_request tid 3 fwd 1 to mds.0, resending to 0
 -10-16 11:05:07.262955 7ffff7fd3780 10 client.4110 choose_target_mds resend_mds specified as mds.0
 -10-16 11:05:07.262960 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:05:07.262972 7ffff7fd3780 10 client.4110 opening session to mds.0
 -10-16 11:05:07.264793 7ffff7fd3780 10 client.4110 waiting for session to mds.0 to open
 -10-16 11:05:07.265785 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6803/14139
 -10-16 11:05:07.274776 7ffff3431700 10 client.4110 handle_client_session client_session(open) v1 from mds.0
 -10-16 11:05:07.274800 7ffff3431700 10 client.4110 renew_caps mds.0
 -10-16 11:05:07.274883 7ffff3431700 10 client.4110 connect_mds_targets for mds.0
 -10-16 11:05:07.274959 7ffff7fd3780 10 client.4110 send_request rebuilding request 3 for mds.0
 -10-16 11:05:07.274997 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b82c0, mds: 0)
 -10-16 11:05:07.275008 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:07.275007
 -10-16 11:05:07.275032 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:3 lookup #1/.Trash-1000) v1 to mds.0
 -10-16 11:05:07.275166 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd1a0
 -10-16 11:05:07.276175 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 1) v1 from mds.0
 -10-16 11:05:07.277036 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 3
 -10-16 11:05:07.277053 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:07.275007 mds.0 is_target=0 is_dentry=0
 -10-16 11:05:07.277077 7ffff3431700 10 client.4110 insert_trace -- no trace
 -10-16 11:05:07.277088 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd1a0
 -10-16 11:05:07.277102 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 3 0x7ffff34306d0
 -10-16 11:05:07.277122 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 3 0x7ffff34306d0
 -10-16 11:05:07.277139 7ffff7fd3780 20 client.4110 lat 0.002130
 -10-16 11:05:07.277167 7ffff7fd3780 10 client.4110 _lookup res is -2
 -10-16 11:05:07.277180 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80) .Trash-1000 = -2
 -10-16 11:05:07.277245 7ffff7fd3780  3 client.4110 ll_lookup 1.head .Trash-1000 -> -2 (0)
 -10-16 11:05:08.242516 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:05:08.242553 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:05:08.242583 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:05:08.242762 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:05:08.242792 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:05:08.244250 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 2) v1 from mds.0
 -10-16 11:05:08.244412 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 2) v1 from mds.1
 -10-16 11:05:10.638632 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:10.638721 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:10.638754 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 09:49:34.805435
 -10-16 11:05:10.638794 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:10.638889 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:10.638913 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:10.638925 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 09:49:34.805435
 -10-16 11:05:10.638953 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:19.126418 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:19.126498 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:19.126529 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 09:49:34.805435
 -10-16 11:05:19.126586 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:19.126694 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:19.126721 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:19.126740 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 09:49:34.805435
 -10-16 11:05:19.126781 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:19.126868 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:05:19.126963 7ffff7fd3780 10 client.4110 _lookup on #1/a11
 -10-16 11:05:19.127002 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:19.127122 7ffff7fd3780 20 client.4110 choose_target_mds inode dir hash is 2 on a11 => 309854497
 -10-16 11:05:19.127144 7ffff7fd3780 20 client.4110 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80) is_hash=1 hash=309854497
 -10-16 11:05:19.127224 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:19.127292 7ffff7fd3780 20 client.4110 mds is 1
 -10-16 11:05:19.127321 7ffff7fd3780 10 client.4110 send_request rebuilding request 4 for mds.1
 -10-16 11:05:19.127354 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b8840, mds: 1)
 -10-16 11:05:19.127364 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:19.127363
 -10-16 11:05:19.127388 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:4 lookup #1/a11) v1 to mds.1
 -10-16 11:05:19.127508 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd1a0
 -10-16 11:05:19.129000 7ffff3431700 10 client.4110 handle_client_request tid 4 fwd 1 to mds.0, resending to 0
 -10-16 11:05:19.129050 7ffff7fd3780 10 client.4110 choose_target_mds resend_mds specified as mds.0
 -10-16 11:05:19.129062 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:05:19.129087 7ffff7fd3780 10 client.4110 send_request rebuilding request 4 for mds.0
 -10-16 11:05:19.129125 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b8840, mds: 0)
 -10-16 11:05:19.129135 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:19.129134
 -10-16 11:05:19.129156 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:4 lookup #1/a11) v1 to mds.0
 -10-16 11:05:19.129253 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd1a0
 -10-16 11:05:19.131867 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 4
 -10-16 11:05:19.131895 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:19.129134 mds.0 is_target=0 is_dentry=1
 -10-16 11:05:19.131952 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:05:19.131966 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:05:19.132036 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 11:05:19.132090 7ffff3431700 10 client.4110  hrm  is_target=0 is_dentry=1
 -10-16 11:05:19.132212 7ffff3431700 12 client.4110 add_update_inode had 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80) caps pAsLsXsFs
 -10-16 11:05:19.132285 7ffff3431700 20 client.4110  dir hash is 2
 -10-16 11:05:19.132295 7ffff3431700 10 client.4110 update_inode_file_bits 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(1=pAsLsXsFs) 0x198dd80) pAsLsXsFs mtime 2012-10-16 10:41:51.525231
 -10-16 11:05:19.132418 7ffff3431700 10 client.4110 add_update_cap issued - -> pAsLsXsFs from mds.0 on 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:19.132498 7ffff3431700 20 client.4110 got dirfrag map for 1 frag * to mds 0
 -10-16 11:05:19.132605 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd1a0
 -10-16 11:05:19.132629 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 4 0x7ffff34306d0
 -10-16 11:05:19.132695 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 4 0x7ffff34306d0
 -10-16 11:05:19.132727 7ffff7fd3780 20 client.4110 lat 0.003590
 -10-16 11:05:19.132760 7ffff7fd3780 10 client.4110 _lookup res is -2
 -10-16 11:05:19.132790 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x198dd80) a11 = -2
 -10-16 11:05:19.132856 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> -2 (0)
 -10-16 11:05:19.132967 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:19.132995 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:19.133009 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 10:41:51.525231 ctime 2012-10-16 10:41:51.525231
 -10-16 11:05:19.133042 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:19.133142 7ffff7fd3780  3 client.4110 ll_create 1.head a11 0100644 33345, uid 0, gid 0
 -10-16 11:05:19.133177 7ffff7fd3780  3 client.4110 _mknod(1 a11, 0100644, 0, uid 0, gid 0)
 -10-16 11:05:19.133231 7ffff7fd3780 20 client.4110 get_or_create 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x198dd80) name a11
 -10-16 11:05:19.133404 7ffff7fd3780 15 client.4110 link dir 0x198dd80 'a11' to inode 0 dn 0x19f22a0 (new dn)
 -10-16 11:05:19.133429 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:19.133484 7ffff7fd3780 20 client.4110 choose_target_mds inode dir hash is 2 on a11 => 309854497
 -10-16 11:05:19.133492 7ffff7fd3780 20 client.4110 choose_target_mds 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x198dd80) is_hash=1 hash=309854497
 -10-16 11:05:19.133543 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x198dd80)
 -10-16 11:05:19.133589 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:05:19.133612 7ffff7fd3780 10 client.4110 send_request rebuilding request 5 for mds.0
 -10-16 11:05:19.133639 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b8580, mds: 0)
 -10-16 11:05:19.133646 7ffff7fd3780 20 client.4110 encode_dentry_release enter(dn:0x19f22a0)
 -10-16 11:05:19.133652 7ffff7fd3780 20 client.4110 encode_inode_release enter(in:1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x198dd80), req:0x19b8580 mds:0, drop:256, unless:512, have:, force:1)
 -10-16 11:05:19.133742 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:19.133741
 -10-16 11:05:19.133765 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:5 mknod #1/a11) v1 to mds.0
 -10-16 11:05:19.133866 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd440
 -10-16 11:05:19.140931 7ffff3431700 10 client.4110  mds.1 seq now 1
 -10-16 11:05:19.140984 7ffff3431700  5 client.4110 handle_cap_grant on in 1 mds.1 seq 2 caps now pAsLsXs was pAsLsXsFs
 -10-16 11:05:19.141032 7ffff3431700 10 client.4110 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXsFs(0=pAsLsXs,1=pAsLsXsFs) 0x198dd80) pAsLsXsFs mtime 2012-10-16 10:41:51.525231
 -10-16 11:05:19.141134 7ffff3431700 10 client.4110   revocation of Fs
 -10-16 11:05:19.141163 7ffff3431700 10 client.4110 check_caps on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80) wanted - used - is_delayed=1
 -10-16 11:05:19.141233 7ffff3431700 10 client.4110  cap mds.0 issued pAsLsXs implemented pAsLsXs revoking -
 -10-16 11:05:19.141252 7ffff3431700 10 client.4110  cap mds.1 issued pAsLsXs implemented pAsLsXsFs revoking Fs
 -10-16 11:05:19.141266 7ffff3431700 10 client.4110 completed revocation of Fs
 -10-16 11:05:19.141278 7ffff3431700 10 client.4110 send_cap 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80) mds.1 seq 2 used - want - flush - retain pAsLsXs held pAsLsXsFs revoking Fs dropping -
 -10-16 11:05:19.163631 7ffff3431700 10 client.4110  mds.0 seq now 1
 -10-16 11:05:19.163638 7ffff3431700  5 client.4110 handle_caps don't have vino 10000000004.head, dropping
 -10-16 11:05:19.164727 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 5
 -10-16 11:05:19.164735 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:19.133741 mds.0 is_target=1 is_dentry=1
 -10-16 11:05:19.164744 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:05:19.164747 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:05:19.164760 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 11:05:19.164773 7ffff3431700 10 client.4110  hrm  is_target=1 is_dentry=1
 -10-16 11:05:19.164824 7ffff3431700 12 client.4110 add_update_inode adding 10000000004.head(ref=0 cap_refs={} open={} mode=100000 size=0 mtime=0.000000 caps=- objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x198e680) caps pAsxLsXsxFsxcrwb
 -10-16 11:05:19.164843 7ffff3431700 10 client.4110 update_inode_file_bits 10000000004.head(ref=0 cap_refs={} open={} mode=100644 size=0 mtime=0.000000 caps=- objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x198e680) - mtime 2012-10-16 11:05:19.148558
 -10-16 11:05:19.164865 7ffff3431700 15 client.4110 add_update_cap first one, opened snaprealm 0x19bec30
 -10-16 11:05:19.164875 7ffff3431700 10 client.4110 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 10000000004.head(ref=0 cap_refs={} open={} mode=100644 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x198e680)
 -10-16 11:05:19.164901 7ffff3431700 12 client.4110 add_update_inode had 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80) caps pAsLsXs
 -10-16 11:05:19.164924 7ffff3431700 20 client.4110  dir hash is 2
 -10-16 11:05:19.164927 7ffff3431700 10 client.4110 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 10:41:51.525231 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80) pAsLsXs mtime 2012-10-16 11:05:19.148558
 -10-16 11:05:19.164958 7ffff3431700 10 client.4110 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80)
 -10-16 11:05:19.164979 7ffff3431700 20 client.4110 got dirfrag map for 1 frag * to mds 0
 -10-16 11:05:19.164999 7ffff3431700 12 client.4110 insert_dentry_inode 'a11' vino 10000000004.head in dir 1.head dn 0x19f22a0
 -10-16 11:05:19.165007 7ffff3431700 15 client.4110 link dir 0x198dd80 'a11' to inode 0x198e680 dn 0x19f22a0 (old dn)
 -10-16 11:05:19.165015 7ffff3431700 20 client.4110 link  inode 0x198e680 parents now 0x19f22a0
 -10-16 11:05:19.165020 7ffff3431700 15 client.4110  setting dn offset to 2
 -10-16 11:05:19.165031 7ffff3431700 10 client.4110 got dentry lease on a11 dur 30000ms ttl 2012-10-16 11:05:49.133741
 -10-16 11:05:19.165045 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd440
 -10-16 11:05:19.165051 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 5 0x7ffff34306d0
 -10-16 11:05:19.165060 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 5 0x7ffff34306d0
 -10-16 11:05:19.165066 7ffff7fd3780 20 client.4110 lat 0.031324
 -10-16 11:05:19.165078 7ffff7fd3780 20 client.4110 trim_cache size 1 max 16384
 -10-16 11:05:19.165081 7ffff7fd3780  3 client.4110 mknod(#1/a11, 0100644) = 0
 -10-16 11:05:19.165113 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 10000000004.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.165136 7ffff7fd3780 20 client.4110 choose_target_mds 10000000004.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) is_hash=0 hash=0
 -10-16 11:05:19.165165 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 10000000004.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.165236 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:05:19.165262 7ffff7fd3780 10 client.4110 send_request rebuilding request 6 for mds.0
 -10-16 11:05:19.165289 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b8000, mds: 0)
 -10-16 11:05:19.165299 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:19.165298
 -10-16 11:05:19.165319 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:6 open #10000000004) v1 to mds.0
 -10-16 11:05:19.165426 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd570
 -10-16 11:05:19.168177 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:0 tid 6
 -10-16 11:05:19.168183 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:19.165298 mds.0 is_target=1 is_dentry=0
 -10-16 11:05:19.168191 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:05:19.168195 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:05:19.168203 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 11:05:19.168214 7ffff3431700 10 client.4110  hrm  is_target=1 is_dentry=0
 -10-16 11:05:19.168229 7ffff3431700 12 client.4110 add_update_inode had 10000000004.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) caps pAsxLsXsxFsxcrwb
 -10-16 11:05:19.168258 7ffff3431700 10 client.4110 update_inode_file_bits 10000000004.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) pAsxLsXsxFsxcrwb mtime 2012-10-16 11:05:19.167175
 -10-16 11:05:19.168290 7ffff3431700 10 client.4110 add_update_cap issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 10000000004.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.167175 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.168318 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd570
 -10-16 11:05:19.168323 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 6 0x7ffff34306d0
 -10-16 11:05:19.168332 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 6 0x7ffff34306d0
 -10-16 11:05:19.168340 7ffff7fd3780 20 client.4110 lat 0.003041
 -10-16 11:05:19.168354 7ffff7fd3780 10 client.4110 _create_fh 10000000004 mode 2
 -10-16 11:05:19.168358 7ffff7fd3780 20 client.4110 trim_cache size 1 max 16384
 -10-16 11:05:19.168362 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100644 mtime 2012-10-16 11:05:19.167175 ctime 2012-10-16 11:05:19.167175
 -10-16 11:05:19.168379 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 1
 -10-16 11:05:19.168383 7ffff7fd3780  3 client.4110 ll_create 1.head a11 0100644 33345 = 0 (0x1989320 10000000004)
 -10-16 11:05:19.168476 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head
 -10-16 11:05:19.168487 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:19.168493 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100644 mtime 2012-10-16 11:05:19.167175 ctime 2012-10-16 11:05:19.167175
 -10-16 11:05:19.168506 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head = 0
 -10-16 11:05:19.168562 7ffff7fd3780  3 client.4110 ll_getxattr 10000000004.head security.capability size 0
 -10-16 11:05:19.168573 7ffff7fd3780 10 client.4110 _getattr mask Xs issued=1
 -10-16 11:05:19.168578 7ffff7fd3780  3 client.4110 _getxattr(10000000004, "security.capability", 0) = -61
 -10-16 11:05:19.168603 7ffff7fd3780  3 client.4110 ll_write 0x1989320 10000000004 0~4
 -10-16 11:05:19.168616 7ffff7fd3780 10 client.4110 cur file size is 0
 -10-16 11:05:19.168625 7ffff7fd3780 10 client.4110 wanted_max_size 0 -> 4
 -10-16 11:05:19.168632 7ffff7fd3780 10 client.4110 check_caps on 10000000004.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.167175 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) wanted pAsxXsxFxwb used - is_delayed=0
 -10-16 11:05:19.168661 7ffff7fd3780 10 client.4110 cap_delay_requeue on 10000000004.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.167175 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.168687 7ffff7fd3780 10 client.4110  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 11:05:19.168702 7ffff7fd3780 10 client.4110 delaying cap release
 -10-16 11:05:19.168707 7ffff7fd3780 10 client.4110 get_caps 10000000004.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.167175 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) have pAsxLsXsxFsxcrwb need Fw want Fb but not Fb revoking -
 -10-16 11:05:19.168740 7ffff7fd3780 10 client.4110  snaprealm snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[])
 -10-16 11:05:19.168754 7ffff7fd3780  5 client.4110 get_cap_ref got first FILE_BUFFER ref on 10000000004.head(ref=3 cap_refs={4096=1,8192=0} open={2=1} mode=100644 size=0 mtime=2012-10-16 11:05:19.167175 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.168944 7ffff7fd3780 10 client.4110 mark_caps_dirty 10000000004.head(ref=4 cap_refs={4096=1,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 11:05:19.167175 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 4] parents=0x19f22a0 0x198e680) - -> Fw
 -10-16 11:05:19.168966 7ffff7fd3780  7 client.4110 wrote to 4, extending file size
 -10-16 11:05:19.168971 7ffff7fd3780 10 client.4110 mark_caps_dirty 10000000004.head(ref=5 cap_refs={4096=1,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 4] parents=0x19f22a0 0x198e680) Fw -> Fw
 -10-16 11:05:19.168992 7ffff7fd3780  3 client.4110 ll_write 0x1989320 0~4 = 4
 -10-16 11:05:19.169023 7ffff7fd3780  3 client.4110 ll_release 0x1989320 10000000004
 -10-16 11:05:19.169027 7ffff7fd3780  5 client.4110 _release_fh 0x1989320 mode 2 on 10000000004.head(ref=5 cap_refs={4096=0,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 4] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.169045 7ffff7fd3780 10 client.4110 _flush 10000000004.head(ref=5 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 4] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.169906 7ffff7fd3780 10 client.4110 check_caps on 10000000004.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 4] parents=0x19f22a0 0x198e680) wanted Fxb used Fb is_delayed=0
 -10-16 11:05:19.169942 7ffff7fd3780 10 client.4110 cap_delay_requeue on 10000000004.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 4] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.169971 7ffff7fd3780 10 client.4110  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 11:05:19.169980 7ffff7fd3780 10 client.4110 delaying cap release
 -10-16 11:05:19.169983 7ffff7fd3780 10 client.4110 put_inode on 10000000004.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 4] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.170993 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6800/14116
 -10-16 11:05:19.175221 7ffff3431700 10 client.4110 put_inode on 10000000004.head(ref=5 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.175269 7ffff3431700 10 client.4110 _flushed 10000000004.head(ref=4 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.175302 7ffff3431700 10 client.4110 _invalidate_inode_cache 10000000004.head(ref=4 cap_refs={1024=0,4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 1 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.175367 7ffff3431700 10 client.4110 check_caps on 10000000004.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) wanted - used - is_delayed=0
 -10-16 11:05:19.175398 7ffff3431700 10 client.4110 cap_delay_requeue on 10000000004.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.175426 7ffff3431700 10 client.4110  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 11:05:19.175437 7ffff3431700 10 client.4110 delaying cap release
 -10-16 11:05:19.175441 7ffff3431700  5 client.4110 put_cap_ref dropped last FILE_BUFFER ref on 10000000004.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.175467 7ffff3431700 10 client.4110 put_inode on 10000000004.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:19.784112 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 6
 -10-16 11:05:19.784163 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:19.165298 mds.0 is_target=0 is_dentry=0
 -10-16 11:05:19.784198 7ffff3431700 10 client.4110 insert_trace -- no trace
 -10-16 11:05:19.785363 7ffff3431700 10 client.4110  mds.0 seq now 2
 -10-16 11:05:19.785414 7ffff3431700  5 client.4110 handle_cap_grant on in 10000000004 mds.0 seq 3 caps now pAsxLsXsxFsxcrwb was pAsxLsXsxFsxcrwb
 -10-16 11:05:19.785446 7ffff3431700 10 client.4110 update_inode_file_bits 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) pAsxLsXsxFsxcrwb mtime 2012-10-16 11:05:19.167175
 -10-16 11:05:19.785540 7ffff3431700 10 client.4110   caps unchanged at pAsxLsXsxFsxcrwb
 -10-16 11:05:22.448425 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:22.448502 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=0
 -10-16 11:05:22.448569 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80)
 -10-16 11:05:22.448635 7ffff7fd3780 20 client.4110 choose_target_mds 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80) is_hash=0 hash=0
 -10-16 11:05:22.448686 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80)
 -10-16 11:05:22.448730 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:05:22.448755 7ffff7fd3780 10 client.4110 send_request rebuilding request 7 for mds.0
 -10-16 11:05:22.448786 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b8b00, mds: 0)
 -10-16 11:05:22.448795 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:22.448794
 -10-16 11:05:22.448828 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:7 getattr pAsLsXsFs #1) v1 to mds.0
 -10-16 11:05:22.448980 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd4f0
 -10-16 11:05:22.459268 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 7
 -10-16 11:05:22.459291 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:22.448794 mds.0 is_target=1 is_dentry=0
 -10-16 11:05:22.459323 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:05:22.459347 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:05:22.459363 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 11:05:22.459404 7ffff3431700 10 client.4110  hrm  is_target=1 is_dentry=0
 -10-16 11:05:22.459462 7ffff3431700 12 client.4110 add_update_inode had 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80) caps pAsLsXsFs
 -10-16 11:05:22.459570 7ffff3431700 20 client.4110  dir hash is 2
 -10-16 11:05:22.459581 7ffff3431700 10 client.4110 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x198dd80) pAsLsXs mtime 2012-10-16 11:05:19.148558
 -10-16 11:05:22.459693 7ffff3431700 10 client.4110 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80)
 -10-16 11:05:22.459801 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd4f0
 -10-16 11:05:22.459822 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 7 0x7ffff34306d0
 -10-16 11:05:22.459853 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 7 0x7ffff34306d0
 -10-16 11:05:22.459881 7ffff7fd3780 20 client.4110 lat 0.011084
 -10-16 11:05:22.459926 7ffff7fd3780 10 client.4110 _getattr result=0
 -10-16 11:05:22.459942 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:05:22.459995 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:22.460141 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:05:22.460185 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:05:22.460252 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:22.460422 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100644 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:19.167175
 -10-16 11:05:22.460465 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 2
 -10-16 11:05:22.460477 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:05:22.460594 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head
 -10-16 11:05:22.460635 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:22.460654 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100644 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:19.167175
 -10-16 11:05:22.460694 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head = 0
 -10-16 11:05:22.460886 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:22.460911 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:22.460929 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:05:22.460971 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:22.461033 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:05:22.461066 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:05:22.461124 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:22.461269 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100644 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:19.167175
 -10-16 11:05:22.461309 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 3
 -10-16 11:05:22.461320 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:05:22.461401 7ffff7fd3780  3 client.4110 ll_setattr 10000000004.head mask 1
 -10-16 11:05:22.461436 7ffff7fd3780 10 client.4110 _setattr mask 1 issued pAsxLsXsxFsxcrwb
 -10-16 11:05:22.461460 7ffff7fd3780 10 client.4110 mark_caps_dirty 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) Fw -> AxFw
 -10-16 11:05:22.461570 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:22.461458
 -10-16 11:05:22.461607 7ffff7fd3780  3 client.4110 ll_setattr 10000000004.head = 0
 -10-16 11:05:24.244776 7ffff4433700 10 client.4110 check_caps on 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=AxFw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) wanted - used - is_delayed=1
 -10-16 11:05:24.244927 7ffff4433700 10 client.4110  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 11:05:24.244951 7ffff4433700 10 client.4110 mark_caps_flushing AxFw 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=AxFw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:24.245030 7ffff4433700 10 client.4110 send_cap 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=AxFw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) mds.0 seq 3 used - want - flush AxFw retain pAsLsXsFs held pAsxLsXsxFsxcrwb revoking - dropping AxXxFxcrwb
 -10-16 11:05:24.245152 7ffff4433700 15 client.4110 auth cap, setting max_size = 4
 -10-16 11:05:24.785694 7ffff3431700 10 client.4110  mds.0 seq now 3
 -10-16 11:05:24.785709 7ffff3431700  5 client.4110 handle_cap_flush_ack mds.0 cleaned AxFw on 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFs(0=pAsLsXsFs) flushing_caps=AxFw objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) with AxFw
 -10-16 11:05:24.785735 7ffff3431700  5 client.4110   flushing_caps AxFw -> -
 -10-16 11:05:24.785738 7ffff3431700 10 client.4110  10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) !flushing
 -10-16 11:05:24.785751 7ffff3431700 10 client.4110 put_inode on 10000000004.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:24.834815 7ffff3431700  1 client.4110 handle_mds_map epoch 22
 -10-16 11:05:28.245439 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:05:28.245493 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:05:28.245526 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:05:28.245694 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:05:28.245718 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:05:28.247843 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 3) v1 from mds.0
 -10-16 11:05:28.248048 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 3) v1 from mds.1
 -10-16 11:05:29.349976 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:29.350061 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:29.350078 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:05:29.350108 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:29.350591 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:29.350653 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:29.350665 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:05:29.350690 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:29.350735 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:05:29.350761 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:05:29.350798 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:05:29.350910 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:22.461458
 -10-16 11:05:29.350952 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 4
 -10-16 11:05:29.350960 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:05:29.351001 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head
 -10-16 11:05:29.351014 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:29.351025 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:22.461458
 -10-16 11:05:29.351060 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head = 0
 -10-16 11:05:29.351130 7ffff7fd3780  3 client.4110 ll_open 10000000004.head 33793
 -10-16 11:05:29.351149 7ffff7fd3780  3 client.4110 ll_open 10000000004.head 33793 = -13 (0)
 -10-16 11:05:53.855809 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:05:53.855868 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:05:53.855903 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:05:53.856059 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:05:53.856090 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:05:53.857778 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 4) v1 from mds.0
 -10-16 11:05:53.857986 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 4) v1 from mds.1
 -10-16 11:05:57.528076 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:05:57.528143 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:05:57.528165 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:05:57.528208 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:05:57.528294 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:05:57.528326 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:05:57.528387 7ffff7fd3780 10 client.4110 _lookup on #1/a11
 -10-16 11:05:57.528427 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80)
 -10-16 11:05:57.528492 7ffff7fd3780 20 client.4110 choose_target_mds inode dir hash is 2 on a11 => 309854497
 -10-16 11:05:57.528500 7ffff7fd3780 20 client.4110 choose_target_mds 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) is_hash=1 hash=309854497
 -10-16 11:05:57.528551 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80)
 -10-16 11:05:57.528598 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:05:57.528624 7ffff7fd3780 10 client.4110 send_request rebuilding request 8 for mds.0
 -10-16 11:05:57.528654 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b82c0, mds: 0)
 -10-16 11:05:57.528663 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:05:57.528662
 -10-16 11:05:57.528684 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:8 lookup #1/a11) v1 to mds.0
 -10-16 11:05:57.528813 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd1a0
 -10-16 11:05:57.533371 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 8
 -10-16 11:05:57.533393 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:05:57.528662 mds.0 is_target=1 is_dentry=1
 -10-16 11:05:57.533424 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:05:57.533437 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:05:57.533471 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 11:05:57.533514 7ffff3431700 10 client.4110  hrm  is_target=1 is_dentry=1
 -10-16 11:06:02.458930 7ffff3431700 12 client.4110 add_update_inode had 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) caps pAsLsXsFscr
 -10-16 11:06:06.328407 7ffff182a700  0 -- 127.0.0.1:0/15600 >> 127.0.0.1:6803/14139 pipe(0x198f900 sd=15 :36286 pgs=12 cs=1 l=0).fault, initiating reconnect
 -10-16 11:07:09.206019 7ffff3431700 10 client.4110 update_inode_file_bits 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) pAsxLsXsxFsxcrwb mtime 2012-10-16 11:05:19.168970
 -10-16 11:07:09.206247 7ffff3431700 10 client.4110 add_update_cap issued pAsLsXsFs -> pAsLsXsFscr from mds.0 on 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:07:23.742229 7ffff3431700 12 client.4110 add_update_inode had 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) caps pAsLsXsFs
 -10-16 11:07:23.742420 7ffff3431700 20 client.4110  dir hash is 2
 -10-16 11:07:23.742432 7ffff3431700 10 client.4110 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) pAsLsXsFs mtime 2012-10-16 11:05:19.148558
 -10-16 11:07:23.742561 7ffff3431700 10 client.4110 add_update_cap issued pAsLsXsFs -> pAsLsXsFs from mds.0 on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80)
 -10-16 11:07:23.742655 7ffff3431700 20 client.4110 got dirfrag map for 1 frag * to mds 0
 -10-16 11:07:23.742716 7ffff3431700 12 client.4110 insert_dentry_inode 'a11' vino 10000000004.head in dir 1.head dn 0x19f22a0
 -10-16 11:07:23.742744 7ffff3431700 12 client.4110  had dentry a11 with correct vino 10000000004.head
 -10-16 11:07:23.742787 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd1a0
 -10-16 11:07:23.742805 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 8 0x7ffff34306d0
 -10-16 11:07:23.742913 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:07:23.742938 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:07:23.742966 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:07:23.743202 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:07:23.743226 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:07:23.743732 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 8 0x7ffff34306d0
 -10-16 11:07:23.743765 7ffff7fd3780 20 client.4110 lat 86.215100
 -10-16 11:07:23.743804 7ffff7fd3780 10 client.4110 _lookup res is 0
 -10-16 11:07:23.743821 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:07:23.743995 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:22.461458
 -10-16 11:07:23.744039 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 5
 -10-16 11:07:23.744053 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:07:23.744240 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6803/14139
 -10-16 11:07:23.744347 7ffff3431700 10 client.4110 handle_client_session client_session(stale seq 3) v1 from mds.0
 -10-16 11:07:23.744374 7ffff3431700 10 client.4110 renew_caps mds.0
 -10-16 11:07:23.744670 7ffff3431700 10 client.4110 handle_client_session client_session(stale seq 1) v1 from mds.1
 -10-16 11:07:23.744696 7ffff3431700 10 client.4110 renew_caps mds.1
 -10-16 11:07:23.745785 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head
 -10-16 11:07:23.745833 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:07:23.745855 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:22.461458
 -10-16 11:07:23.745901 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head = 0
 -10-16 11:07:23.746057 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 5) v1 from mds.1
 -10-16 11:07:23.746547 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 6) v1 from mds.1
 -10-16 11:07:23.747003 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 5) v1 from mds.0
 -10-16 11:07:23.747308 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:07:23.747341 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:07:23.747364 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:07:23.747412 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:07:23.747447 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 6) v1 from mds.0
 -10-16 11:07:23.747544 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:07:23.747589 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:07:23.747621 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:07:23.747771 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:05:22.461458
 -10-16 11:07:23.747813 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 6
 -10-16 11:07:23.747828 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:07:23.747915 7ffff7fd3780  3 client.4110 ll_setattr 10000000004.head mask 1
 -10-16 11:07:23.747947 7ffff7fd3780 10 client.4110 _setattr mask 1 issued pAsLsXsFscr
 -10-16 11:07:23.748036 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:07:23.748109 7ffff7fd3780 20 client.4110 choose_target_mds 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) is_hash=0 hash=0
 -10-16 11:07:23.748205 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:07:23.748296 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:07:23.748325 7ffff7fd3780 10 client.4110 send_request rebuilding request 9 for mds.0
 -10-16 11:07:23.748365 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b98c0, mds: 0)
 -10-16 11:07:23.748379 7ffff7fd3780 20 client.4110 encode_inode_release enter(in:10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680), req:0x19b98c0 mds:0, drop:4, unless:0, have:, force:0)
 -10-16 11:07:23.748506 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:07:23.748504
 -10-16 11:07:23.748538 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:9 setattr mode=064331882 #10000000004) v1 to mds.0
 -10-16 11:07:23.748699 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd490
 -10-16 11:07:23.756632 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:0 tid 9
 -10-16 11:07:23.756673 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:07:23.748504 mds.0 is_target=1 is_dentry=0
 -10-16 11:07:23.756705 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:07:23.756717 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:07:23.756751 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 11:07:23.756797 7ffff3431700 10 client.4110  hrm  is_target=1 is_dentry=0
 -10-16 11:07:42.584417 7ffff1527700  0 -- 127.0.0.1:0/15600 >> 127.0.0.1:6803/14139 pipe(0x198f900 sd=15 :36290 pgs=13 cs=3 l=0).fault, initiating reconnect
 -10-16 11:07:42.579676 7ffff3431700 12 client.4110 add_update_inode had 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) caps pLsXsFscr
 -10-16 11:08:07.373173 7ffff3431700 10 client.4110 update_inode_file_bits 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) pAxLsXsxFsxcrwb mtime 2012-10-16 11:05:19.168970
 -10-16 11:08:07.373422 7ffff2c30700  0 -- 127.0.0.1:0/15600 submit_message mon_subscribe({mdsmap=23+,monmap=2+}) v2 remote, 127.0.0.1:6789/0, failed lossy con, dropping message 0x19aa380
 -10-16 11:08:07.373376 7ffff3431700 10 client.4110 add_update_cap issued pLsXsFscr -> pLsXsFscr from mds.0 on 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:08:07.373484 7ffff2c30700  0 -- 127.0.0.1:0/15600 send_keepalive con 0x1998780, no pipe.
 -10-16 11:08:07.373495 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd490
 -10-16 11:08:07.373514 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 9 0x7ffff34306d0
 -10-16 11:08:07.373587 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 9 0x7ffff34306d0
 -10-16 11:08:07.373619 7ffff7fd3780 20 client.4110 lat 43.625112
 -10-16 11:08:07.373666 7ffff7fd3780 10 client.4110 _setattr result=0
 -10-16 11:08:07.373682 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:07:23.753397
 -10-16 11:08:07.373735 7ffff7fd3780  3 client.4110 ll_setattr 10000000004.head = 0
 -10-16 11:08:07.373855 7ffff3431700  0 monclient: hunting for new mon
 -10-16 11:08:07.374060 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:08:07.374087 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:08:07.374121 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:08:07.376935 7ffff3431700  0 client.4110 ms_handle_reset on 127.0.0.1:6789/0
 -10-16 11:08:07.376780 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:08:07.377381 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:08:07.378362 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6803/14139
 -10-16 11:08:07.378489 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 9
 -10-16 11:08:07.378511 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:07:23.748504 mds.0 is_target=0 is_dentry=0
 -10-16 11:08:07.378543 7ffff3431700 10 client.4110 insert_trace -- no trace
 -10-16 11:08:07.378702 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 7) v1 from mds.0
 -10-16 11:08:07.378961 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6791/0
 -10-16 11:08:07.379301 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 7) v1 from mds.1
 -10-16 11:08:27.377055 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:08:27.377104 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:08:27.377127 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:08:27.377274 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:08:27.377298 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:08:27.380305 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 8) v1 from mds.1
 -10-16 11:08:27.380612 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 8) v1 from mds.0
 -10-16 11:08:34.607665 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:08:34.607726 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:08:34.607748 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:08:34.607832 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:08:34.607913 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:08:34.607949 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:08:34.607973 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:08:34.608081 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:07:23.753397
 -10-16 11:08:34.608106 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 7
 -10-16 11:08:34.608114 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:08:34.608185 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head
 -10-16 11:08:34.608211 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=0
 -10-16 11:08:34.608268 7ffff7fd3780 20 client.4110 choose_target_mds starting with req->inode 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:08:34.608350 7ffff7fd3780 20 client.4110 choose_target_mds 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) is_hash=0 hash=0
 -10-16 11:08:34.608409 7ffff7fd3780 10 client.4110 choose_target_mds from caps on inode 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:08:34.608469 7ffff7fd3780 20 client.4110 mds is 0
 -10-16 11:08:34.608495 7ffff7fd3780 10 client.4110 send_request rebuilding request 10 for mds.0
 -10-16 11:08:34.608523 7ffff7fd3780 20 client.4110 encode_cap_releases enter (req: 0x19b9600, mds: 0)
 -10-16 11:08:34.608534 7ffff7fd3780 20 client.4110 send_request set sent_stamp to 2012-10-16 11:08:34.608531
 -10-16 11:08:34.608555 7ffff7fd3780 10 client.4110 send_request client_request(unknown.0:10 getattr pAsLsXsFs #10000000004) v1 to mds.0
 -10-16 11:08:34.608688 7ffff7fd3780 20 client.4110 awaiting reply|forward|kick on 0x7fffffffd4f0
 -10-16 11:08:34.614926 7ffff3431700 20 client.4110 handle_client_reply got a reply. Safe:1 tid 10
 -10-16 11:08:34.614953 7ffff3431700 10 client.4110 insert_trace from 2012-10-16 11:08:34.608531 mds.0 is_target=1 is_dentry=0
 -10-16 11:08:34.614988 7ffff3431700 10 client.4110  features 0x7fffff
 -10-16 11:08:34.615001 7ffff3431700 10 client.4110 update_snap_trace len 48
 -10-16 11:08:34.615067 7ffff3431700 10 client.4110 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 11:08:34.615111 7ffff3431700 10 client.4110  hrm  is_target=1 is_dentry=0
 -10-16 11:08:54.011947 7ffff1426700  0 -- 127.0.0.1:0/15600 >> 127.0.0.1:6803/14139 pipe(0x198f900 sd=15 :36301 pgs=14 cs=5 l=0).fault, initiating reconnect
 -10-16 11:08:53.991737 7ffff3431700 12 client.4110 add_update_inode had 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) caps pAsLsXsFscr
 -10-16 11:08:56.040628 7ffff1325700  0 -- 127.0.0.1:0/15600 >> 127.0.0.1:6803/14139 pipe(0x198f900 sd=15 :36304 pgs=15 cs=7 l=0).fault, initiating reconnect
 -10-16 11:09:15.284735 7ffff3431700 10 client.4110 update_inode_file_bits 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680) pAxLsXsxFsxcrwb mtime 2012-10-16 11:05:19.168970
 -10-16 11:09:15.288457 7ffff3431700 10 client.4110 add_update_cap issued pLsXsFscr -> pAsLsXsFscr from mds.0 on 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:09:15.288610 7ffff3431700 20 client.4110 handle_client_reply signalling caller 0x7fffffffd4f0
 -10-16 11:09:15.288631 7ffff3431700 20 client.4110 handle_client_reply awaiting kickback on tid 10 0x7ffff34306d0
 -10-16 11:09:15.288747 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:09:15.288762 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:09:15.288790 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:09:15.288968 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:09:15.289001 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:09:15.289913 7ffff7fd3780 20 client.4110 sendrecv kickback on tid 10 0x7ffff34306d0
 -10-16 11:09:15.289943 7ffff7fd3780 20 client.4110 lat 40.681409
 -10-16 11:09:15.289990 7ffff7fd3780 10 client.4110 _getattr result=0
 -10-16 11:09:15.290008 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:07:23.753397
 -10-16 11:09:15.290068 7ffff7fd3780  3 client.4110 ll_getattr 10000000004.head = 0
 -10-16 11:09:15.290545 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6803/14139
 -10-16 11:09:15.290604 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:09:15.290637 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:09:15.290664 7ffff3431700  0 client.4110 ms_handle_reset on 127.0.0.1:6800/14116
 -10-16 11:09:15.290662 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:09:15.290707 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:09:15.293435 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6803/14139
 -10-16 11:09:15.293540 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 9) v1 from mds.0
 -10-16 11:09:15.293770 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 9) v1 from mds.1
 -10-16 11:09:15.293903 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:09:15.293956 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:09:15.294001 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:09:15.294157 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:07:23.753397
 -10-16 11:09:15.294202 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 8
 -10-16 11:09:15.294216 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:09:15.294317 7ffff7fd3780  3 client.4110 ll_getxattr 10000000004.head security.selinux size 255
 -10-16 11:09:15.294348 7ffff7fd3780 10 client.4110 _getattr mask Xs issued=1
 -10-16 11:09:15.294369 7ffff7fd3780  3 client.4110 _getxattr(10000000004, "security.selinux", 255) = -61
 -10-16 11:09:15.294478 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:09:15.294508 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:09:15.294527 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:09:15.294573 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:09:15.294649 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:09:15.294688 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:09:15.294717 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:09:15.294868 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:07:23.753397
 -10-16 11:09:15.294909 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 9
 -10-16 11:09:15.294922 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:09:15.295000 7ffff7fd3780  3 client.4110 ll_getxattr 10000000004.head system.posix_acl_access size 0
 -10-16 11:09:15.295037 7ffff7fd3780 10 client.4110 _getattr mask Xs issued=1
 -10-16 11:09:15.295084 7ffff7fd3780  3 client.4110 _getxattr(10000000004, "system.posix_acl_access", 0) = -61
 -10-16 11:09:15.295154 7ffff7fd3780  3 client.4110 ll_getattr 1.head
 -10-16 11:09:15.295180 7ffff7fd3780 10 client.4110 _getattr mask pAsLsXsFs issued=1
 -10-16 11:09:15.295199 7ffff7fd3780 10 client.4110 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 11:09:15.295243 7ffff7fd3780  3 client.4110 ll_getattr 1.head = 0
 -10-16 11:09:15.295313 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11
 -10-16 11:09:15.295344 7ffff7fd3780 20 client.4110 _lookup have dn a11 mds.0 ttl 2012-10-16 11:05:49.133741 seq 2
 -10-16 11:09:15.295378 7ffff7fd3780 10 client.4110 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x198dd80) a11 = 10000000004.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 11:05:19.168970 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x19f22a0 0x198e680)
 -10-16 11:09:15.295532 7ffff7fd3780 10 client.4110 fill_stat on 10000000004 snap/devhead mode 0100400 mtime 2012-10-16 11:05:19.168970 ctime 2012-10-16 11:07:23.753397
 -10-16 11:09:15.295574 7ffff7fd3780 20 client.4110 _ll_get 0x198e680 10000000004 -> 10
 -10-16 11:09:15.295587 7ffff7fd3780  3 client.4110 ll_lookup 1.head a11 -> 0 (10000000004)
 -10-16 11:09:15.295665 7ffff7fd3780  3 client.4110 ll_getxattr 10000000004.head system.posix_acl_default size 0
 -10-16 11:09:15.295708 7ffff7fd3780 10 client.4110 _getattr mask Xs issued=1
 -10-16 11:09:15.295725 7ffff7fd3780  3 client.4110 _getxattr(10000000004, "system.posix_acl_default", 0) = -61
 -10-16 11:09:15.296542 7ffff3431700 10 client.4110 ms_handle_connect on 127.0.0.1:6800/14116
 -10-16 11:09:35.291359 7ffff4433700 10 client.4110 renew_caps()
 -10-16 11:09:35.291405 7ffff4433700 15 client.4110 renew_caps requesting from mds.0
 -10-16 11:09:35.291429 7ffff4433700 10 client.4110 renew_caps mds.0
 -10-16 11:09:35.291586 7ffff4433700 15 client.4110 renew_caps requesting from mds.1
 -10-16 11:09:35.291611 7ffff4433700 10 client.4110 renew_caps mds.1
 -10-16 11:09:35.293270 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 10) v1 from mds.0
 -10-16 11:09:35.293421 7ffff3431700 10 client.4110 handle_client_session client_session(renewcaps seq 10) v1 from mds.1
 -10-16 12:17:25.933048 7f8b43dab780  0 ceph version  (commit:), process ceph-fuse, pid 17131
 -10-16 12:17:25.935013 7f8b3f208700 10 client.-1 ms_handle_connect on 127.0.0.1:6789/0
 -10-16 12:17:25.941358 7f8b43dab780  2 client.4113 mounted: have osdmap 0 and mdsmap 0
 -10-16 12:17:25.941392 7f8b43dab780 10 client.4113 did not get mds through better means, so chose random mds -1
 -10-16 12:17:25.941395 7f8b43dab780 20 client.4113 mds is -1
 -10-16 12:17:25.941396 7f8b43dab780 10 client.4113  target mds.-1 not active, waiting for new mdsmap
 -10-16 12:17:25.944071 7f8b3f208700  1 client.4113 handle_mds_map epoch 23
 -10-16 12:17:25.944514 7f8b43dab780 10 client.4113 did not get mds through better means, so chose random mds 1
 -10-16 12:17:25.944532 7f8b43dab780 20 client.4113 mds is 1
 -10-16 12:17:25.944574 7f8b43dab780 10 client.4113 opening session to mds.1
 -10-16 12:17:25.944663 7f8b43dab780 10 client.4113 waiting for session to mds.1 to open
 -10-16 12:17:25.946293 7f8b3f208700 10 client.4113 ms_handle_connect on 127.0.0.1:6804/14221
 -10-16 12:17:25.956927 7f8b3f208700 10 client.4113 handle_client_session client_session(open) v1 from mds.1
 -10-16 12:17:25.956946 7f8b3f208700 10 client.4113 renew_caps mds.1
 -10-16 12:17:25.956993 7f8b3f208700 10 client.4113 connect_mds_targets for mds.1
 -10-16 12:17:25.957048 7f8b43dab780 10 client.4113 send_request rebuilding request 1 for mds.1
 -10-16 12:17:25.957069 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da000, mds: 1)
 -10-16 12:17:25.957075 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:25.957074
 -10-16 12:17:25.957095 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:1 getattr pAsLsXsFs #1) v1 to mds.1
 -10-16 12:17:25.957148 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e6d90
 -10-16 12:17:25.957444 7f8b3f208700 10 client.4113 handle_client_session client_session(renewcaps seq 1) v1 from mds.1
 -10-16 12:17:25.957756 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 1
 -10-16 12:17:25.957771 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:25.957074 mds.1 is_target=1 is_dentry=0
 -10-16 12:17:25.957781 7f8b3f208700 10 client.4113  features 0x7fffff
 -10-16 12:17:25.957786 7f8b3f208700 10 client.4113 update_snap_trace len 48
 -10-16 12:17:25.957804 7f8b3f208700 10 client.4113 update_snap_trace snaprealm(1 nref=2 c=0 seq=0 parent=0 my_snaps=[] cached_snapc=0=[]) seq 1 > 0
 -10-16 12:17:25.957822 7f8b3f208700 10 client.4113  flushing caps on snaprealm(1 nref=2 c=0 seq=0 parent=0 my_snaps=[] cached_snapc=0=[])
 -10-16 12:17:25.957839 7f8b3f208700 10 client.4113 invalidate_snaprealm_and_children snaprealm(1 nref=2 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=0=[])
 -10-16 12:17:25.957850 7f8b3f208700 15 client.4113 update_snap_trace snaprealm(1 nref=2 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=0=[]) self|parent updated
 -10-16 12:17:25.957859 7f8b3f208700 15 client.4113   snapc 1=[]
 -10-16 12:17:25.957871 7f8b3f208700 10 client.4113  hrm  is_target=1 is_dentry=0
 -10-16 12:17:25.957904 7f8b3f208700 12 client.4113 add_update_inode adding 1.head(ref=1 cap_refs={} open={} mode=40000 size=0 mtime=0.000000 caps=- 0x33aed80) caps pAsLsXsFs
 -10-16 12:17:25.957926 7f8b3f208700 20 client.4113  dir hash is 2
 -10-16 12:17:25.957930 7f8b3f208700 10 client.4113 update_inode_file_bits 1.head(ref=1 cap_refs={} open={} mode=40755 size=0 mtime=0.000000 caps=- 0x33aed80) - mtime 2012-10-16 11:05:19.148558
 -10-16 12:17:25.957953 7f8b3f208700 15 client.4113 add_update_cap first one, opened snaprealm 0x33e0c30
 -10-16 12:17:25.957966 7f8b3f208700 10 client.4113 add_update_cap issued - -> pAsLsXsFs from mds.1 on 1.head(ref=1 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:25.957991 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e6d90
 -10-16 12:17:25.957996 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 1 0x7f8b3f2076d0
 -10-16 12:17:25.958016 7f8b43dab780 20 client.4113 sendrecv kickback on tid 1 0x7f8b3f2076d0
 -10-16 12:17:25.958023 7f8b43dab780 20 client.4113 lat 0.000948
 -10-16 12:17:25.958038 7f8b43dab780 10 client.4113 root getattr result=0
 -10-16 12:17:25.958043 7f8b43dab780 20 client.4113 _ll_get 0x33aed80 1 -> 1
 -10-16 12:17:25.961218 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:25.961311 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:25.961326 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 10:41:51.525231
 -10-16 12:17:25.961357 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:25.961452 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:25.961495 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:25.961503 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 10:41:51.525231
 -10-16 12:17:25.961532 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:25.961567 7f8b43dab780  3 client.4113 ll_lookup 1.head .Trash
 -10-16 12:17:25.961646 7f8b43dab780 10 client.4113 _lookup on #1/.Trash
 -10-16 12:17:25.961670 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:25.961731 7f8b43dab780 20 client.4113 choose_target_mds inode dir hash is 2 on .Trash => 571883718
 -10-16 12:17:25.961740 7f8b43dab780 20 client.4113 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80) is_hash=1 hash=571883718
 -10-16 12:17:25.961785 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:25.961809 7f8b43dab780 20 client.4113 mds is 1
 -10-16 12:17:25.961839 7f8b43dab780 10 client.4113 send_request rebuilding request 2 for mds.1
 -10-16 12:17:25.961869 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da580, mds: 1)
 -10-16 12:17:25.961887 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:25.961886
 -10-16 12:17:25.961925 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:2 lookup #1/.Trash) v1 to mds.1
 -10-16 12:17:25.962067 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e65a0
 -10-16 12:17:25.963137 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 2
 -10-16 12:17:25.963159 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:25.961886 mds.1 is_target=0 is_dentry=0
 -10-16 12:17:25.963186 7f8b3f208700 10 client.4113 insert_trace -- no trace
 -10-16 12:17:25.963193 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e65a0
 -10-16 12:17:25.963201 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 2 0x7f8b3f2076d0
 -10-16 12:17:25.963216 7f8b43dab780 20 client.4113 sendrecv kickback on tid 2 0x7f8b3f2076d0
 -10-16 12:17:25.963226 7f8b43dab780 20 client.4113 lat 0.001338
 -10-16 12:17:25.963248 7f8b43dab780 10 client.4113 _lookup res is -2
 -10-16 12:17:25.963253 7f8b43dab780 10 client.4113 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80) .Trash = -2
 -10-16 12:17:25.963279 7f8b43dab780  3 client.4113 ll_lookup 1.head .Trash -> -2 (0)
 -10-16 12:17:25.963473 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:25.963503 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:25.963523 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 10:41:51.525231
 -10-16 12:17:25.963540 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:25.963571 7f8b43dab780  3 client.4113 ll_lookup 1.head .Trash-1000
 -10-16 12:17:25.963601 7f8b43dab780 10 client.4113 _lookup on #1/.Trash-1000
 -10-16 12:17:25.963613 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:25.963639 7f8b43dab780 20 client.4113 choose_target_mds inode dir hash is 2 on .Trash-1000 => 792943375
 -10-16 12:17:25.963644 7f8b43dab780 20 client.4113 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80) is_hash=1 hash=792943375
 -10-16 12:17:25.963665 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:25.963684 7f8b43dab780 20 client.4113 mds is 1
 -10-16 12:17:25.963695 7f8b43dab780 10 client.4113 send_request rebuilding request 3 for mds.1
 -10-16 12:17:25.963709 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da2c0, mds: 1)
 -10-16 12:17:25.963715 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:25.963714
 -10-16 12:17:25.963726 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:3 lookup #1/.Trash-1000) v1 to mds.1
 -10-16 12:17:25.963789 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e65a0
 -10-16 12:17:25.964493 7f8b3f208700 10 client.4113 handle_client_request tid 3 fwd 1 to mds.0, resending to 0
 -10-16 12:17:25.964536 7f8b43dab780 10 client.4113 choose_target_mds resend_mds specified as mds.0
 -10-16 12:17:25.964550 7f8b43dab780 20 client.4113 mds is 0
 -10-16 12:17:25.964584 7f8b43dab780 10 client.4113 opening session to mds.0
 -10-16 12:17:25.964677 7f8b43dab780 10 client.4113 waiting for session to mds.0 to open
 -10-16 12:17:25.965546 7f8b3f208700 10 client.4113 ms_handle_connect on 127.0.0.1:6803/14139
 -10-16 12:17:25.978424 7f8b3f208700 10 client.4113 handle_client_session client_session(open) v1 from mds.0
 -10-16 12:17:25.978472 7f8b3f208700 10 client.4113 renew_caps mds.0
 -10-16 12:17:25.978559 7f8b3f208700 10 client.4113 connect_mds_targets for mds.0
 -10-16 12:17:25.978668 7f8b43dab780 10 client.4113 send_request rebuilding request 3 for mds.0
 -10-16 12:17:25.978735 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da2c0, mds: 0)
 -10-16 12:17:25.978751 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:25.978748
 -10-16 12:17:25.978777 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:3 lookup #1/.Trash-1000) v1 to mds.0
 -10-16 12:17:25.978895 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e65a0
 -10-16 12:17:25.979630 7f8b3f208700 10 client.4113 handle_client_session client_session(renewcaps seq 1) v1 from mds.0
 -10-16 12:17:25.980780 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 3
 -10-16 12:17:25.980797 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:25.978748 mds.0 is_target=0 is_dentry=0
 -10-16 12:17:25.980820 7f8b3f208700 10 client.4113 insert_trace -- no trace
 -10-16 12:17:25.980831 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e65a0
 -10-16 12:17:25.980844 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 3 0x7f8b3f2076d0
 -10-16 12:17:25.980903 7f8b43dab780 20 client.4113 sendrecv kickback on tid 3 0x7f8b3f2076d0
 -10-16 12:17:25.980922 7f8b43dab780 20 client.4113 lat 0.002171
 -10-16 12:17:25.980952 7f8b43dab780 10 client.4113 _lookup res is -2
 -10-16 12:17:25.980964 7f8b43dab780 10 client.4113 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80) .Trash-1000 = -2
 -10-16 12:17:25.981025 7f8b43dab780  3 client.4113 ll_lookup 1.head .Trash-1000 -> -2 (0)
 -10-16 12:17:26.941497 7f8b4020a700 10 client.4113 renew_caps()
 -10-16 12:17:26.941539 7f8b4020a700 15 client.4113 renew_caps requesting from mds.0
 -10-16 12:17:26.941569 7f8b4020a700 10 client.4113 renew_caps mds.0
 -10-16 12:17:26.941747 7f8b4020a700 15 client.4113 renew_caps requesting from mds.1
 -10-16 12:17:26.941775 7f8b4020a700 10 client.4113 renew_caps mds.1
 -10-16 12:17:26.943130 7f8b3f208700 10 client.4113 handle_client_session client_session(renewcaps seq 2) v1 from mds.0
 -10-16 12:17:26.943355 7f8b3f208700 10 client.4113 handle_client_session client_session(renewcaps seq 2) v1 from mds.1
 -10-16 12:17:31.511976 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:31.512061 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:31.512092 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 10:41:51.525231
 -10-16 12:17:31.512143 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:31.512249 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:31.512274 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:31.512293 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 10:41:51.525231
 -10-16 12:17:31.512343 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:43.999661 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:43.999740 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:43.999774 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 10:41:51.525231
 -10-16 12:17:43.999832 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:44.000015 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:44.000048 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:44.000062 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 10:41:51.525231
 -10-16 12:17:44.000088 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:44.000247 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:44.000334 7f8b43dab780 10 client.4113 _lookup on #1/baz
 -10-16 12:17:44.000374 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:44.000459 7f8b43dab780 20 client.4113 choose_target_mds inode dir hash is 2 on baz => 973105927
 -10-16 12:17:44.000476 7f8b43dab780 20 client.4113 choose_target_mds 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80) is_hash=1 hash=973105927
 -10-16 12:17:44.000521 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:44.000559 7f8b43dab780 20 client.4113 mds is 1
 -10-16 12:17:44.000586 7f8b43dab780 10 client.4113 send_request rebuilding request 4 for mds.1
 -10-16 12:17:44.000616 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da840, mds: 1)
 -10-16 12:17:44.000628 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:44.000627
 -10-16 12:17:44.000652 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:4 lookup #1/baz) v1 to mds.1
 -10-16 12:17:44.000770 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e65a0
 -10-16 12:17:44.002215 7f8b3f208700 10 client.4113 handle_client_request tid 4 fwd 1 to mds.0, resending to 0
 -10-16 12:17:44.002272 7f8b43dab780 10 client.4113 choose_target_mds resend_mds specified as mds.0
 -10-16 12:17:44.002296 7f8b43dab780 20 client.4113 mds is 0
 -10-16 12:17:44.002323 7f8b43dab780 10 client.4113 send_request rebuilding request 4 for mds.0
 -10-16 12:17:44.002368 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da840, mds: 0)
 -10-16 12:17:44.002384 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:44.002382
 -10-16 12:17:44.002413 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:4 lookup #1/baz) v1 to mds.0
 -10-16 12:17:44.002563 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e65a0
 -10-16 12:17:44.005085 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 4
 -10-16 12:17:44.005098 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:44.002382 mds.0 is_target=0 is_dentry=1
 -10-16 12:17:44.005118 7f8b3f208700 10 client.4113  features 0x7fffff
 -10-16 12:17:44.005126 7f8b3f208700 10 client.4113 update_snap_trace len 48
 -10-16 12:17:44.005175 7f8b3f208700 10 client.4113 update_snap_trace snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 12:17:44.005205 7f8b3f208700 10 client.4113  hrm  is_target=0 is_dentry=1
 -10-16 12:17:44.005299 7f8b3f208700 12 client.4113 add_update_inode had 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80) caps pAsLsXsFs
 -10-16 12:17:44.005368 7f8b3f208700 20 client.4113  dir hash is 2
 -10-16 12:17:44.005375 7f8b3f208700 10 client.4113 update_inode_file_bits 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(1=pAsLsXsFs) 0x33aed80) pAsLsXsFs mtime 2012-10-16 11:05:19.148558
 -10-16 12:17:44.005450 7f8b3f208700 10 client.4113 add_update_cap issued - -> pAsLsXsFs from mds.0 on 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:44.005522 7f8b3f208700 20 client.4113 got dirfrag map for 1 frag * to mds 0
 -10-16 12:17:44.005600 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e65a0
 -10-16 12:17:44.005614 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 4 0x7f8b3f2076d0
 -10-16 12:17:44.005649 7f8b43dab780 20 client.4113 sendrecv kickback on tid 4 0x7f8b3f2076d0
 -10-16 12:17:44.005679 7f8b43dab780 20 client.4113 lat 0.003293
 -10-16 12:17:44.005719 7f8b43dab780 10 client.4113 _lookup res is -2
 -10-16 12:17:44.005754 7f8b43dab780 10 client.4113 _lookup 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x33aed80) baz = -2
 -10-16 12:17:44.005839 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> -2 (0)
 -10-16 12:17:44.005974 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:44.006021 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:44.006054 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 11:05:19.148558 ctime 2012-10-16 11:05:19.148558
 -10-16 12:17:44.006099 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:44.006257 7f8b43dab780  3 client.4113 ll_create 1.head baz 0100644 33345, uid 0, gid 0
 -10-16 12:17:44.006301 7f8b43dab780  3 client.4113 _mknod(1 baz, 0100644, 0, uid 0, gid 0)
 -10-16 12:17:44.006374 7f8b43dab780 20 client.4113 get_or_create 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x33aed80) name baz
 -10-16 12:17:44.006584 7f8b43dab780 15 client.4113 link dir 0x33aed80 'baz' to inode 0 dn 0x34142a0 (new dn)
 -10-16 12:17:44.006616 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:44.006695 7f8b43dab780 20 client.4113 choose_target_mds inode dir hash is 2 on baz => 973105927
 -10-16 12:17:44.006709 7f8b43dab780 20 client.4113 choose_target_mds 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x33aed80) is_hash=1 hash=973105927
 -10-16 12:17:44.006789 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x33aed80)
 -10-16 12:17:44.006862 7f8b43dab780 20 client.4113 mds is 0
 -10-16 12:17:44.006891 7f8b43dab780 10 client.4113 send_request rebuilding request 5 for mds.0
 -10-16 12:17:44.006930 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da580, mds: 0)
 -10-16 12:17:44.006944 7f8b43dab780 20 client.4113 encode_dentry_release enter(dn:0x34142a0)
 -10-16 12:17:44.006953 7f8b43dab780 20 client.4113 encode_inode_release enter(in:1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXsFs) 0x33aed80), req:0x33da580 mds:0, drop:256, unless:512, have:, force:1)
 -10-16 12:17:44.007136 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:44.007134
 -10-16 12:17:44.007180 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:5 mknod #1/baz) v1 to mds.0
 -10-16 12:17:44.007318 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e6840
 -10-16 12:17:44.015174 7f8b3f208700 10 client.4113  mds.1 seq now 1
 -10-16 12:17:44.015238 7f8b3f208700  5 client.4113 handle_cap_grant on in 1 mds.1 seq 2 caps now pAsLsXs was pAsLsXsFs
 -10-16 12:17:44.015285 7f8b3f208700 10 client.4113 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXsFs(0=pAsLsXs,1=pAsLsXsFs) 0x33aed80) pAsLsXsFs mtime 2012-10-16 11:05:19.148558
 -10-16 12:17:44.015392 7f8b3f208700 10 client.4113   revocation of Fs
 -10-16 12:17:44.015415 7f8b3f208700 10 client.4113 check_caps on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80) wanted - used - is_delayed=1
 -10-16 12:17:44.015470 7f8b3f208700 10 client.4113  cap mds.0 issued pAsLsXs implemented pAsLsXs revoking -
 -10-16 12:17:44.015489 7f8b3f208700 10 client.4113  cap mds.1 issued pAsLsXs implemented pAsLsXsFs revoking Fs
 -10-16 12:17:44.015510 7f8b3f208700 10 client.4113 completed revocation of Fs
 -10-16 12:17:44.015529 7f8b3f208700 10 client.4113 send_cap 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80) mds.1 seq 2 used - want - flush - retain pAsLsXs held pAsLsXsFs revoking Fs dropping -
 -10-16 12:17:44.039985 7f8b3f208700 10 client.4113  mds.0 seq now 1
 -10-16 12:17:44.040021 7f8b3f208700  5 client.4113 handle_caps don't have vino 10000000005.head, dropping
 -10-16 12:17:44.042639 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 5
 -10-16 12:17:44.042676 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:44.007134 mds.0 is_target=1 is_dentry=1
 -10-16 12:17:44.042706 7f8b3f208700 10 client.4113  features 0x7fffff
 -10-16 12:17:44.042718 7f8b3f208700 10 client.4113 update_snap_trace len 48
 -10-16 12:17:44.042755 7f8b3f208700 10 client.4113 update_snap_trace snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 12:17:44.042802 7f8b3f208700 10 client.4113  hrm  is_target=1 is_dentry=1
 -10-16 12:17:44.042965 7f8b3f208700 12 client.4113 add_update_inode adding 10000000005.head(ref=0 cap_refs={} open={} mode=100000 size=0 mtime=0.000000 caps=- objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x33af680) caps pAsxLsXsxFsxcrwb
 -10-16 12:17:44.043027 7f8b3f208700 10 client.4113 update_inode_file_bits 10000000005.head(ref=0 cap_refs={} open={} mode=100644 size=0 mtime=0.000000 caps=- objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x33af680) - mtime 2012-10-16 12:17:44.022617
 -10-16 12:17:44.043152 7f8b3f208700 15 client.4113 add_update_cap first one, opened snaprealm 0x33e0c30
 -10-16 12:17:44.043194 7f8b3f208700 10 client.4113 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 10000000005.head(ref=0 cap_refs={} open={} mode=100644 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x33af680)
 -10-16 12:17:44.043225 7f8b3f208700 12 client.4113 add_update_inode had 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80) caps pAsLsXs
 -10-16 12:17:44.043251 7f8b3f208700 20 client.4113  dir hash is 2
 -10-16 12:17:44.043254 7f8b3f208700 10 client.4113 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 11:05:19.148558 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80) pAsLsXs mtime 2012-10-16 12:17:44.022617
 -10-16 12:17:44.043286 7f8b3f208700 10 client.4113 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80)
 -10-16 12:17:44.043309 7f8b3f208700 20 client.4113 got dirfrag map for 1 frag * to mds 0
 -10-16 12:17:44.043331 7f8b3f208700 12 client.4113 insert_dentry_inode 'baz' vino 10000000005.head in dir 1.head dn 0x34142a0
 -10-16 12:17:44.043339 7f8b3f208700 15 client.4113 link dir 0x33aed80 'baz' to inode 0x33af680 dn 0x34142a0 (old dn)
 -10-16 12:17:44.043347 7f8b3f208700 20 client.4113 link  inode 0x33af680 parents now 0x34142a0
 -10-16 12:17:44.043356 7f8b3f208700 15 client.4113  setting dn offset to 2
 -10-16 12:17:44.043366 7f8b3f208700 10 client.4113 got dentry lease on baz dur 30000ms ttl 2012-10-16 12:18:14.007134
 -10-16 12:17:44.043381 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e6840
 -10-16 12:17:44.043387 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 5 0x7f8b3f2076d0
 -10-16 12:17:44.043398 7f8b43dab780 20 client.4113 sendrecv kickback on tid 5 0x7f8b3f2076d0
 -10-16 12:17:44.043406 7f8b43dab780 20 client.4113 lat 0.036270
 -10-16 12:17:44.043422 7f8b43dab780 20 client.4113 trim_cache size 1 max 16384
 -10-16 12:17:44.043427 7f8b43dab780  3 client.4113 mknod(#1/baz, 0100644) = 0
 -10-16 12:17:44.043460 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 10000000005.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.043484 7f8b43dab780 20 client.4113 choose_target_mds 10000000005.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) is_hash=0 hash=0
 -10-16 12:17:44.043500 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 10000000005.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.043518 7f8b43dab780 20 client.4113 mds is 0
 -10-16 12:17:44.043526 7f8b43dab780 10 client.4113 send_request rebuilding request 6 for mds.0
 -10-16 12:17:44.043535 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da000, mds: 0)
 -10-16 12:17:44.043538 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:44.043538
 -10-16 12:17:44.043543 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:6 open #10000000005) v1 to mds.0
 -10-16 12:17:44.043575 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e6970
 -10-16 12:17:44.047882 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:0 tid 6
 -10-16 12:17:44.047886 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:44.043538 mds.0 is_target=1 is_dentry=0
 -10-16 12:17:44.047892 7f8b3f208700 10 client.4113  features 0x7fffff
 -10-16 12:17:44.047894 7f8b3f208700 10 client.4113 update_snap_trace len 48
 -10-16 12:17:44.047901 7f8b3f208700 10 client.4113 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 12:17:44.047929 7f8b3f208700 10 client.4113  hrm  is_target=1 is_dentry=0
 -10-16 12:17:44.047967 7f8b3f208700 12 client.4113 add_update_inode had 10000000005.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) caps pAsxLsXsxFsxcrwb
 -10-16 12:17:44.048051 7f8b3f208700 10 client.4113 update_inode_file_bits 10000000005.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) pAsxLsXsxFsxcrwb mtime 2012-10-16 12:17:44.044848
 -10-16 12:17:44.048148 7f8b3f208700 10 client.4113 add_update_cap issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 10000000005.head(ref=1 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.044848 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.048223 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e6970
 -10-16 12:17:44.048236 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 6 0x7f8b3f2076d0
 -10-16 12:17:44.048259 7f8b43dab780 20 client.4113 sendrecv kickback on tid 6 0x7f8b3f2076d0
 -10-16 12:17:44.048285 7f8b43dab780 20 client.4113 lat 0.004743
 -10-16 12:17:44.048311 7f8b43dab780 10 client.4113 _create_fh 10000000005 mode 2
 -10-16 12:17:44.048315 7f8b43dab780 20 client.4113 trim_cache size 1 max 16384
 -10-16 12:17:44.048319 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100644 mtime 2012-10-16 12:17:44.044848 ctime 2012-10-16 12:17:44.044848
 -10-16 12:17:44.048334 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 1
 -10-16 12:17:44.048339 7f8b43dab780  3 client.4113 ll_create 1.head baz 0100644 33345 = 0 (0x33aa320 10000000005)
 -10-16 12:17:44.048388 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head
 -10-16 12:17:44.048399 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:44.048404 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100644 mtime 2012-10-16 12:17:44.044848 ctime 2012-10-16 12:17:44.044848
 -10-16 12:17:44.048416 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head = 0
 -10-16 12:17:44.048474 7f8b43dab780  3 client.4113 ll_getxattr 10000000005.head security.capability size 0
 -10-16 12:17:44.048485 7f8b43dab780 10 client.4113 _getattr mask Xs issued=1
 -10-16 12:17:44.048491 7f8b43dab780  3 client.4113 _getxattr(10000000005, "security.capability", 0) = -61
 -10-16 12:17:44.048510 7f8b43dab780  3 client.4113 ll_write 0x33aa320 10000000005 0~4
 -10-16 12:17:44.048523 7f8b43dab780 10 client.4113 cur file size is 0
 -10-16 12:17:44.048532 7f8b43dab780 10 client.4113 wanted_max_size 0 -> 4
 -10-16 12:17:44.048539 7f8b43dab780 10 client.4113 check_caps on 10000000005.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.044848 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) wanted pAsxXsxFxwb used - is_delayed=0
 -10-16 12:17:44.048569 7f8b43dab780 10 client.4113 cap_delay_requeue on 10000000005.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.044848 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.048594 7f8b43dab780 10 client.4113  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 12:17:44.048611 7f8b43dab780 10 client.4113 delaying cap release
 -10-16 12:17:44.048616 7f8b43dab780 10 client.4113 get_caps 10000000005.head(ref=3 cap_refs={} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.044848 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) have pAsxLsXsxFsxcrwb need Fw want Fb but not Fb revoking -
 -10-16 12:17:44.048648 7f8b43dab780 10 client.4113  snaprealm snaprealm(1 nref=3 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[])
 -10-16 12:17:44.048661 7f8b43dab780  5 client.4113 get_cap_ref got first FILE_BUFFER ref on 10000000005.head(ref=3 cap_refs={4096=1,8192=0} open={2=1} mode=100644 size=0 mtime=2012-10-16 12:17:44.044848 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.048891 7f8b43dab780 10 client.4113 mark_caps_dirty 10000000005.head(ref=4 cap_refs={4096=1,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 12:17:44.044848 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 4] parents=0x34142a0 0x33af680) - -> Fw
 -10-16 12:17:44.048923 7f8b43dab780  7 client.4113 wrote to 4, extending file size
 -10-16 12:17:44.048929 7f8b43dab780 10 client.4113 mark_caps_dirty 10000000005.head(ref=5 cap_refs={4096=1,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 4] parents=0x34142a0 0x33af680) Fw -> Fw
 -10-16 12:17:44.048963 7f8b43dab780  3 client.4113 ll_write 0x33aa320 0~4 = 4
 -10-16 12:17:44.049003 7f8b43dab780  3 client.4113 ll_release 0x33aa320 10000000005
 -10-16 12:17:44.049011 7f8b43dab780  5 client.4113 _release_fh 0x33aa320 mode 2 on 10000000005.head(ref=5 cap_refs={4096=0,8192=1} open={2=1} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 4] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.049042 7f8b43dab780 10 client.4113 _flush 10000000005.head(ref=5 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 4] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.049528 7f8b43dab780 10 client.4113 check_caps on 10000000005.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 4] parents=0x34142a0 0x33af680) wanted Fxb used Fb is_delayed=0
 -10-16 12:17:44.049561 7f8b43dab780 10 client.4113 cap_delay_requeue on 10000000005.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 4] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.049592 7f8b43dab780 10 client.4113  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 12:17:44.049601 7f8b43dab780 10 client.4113 delaying cap release
 -10-16 12:17:44.049604 7f8b43dab780 10 client.4113 put_inode on 10000000005.head(ref=6 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 4] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.050342 7f8b3f208700 10 client.4113 ms_handle_connect on 127.0.0.1:6800/14116
 -10-16 12:17:44.054178 7f8b3f208700 10 client.4113 put_inode on 10000000005.head(ref=5 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.054205 7f8b3f208700 10 client.4113 _flushed 10000000005.head(ref=4 cap_refs={4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.054224 7f8b3f208700 10 client.4113 _invalidate_inode_cache 10000000005.head(ref=4 cap_refs={1024=0,4096=0,8192=1} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 1 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.054265 7f8b3f208700 10 client.4113 check_caps on 10000000005.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) wanted - used - is_delayed=0
 -10-16 12:17:44.054283 7f8b3f208700 10 client.4113 cap_delay_requeue on 10000000005.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.054300 7f8b3f208700 10 client.4113  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 12:17:44.054306 7f8b3f208700 10 client.4113 delaying cap release
 -10-16 12:17:44.054308 7f8b3f208700  5 client.4113 put_cap_ref dropped last FILE_BUFFER ref on 10000000005.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.054323 7f8b3f208700 10 client.4113 put_inode on 10000000005.head(ref=4 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:44.940817 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 6
 -10-16 12:17:44.940854 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:44.043538 mds.0 is_target=0 is_dentry=0
 -10-16 12:17:44.940888 7f8b3f208700 10 client.4113 insert_trace -- no trace
 -10-16 12:17:44.941639 7f8b3f208700 10 client.4113  mds.0 seq now 2
 -10-16 12:17:44.941673 7f8b3f208700  5 client.4113 handle_cap_grant on in 10000000005 mds.0 seq 3 caps now pAsxLsXsxFsxcrwb was pAsxLsXsxFsxcrwb
 -10-16 12:17:44.941705 7f8b3f208700 10 client.4113 update_inode_file_bits 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) pAsxLsXsxFsxcrwb mtime 2012-10-16 12:17:44.044848
 -10-16 12:17:44.941794 7f8b3f208700 10 client.4113   caps unchanged at pAsxLsXsxFsxcrwb
 -10-16 12:17:46.944353 7f8b4020a700 10 client.4113 renew_caps()
 -10-16 12:17:46.944405 7f8b4020a700 15 client.4113 renew_caps requesting from mds.0
 -10-16 12:17:46.944441 7f8b4020a700 10 client.4113 renew_caps mds.0
 -10-16 12:17:46.944689 7f8b4020a700 15 client.4113 renew_caps requesting from mds.1
 -10-16 12:17:46.944734 7f8b4020a700 10 client.4113 renew_caps mds.1
 -10-16 12:17:46.946834 7f8b3f208700 10 client.4113 handle_client_session client_session(renewcaps seq 3) v1 from mds.1
 -10-16 12:17:46.947123 7f8b3f208700 10 client.4113 handle_client_session client_session(renewcaps seq 3) v1 from mds.0
 -10-16 12:17:47.929537 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:47.929606 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=0
 -10-16 12:17:47.929675 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80)
 -10-16 12:17:47.929739 7f8b43dab780 20 client.4113 choose_target_mds 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80) is_hash=0 hash=0
 -10-16 12:17:47.929802 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80)
 -10-16 12:17:47.929850 7f8b43dab780 20 client.4113 mds is 0
 -10-16 12:17:47.929876 7f8b43dab780 10 client.4113 send_request rebuilding request 7 for mds.0
 -10-16 12:17:47.929903 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33dab00, mds: 0)
 -10-16 12:17:47.929914 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:47.929913
 -10-16 12:17:47.929937 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:7 getattr pAsLsXsFs #1) v1 to mds.0
 -10-16 12:17:47.930069 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e68f0
 -10-16 12:17:47.941788 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 7
 -10-16 12:17:47.941828 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:47.929913 mds.0 is_target=1 is_dentry=0
 -10-16 12:17:47.941856 7f8b3f208700 10 client.4113  features 0x7fffff
 -10-16 12:17:47.941867 7f8b3f208700 10 client.4113 update_snap_trace len 48
 -10-16 12:17:47.941900 7f8b3f208700 10 client.4113 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 12:17:47.941944 7f8b3f208700 10 client.4113  hrm  is_target=1 is_dentry=0
 -10-16 12:17:47.942000 7f8b3f208700 12 client.4113 add_update_inode had 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80) caps pAsLsXsFs
 -10-16 12:17:47.942118 7f8b3f208700 20 client.4113  dir hash is 2
 -10-16 12:17:47.942129 7f8b3f208700 10 client.4113 update_inode_file_bits 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXs(0=pAsLsXs,1=pAsLsXs) 0x33aed80) pAsLsXs mtime 2012-10-16 12:17:44.022617
 -10-16 12:17:47.942272 7f8b3f208700 10 client.4113 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80)
 -10-16 12:17:47.942372 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e68f0
 -10-16 12:17:47.942395 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 7 0x7f8b3f2076d0
 -10-16 12:17:47.942423 7f8b43dab780 20 client.4113 sendrecv kickback on tid 7 0x7f8b3f2076d0
 -10-16 12:17:47.942436 7f8b43dab780 20 client.4113 lat 0.012520
 -10-16 12:17:47.942472 7f8b43dab780 10 client.4113 _getattr result=0
 -10-16 12:17:47.942485 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:47.942531 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:47.942688 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:47.942729 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:47.942800 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:47.942920 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100644 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:44.044848
 -10-16 12:17:47.942961 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 2
 -10-16 12:17:47.942974 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:47.943133 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head
 -10-16 12:17:47.943167 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:47.943173 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100644 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:44.044848
 -10-16 12:17:47.943184 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head = 0
 -10-16 12:17:47.943215 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:47.943222 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:47.943227 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:47.943239 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:47.943258 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:47.943266 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:47.943279 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100644 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:47.943311 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100644 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:44.044848
 -10-16 12:17:47.943322 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 3
 -10-16 12:17:47.943326 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:47.943350 7f8b43dab780  3 client.4113 ll_setattr 10000000005.head mask 1
 -10-16 12:17:47.943362 7f8b43dab780 10 client.4113 _setattr mask 1 issued pAsxLsXsxFsxcrwb
 -10-16 12:17:47.943370 7f8b43dab780 10 client.4113 mark_caps_dirty 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) Fw -> AxFw
 -10-16 12:17:47.943404 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:47.943369
 -10-16 12:17:47.943416 7f8b43dab780  3 client.4113 ll_setattr 10000000005.head = 0
 -10-16 12:17:49.944736 7f8b4020a700 10 client.4113 check_caps on 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=AxFw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) wanted - used - is_delayed=1
 -10-16 12:17:49.944946 7f8b4020a700 10 client.4113  cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking -
 -10-16 12:17:49.944994 7f8b4020a700 10 client.4113 mark_caps_flushing AxFw 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=AxFw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:49.945119 7f8b4020a700 10 client.4113 send_cap 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=AxFw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) mds.0 seq 3 used - want - flush AxFw retain pAsLsXsFs held pAsxLsXsxFsxcrwb revoking - dropping AxXxFxcrwb
 -10-16 12:17:49.945312 7f8b4020a700 15 client.4113 auth cap, setting max_size = 4
 -10-16 12:17:54.950897 7f8b3f208700 10 client.4113  mds.0 seq now 3
 -10-16 12:17:54.950917 7f8b3f208700  5 client.4113 handle_cap_flush_ack mds.0 cleaned AxFw on 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) flushing_caps=AxFw objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) with AxFw
 -10-16 12:17:54.950948 7f8b3f208700  5 client.4113   flushing_caps AxFw -> -
 -10-16 12:17:54.950952 7f8b3f208700 10 client.4113  10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) !flushing
 -10-16 12:17:54.950978 7f8b3f208700 10 client.4113 put_inode on 10000000005.head(ref=3 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:54.982320 7f8b3f208700  1 client.4113 handle_mds_map epoch 24
 -10-16 12:17:55.384561 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:55.384608 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:55.384618 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:55.384637 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:55.384672 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:55.384686 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:55.384708 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:55.384746 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:47.943369
 -10-16 12:17:55.384758 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 4
 -10-16 12:17:55.384762 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:55.384827 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head
 -10-16 12:17:55.384851 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:55.384856 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:47.943369
 -10-16 12:17:55.384868 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head = 0
 -10-16 12:17:55.384922 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:55.384956 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:55.384961 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:55.384974 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:55.385004 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:55.385014 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:55.385027 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:55.385056 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:47.943369
 -10-16 12:17:55.385067 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 5
 -10-16 12:17:55.385070 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:55.385134 7f8b43dab780  3 client.4113 ll_setattr 10000000005.head mask 1
 -10-16 12:17:55.385165 7f8b43dab780 10 client.4113 _setattr mask 1 issued pAsLsXsFs
 -10-16 12:17:55.385217 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:55.385237 7f8b43dab780 20 client.4113 choose_target_mds 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) is_hash=0 hash=0
 -10-16 12:17:55.385261 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:55.385284 7f8b43dab780 20 client.4113 mds is 0
 -10-16 12:17:55.385296 7f8b43dab780 10 client.4113 send_request rebuilding request 8 for mds.0
 -10-16 12:17:55.385311 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33da2c0, mds: 0)
 -10-16 12:17:55.385316 7f8b43dab780 20 client.4113 encode_inode_release enter(in:10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pAsLsXsFs(0=pAsLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680), req:0x33da2c0 mds:0, drop:4, unless:0, have:, force:0)
 -10-16 12:17:55.385349 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:55.385348
 -10-16 12:17:55.385363 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:8 setattr mode=064331882 #10000000005) v1 to mds.0
 -10-16 12:17:55.385419 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e6890
 -10-16 12:17:55.387544 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:0 tid 8
 -10-16 12:17:55.387550 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:55.385348 mds.0 is_target=1 is_dentry=0
 -10-16 12:17:55.387556 7f8b3f208700 10 client.4113  features 0x7fffff
 -10-16 12:17:55.387559 7f8b3f208700 10 client.4113 update_snap_trace len 48
 -10-16 12:17:55.387571 7f8b3f208700 10 client.4113 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 12:17:55.387587 7f8b3f208700 10 client.4113  hrm  is_target=1 is_dentry=0
 -10-16 12:17:55.387603 7f8b3f208700 12 client.4113 add_update_inode had 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFs(0=pLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) caps pLsXsFscr
 -10-16 12:17:55.387634 7f8b3f208700 10 client.4113 update_inode_file_bits 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFs(0=pLsXsFs) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) pAxLsXsxFsxcrwb mtime 2012-10-16 12:17:44.048929
 -10-16 12:17:55.387700 7f8b3f208700 10 client.4113 add_update_cap issued pLsXsFs -> pLsXsFscr from mds.0 on 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:55.387727 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e6890
 -10-16 12:17:55.387734 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 8 0x7f8b3f2076d0
 -10-16 12:17:55.387743 7f8b43dab780 20 client.4113 sendrecv kickback on tid 8 0x7f8b3f2076d0
 -10-16 12:17:55.387747 7f8b43dab780 20 client.4113 lat 0.002398
 -10-16 12:17:55.387758 7f8b43dab780 10 client.4113 _setattr result=0
 -10-16 12:17:55.387762 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:55.386696
 -10-16 12:17:55.387774 7f8b43dab780  3 client.4113 ll_setattr 10000000005.head = 0
 -10-16 12:17:57.826810 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:57.826877 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:57.826906 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:57.826955 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:57.827073 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:57.827114 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:57.827168 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:57.827314 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:55.386696
 -10-16 12:17:57.827355 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 6
 -10-16 12:17:57.827368 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:57.827489 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head
 -10-16 12:17:57.827549 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=0
 -10-16 12:17:57.827639 7f8b43dab780 20 client.4113 choose_target_mds starting with req->inode 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:57.827717 7f8b43dab780 20 client.4113 choose_target_mds 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) is_hash=0 hash=0
 -10-16 12:17:57.827807 7f8b43dab780 10 client.4113 choose_target_mds from caps on inode 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:57.827887 7f8b43dab780 20 client.4113 mds is 0
 -10-16 12:17:57.827920 7f8b43dab780 10 client.4113 send_request rebuilding request 9 for mds.0
 -10-16 12:17:57.827963 7f8b43dab780 20 client.4113 encode_cap_releases enter (req: 0x33db8c0, mds: 0)
 -10-16 12:17:57.827979 7f8b43dab780 20 client.4113 send_request set sent_stamp to 2012-10-16 12:17:57.827977
 -10-16 12:17:57.828008 7f8b43dab780 10 client.4113 send_request client_request(unknown.0:9 getattr pAsLsXsFs #10000000005) v1 to mds.0
 -10-16 12:17:57.828188 7f8b43dab780 20 client.4113 awaiting reply|forward|kick on 0x7fffba5e68f0
 -10-16 12:17:57.833408 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 9
 -10-16 12:17:57.833455 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:57.827977 mds.0 is_target=1 is_dentry=0
 -10-16 12:17:57.833482 7f8b3f208700 10 client.4113  features 0x7fffff
 -10-16 12:17:57.833493 7f8b3f208700 10 client.4113 update_snap_trace len 48
 -10-16 12:17:57.833527 7f8b3f208700 10 client.4113 update_snap_trace snaprealm(1 nref=4 c=0 seq=1 parent=0 my_snaps=[] cached_snapc=1=[]) seq 1 <= 1 and same parent, SKIPPING
 -10-16 12:17:57.833574 7f8b3f208700 10 client.4113  hrm  is_target=1 is_dentry=0
 -10-16 12:17:57.833631 7f8b3f208700 12 client.4113 add_update_inode had 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) caps pLsXsFscr
 -10-16 12:17:57.833745 7f8b3f208700 10 client.4113 update_inode_file_bits 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) pAxLsXsxFsxcrwb mtime 2012-10-16 12:17:44.048929
 -10-16 12:17:57.833881 7f8b3f208700 10 client.4113 add_update_cap issued pLsXsFscr -> pLsXsFscr from mds.0 on 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:57.834001 7f8b3f208700 20 client.4113 handle_client_reply signalling caller 0x7fffba5e68f0
 -10-16 12:17:57.834022 7f8b3f208700 20 client.4113 handle_client_reply awaiting kickback on tid 9 0x7f8b3f2076d0
 -10-16 12:17:57.834056 7f8b43dab780 20 client.4113 sendrecv kickback on tid 9 0x7f8b3f2076d0
 -10-16 12:17:57.834069 7f8b43dab780 20 client.4113 lat 0.006089
 -10-16 12:17:57.834106 7f8b43dab780 10 client.4113 _getattr result=0
 -10-16 12:17:57.834118 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:55.386696
 -10-16 12:17:57.834160 7f8b43dab780  3 client.4113 ll_getattr 10000000005.head = 0
 -10-16 12:17:57.834291 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:57.834330 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:57.834352 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:57.834415 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:57.834493 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:57.834529 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:57.834575 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:57.834723 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:55.386696
 -10-16 12:17:57.834763 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 7
 -10-16 12:17:57.834775 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:57.834857 7f8b43dab780  3 client.4113 ll_getxattr 10000000005.head security.selinux size 255
 -10-16 12:17:57.834887 7f8b43dab780 10 client.4113 _getattr mask Xs issued=1
 -10-16 12:17:57.834907 7f8b43dab780  3 client.4113 _getxattr(10000000005, "security.selinux", 255) = -61
 -10-16 12:17:57.834998 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:57.835023 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:57.835077 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:57.835125 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:57.835196 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:57.835230 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:57.835273 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:57.835422 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:55.386696
 -10-16 12:17:57.835464 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 8
 -10-16 12:17:57.835494 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:57.835572 7f8b43dab780  3 client.4113 ll_getxattr 10000000005.head system.posix_acl_access size 0
 -10-16 12:17:57.835599 7f8b43dab780 10 client.4113 _getattr mask Xs issued=1
 -10-16 12:17:57.835616 7f8b43dab780  3 client.4113 _getxattr(10000000005, "system.posix_acl_access", 0) = -61
 -10-16 12:17:57.835682 7f8b43dab780  3 client.4113 ll_getattr 1.head
 -10-16 12:17:57.835707 7f8b43dab780 10 client.4113 _getattr mask pAsLsXsFs issued=1
 -10-16 12:17:57.835725 7f8b43dab780 10 client.4113 fill_stat on 1 snap/devhead mode 040755 mtime 2012-10-16 12:17:44.022617 ctime 2012-10-16 12:17:44.022617
 -10-16 12:17:57.835766 7f8b43dab780  3 client.4113 ll_getattr 1.head = 0
 -10-16 12:17:57.835832 7f8b43dab780  3 client.4113 ll_lookup 1.head baz
 -10-16 12:17:57.835863 7f8b43dab780 20 client.4113 _lookup have dn baz mds.0 ttl 2012-10-16 12:18:14.007134 seq 2
 -10-16 12:17:57.835904 7f8b43dab780 10 client.4113 _lookup 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) baz = 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:17:57.836024 7f8b43dab780 10 client.4113 fill_stat on 10000000005 snap/devhead mode 0100400 mtime 2012-10-16 12:17:44.048929 ctime 2012-10-16 12:17:55.386696
 -10-16 12:17:57.836064 7f8b43dab780 20 client.4113 _ll_get 0x33af680 10000000005 -> 9
 -10-16 12:17:57.836076 7f8b43dab780  3 client.4113 ll_lookup 1.head baz -> 0 (10000000005)
 -10-16 12:17:57.836151 7f8b43dab780  3 client.4113 ll_getxattr 10000000005.head system.posix_acl_default size 0
 -10-16 12:17:57.836179 7f8b43dab780 10 client.4113 _getattr mask Xs issued=1
 -10-16 12:17:57.836201 7f8b43dab780  3 client.4113 _getxattr(10000000005, "system.posix_acl_default", 0) = -61
 -10-16 12:17:59.939901 7f8b3f208700 20 client.4113 handle_client_reply got a reply. Safe:1 tid 8
 -10-16 12:17:59.939909 7f8b3f208700 10 client.4113 insert_trace from 2012-10-16 12:17:55.385348 mds.0 is_target=0 is_dentry=0
 -10-16 12:17:59.939920 7f8b3f208700 10 client.4113 insert_trace -- no trace
 -10-16 12:18:05.403832 7f8b43dab780  3 client.4113 ll_forget 10000000005.head 9
 -10-16 12:18:05.403906 7f8b43dab780 20 client.4113 _ll_put 0x33af680 10000000005 9 -> 0
 -10-16 12:18:05.403927 7f8b43dab780 10 client.4113 put_inode on 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:18:05.404322 7f8b43dab780  3 client.4113 ll_forget 1.head 1
 -10-16 12:18:05.404700 7f8b43dab780  2 client.4113 unmounting
 -10-16 12:18:05.404747 7f8b43dab780 10 client.4113 put_inode on 1.head(ref=3 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80)
 -10-16 12:18:05.404839 7f8b43dab780 10 client.4113 _ll_drop_pins
 -10-16 12:18:05.404892 7f8b43dab780 20 client.4113 _ll_put 0x33aed80 1 1 -> 0
 -10-16 12:18:05.404906 7f8b43dab780 10 client.4113 put_inode on 1.head(ref=2 cap_refs={} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80)
 -10-16 12:18:05.405022 7f8b43dab780 10 client.4113 _flush 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:18:05.405107 7f8b43dab780 10 client.4113  nothing to flush
 -10-16 12:18:05.405118 7f8b43dab780 10 client.4113 put_inode on 10000000005.head(ref=2 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680)
 -10-16 12:18:05.405246 7f8b43dab780 10 client.4113 _flush 1.head(ref=2 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80)
 -10-16 12:18:05.405304 7f8b43dab780 10 client.4113  nothing to flush
 -10-16 12:18:05.405313 7f8b43dab780 10 client.4113 put_inode on 1.head(ref=2 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80)
 -10-16 12:18:05.405411 7f8b43dab780 10 client.4113 flush_caps
 -10-16 12:18:05.405429 7f8b43dab780 10 client.4113 check_caps on 1.head(ref=1 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) wanted - used - is_delayed=1
 -10-16 12:18:05.405518 7f8b43dab780 10 client.4113  cap mds.0 issued pAsLsXsFs implemented pAsLsXsFs revoking -
 -10-16 12:18:05.405546 7f8b43dab780 10 client.4113 send_cap 1.head(ref=1 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXsFs(0=pAsLsXsFs,1=pAsLsXs) 0x33aed80) mds.0 seq 3 used - want - flush - retain p held pAsLsXsFs revoking - dropping AsLsXsFs
 -10-16 12:18:05.405673 7f8b43dab780 15 client.4113 auth cap, setting max_size = 0
 -10-16 12:18:05.405838 7f8b43dab780 10 client.4113  cap mds.1 issued pAsLsXs implemented pAsLsXs revoking -
 -10-16 12:18:05.405869 7f8b43dab780 10 client.4113 send_cap 1.head(ref=1 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=pAsLsXs(0=p,1=pAsLsXs) 0x33aed80) mds.1 seq 2 used - want - flush - retain p held pAsLsXs revoking - dropping AsLsXs
 -10-16 12:18:05.406116 7f8b43dab780 10 client.4113 check_caps on 10000000005.head(ref=1 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) wanted - used - is_delayed=1
 -10-16 12:18:05.406259 7f8b43dab780 10 client.4113  cap mds.0 issued pLsXsFscr implemented pAxLsXsxFsxcrwb revoking AxXxFxwb
 -10-16 12:18:05.406299 7f8b43dab780 10 client.4113 completed revocation of AxXxFxwb
 -10-16 12:18:05.406315 7f8b43dab780 10 client.4113 send_cap 10000000005.head(ref=1 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=pLsXsFscr(0=pLsXsFscr) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x34142a0 0x33af680) mds.0 seq 5 used - want - flush - retain p held pAxLsXsxFsxcrwb revoking AxXxFxwb dropping LsXsFscr
 -10-16 12:18:05.406452 7f8b43dab780 15 client.4113 auth cap, setting max_size = 4
 -10-16 12:18:05.406587 7f8b43dab780 10 client.4113 wait_sync_caps want 1 (last is 1, 0 total flushing)
 -10-16 12:18:05.406614 7f8b43dab780 20 client.4113 trim_cache size 1 max 0
 -10-16 12:18:05.406628 7f8b43dab780 15 client.4113 trim_dentry unlinking dn baz in dir 1
 -10-16 12:18:05.406640 7f8b43dab780 15 client.4113 unlink dir 0x33aed80 'baz' dn 0x34142a0 inode 0x33af680
 -10-16 12:18:05.406689 7f8b43dab780 20 client.4113 unlink  inode 0x33af680 parents now
 -10-16 12:18:05.406701 7f8b43dab780 10 client.4113 put_inode on 10000000005.head(ref=1 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=p(0=p) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x33af680)
 -10-16 12:18:05.406779 7f8b43dab780 10 client.4113 remove_cap mds.0 on 10000000005.head(ref=0 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=p(0=p) objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x33af680)
 -10-16 12:18:05.406893 7f8b43dab780 15 client.4113 remove_cap last one, closing snaprealm 0x33e0c30
 -10-16 12:18:05.406908 7f8b43dab780 10 client.4113 put_inode deleting 10000000005.head(ref=0 cap_refs={1024=0,4096=0,8192=0} open={2=0} mode=100400 size=4 mtime=2012-10-16 12:17:44.048929 caps=- objectset[10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x33af680)
 -10-16 12:18:05.407071 7f8b43dab780 15 client.4113 close_dir dir 0x3414310 on 0x33aed80
 -10-16 12:18:05.407095 7f8b43dab780 10 client.4113 put_inode on 1.head(ref=1 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=p(0=p,1=p) 0x33aed80)
 -10-16 12:18:05.407164 7f8b43dab780 10 client.4113 remove_cap mds.0 on 1.head(ref=0 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=p(0=p,1=p) 0x33aed80)
 -10-16 12:18:05.407250 7f8b43dab780 10 client.4113 remove_cap mds.1 on 1.head(ref=0 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=p(1=p) 0x33aed80)
 -10-16 12:18:05.407338 7f8b43dab780 15 client.4113 remove_cap last one, closing snaprealm 0x33e0c30
 -10-16 12:18:05.407351 7f8b43dab780 10 client.4113 put_inode deleting 1.head(ref=0 cap_refs={1024=0} open={} mode=40755 size=0 mtime=2012-10-16 12:17:44.022617 caps=- 0x33aed80)
 -10-16 12:18:05.407436 7f8b43dab780  2 client.4113 sending client_session close to mds.0 seq 3
 -10-16 12:18:05.407564 7f8b43dab780  2 client.4113 sending client_session close to mds.1 seq 1
 -10-16 12:18:05.407682 7f8b43dab780  2 client.4113 waiting for 2 mds sessions to close
 -10-16 12:18:05.423847 7f8b3f208700 10 client.4113 handle_client_session client_session(close) v1 from mds.1
 -10-16 12:18:05.423863 7f8b3f208700 10 client.4113 kick_requests for mds.1
 -10-16 12:18:05.423892 7f8b3f208700 10 client.4113 unmounting: trim pass, size was 0+0
 -10-16 12:18:05.423898 7f8b3f208700 20 client.4113 trim_cache size 0 max 0
 -10-16 12:18:05.423902 7f8b3f208700 10 client.4113 unmounting: trim pass, cache now empty, waking unmount()
 -10-16 12:18:05.423917 7f8b43dab780  2 client.4113 waiting for 1 mds sessions to close
 -10-16 12:18:05.428217 7f8b3f208700 10 client.4113 handle_client_session client_session(close) v1 from mds.0
 -10-16 12:18:05.428230 7f8b3f208700 10 client.4113 kick_requests for mds.0
 -10-16 12:18:05.428257 7f8b3f208700 10 client.4113 unmounting: trim pass, size was 0+0
 -10-16 12:18:05.428262 7f8b3f208700 20 client.4113 trim_cache size 0 max 0
 -10-16 12:18:05.428266 7f8b3f208700 10 client.4113 unmounting: trim pass, cache now empty, waking unmount()
 -10-16 12:18:05.428357 7f8b43dab780  2 client.4113 unmounted.
 -10-16 12:18:05.428388 7f8b43dab780  1 client.4113 shutdown
 -10-16 12:18:05.429546 7f8b43dab780 20 client.4113 trim_cache size 0 max 0

(3-3/5)

Project

General

Profile

Ceph » CephFS

Bug #3301 » client.admin.log