Ceph » CephFS

hi. I have cephfs (kernel client) mounted from two hosts at /var/www.
I'm trying to do

stat /var/www/configuration/etc/php5/apache2/php.ini

ls -la /var/www/configuration/etc/php5/apache2/php.ini

and it hangs.

MDS doesn't show anything except

2013-03-19 00:00:25.721238 7fa79ddfe700 10 mds.-1.0 handle_mds_beacon up:standby seq 69 rtt 0.002541
2013-03-19 00:00:28.713766 7fa79bcf9700 20 mds.-1.bal get_load no root, no load
2013-03-19 00:00:28.713831 7fa79bcf9700 15 mds.-1.bal get_load mdsload<[0,0 0]/[0,0 0], req 0, hr 0, qlen 0, cpu 0.12>
2013-03-19 00:00:29.718796 7fa79bcf9700 10 mds.-1.0 beacon_send up:standby seq 70 (currently up:standby)
2013-03-19 00:00:29.718830 7fa79bcf9700  1 -- 10.252.0.4:6802/4678 --> 10.252.0.3:6789/0 -- mdsbeacon(15037/1 up:standby seq 70 v463) v2 -- ?+0 0x1e4fdc0 con 0x1de9580
2013-03-19 00:00:29.720840 7fa79ddfe700  1 -- 10.252.0.4:6802/4678 <== mon.1 10.252.0.3:6789/0 86 ==== mdsbeacon(15037/1 up:standby seq 70 v463) v2 ==== 103+0+0 (3353078024 0 0) 0x1e49840 con 0x1de9580
2013-03-19 00:00:29.720863 7fa79ddfe700 10 mds.-1.0 handle_mds_beacon up:standby seq 70 rtt 0.002053
2013-03-19 00:00:33.713839 7fa79bcf9700 20 mds.-1.bal get_load no root, no load
2013-03-19 00:00:33.713903 7fa79bcf9700 15 mds.-1.bal get_load mdsload<[0,0 0]/[0,0 0], req 0, hr 0, qlen 0, cpu 0.19>
2013-03-19 00:00:33.718915 7fa79bcf9700 10 mds.-1.0 beacon_send up:standby seq 71 (currently up:standby)
2013-03-19 00:00:33.718944 7fa79bcf9700  1 -- 10.252.0.4:6802/4678 --> 10.252.0.3:6789/0 -- mdsbeacon(15037/1 up:standby seq 71 v463) v2 -- ?+0 0x1e4fb00 con 0x1de9580
2013-03-19 00:00:33.720976 7fa79ddfe700  1 -- 10.252.0.4:6802/4678 <== mon.1 10.252.0.3:6789/0 87 ==== mdsbeacon(15037/1 up:standby seq 71 v463) v2 ==== 103+0+0 (3203568751 0 0) 0x1e49b00 con 0x1de9580
2013-03-19 00:00:33.721003 7fa79ddfe700 10 mds.-1.0 handle_mds_beacon up:standby seq 71 rtt 0.002077
2013-03-19 00:00:37.719037 7fa79bcf9700 10 mds.-1.0 beacon_send up:standby seq 72 (currently up:standby)
2013-03-19 00:00:37.719077 7fa79bcf9700  1 -- 10.252.0.4:6802/4678 --> 10.252.0.3:6789/0 -- mdsbeacon(15037/1 up:standby seq 72 v463) v2 -- ?+0 0x1e4f840 con 0x1de9580
2013-03-19 00:00:37.721179 7fa79ddfe700  1 -- 10.252.0.4:6802/4678 <== mon.1 10.252.0.3:6789/0 88 ==== mdsbeacon(15037/1 up:standby seq 72 v463) v2 ==== 103+0+0 (331341952 0 0) 0x1e49dc0 con 0x1de9580

with

debug ms = 1
debug mds = 20

It stales on file

php.ini - usual file

Hangs on both clients.

Kernel version is 3.7.2.

root@hosting-cloud1-s1:/var/www/configuration/etc/php5/apache2# stat php.ini
  File: `php.ini'
  Size: 67654           Blocks: 133        IO Block: 4194304 regular file
Device: 0h/0d   Inode: 1099514486171  Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2013-03-13 16:39:01.000000000 +0700
Modify: 2013-01-18 16:12:01.000000000 +0700
Change: 2013-03-14 13:51:06.942637000 +0700

After second client reboot, no more hangs.

Mounted as

10.252.0.3:6789,10.252.0.2:6789,10.252.0.4:6789:/hosting/cloud-1/ on /var/www type ceph (snapdirname=.cc633faa563cbe671221758ad9c01de3,dirstat,norbytes,nocrc,name=admin,readdir_max_entries=8192,readdir_max_bytes=4194304,key=client.admin)