Ceph

I am running ceph on 64 bit OS (Debian linux-image-3.0.0-2-x86_64). It is on two machines each of them having 1 mon, 1 mds, and 4 osds. It is using ext4 instead of btrfs, but this error used to happen on btrfs as well. Clients are on 32 bit machines and 64 bit machines. Both architectures are running Debian with very similar configuration. On 32bit machines it is running linux-image-3.0.0-2-686-pae and also tried linux-image-3.0.0-2-486.

When defining libraries which are located in ceph mounted directories in /etc/ld.so.conf.d and running ldconfig, in 32 bit machines, no libraries are found in /etc/ld.so.cache while 64 bit machines work ok. When moving the libraries in tmpfs it loads ok.

When deleting directories with rm -rf in 32 bit client, it fails to delete with following message. I made a copy of library modules in ceph client and tried to delete it. The same operation in 64 bit client happens flawlessly.
rm: WARNING: Circular directory structure.
This almost certainly means that you have a corrupted file system.
NOTIFY YOUR SYSTEM MANAGER.
The following directory is part of the cycle:
`3.0.0-2-686-pae/kernel'

rm: cannot remove `3.0.0-2-686-pae': Directory not empty

I tried to see if there was anything logged for this case but wasn't able to find much on the ceph mon, mds, or osd logs. I am not sure if both are related issues.

Let me know what I can look at to help out debugging this.

Regards,
Hong