Ceph

Via Martin Wilderoth, we have a number of logs with crashes. Not a lot of debugging though -- just messages and the backtrace.
I suspect these may be configuration issues, but don't know.

The logs are available at kai:~gregf/logs/host[1,2]-ceph-logs.tar. (Too large to upload here.)
Backtraces are:

2011-03-21 22:10:11.271281 7f0077984700 -- 10.0.6.10:6804/2341 <== mon0 10.0.6.10:6789/0 4 ==== osd_map(552,553) v1 ==== 837+0+0 (3253532737 0 0) 0x2380e00 con 0x2b833c0
os/FileStore.cc: In function 'void FileStore::sync_entry()', in thread '0x7f007b98c700'
os/FileStore.cc: 2580: FAILED assert(r == 0)
 ceph version 0.25.1 (commit:7f4a161e7fd1bb0d0eab3958b427a3c4c585bc05)
 1: (FileStore::sync_entry()+0x198d) [0x59663d]
 2: (FileStore::SyncThread::entry()+0xd) [0x5a277d]
 3: (()+0x68ba) [0x7f0081fe98ba]
 4: (clone()+0x6d) [0x7f0080c7e02d]

2011-03-21 22:15:44.220099 7f2eee709700 -- 0.0.0.0:6802/2242 <== osd3 10.0.6.11:6805/1725 145 ==== PGq v1 ==== 26730+0+0 (2176933432 0 0) 0x1f35000 con 0x193e500
osd/ReplicatedPG.cc: In function 'virtual bool ReplicatedPG::snap_trimmer()', in thread '0x7f2eeb602700'
osd/ReplicatedPG.cc: 693: FAILED assert(r == 0)
 ceph version 0.25.1 (commit:7f4a161e7fd1bb0d0eab3958b427a3c4c585bc05)
 1: (ReplicatedPG::snap_trimmer()+0x57f3) [0x4a77d3]
 2: (ThreadPool::worker()+0x519) [0x602669]
 3: (ThreadPool::WorkThread::entry()+0xd) [0x51fd3d]
 4: (()+0x68ba) [0x7f2ef956f8ba]
 5: (clone()+0x6d) [0x7f2ef820402d]

2011-03-21 22:09:59.344377 7fa9498b4700 -- 0.0.0.0:6802/1645 mark_down 10.0.6.10:6805/1389 -- pipe dne
os/FileStore.cc: In function 'void FileStore::sync_entry()', in thread '0x7fa94d8bc700'
os/FileStore.cc: 2577: FAILED assert(r == 0)
 ceph version 0.25 (commit:3fa121bf0a8c142897a684c92a66b98d7db1672e)
 1: (FileStore::sync_entry()+0x194d) [0x59867d]
 2: (FileStore::SyncThread::entry()+0xd) [0x5a224d]
 3: (()+0x68ba) [0x7fa953f198ba]
 4: (clone()+0x6d) [0x7fa952bae02d]