Bug #17432
closedCephFS - Bonnie++: Can't create file
0%
Description
Trying to run bonnie++ (v1.97) benchmark on cephfs mounted with kernel client and get error:
bonnie++ -u root -d /mnt/cephfs -s 8000 -n 1000
Using uid:0, gid:0.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order... Can't create file 00000186a0
Cleaning up test directory after error.
----
Client is Ubuntu 14.04.5 with kernel 4.4.22-040422-generic x86_64
Ceph server v10.2.3 on Ubuntu 14.04.5 with kernel 4.4.19-040419-generic
Fio test's are running ok on same fs. No errors in logs either on client or server side.
Ceph v10.2.2 was completing bonnie tests without errors.
----
MDS part from ceph.conf file:
max_mds = 1
mds_beacon_interval = 3
mds_beacon_grace = 10
mds_standby_replay = true
mds_cache_size = 5000000
mds_log_max_segments = 250
mds_log_max_expiring = 200
Updated by elder one about 7 years ago
Figured it out - bonnie creates many files into one directory and hits default "mds bal fragment size max = 100000" limit, which is as I understand max files in directory without directory fragmentation (disabled by default).
So increasing "mds bal fragment size max" size or enabling dir fragmentation will do the trick.