Tuning GlusterFS for Small Files

Hi,

I'm doing some test with GlusterFS on 3 VMs inside a big dedicate server, all VM are connected with private LAN at 20Gbps. They also have 16 core and 8gb, 100GB ssd each.

I have configured a volume with 3 bricks in replica and mounted the volume inside the first node and also in a external host always inside the lan.

Now the problem is the performance, when try to transfer a big file, the max transfer rate is 70MB/s while in the host the transfer are 800MB/s and network is 20Gbps: gluster don't use all capacity of the resources allocated.

Another big issue is the file lookup, when try to listing recursively a directory with 34K files, the first listing take 40 seconds and the second listing take 20seconds.

Bypassing glusterfs and listing directly on the filesystem of the disk, i get the first listing 9 seconds and the second, 225ms!

So there are much to optimize.

First, i need to optimize the transfer rate of external client.

I also need to force client read the files in a specific brick of the volume.

Please don't bid if you don't know what doing.

Consider to work under shared screen on terminal.

Thanks a lot for your time

Linux Network Administration Storage Area Networks System Admin UNIX

Project ID: #12935187

About the project