Gluster Performance

I did some basic tests using GlusterFS with the default settings. rsync tests were only run once. DD tests are run 3 times, so they are more accurate. Rsync was done with 2.4Gb of content from a cPanel homedir, so this includes web content and email.

Normally I will do seeker and htparm tests, but since these are not block devices that does not work.

Gluster -> Virtual Disk

sent 2566167103 bytes  received 902896 bytes  4325307.50 bytes/sec
total size is 2562442673  speedup is 1.00

real    9m52.757s
user    0m15.201s
sys     0m24.269s

Virtual Disk -> Virtual Disk

sent 2566167140 bytes  received 902896 bytes  4612884.16 bytes/sec
total size is 2562442673  speedup is 1.00

real    9m16.103s
user    0m14.680s
sys     0m22.593s

Gluster Delete

real    14m43.588s
user    0m0.176s
sys     0m1.979s

Virtual Disk -> Gluster

sent 2566167140 bytes  received 902896 bytes  2407004.25 bytes/sec
total size is 2562442673  speedup is 1.00

real    17m45.812s
user    0m16.778s
sys     0m34.144s

Physical Delete

real	0m1.780s
user	0m0.045s
sys	0m0.801s

Gluster Disk Performance Test (dd)

Write Test
2147483648 bytes (2.1 GB) copied, 1119.96 s, 1.9 MB/s
2147483648 bytes (2.1 GB) copied, 1156.09 s, 1.9 MB/s
2147483648 bytes (2.1 GB) copied, 1119.97 s, 1.9 MB/s
Read Test
   2GB 0:02:06 [16.2MB/s]  
   2GB 0:01:47 [  19MB/s] 
   2GB 0:01:51 [18.3MB/s]

Physical Disk Performance Test (dd)

Write Test
2147483648 bytes (2.1 GB) copied, 59.9162 s, 35.8 MB/s
2147483648 bytes (2.1 GB) copied, 70.6282 s, 30.4 MB/s
2147483648 bytes (2.1 GB) copied, 67.3352 s, 31.9 MB/s
Read Test
   2GB 0:00:23 [  88MB/s]  
   2GB 0:00:23 [87.4MB/s]  
   2GB 0:00:22 [89.5MB/s]

Apache Bench From Virtual Drive

Server Software:        Apache/2.2.15
Server Hostname:        localhost
Server Port:            80

Document Path:          /
Document Length:        4974 bytes

Concurrency Level:      1000
Time taken for tests:   0.790 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      5246000 bytes
HTML transferred:       4974000 bytes
Requests per second:    1265.73 [#/sec] (mean)
Time per request:       790.058 [ms] (mean)
Time per request:       0.790 [ms] (mean, across all concurrent requests)
Transfer rate:          6484.39 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   10  13.5      1      33
Processing:     2   86 146.5     36     753
Waiting:        1   84 144.9     35     752
Total:         32   95 153.7     38     781

Percentage of the requests served within a certain time (ms)
  50%     38
  66%     40
  75%     51
  80%     62
  90%    284
  95%    296
  98%    779
  99%    781
 100%    781 (longest request)

Apache Bench From GlusterFS

Server Software:        Apache/2.2.15
Server Hostname:        localhost
Server Port:            80

Document Path:          /
Document Length:        4974 bytes

Concurrency Level:      1000
Time taken for tests:   3.179 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      5290000 bytes
HTML transferred:       4974000 bytes
Requests per second:    314.52 [#/sec] (mean)
Time per request:       3179.485 [ms] (mean)
Time per request:       3.179 [ms] (mean, across all concurrent requests)
Transfer rate:          1624.80 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   83 467.5      0    3000
Processing:    57  685 825.7    383    3034
Waiting:       57  685 825.7    383    3034
Total:        204  768 909.3    385    3168

Percentage of the requests served within a certain time (ms)
  50%    385
  66%    401
  75%    415
  80%    450
  90%   2839
  95%   2982
  98%   3073
  99%   3112
 100%   3168 (longest request)