Recently PaaS (Platform as a service) is new technologies that grow rapidly, to provide a platform let developers focus on creating awesome application/website instead of configuring/maintaining servers. In this fews weeks, I was playing around two PaaS, which are CloudFoundry and AppFog. These two PaaS provider is really awesome, and CloudFoundry is open source PaaS that available on github and AppFog is based on CloudFoundry.
In this post, I will do a simple load test againts these two provider using Apache Benchmark, to see which one is performance better, and the result is surprising. The load test I doing is againt a simple Java web application available on at here. The main reason I use this simple application is because AppFog currently is having issue with Java application, thus I only can use the sample provided by them. I deployed same application to both of the provider. For AppFog, I deployed to AWS Virginia DC.
CloudFoundry
| Cocurrent | 200 Requests | 600 Requests |
|---|---|---|
| 20 | 118.76 Requests per second | 113.17 Requests per second |
| 40 | 211.93 Requests per second | 226.95 Requests per second |
| 60 | 317.88 Requests per second | 338.05 Requests per second |
| 80 | 426.50 Requests per second | 408.15 Requests per second |
| 100 | 482.07 Requests per second | 440.98 Requests per second |
| 120 | 461.10 Requests per second | 471.54 Requests per second |
| 140 | 443.34 Requests per second | 483.24 Requests per second |
| 160 | 411.08 Requests per second | 502.00 Requests per second |
| 180 | 410.2 Requests per second | 498.79 Requests per second |
AppFog
| Cocurrent | 200 Requests | 600 Requests |
|---|---|---|
| 20 | 22.90 Requests per second | 19.92 Requests per second |
| 40 | 23.98 Requests per second | 24.56 Requests per second |
| 60 | 25.46 Requests per second | 25.29 Requests per second |
| 80 | 26.89 Requests per second | 22.27 Requests per second |
| 100 | 24.75 Requests per second | 24.78 Requests per second |
| 120 | 26.16 Requests per second | 25.66 Requests per second |
| 140 | 24.20 Requests per second | 25.31 Requests per second |
| 160 | 23.90 Requests per second | 24.51 Requests per second |
| 180 | 22.40 Requests per second | 24.20 Requests per second |
Conclusion
From the two tables, we can notice that CloudFoundry can handle up to 500 requests per second while AppFog only 25 requests per second which is 20 times slower than CloudFoundry.