In this third round of testing, we have compared the WSO2 Enterprise Service Bus (ESB) v1.7 against the leading proprietary ESB, the proprietary version of an Open Source ESB, the open source alternatives - Apache Service Mix 3.2.1 and Mule Community Edition 2.0.1. The WSO2 Enterprise Service Bus (ESB) is an open source project (under the Apache License v2.0) developed by WSO2 based on the popular Apache Synapse Enterprise Service Bus (ESB). Since the WSO2 ESB v1.7 embeds the Apache Synapse ESB v1.2 release, the performance figures between these will be identical. However, the WSO2 ESB ships with better management and development support with a graphical Web interface, enhanced JMX support and a built-in WSO2 Registry instance. Although, initially we planned to include the OpenESB and the JBoss ESB in the testing rounds, due to the complexity involved in understanding these products to build the simple scenarios we needed, we decided to go without them and to include a follow up article instead.
Some of the highlights from the observations and conclusions are as follows:
- Mule CE 2.0.1 couldn't handle the cases where we used a concurrency level of 80; while other ESB's scaled to support to over 2500 concurrent connections. This was after tuning the maximum active thread count to 100 from its default value, which limited Mule to a very few concurrent connections.
- A proprietary version of an open source ESB had the same problem described above.
- Mule CE 2.0.1 also dropped 1% of ALL requests it received
- Apache ServiceMix 3.2.1 failed to forward the incoming SOAPAction for proxy services, and this was now a known issue (I would consider this a blocker, and would suggest that ServiceMix folks follow up a 3.2.2 release just to fix this critical issue)
- A proprietary ESB we benchmarked and beat last year, did some major improvements to their performance, and did 1.6~1.9 times better than us for some of the scenarios
- The WSO2 Enterprise Service Bus (ESB) / Apache Synapse Enterprise Service Bus (ESB) shows a clear lead and dominates the open source ESB space
Read about it all here: http://wso2.org/library/3740
and run the benchmarks yourself!