TSSJS Barcelona: James Strachan, Advance Messaging with ActiveMQ

Discussions

News: TSSJS Barcelona: James Strachan, Advance Messaging with ActiveMQ

  1. James Strachan discussed one of the most challenging topics facing the open source movement today: enterprise scalability. One of the hottest developments this year that is working to address this challenge is the open source JMS server ActiveMQ. The ActiveMQ promise is enterprise wide scalability and robustness. James demonstrated the many new features aimed at conquering hurdles faced by large scale, distributed enterprise solutions. During the talk James started with a description JMS basics including; Connection, Queue/Topic, and Producer/Consumer. James shows the first step toward scalability: JMS Queues. These queues provide a means to distribute message processing across multiple message consumers. Queues enable horizontal scaling for applications. The only requirement for handling an increase in message load is additional hardware. He pointed out a major obstacle to scaling message consumers is message sequencing. In most enterprise applications, the sequence of certain messages is imperative for accurate business processing. In a simple bank application, consider a "credit-account" message being received prior to the "create-account" message. Business errors can only be detected as a superset over and above of unit testing. To ensure message delivery sequence while multi-threading the message consumption and processing, James illustrated the use of JMS Message property, JMSXGroupId. This property effectively partitions the queue into a set of message sequences to ensure the correct business processing. The messages within a single JMSGroupId are delivered in order from the message broker. Additionally, James discusses is the importance to understand the various latency factors during design. If method is local and access information from within the same process; local access is almost instantaneous. However, if additional threads, processes or servers are involved to access the data, the latency increases by several orders of magnitude. The most important factor for distributed systems is latency. When business functions are composed of several message based interaction latency will accumulate. Overall performance is ultimately tied to the ability to minimize latency and this implies that network based interactions must be reduced. To illustrate, consider the case where ordering a beer takes one second and that represents a local data access. In this scenario, accessing information on another machine will take fourteen years. As James described it, "that’s like having a beer on Pluto! And worse, after only three beers, you are eighty-four years old!" When constructing a messaging based solution one must design to minimize expensive WAN based calls whenever possible.
  2. Searchable Domain[ Go to top ]

    I attended James presentation and first let me say that it was an excellent one. James mentioned in the session that he has seen several cases where the domain was exposed using text based search, where the database was used for backup/reporting/... . I never got a chance to ask if maybe James can elaborate on it, or anybody else that has done it. As for my personal angle, James mentioned Lucene was used for the search, and using Compass is just a logical step away. -Shay
  3. Re: Searchable Domain[ Go to top ]

    I attended James presentation and first let me say that it was an excellent one.
    Thanks!
    James mentioned in the session that he has seen several cases where the domain was exposed using text based search, where the database was used for backup/reporting/... . I never got a chance to ask if maybe James can elaborate on it, or anybody else that has done it.

    As for my personal angle, James mentioned Lucene was used for the search, and using Compass is just a logical step away.
    John Davies mentioned it in some of his talks too - some investment banks are using Google appliance to search their trading data. I've talked with other investment banks who use Lucene too. It seems quite a common trend to export your data into various search engines & caches so that queries & lookups can be done easily and very quickly - whether its via Lucene/Nutch or Google appliance for text based queries or JCache/ehcache, Tangosol or GigaSpaces for Java/Map/SQL style lookups/queries - the concept is similar, move data to where its most useful & take the read operations off the database letting it focus more on the writes while you have an easy-to-scale fast query layer. James LogicBlaze Fuse: Open Source SOA
  4. Ok, that is an abstract and very interested part from one of the numerous discussions from the TSS JS in Barcelona. A better effect from the locale ambience and potentially more details could be provide some online videos from this and some other interested discussions. I think, such videos could be very interested for the numerous part of the people, which unhappily can't be present in the very nice Barcelona. Roland SOA Kompetenznetzwerk SOA & ESA Information & Collaboration-Portal in German Language
  5. For those interested in JMS capabilities you should check BEA's implementation which is just ahead in terms of performance et features ! ActiveMQ sounds good, I'll give it a try ! Few really cool things about BEA JMS stack : Store-And-Forward, Filestore performance, cluster-support and auto-migration of JMS components from server to server, Unit-of-Order (refered here as JMSGroupIdX..), .. try it ! Sometimes commercial software does it better !
  6. For those interested in JMS capabilities you should check BEA's implementation which is just ahead in terms of performance et features !
    I'm not so sure about that :) but I'm completely biassed - so please do compare them and make up your own mind.
    ActiveMQ sounds good, I'll give it a try ! Few really cool things about BEA JMS stack : Store-And-Forward, Filestore performance, cluster-support and auto-migration of JMS components from server to server, Unit-of-Order (refered here as JMSGroupIdX..),
    Sounds like Apache ActiveMQ can do all of that :)

    Sometimes commercial software does it better !
    It better had otherwise folks won't buy it :) James LogicBlaze Fuse: Open Source SOA
  7. James, From a user point of view, influencing is a good thing ! My post was just to let people know that most discussed features already exist in long time available products !! that's it ! Please don't go back to Open Source as an ideology, people are tired with it ! Be more open in Open Source is considering others too ! So once a message is posted on TSS about a brand new implementation, it should be possible to talk about existing features so that people can shape their own mind ! Stephan
  8. Please re-read James' post. I didn't see any statements that could be interpreted as "Open Source as an idealogy". All I read was an attempt to correct some statements that implied that ActiveMQ did not have some of the features that were referenced in your post. James specifically stated to try all and then decide. Personally, I would read some of your statements "Sometimes commercial software does it better!" as having a commercial software bias, especially considering that you are making an uninformed opinion since you stated that you haven't even tried ActiveMQ yet. Also, if you don't want to inflame a conversation try using less exclamation points. Lastly, sometimes it is helpful (at least to me) for posters to say that they aren't affiliated with BEA (or whatever product they are recommending) so there is no hint of bias or at least we are aware bias may exist. Thanks, Matt
  9. Matt, Thank you for adding these few words. This really helps. and thank you for telling me how to write, and what might not be emphasized! I am not a BEA employee, but at this point what kind of difference does it make considering that James is part of ActiveMQ lol let's keep it down, my post was just to make people react and share. regards Stephan
  10. Sorry, that's not personal meant - maybe with some other words, this theme would be a base for a good discussion in this interested areas ... Roland SOA Kompetenznetzwerk SOA & ESA Information & Collaboration-Portal in German Language
  11. For those interested in JMS capabilities you should check BEA's implementation which is just ahead in terms of performance et features ! ActiveMQ sounds good, I'll give it a try ! Few really cool things about BEA JMS stack : Store-And-Forward, Filestore performance, cluster-support and auto-migration of JMS components from server to server, Unit-of-Order (refered here as JMSGroupIdX..), .. try it !
    Sometimes commercial software does it better !
    I'am not the person to say one product is better then other. Many of the available comercial or open source solutions has many of this mentioned criterions. I think, the best way its everytime, to take a (detailled) look to many different solutions and to test the promised capabilities and performance criterions in a profound manner by each product itself. Maybe, sometimes is the best solution a fine tuning by a good combination of commercial and open source solutions. Roland SOA Kompetenznetzwerk SOA & ESA Information & Collaboration-Portal in German Language
  12. I didn't attend the conference, so all I have to go on is this summary. I'm struck by the figures given in the analogy at the end: if local data access takes 1 second then accessing information on another machine takes 14 years. This seems to be suggesting that a local method call (I presume this is what is meant by "local data access") is 430 million times faster than remote access. So, if a local method call actually takes one nanosecond, then a remote call would take 430 seconds or just over 7 minutes. That doesn't sound right to me because our remote calls are slow, but not that slow. Have I missed something here? (I'm not sure how fast a local method call really is. I guess it depends on what it does and how much data it returns.)
  13. activmq[ Go to top ]

    Hello,

     

    I run a project for a chat in Barcelona:

    Is it possible you know some specialist in Barcelona who has the skill to tune a ActiveMQ related with STOMP and Orbited: the installation is done, just the settings of the new release 5.5 is difficult for my engineer.

    It will help a lot.

     

    Thanks,

     

    Alain PERISSE