CSIRO Middleware Technology Evaluation Reports Now Free!


News: CSIRO Middleware Technology Evaluation Reports Now Free!

  1. CSIRO's Software Architectures and Components Technologies (SACT) Group is living up to it's name, as we're closing down. However, we'd like to go out with a bang, so have made PDF versions of all our reports available for free from:

    MTE reports

    Of particular interest to TSS readers is the last version of our J2EE report: "Evaluating J2EE Application Servers" (June 2002). Other reports cover Message Brokers, Message Oriented Middleware, EAI and Workflow technologies. Given the rapid changes between product versions some of the specific results are showing their age, however, there is a wealth of information in the reports on quantitative and qualitative evaluation methodologies, configuring and optimising technologies/products, and the impact of architectural/design choices.

    Check out our paper in IEEE Computer (March 2003) for an overview of the MTE project. We're also in the process of making our EJB benchmark (Stock-Online) available.

    Threaded Messages (5)

  2. Check dates before reading ![ Go to top ]

    WebLogic Enterprise v5.1

    WebLogic Server v6.0

    Authors: Anna Liu, Ian Gorton, Lei Hu
    Creation Date: July 2001
    Version: 1.0

    Looks like the site has old reports.
  3. Old Products????[ Go to top ]

    BEA just announced WLS 8.1, so this stuff is very dated.
  4. Check dates before reading ![ Go to top ]

    Two of the three authors have quit CSIRO quite sometime ago. CSIRO does the evaluation every year and comes up with reports for a big price. They don't always use the latest versions or include all products in the eval. Only these old reports are made free. They are irrelevant now.
  5. who cares ....[ Go to top ]

    Most of the stuff was ancient and hardly based on scientific research (contrary to your name)!

  6. not irrelevant, just history...[ Go to top ]

    you're all perfectly correct - these reports are out of date and shouldn't be used to choose products based on current versions. No one said they should...the project is over so they're now available - that's all. They're there for historical interest and maybe researchers to mine, as empirical results of this ilk are not commonplace.

    And Andy, I'm sure a renowned scientist like yourself would be more than happy to tell us where we went wrong. As scientists as well as software engineers, we are always open to criticism based on fact and sound, justifiable evidence. It's odd tho, how you see our failings, while the participating vendors and all the referees from our recent IEEE journal and conference publications missed them.

    If only everyone was as smart as you. The 100's of people downloading the stuff need your wisdom....