667514 members! Sign up to stay informed.

Sponsored Links


Resources

Enterprise Java
Research Library

Get Java white papers, product information, case studies and webcasts

News News News Messages: 5 Messages: 5 Messages: 5 Printer friendly Printer friendly Printer friendly Post reply Post reply Post reply XML XML XML

Article: Tuning Your Stress Test Harness

Posted by: Joseph Ottinger on June 10, 2005 DIGG
Putting together a viable stress test is not as simple a task as it would seem to be at a casual glance. The problems that one encounters can be subtle and often can only be clearly seen if one uses some not-so-simple mathematics to clarify things. But rather than watch your eyes glaze over in a complex exploration of Markov chains, state change models, queuing theory, probability distributions, etc., Kirk Pepperdine explores a less tedious, more hand-waving explanation that hopefully will shed some light on how to fix this common problem found in many stress tests.

Read Tuning Your Stress Test Harness

Threaded replies

·  Article: Tuning Your Stress Test Harness by Joseph Ottinger on Fri Jun 10 12:28:10 EDT 2005
  ·  Nice Introductory Article by William Louth on Tue Jun 14 11:08:28 EDT 2005
    ·  Kerk = Church in Dutch by William Louth on Tue Jun 14 11:11:43 EDT 2005
    ·  Nice Introductory Article by Kirk Pepperdine on Thu Jun 16 10:27:39 EDT 2005
  ·  Confusion by dave kerrigan on Fri Jun 17 12:35:30 EDT 2005
  ·  A little confusion by J. Erica Cody on Wed Jun 22 16:50:06 EDT 2005
  Message #174445 Post reply Post reply Post reply Go to top Go to top Go to top

Nice Introductory Article

Posted by: William Louth on June 14, 2005 in response to Message #173957
Hi Kerk,

Nice gentle introduction to software performance testing. I was wondering do you see many home grown testing solutions being used in the field? Are most of your assignments involving the configuration of commercial load tools?

You did not mention that impact of test (user transaction) case mixing in the article. Do you have any advice in this area? This seems to be another area were testing teams fail.

A nice outline of the overall steps involved in a good performance or stress assignment would be a good follow up.


All the best,


William Louth
JXInsight Product Architect
JInspired


"J2EE tuning, testing and tracing with JXInsight"
http://www.jinspired.com

  Message #174446 Post reply Post reply Post reply Go to top Go to top Go to top

Kerk = Church in Dutch

Posted by: William Louth on June 14, 2005 in response to Message #174445
Sorry Kirk,

I was looking out the window at time and the bit of Dutch I do know and speak came to the surface.

William

  Message #174809 Post reply Post reply Post reply Go to top Go to top Go to top

Nice Introductory Article

Posted by: Kirk Pepperdine on June 16, 2005 in response to Message #174445
Hi Kerk,Nice gentle introduction to software performance testing. I was wondering do you see many home grown testing solutions being used in the field?

Actually no. I see quite a few people using Mercury LoadRunner. It's quite a good tool but it still requires one to understand the things that I put into the article in order for one to use it effectivily. I've seen teams make interesting customizations to LoadRunner which did end up causing some problems. In those cases, the customizations were wonderful ideas that just needed a bit of tuning.
 Are most of your assignments involving the configuration of commercial load tools?

Actually my assignments are an even split between reviewing architectures and performance tuning.
You did not mention that impact of test (user transaction) case mixing in the article. Do you have any advice in this area? This seems to be another area were testing teams fail.
I do cover this topic in my performance tuning courses. Maybe it's ripe for yet another article. The general advice is make it real!

Kirk

  Message #175000 Post reply Post reply Post reply Go to top Go to top Go to top

Confusion

Posted by: dave kerrigan on June 17, 2005 in response to Message #173957
Thanks for the article, it made interesting reading, but I did get a little lost towards the end. It seemed to be saying that an increase in the average pause time was prefered, but the results showed that this was reducing the number of requests per second and that there is little value in increasing the number of threads?

Isn't it necessary to have staged tests where the load applied is increased in stages with the results recorded for each load, otherwise if you apply as much load as you can the total throughout will likely be less than the maximum and also the response times will be high, i.e. a convergent system. What you want is to do is push the system to see what is the limit of it being a steady state system

Dave

  Message #175498 Post reply Post reply Post reply Go to top Go to top Go to top

A little confusion

Posted by: J. Erica Cody on June 22, 2005 in response to Message #173957
I also felt a little perplexed. I believe what you are saying is you are testing the actual thruput of the application, irregardless of load. If you need more thruput, then you tune the application until it performs better (e.g. lower response time), but having more threads does not tell you much other than you are overloading the server. Is that correct?

New content on TheServerSide.comNew content on TheServerSide.comNew content on TheServerSide.com

Dependency Injection in Java EE 6 - Part 1

Reza Rahman explores the features of the proposed JSR 299, Contexts and Dependency Injection for Java EE (CDI). When approved, it promises to be a key feature of Java EE 6. (November 2, Article)

SAML: It's Not just for Web services

SAML is an XML-based standard for exchanging authentication and authorization data between security domains. The single most important problem that SAML was created to solve is the Web browser Single Sign-On problem. Many organizations are debating whether to stay with version 1.1 or move to 2.0. This article makes observations about both options. (September 28, Article)

Programming is Also Teaching Your Team

Joe Ottinger takes a look at how people learn, and applies it to the practice of programming. He notes that understanding how people learn is an essential part of working in a programming team. (September 22, Article)

Can Java EE Deliver The Asynchronous Web?

Stephen Maryka gave us an article about the Asynchronous Web and posed a number of questions that get examined like an approach to delivering Asynchronous Web capabilities through extensions to existing Java EE technologies. (July 14, Article)

JSF Flex

JavaServer Faces Flex goal is to provide users capability in creating standard Flex components, part of flexSDK which is open sourced through MPL license, as normal JSF components. This article by Ji Hoon Kim will provide an overview of creating a simple multilingual JSF page consisting of JSF Flex tags. (June 29, Article)

The Rules of SOA - A Road to a Successful SOA Implementation

In this session Jeff explores the key characteristics of successful SOA projects. He covers some of the patterns, and anti-patterns, tool sets, and strategies that he himself learned the hard way. Last, he provides a strategy and blueprint for achieving a high likelihood of success in your SOA project. (June 23, Tech Talk)

Ari Zilka Talks About Terracotta 3.1

Ari Zilka, CTO of Terracotta, Inc., talks about the new features in Terracotta 3.1, announced during JavaOne and available now. (June 15, Tech Talk)

Enterprise Application Integration, and Spring

In this Tech Talk, Josh Long explores an integration challenge using Spring Integration and walks through the implementation, employing and expanding on the basic patterns of Enterprise Application Integration to tie together components into a function integration solution, and then demonstrates how Spring Integration helps address the integration requirements. (June 15, Tech Talk)

Google Web Toolkit: An Introduction

In this Tech Talk, David Geary teaches you: The basics of Google Web Toolkit; How to implement Ajax-enabled applications in Java; Internationalization; Hooking into the browser history mechanism; Remote procedure calls. (June 4, Tech Talk)

Just Enough Early Architecture to Guide Development

Jon Kern discusses the best architecture/technical solutions and ensure that they are repeated by all developers. By tackling the architecture up-front in a serial manner, subsequent parallel development will be much more manageable and predictable. (May 28, Tech Talk)

Productive Programmer: On the Lam from the Furniture Police

This keynote describes the frustrations of modern knowledge workers in their quest to actually get some work done, and solutions for how to guard yourself against all those distractions. Neal Ford talks about environments, coding, acceleration, automation, and avoiding repetition as ways to defeat the misguided attempts to sap your ability to produce good work. (May 26, Tech Talk)

Auto-Scaling Your Existing Web Application

Gil demonstrates how new, aggressive uses of already abundant compute capacity by common applications offer competitive value for application designers. (May 21, Tech Talk)

Automating Hibernate Mapping and Queries For Java Web Development

Chris Keene introduces WaveMaker as a new way to automate the ability to generate Hibernate classes in order to more quickly bring OR mapping into an application. (May 19, Article)

Auto-Scaling Your Existing Web Application

In this session Nati Shalom demonstrates how to take a standard Java EE web application and scale it out or down dynamically without changes to the application code. Seeing as most web applications are over-provisioned to meet infrequent peak loads, this is a dramatic change because it enables growing your application as needed, when needed, without paying for unutilized resources. (May 19, Tech Talk)

Free Book PDF Download: Mastering EJB Third Edition

Mastering EJB was one of the original and most influential EJB books in the industry. Mastering EJB III now returns with two new expert co-authors, updated for EJB 2.1 and 30% new chapters including security, integration, best practices, open source, and more.
(Book PDF Download)

Application Server Matrix

The Application Server Matrix is a detailed listing of J2EE vendors and their application server products, with information on latest version numbers, J2EE spec support and licensing, pricing, platform support, and links to product downloads and reviews.
(Application Server Comparison Matrix)

News | Blogs | Discussions | Tech talks | Patterns | Reviews | White Papers | Downloads | Articles | Media kit | About
Java Solutions
All Content Copyright ©2007 TheServerSide Privacy Policy
Site Map