667481 members! Sign up to stay informed.

Sponsored Links


Resources

Enterprise Java
Research Library

Get Java white papers, product information, case studies and webcasts

News News News Messages: 16 Messages: 16 Messages: 16 Printer friendly Printer friendly Printer friendly Post reply Post reply Post reply XML XML XML

Azul releases new server appliance that processes J2EE tasks

Posted by: Jay K on September 27, 2004 DIGG
A new startup company, Azul Systems, is introducing a new concept to out-source our J2EE code. Azul Systems has created a server applicance that when mounted on existing servers take up all processing tasks.

Customer need to install a proxy server into their servers and the server applicance acts as a booster. It runs Java applications, divided into smaller, discrete tasks called threads. This would enable much faster processing times than that achieved by today's servers.

"An interesting concept" said Kevin Krewell, editor-in-chief of Microprocessor Report, "The issue is the overhead".
What makes Azul's approach different? Today's servers are designed to run a particular brand of software. For example, PCs are tuned to run Windows-compatible programs. But nearly all new corporate software is developed with so-called "virtual-machine" technologies, such as Java or Microsoft's (MSFT) .net, that let it run on any type of underlying hardware. Azul's server, dubbed the compute appliance, is the first designed from scratch to do one thing: run this "virtual machine" code faster and more efficiently than existing servers.
Azul press release on network attached processsing

What are your thoughts about the concept?

~Jay
http://JavaRSS.com

Threaded replies

·  Azul releases new server appliance that processes J2EE tasks by Jay K on Mon Sep 27 16:50:39 EDT 2004
  ·  Azul releases new server appliance that processes J2EE tasks by Claude Vedovini on Tue Sep 28 11:59:18 EDT 2004
    ·  Azul releases new server appliance that processes J2EE tasks by Cameron Purdy on Tue Sep 28 12:14:18 EDT 2004
      ·  What is"special" about VM code ? by Brian Kay on Tue Sep 28 13:47:15 EDT 2004
        ·  What is"special" about VM code ? by Jez Humble on Tue Sep 28 14:39:26 EDT 2004
        ·  What is"special" about VM code ? by Cameron Purdy on Tue Sep 28 21:45:41 EDT 2004
          ·  Compute Bound and IO Bound by William Louth on Wed Sep 29 05:06:38 EDT 2004
            ·  Compute Bound and IO Bound by Cameron Purdy on Wed Sep 29 08:11:27 EDT 2004
              ·  My Analysis of Azul by Sam Pullara on Wed Sep 29 15:03:21 EDT 2004
              ·  SOAP is mostly compute bound ? by Nick Minutello on Fri Oct 01 19:37:35 EDT 2004
            ·  Compute grid here we come by Nick Minutello on Fri Oct 01 19:35:12 EDT 2004
      ·  Azul releases new server appliance that processes J2EE tasks by Brian Miller on Tue Sep 28 16:04:07 EDT 2004
      ·  Azul releases new server appliance that processes J2EE tasks by Claude Vedovini on Sat Oct 02 19:00:39 EDT 2004
  ·  Java Co-Processor by Matt Giacomini on Tue Sep 28 23:16:42 EDT 2004
    ·  Unbound Compute by Gil Tene on Wed Sep 29 00:55:22 EDT 2004
      ·  Proprietary JDK/VM? by Frank Bolander on Wed Sep 29 12:09:07 EDT 2004
      ·  Azul Usage with Fortune 500 Enterprises by James McGovern on Tue Nov 23 12:29:13 EST 2004
  Message #140068 Post reply Post reply Post reply Go to top Go to top Go to top

Azul releases new server appliance that processes J2EE tasks

Posted by: Claude Vedovini on September 28, 2004 in response to Message #139896
VMs have been especially designed for running on any platform and now there is a new platform especially designed to run VMs? Am I missing something?

  Message #140075 Post reply Post reply Post reply Go to top Go to top Go to top

Azul releases new server appliance that processes J2EE tasks

Posted by: Cameron Purdy on September 28, 2004 in response to Message #140068
VMs have been especially designed for running on any platform and now there is a new platform especially designed to run VMs? Am I missing something?
Yeah, you're missing something: One Azul box will have more Java horsepower than an entire rack of servers (I don't know yet if they've unveiled just how much, so that's all I can say,) and it can handle a couple of hundred GB on a Java heap with no full GC pauses.

One word: Sweet.

Peace,

Cameron Purdy
Tangosol, Inc.
Coherence: Shared Memories for J2EE Clusters

  Message #140108 Post reply Post reply Post reply Go to top Go to top Go to top

What is"special" about VM code ?

Posted by: Brian Kay on September 28, 2004 in response to Message #140075
Hi Cameron,
 
From the article, ' "virtual machine" code faster and more efficiently than existing servers.'

PMI, but what is so different about VM code, say from say C code ?

  Message #140122 Post reply Post reply Post reply Go to top Go to top Go to top

What is"special" about VM code ?

Posted by: Jez Humble on September 28, 2004 in response to Message #140108
I imagine the point of this hardware is that it will be optimised so that things that require complex code in current VMs (such as garbage collection, synchronization, security etc) no longer do so using the new hardware. Then they'll ship special VMs which are to a greater or lesser extent wrappers for this hardware.

My guess is that they'll be designing something along the line of the CPUs that were supposed to run byte code natively - but of course they'll be a bit more general so that they're not tied to running Java byte code.

  Message #140137 Post reply Post reply Post reply Go to top Go to top Go to top

Azul releases new server appliance that processes J2EE tasks

Posted by: Brian Miller on September 28, 2004 in response to Message #140075
One Azul box will have more Java horsepower than an entire rack of servers (I don't know yet if they've unveiled just how much, so that's all I can say,) and it can handle a couple of hundred GB on a Java heap with no full GC pauses.
Interestingly AzulSystems.com makes no claim of accelerating Java execution. Instead Azul delivers what it named "network attached processing", aka utility computing. Azul's value-proposition pitch is:

- "costs can be spread across multiple applications"

- "dramatically reduce the number of systems under management"

The entrenched rival of Azul is grid-based cycle scavenging, eg Condor. BusinessWeekAsia.com claims that Azul avoids inherent faults of its grid rival, which "...requires expensive software and often lots of consulting services. And [grid] does nothing to control the proliferation of more and more computers to do all of this..."

  Message #140172 Post reply Post reply Post reply Go to top Go to top Go to top

What is"special" about VM code ?

Posted by: Cameron Purdy on September 28, 2004 in response to Message #140108
From the article, ' "virtual machine" code faster and more efficiently than existing servers.'

PMI, but what is so different about VM code, say from say C code ?
There's a standard for VM code ;-)

Seriously, there's no such thing as executable "C code" .. C code typically compiles to an intermediate language (higher level than assembly, but designed for assembly production) which is then optimized/assembled into machine code. That machine code is designed for a hardware processor, hence it's "machine code."

What Azul does is run "machine code" that is designed for a Java virtual machine, instead of for a particular hardware processor. I am not allowed to talk about the performance, but I can say that it can run more threads concurrently in a relatively small box than the biggest existing server on the market today, and there's little chance that anyone will pass them for quite a while. ;-)

Regarding some of the other coolness, they own the hardware design, so they do some (in retrospect) pretty obvious stuff with memory that allows them to do GCs without stopping execution.

So, as soon as this hits the market, there's no such thing as "compute bound" anymore for Java applications. And the technology can apply to other "virtual machine languages" too, including the CLI, if/when there is market demand.

Peace,

Cameron Purdy
Tangosol, Inc.
Coherence: Shared Memories for J2EE Clusters

  Message #140187 Post reply Post reply Post reply Go to top Go to top Go to top

Java Co-Processor

Posted by: Matt Giacomini on September 28, 2004 in response to Message #139896
How about selling this technology as a Java Co-Processor? It could be a PCI board that I drop in my server. Ok I'm dreaming nevermind.

  Message #140198 Post reply Post reply Post reply Go to top Go to top Go to top

Unbound Compute

Posted by: Gil Tene on September 29, 2004 in response to Message #140187
How about selling this technology as a Java Co-Processor? It could be a PCI board that I drop in my server. Ok I'm dreaming nevermind.
You're not dreaming. We'll do even better. You just drop our compute appliances in your network and use our J2SDK on any of your existing servers, and the full power of our compute pools becomes transparently available to your Java and J2EE programs.

Gil Tene
VP Technology, CTO
Azul Systems, Inc.<Unbound Compute.

  Message #140228 Post reply Post reply Post reply Go to top Go to top Go to top

Compute Bound and IO Bound

Posted by: William Louth on September 29, 2004 in response to Message #140172
Hi Cameron,

This all sounds fascinating and for many of the GC issues associated with J2EE containers under heavy concurrency this may offer some relief but it is not going to solve the main IO issues (JCA, JMS, JDBC, and SOAP).

Honestly how much of the J2EE work can be offloaded while at the same time not offsetting any gains during the transfer of required data and code. Have we got any figures on this. Note I am focusing on the integration of the product into an existing environment rather than the total migration to the Azul server. I would assume in the latter case the gains would be greater by a significant margin.

By the way does this represent an business opportunity or threat to your "Shared Memories for J2EE Clusters" product.

Regards,


William Louth
CTO, JInspired

"J2EE tuning, tracing and testing with Insight"
http://www.jinspired.com

  Message #140249 Post reply Post reply Post reply Go to top Go to top Go to top

Compute Bound and IO Bound

Posted by: Cameron Purdy on September 29, 2004 in response to Message #140228
By the way does this represent an business opportunity or threat to your "Shared Memories for J2EE Clusters" product.
I'll just make up a new tag-line. ;-)

To be honest, it's such a tangent from everything we've seen in the market that it's hard to say how it will effect anyone. If it naturally increases the need for scalable access to data, then I'm going to guess that it helps open new doors for Coherence.

The real question is how we get rid of the "main IO issues" in the long term .. for example, are there ways of scaling up IO with processing power besides caching. I'm looking at cluster-durable JMS queues and topics as one good example of achieving scalable performance for messaging (to/from or within an application, not as an ESB.) For database scalability, a well-built pure-Java database should now easily be able to achieve the highest non-clustered throughput numbers (running on this box) for any benchmark. SOAP is mostly compute bound (parsing, etc.) so this box is perfect for XML stuff (XML is certified 99.999% inefficient.)

The things that we can't just "get rid of" are the legacy application integration points, including mainframe services, the well-established datastores, and the enterprise-adopted messaging systems. Over time, some of them can be phased out one-by-one, but it's rare for IT to get rid of something when they can build something complex and slower on top of it instead. ;-)

Peace,

Cameron Purdy
Tangosol, Inc.
Coherence: Shared Memories for J2EE Clusters

  Message #140320 Post reply Post reply Post reply Go to top Go to top Go to top

Proprietary JDK/VM?

Posted by: Frank Bolander on September 29, 2004 in response to Message #140198
You're not dreaming. We'll do even better. You just drop our compute appliances in your network and use our J2SDK on any of your existing servers, and the full power of our compute pools becomes transparently available to your Java and J2EE programs.
Gil,

So will Azul be developing a custom JDK/VM around your product line or will there just be proxy components as specified in your literature to allow flexibility on choosing a "commodity" JDK/VM for a given task?

Frank Bolander

  Message #140373 Post reply Post reply Post reply Go to top Go to top Go to top

My Analysis of Azul

Posted by: Sam Pullara on September 29, 2004 in response to Message #140249
When I first heard about what they were doing over at Azul last year, I have to admit I was pretty skeptical. Creating a new piece of hardware with a custom chip, custom architecture, and a custom JVM is a tall order. Additionally, no one in the past has been able to build custom hardware for generic computation that performs, in the long run, better than commodity processors for a similar price point. This project is different though because they are not limited to a real CPU, but rather to a VM that gives them tremendous opportunity for scale in a similar way to the GPU market. You'll notice that few computers use their CPU to draw graphics on the screen. They can take advantage of some of the same architectural choices to run Java code.

The multi-core architecture that they have created is definitely the future. If you look at announcements from Intel (both x86 and ARM), Sun (The niagra project), and IBM (PowerPC) you will see the whole industry is headed for a multi-core world where multi-threaded code will get the most return. Azul is just getting there first and with a really, really huge box. Their box will have similar power to racks and racks of Dell blade systems except it will appear to be just a big SMP machine with all the management characteristics of a single system. If one application spikes its load, it just uses more compute power instantaneously, instead of using esoteric management software to try and shuffle resources in an inefficient and ultimately fragile way.

Their proxy VM system is equally innovative. These boxes themselves have no disk and no direct network access, everything goes through the proxy machine that connects to Azul. Fewer parts that can fail, fewer things to configure on the new system. To switch your application from running locally and running remotely on their box you would simply change JAVA_HOME and point it at the Azul system you want to run on. I was initially skeptical that this proxy system would be major bottleneck. It has an appreciable effect but it is minimized through buffered/prefetched I/O. When it goes GA you can expect to see the biggest SPECjAppServer number ever.

At WebLogic we often speculated on the things you could do if you owned the hardware to improve the efficiency of the VM. They have done these optimizations. Their chips have specific instructions that optimize concurrency, virtual invocations, and garbage collection. Nearly pauseless garbage collection is a benefit that I think almost any deployed application can take advantage of and it would not be possible without the kinds of control they have in an Azul system.

Their work has definitely moved us closer to the infinite CPU source in the sky that storage systems have had for years now.

Sam Pullara
EIR @ Accel Partners

  Message #140896 Post reply Post reply Post reply Go to top Go to top Go to top

Compute grid here we come

Posted by: Nick Minutello on October 01, 2004 in response to Message #140228
I have a suspicion that this is going to be really interesting for finance analytics computation.

In maths-intensive calculations - where typically C/C++ was considered the default - it is increasingly becoming the case that Java/C# performance is comparable with native language performance.
With all of the productivity benefits associated with VM languages, the consensus is growing that default choice is no longer C++...

Theoretically, even on current hardware, VM language performance can exceed that of compile-time optimised languages like C/C++.

If specialised hardware like this starts appearing, then the native-vs-vm perf gap is going to reverse sharply. And, as Sam mentioned, with some serious vertical scalability to boot.

I wonder if Azul - or friends - will be interested in offering a compute service model similar to what Sun are doing with http://www.technewsworld.com/story/36822.html

Its going to be interesting when some hard data comes out on this thing.

-Nick

  Message #140898 Post reply Post reply Post reply Go to top Go to top Go to top

SOAP is mostly compute bound ?

Posted by: Nick Minutello on October 01, 2004 in response to Message #140249
It has a high GC hit - like serialisation in general.

The biggest hit I have seen is on the wire though...
(unless you talk about compression...)

-Nick

  Message #140985 Post reply Post reply Post reply Go to top Go to top Go to top

Azul releases new server appliance that processes J2EE tasks

Posted by: Claude Vedovini on October 02, 2004 in response to Message #140075
One Azul box will have more Java horsepower than an entire rack of servers
Well, I guess that having 48 times more CPUs and 16 times more memory than the typical server box will help :-)
And this would help with any kind of language not only Java or .NET

However, it seems to me that their biggest argument does not concern horse power but TCO. Reducing the TCO by reducing the number of servers needed to survive peaks?!
It is not uncommon for large data centers to have hundreds of applications running on thousands of servers. Managing and maintaining these applications becomes more challenging and costly every year as more applications are brought on-line. Additionally each application requires dedicated host servers or partitions with headroom capacity to handle unpredictable workloads. The result is millions of dollars spent to deploy and maintain servers with low utilization, slow return on investment and very high total cost of ownership.
AFAIK when several servers are put together to serve 24x7 applications, having one more can help to support peaks but it is most of the time there for failover.
If the argument was "our server is 40 times more powerfull than other's, just buy two of them and dump your 100 servers pool" I would say that's sounds good, however this not the case. Unless I misinterpret, they just say drop some, use our JVM on the rest, we will take the overload.

By the way, I have never seen any client pretending they have "unpredictable workloads"

Sweet, if I could have one to run a Quake server.

Prosperity,

Claude Vedovini
Anonymous geek

  Message #147069 Post reply Post reply Post reply Go to top Go to top Go to top

Azul Usage with Fortune 500 Enterprises

Posted by: James McGovern on November 23, 2004 in response to Message #140198
I am an Enterprise Architect for a Fortune 100 who will be putting Azul through our gauntlet in the December timeframe. Don't listen to speculation from others on this topic, go and figure it out for yourself.

If time permits, may even blog any discoveries that are generally applicable to Java development at: http://blogs.ittoolbox.com/eai/leadership

Industry Analysts and those in the media are welcome to contact me in the January timeframe to provide an indepth customer perspective.

If you happen to be an Azul customer, maybe we could trade notes...

New content on TheServerSide.comNew content on TheServerSide.comNew content on TheServerSide.com

Dependency Injection in Java EE 6 - Part 1

Reza Rahman explores the features of the proposed JSR 299, Contexts and Dependency Injection for Java EE (CDI). When approved, it promises to be a key feature of Java EE 6. (November 2, Article)

SAML: It's Not just for Web services

SAML is an XML-based standard for exchanging authentication and authorization data between security domains. The single most important problem that SAML was created to solve is the Web browser Single Sign-On problem. Many organizations are debating whether to stay with version 1.1 or move to 2.0. This article makes observations about both options. (September 28, Article)

Programming is Also Teaching Your Team

Joe Ottinger takes a look at how people learn, and applies it to the practice of programming. He notes that understanding how people learn is an essential part of working in a programming team. (September 22, Article)

Can Java EE Deliver The Asynchronous Web?

Stephen Maryka gave us an article about the Asynchronous Web and posed a number of questions that get examined like an approach to delivering Asynchronous Web capabilities through extensions to existing Java EE technologies. (July 14, Article)

JSF Flex

JavaServer Faces Flex goal is to provide users capability in creating standard Flex components, part of flexSDK which is open sourced through MPL license, as normal JSF components. This article by Ji Hoon Kim will provide an overview of creating a simple multilingual JSF page consisting of JSF Flex tags. (June 29, Article)

The Rules of SOA - A Road to a Successful SOA Implementation

In this session Jeff explores the key characteristics of successful SOA projects. He covers some of the patterns, and anti-patterns, tool sets, and strategies that he himself learned the hard way. Last, he provides a strategy and blueprint for achieving a high likelihood of success in your SOA project. (June 23, Tech Talk)

Ari Zilka Talks About Terracotta 3.1

Ari Zilka, CTO of Terracotta, Inc., talks about the new features in Terracotta 3.1, announced during JavaOne and available now. (June 15, Tech Talk)

Enterprise Application Integration, and Spring

In this Tech Talk, Josh Long explores an integration challenge using Spring Integration and walks through the implementation, employing and expanding on the basic patterns of Enterprise Application Integration to tie together components into a function integration solution, and then demonstrates how Spring Integration helps address the integration requirements. (June 15, Tech Talk)

Google Web Toolkit: An Introduction

In this Tech Talk, David Geary teaches you: The basics of Google Web Toolkit; How to implement Ajax-enabled applications in Java; Internationalization; Hooking into the browser history mechanism; Remote procedure calls. (June 4, Tech Talk)

Just Enough Early Architecture to Guide Development

Jon Kern discusses the best architecture/technical solutions and ensure that they are repeated by all developers. By tackling the architecture up-front in a serial manner, subsequent parallel development will be much more manageable and predictable. (May 28, Tech Talk)

Productive Programmer: On the Lam from the Furniture Police

This keynote describes the frustrations of modern knowledge workers in their quest to actually get some work done, and solutions for how to guard yourself against all those distractions. Neal Ford talks about environments, coding, acceleration, automation, and avoiding repetition as ways to defeat the misguided attempts to sap your ability to produce good work. (May 26, Tech Talk)

Auto-Scaling Your Existing Web Application

Gil demonstrates how new, aggressive uses of already abundant compute capacity by common applications offer competitive value for application designers. (May 21, Tech Talk)

Automating Hibernate Mapping and Queries For Java Web Development

Chris Keene introduces WaveMaker as a new way to automate the ability to generate Hibernate classes in order to more quickly bring OR mapping into an application. (May 19, Article)

Auto-Scaling Your Existing Web Application

In this session Nati Shalom demonstrates how to take a standard Java EE web application and scale it out or down dynamically without changes to the application code. Seeing as most web applications are over-provisioned to meet infrequent peak loads, this is a dramatic change because it enables growing your application as needed, when needed, without paying for unutilized resources. (May 19, Tech Talk)

Free Book PDF Download: Mastering EJB Third Edition

Mastering EJB was one of the original and most influential EJB books in the industry. Mastering EJB III now returns with two new expert co-authors, updated for EJB 2.1 and 30% new chapters including security, integration, best practices, open source, and more.
(Book PDF Download)

Application Server Matrix

The Application Server Matrix is a detailed listing of J2EE vendors and their application server products, with information on latest version numbers, J2EE spec support and licensing, pricing, platform support, and links to product downloads and reviews.
(Application Server Comparison Matrix)

News | Blogs | Discussions | Tech talks | Patterns | Reviews | White Papers | Downloads | Articles | Media kit | About
Java Solutions
All Content Copyright ©2007 TheServerSide Privacy Policy
Site Map