I'm pleased to be able to place 158.000 lines of Java code under the LGPL license in the form of a complete ETL environment called Kettle. Kettle has been more then 4 years in the making and in that period has grown to a very usable and complete ETL tool. It is available for download from the Kettle project homepage at Javaforge.
Kettle comes with 4 tools:
- Spoon: GUI allowing you to design complex transformations
- Pan: Batch executor of transformations (XML or in repository)
- Chef: GUI allowing you to design complex jobs
- Kitchen: Batch executor of jobs (XML or in repository)
Interesting things to know about Kettle:
- Transformations and jobs are made up of 100% meta data. This meta-data is parsed by Kettle and executed. No code-generation is involved.
- At the moment there are around 35 different step types available to create transformations and about 10 job entry types.
- Almost every popular database is supported including MySQL, PostgreSQL, MS Access, SQL Server, Oracle, DB2, Sybase, Informix, MaxDB, Firebird, AS/400, Ingres, Caché, ...
- Kettle can be used for many things, but was developed to create and populate data warehouses. As such, slowly changing dimensions (Kimbal Types I, II and III) and junk dimensions are supported in a single step.
- Many advanced features exists to allow fast inserts such as batch updates.
- Kettle is one of the only ETL tools on the market to support partitioned tables on PostgreSQL by allowing records to be inserted into different inherited tables.
- Kettle is providing a plugin mechanism that allows you to create plugins for any possible data acquisition or transformation purpose. For example the German company Proratio (http://www.proratio.de/kettle/kettleen/) provides a Kettle plugin to read information from an SAP application server. They have a free trial you can use for 30 days.
This message serves as an invitation to all Java and Data Warehouse developers to come and help make Kettle even better. Let me know what you all think and please join the Kettle development team!
I hope you all have as much fun using Kettle as I had writing it.
Brussels/Belgium, december 2005