|
Sponsored Links
Resources
Enterprise Java
Research Library
Get Java white papers, product information, case studies and webcasts
|
News
News
News
|
Messages: 17
Messages: 17
Messages: 17
Printer friendly
Printer friendly
Printer friendly
Post reply
Post reply
Post reply
XML
XML
XML
|
 |
Open Source Log Analysis tool
MindTree Insight is a log analysis tool inspired by the Log4j Chainsaw. It is now an OpenSource project on SourceForge and is available at : http://sourceforge.net/projects/mindtreeinsight
The download of the latest release is available at: http://sourceforge.net/project/showfiles.php?group_id=212019&package_id=254922
This blog entry describes the need for such a tool and its background : http://regumindtrail.wordpress.com/2007/02/06/the-spot-the-log-entry-contest/In brief it provides the following:- Provide visual analysis of any pattern based log files
- Analyze logs from remote servers over (S)Ftp and Http.
- Supports tailing of local files and a plug-in for Eclipse
- Provides summary and detailed view of the log event
- Supports “no-mutating” analysis of the data set - such as search, sort.
- Supports “mutating” analysis of data set - via progressive filtering
- Helps to locate the “context” of an event i.e snap shot of log entries around a specific log entry.
- Optimized for performance and footprint size
- Loads 1000 entries in around 375 ms
- VM size between 45 to 60MB even after loading 110 000 entries
|
|
|
Message #249864
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Very Windows friendly!
Too bad I don't have Windows.
$> cat insight.sh
echo "Not yet implemented"
Nice!
|
|
|
Message #249865
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: Open Source Log Analysis tool
It looks good. But I had some question after using the product.
1. What is that additional feature this tool gives, which "grep" tool provides in unix or cygwin?.
The above question is purely based on log analysis perspective. Some of the good features of the product include ftp, remote server etc.
|
|
|
Message #249869
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: Open Source Log Analysis tool
Hi
Tool gives a tabular view from a flat file system. i feel it should give much graphical view like google/analytics or some sort of basic reports to get value-added information.
thanks
ek
|
|
|
Message #249874
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: Very Windows friendly!
Do agree with the statement. However, Insight is an open source project, and any contributions are most welcome.
|
|
|
Message #249881
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
A first shot
Always got a "Specified log pattern doesn't match data" error until I removed almost all formatting. I prefer an interface like BareTail.
|
|
|
Message #249884
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
contributions weren't welcome to chainsaw??
I always wonder why we have soooooo many Open Source Java projects that claim "It has features that the $$$ team found missing in %%%%" and then tell everyone who mentions a feature missing in their project that contributions are welcome.. Why didn't you add the features as contributions to Chainsaw and save us all the headache of yet another java project...
Just my two cents...
Gary
|
|
|
Message #249898
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: contributions weren't welcome to chainsaw??
Gary,
Good point. Insight was developed as closed source initially in 2005. We did find some useful stuff in Chainsaw but then realized that we wanted Insight to be more than a log analyzer. FYI, we wanted to build JVM profiling into it as well which, well, never happened :)
|
|
|
Message #249899
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: Open Source Log Analysis tool
Rajesh,
Isn't the world dominated by point-and-click users ? :)
The ability to do progressive filtering, ability to locate the context of a log entry, searching on selective log entry fields, fileset definitions, remote browsing of 'nix servers, Eclipse plug-in, tailing of files e.t.c. are not possible using "grep" AFAIK.
|
|
|
Message #249900
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: Very Windows friendly!
Tracy,
Good catch :) Its no excuse, but all of us here use Windows!
We have added a ticket for this at :
https://sourceforge.net/tracker/?func=detail&atid=1020095&aid=1931541&group_id=212019
In the meanwhile, you can maybe create a shell script out of the Windows .bat file contents provided below:
-------------------------------------------------------------
@echo off
rem ---------------------------------------------------------------------------
rem Startup Script for Insight
rem
rem Environment Variable Prequisites
rem
rem JAVA_HOME Must point to a valid Java 2 JRE or JDK directory with version 1.4.2 or later
rem
rem INSIGHT_HOME Must point to the directory where this shell was extracted to
rem ---------------------------------------------------------------------------
set TMP=c:\tmp
set JAVA_HOME=D:\WorkTools\j2sdk1.4.2_02
set INSIGHT_HOME=D:/projects/insight
set INSIGHT_JAR=@@@INSIGHT_JAR@@@
:checkJavaHome
if not "%JAVA_HOME%" == "" goto gotJavaHome
echo The JAVA_HOME environment variable has not been defined
goto end
:checkInsightHome
if not "%INSIGHT_HOME%" == "" goto gotInsightHome
echo The INSIGHT_HOME environment variable has not been defined
goto end
:gotJavaHome
if exist "%JAVA_HOME%\bin\java.exe" goto checkInsightHome
echo The JAVA_HOME environment variable is not defined correctly
echo This environment variable is needed to run this program. Please set it to JRE or JDK version 1.4.2 or later
goto end
:gotInsightHome
if exist "%INSIGHT_HOME%\config\insight-preferences.xml" goto okHome
echo The INSIGHT_HOME environment variable is not defined correctly
echo This environment variable is needed to run this program. Please set it to the folder where Insight archive was extracted
goto end
:okHome
set INSIGHT_CLASS_PATH=.;%INSIGHT_JAR%;%INSIGHT_HOME%/bin;%INSIGHT_HOME%/lib/looks-1.2.2.jar;%INSIGHT_HOME%/lib/jakarta-oro-2.0.6.jar;%INSIGHT_HOME%/lib/log4j-1.3alpha.jar;%INSIGHT_HOME%/lib/log4j-chainsaw-1.3alpha-3.jar;%INSIGHT_HOME%/lib/xercesImpl.jar;%INSIGHT_HOME%/lib/xml-apis.jar;%INSIGHT_HOME%/lib/xmlParserAPIs.jar;%INSIGHT_HOME%/lib/commons-logging.jar;%INSIGHT_HOME%/lib/j2ssh-core.jar;%INSIGHT_HOME%/lib/commons-httpclient-2.0.2.jar;%INSIGHT_HOME%/lib/commons-net-1.3.0.jar
%JAVA_HOME%\bin\java -classpath %INSIGHT_CLASS_PATH% -DINSIGHT_HOME=%INSIGHT_HOME% com.mindtree.insight.gui.Insight
:end
------------------------------------------------------------
|
|
|
Message #249901
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: Very Windows friendly!
Tracy,
Good catch :) Its no excuse, but all of us here use Windows!
We have added a ticket for this at :
https://sourceforge.net/tracker/?func=detail&atid=1020095&aid=1931541&group_id=212019
In the meanwhile, you can maybe create a shell script out of the Windows .bat file contents provided below:
-------------------------------------------------------------
@echo off
rem ---------------------------------------------------------------------------
rem Startup Script for Insight
rem
rem Environment Variable Prequisites
rem
rem JAVA_HOME Must point to a valid Java 2 JRE or JDK directory with version 1.4.2 or later
rem
rem INSIGHT_HOME Must point to the directory where this shell was extracted to
rem ---------------------------------------------------------------------------
set TMP=c:\tmp
set JAVA_HOME=D:\WorkTools\j2sdk1.4.2_02
set INSIGHT_HOME=D:/projects/insight
set INSIGHT_JAR=@@@INSIGHT_JAR@@@
:checkJavaHome
if not "%JAVA_HOME%" == "" goto gotJavaHome
echo The JAVA_HOME environment variable has not been defined
goto end
:checkInsightHome
if not "%INSIGHT_HOME%" == "" goto gotInsightHome
echo The INSIGHT_HOME environment variable has not been defined
goto end
:gotJavaHome
if exist "%JAVA_HOME%\bin\java.exe" goto checkInsightHome
echo The JAVA_HOME environment variable is not defined correctly
echo This environment variable is needed to run this program. Please set it to JRE or JDK version 1.4.2 or later
goto end
:gotInsightHome
if exist "%INSIGHT_HOME%\config\insight-preferences.xml" goto okHome
echo The INSIGHT_HOME environment variable is not defined correctly
echo This environment variable is needed to run this program. Please set it to the folder where Insight archive was extracted
goto end
:okHome
set INSIGHT_CLASS_PATH=.;%INSIGHT_JAR%;%INSIGHT_HOME%/bin;%INSIGHT_HOME%/lib/looks-1.2.2.jar;%INSIGHT_HOME%/lib/jakarta-oro-2.0.6.jar;%INSIGHT_HOME%/lib/log4j-1.3alpha.jar;%INSIGHT_HOME%/lib/log4j-chainsaw-1.3alpha-3.jar;%INSIGHT_HOME%/lib/xercesImpl.jar;%INSIGHT_HOME%/lib/xml-apis.jar;%INSIGHT_HOME%/lib/xmlParserAPIs.jar;%INSIGHT_HOME%/lib/commons-logging.jar;%INSIGHT_HOME%/lib/j2ssh-core.jar;%INSIGHT_HOME%/lib/commons-httpclient-2.0.2.jar;%INSIGHT_HOME%/lib/commons-net-1.3.0.jar
%JAVA_HOME%\bin\java -classpath %INSIGHT_CLASS_PATH% -DINSIGHT_HOME=%INSIGHT_HOME% com.mindtree.insight.gui.Insight
:end
------------------------------------------------------------
|
|
|
Message #249908
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: Open Source Log Analysis tool
>>>> context of a log entry, searching on selective log entry fields, fileset definitions, remote browsing of 'nix servers, Eclipse plug-in, tailing of files e.t.c. are not possible using "grep" AFAIK
Thankx for the reply Regunath. "grep" in unix is much more powerful specifically for nailing down a specific set of criteria that you pass as regex.
Just to address some of your concerns: Tailing a file is perfectly possbile in unix (in windows use cygwin), remote logging using putty.exe or any such tool.
I fully agree with your good intention to opensource this. I am giving the points purely from the common experience people had with production systems.
|
|
|
Message #249944
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
log4j 1.3??
http://logging.apache.org/log4j/1.3/index.html
log4j 1.3 development has been abandoned and no future releases or development is anticipated. Users of log4j 1.3 are encouraged to migrate to log4j 1.2 or to monitor and contribute to the log4j 2.0 development effort. The companions for log4j 1.2 provide many of the features that were developed during the log4j 1.3 development effort.
That being said I dont quite finish to understand why you are using log4j-1.3alpha9-SNAPSHOT.jar as the log4j library for insight-ui.
|
|
|
Message #249978
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Broken
Make it work first then start showing 1.5.1.
When I save FTP configuration and exit app, i found nothing on app restart.
|
|
|
Message #249984
Post reply
Post reply
Post reply
Go to top
Go to top
Go to top
|
|
Re: log4j 1.3??
Sebastian,
It is a matter of need based migration. We used 1.3 Alpha when it was released. We primarily use the log4.jar for classes like Level, LoggingEvent e.t.c which havent changed much over time. In case we choose to use log4j 2.0, we might have to support additional severity/priority levels or make changes to support existing ones.
We intend to migrate to log4j 2.0 when it becomes stable. Until then any version that supports these basic classes work for Insight.
|
|
|
| New content on TheServerSide.comNew content on TheServerSide.comNew content on TheServerSide.com |
|
|
Reza Rahman explores the features of the proposed JSR 299, Contexts and Dependency Injection for Java EE (CDI). When approved, it promises to be a key feature of Java EE 6.
(November 2, Article)
SAML is an XML-based standard for exchanging authentication and authorization data between security domains. The single most important problem that SAML was created to solve is the Web browser Single Sign-On problem. Many organizations are debating whether to stay with version 1.1 or move to 2.0. This article makes observations about both options.
(September 28, Article)
Joe Ottinger takes a look at how people learn, and applies it to the practice of programming. He notes that understanding how people learn is an essential part of working in a programming team.
(September 22, Article)
Stephen Maryka gave us an article about the Asynchronous Web and posed a number of questions that get examined like an approach to delivering Asynchronous Web capabilities through extensions to existing Java EE technologies.
(July 14, Article)
JavaServer Faces Flex goal is to provide users capability in creating standard Flex components, part of flexSDK which is open sourced through MPL license, as normal JSF components. This article by Ji Hoon Kim will provide an overview of creating a simple multilingual JSF page consisting of JSF Flex tags.
(June 29, Article)
In this session Jeff explores the key characteristics of successful SOA projects. He covers some of the patterns, and anti-patterns, tool sets, and strategies that he himself learned the hard way. Last, he provides a strategy and blueprint for achieving a high likelihood of success in your SOA project.
(June 23, Tech Talk)
Ari Zilka, CTO of Terracotta, Inc., talks about the new features in Terracotta 3.1, announced during JavaOne and available now.
(June 15, Tech Talk)
In this Tech Talk, Josh Long explores an integration challenge using Spring Integration and walks through the implementation, employing and expanding on the basic patterns of Enterprise Application Integration to tie together components into a function integration solution, and then demonstrates how Spring Integration helps address the integration requirements.
(June 15, Tech Talk)
In this Tech Talk, David Geary teaches you: The basics of Google Web Toolkit; How to implement Ajax-enabled applications in Java; Internationalization; Hooking into the browser history mechanism; Remote procedure calls.
(June 4, Tech Talk)
Jon Kern discusses the best architecture/technical solutions and ensure that they are repeated by all developers. By tackling the architecture up-front in a serial manner, subsequent parallel development will be much more manageable and predictable.
(May 28, Tech Talk)
This keynote describes the frustrations of modern knowledge workers in their quest to actually get some work done, and solutions for how to guard yourself against all those distractions. Neal Ford talks about environments, coding, acceleration, automation, and avoiding repetition as ways to defeat the misguided attempts to sap your ability to produce good work.
(May 26, Tech Talk)
Gil demonstrates how new, aggressive uses of already abundant compute capacity by common applications offer competitive value for application designers.
(May 21, Tech Talk)
Chris Keene introduces WaveMaker as a new way to automate the ability to generate Hibernate classes in order to more quickly bring OR mapping into an application.
(May 19, Article)
In this session Nati Shalom demonstrates how to take a standard Java EE web application and scale it out or down dynamically without changes to the application code. Seeing as most web applications are over-provisioned to meet infrequent peak loads, this is a dramatic change because it enables growing your application as needed, when needed, without paying for unutilized resources.
(May 19, Tech Talk)
Mastering EJB was one of the original and most influential EJB books in the industry. Mastering EJB III now returns with two new expert co-authors, updated for EJB 2.1 and 30% new chapters including security, integration, best practices, open source, and more.
(Book PDF Download)
The Application Server Matrix is a detailed listing of J2EE vendors and their application server products, with information on latest version numbers, J2EE spec support and licensing, pricing, platform support, and links to product downloads and reviews.
(Application Server Comparison Matrix)
|
|
