Big data architecture
As enterprise organizations begin to collect massive amounts of data and to begin to find ways to capitalize on that data, enterprise application developers are increasingly being asked to build big data architecture. Developing effective big data strategies that can go beyond processing big data in big batches and bring the enterprise into real-time big data analytics is a heavy challenge. Big data frameworks such as Hadoop can be very helpful, but at this point, enterprise architects need a thorough understanding of basics of big data.
Top Stories
-
Feature
15 Mar 2021
Why Java devs should switch to Python or R for data science
Java devs looking to explore or work in data science may need another language up their sleeves. Python and R are common Java alternatives for data science. Continue Reading
-
Tutorial
18 Nov 2020
An Apache Commons FileUpload example and the HttpClient
In this article you will have a look at the capabilities of the HttpClient component and also some hands-on examples. Continue Reading
-
Definition
10 Nov 2022
search engine
A search engine is a coordinated set of programs that searches for and identifies items in a database that match specified criteria. Continue Reading
-
Blog Post
31 May 2022
How to create a database schema in MySQL
Want to work with MySQL databases using Java? Here's a quick walkthrough of the first step to do that: create a schema. Continue Reading
-
Blog Post
11 Aug 2021
Java shows promise AI app scaling
Find out how Java provides a promising alternative for coding data science applications that may make it easier to develop more scalable AI. Continue Reading
-
Blog Post
01 Aug 2021
RPA examples that prove robotic automation works
Although Robotic Process Automation has been around for years, banks and financial institutions continue to find new RPA use cases to save time, effort and money. Continue Reading
-
Feature
15 Mar 2021
Why Java devs should switch to Python or R for data science
Java devs looking to explore or work in data science may need another language up their sleeves. Python and R are common Java alternatives for data science. Continue Reading
-
Tutorial
18 Nov 2020
An Apache Commons FileUpload example and the HttpClient
In this article you will have a look at the capabilities of the HttpClient component and also some hands-on examples. Continue Reading
-
Video
23 Jun 2020
How MySQL InnoDB vs. MyISAM data engines compare
Data integrity, performance and transactional capabilities create the MyISAM vs. InnoDB data set debate for MySQL users. Compare the two to see which one makes sense for your data. Continue Reading
-
Blog Post
25 Jun 2019
Hibernate vs JPA: What's the difference between them?
Let us settle the Hibernate vs JPA debate for you. Here we explain the difference between JPA and Hibernate so that you'll never have to choose between the two database APIs. Continue Reading
-
Video
30 May 2019
JDBC in Java: 5 facts to know before you begin
Are you new to Java programming? Here are five interesting facts about the JDBC API and what you need to know about it to ease your development pathway. Continue Reading
-
Video
24 May 2019
JDBC vs. ODBC: What's the difference between these APIs?
There are more similarities between ODBC and JDBC than there are differences. But, the differences are significant. Here we highlight them. Continue Reading
-
Feature
28 Dec 2018
Java developer tutorials a popular destination for 2018 readers
What were readers interested in during 2018? Java developer tutorials topped the list. Learn how to integrate RESTful APIs, GIT, and Jenkins CI tools. Continue Reading
-
Blog Post
01 Oct 2018
How big data and AI bring synergies to data science
Data science is having its day in the sun, delivering a wealth of possibilities for women in technology. Talent is in high demand, open source is democratizing access, and innovation is blossoming. ... Continue Reading
-
Blog Post
20 Sep 2018
Top three mistakes new data scientists need to avoid
Data science as a discipline has a brief history but a bright future. The label for this particular field of specialization has caught on in the past ten years after being popularized by ... Continue Reading
-
Blog Post
01 Jul 2018
Surprise results stem from curious data analytics models
Sometimes it's just a hunch that kicks off a data analytics project. But surprising results often come from data analytics models put together by those who are both curious and perceptive. Continue Reading
-
Tip
22 Mar 2018
A side-by-side comparison of MongoDB vs Cassandra databases
How do you choose one NoSQL database over another? Expert Christopher Tozzi explains the difference between MongoDB and Cassandra. Continue Reading
-
Blog Post
27 Feb 2018
The things you need to know about managing cloud data
Many organizations moved into the cloud with more enthusiasm than forethought. Which is why it is more important than ever for organizations to rethink how they manage and secure cloud data. Continue Reading
-
Blog Post
06 Nov 2017
Seven mistakes digital transformation projects must avoid
Every organization managing big data, employing IoT devices or pulling from a disparate set of information streams is looking at ways to put all of the data they have gleamed from their various ... Continue Reading
-
Blog Post
03 Oct 2017
Three reasons to start digital transformation projects
What's driving businesses to start digital transformation projects? Tata Consultancy experts explain the human and technology forces in play. Continue Reading
-
Guide
29 Aug 2017
Top JavaScript frameworks accelerate software development
Despite its tough reputation, JavaScript frameworks are still growing in popularity in the software development world. Get the latest on JavaScript's status and future expectations. Continue Reading
-
Feature
16 Aug 2017
How a data cache can solve your JavaScript performance problems
There are many barriers to improved web application performance, but using a data cache effectively can break down many of those performance barriers. Continue Reading
-
Feature
09 Aug 2017
How Pandora built a better recommendation engine
Find out how Pandora developed an AI application for building a better recommendation engine that combines novelty and comfort. Continue Reading
-
Feature
07 Aug 2017
Edge device developers not addressing IoT security vulnerabilities
Security is problematic when software is deployed behind firewalls, but when you have edge devices out in the wild, IoT security vulnerabilities become even more of a concern. Continue Reading
-
Opinion
01 Jun 2017
Standardized data the key to making cloud storage a commodity
Wouldn't it be nice if accessing cloud storage solutions were as easy as plugging in a toaster? Standardized data is the key. Cloud storage as a commodity is the future. Continue Reading
-
Feature
04 May 2017
DevOps performance teams using AIOps for app performance insights
Find out how enterprise organizations are beginning to leverage algorithmic IT operations to mine performance logs and improve application performance. Continue Reading
-
Opinion
01 May 2017
Software ethics and why 'Uber developer' stains a professional resume
After all of the playboy antics of the CEO, along with the unethical practices of fingerprinting and geofencing, the term 'Uber developer' is a stain on any professional resume. Continue Reading
-
Blog Post
10 Mar 2017
Machine learning and big data experts gather at the Dallas Data Science Association Conference
For the second year in a row, experts gathered in Dallas to explore the world of machine learning and data science. Continue Reading
-
Feature
08 Mar 2017
Big data IoT projects shaping the future of trucking and shipping
You don't regularly associate IoT and big data with transports bearing down on the highway, but big data IoT projects are revolutionizing the trucking industry. Continue Reading
-
Feature
07 Mar 2017
Big data recognition technology the next frontier for machine learning
It's one thing to have big data, but it's another to be able to understand it. That's why big data recognition technology is so important to the world of machine learning. Continue Reading
-
Feature
06 Mar 2017
Applying data science to doc migrations brought sense to the City of LA
When the city of LA was burdened with antiquated systems of sharing information, data science was applied and doc migrations performed. Continue Reading
-
Feature
03 Mar 2017
Bringing business leaders, data science and advanced analytics together
How do you bridge the gap between academia and industry when it comes to data science and advanced analytics? Sai Devulapalli, Data Analytics Product and Business Leader at Dell, has some ideas. Continue Reading
-
Blog Post
27 Feb 2017
How to win at an IoT hackathon
Unlike most technology hackathons, this event kept a laser focus on the commercial side of technical innovation. What was the outcome of this IoT hackathon? It was a very tight race. Continue Reading
-
Blog Post
26 Feb 2017
Addressing the challenges of modern day big data science
The Dallas Data Science Conference for 2017 focused on the three key areas of technology, innovation, and career for a large audience of students, industry professionals, and entrepreneurs. The ... Continue Reading
-
Blog Post
22 Feb 2017
Arguing the business case for IoT adoption
As an increasing number of businesses embrace IoT adoption to create more efficiency, reach new market segments, and innovate for the future, they are facing challenges along the way. Continue Reading
-
Blog Post
22 Feb 2017
Unclear strategies and a lack of expertise remain common IoT challenges
As an increasing number of businesses embrace the Internet of Things to create more efficiency, reach new market segments, and innovate for the future, they are facing challenges along the way. Continue Reading
-
Blog Post
20 Feb 2017
IoT analytics reveal the true value of edge device deployment
Analytics delivers the real value of IoT and it’s not surprising that this is the area where businesses, vendors, and thought leaders are focusing their attention. Continue Reading
-
News
17 Feb 2017
How deep learning and AI techniques accelerate domain-driven design
Is the codebase aligned with the enterprise model? Deep learning and other AI technologies are helping to align domain-driven design with the organization's business objectives. Continue Reading
-
Podcast
03 Nov 2016
IoT data consumption a key challenge in edge device scalability
IoT devices can be most unfriendly -- from cheap components to bad sensors -- which means handling, consuming and processing IoT data is a key to edge device scalability. Continue Reading
-
Podcast
03 Aug 2016
Java Champion Trisha Gee on NoSQL, IntelliJ and Java 8
Presenting at QCon New York, Java Champion Trisha Gee talks about the hot-button topics in the conference's community, including NoSQL, IntelliJ and Java 8. Continue Reading
-
Podcast
22 Jul 2016
Apache Arrow to revolutionize big data analytics performance
Apache Arrow will not only improve the performance of your big data analytics engines, but it will make system interoperability more efficient as well. Continue Reading
-
News
17 Jun 2016
Apache Spark streaming analytics engine key to integrating big data
Learn how a variety of improvements to the open source Apache Spark streaming analytics engine promises to improve the development of big data applications. Continue Reading
-
Tutorial
09 Jun 2016
Apache Drill case study: A tutorial on processing CSV files
Rob Terpilowski decided to take Apache Drill for a test drive and use it for processing CSV files. Here's a quick tutorial to show how you can do it to. Continue Reading
-
Blog Post
19 May 2016
Big data isn't going to go mainstream, it's already there
Big data is undeniably becoming more wide-spread as it continues to grow. Part of the reason for that is because many things are fueling big data, but what's interesting is that big data, in ... Continue Reading
-
Blog Post
11 May 2016
How big data can help your enterprise
Big data is defined as "any voluminous amount of structured, semi-structured and unstructured data that has the potential to be mined for information." That's great, that means all businesses need ... Continue Reading
-
News
21 Apr 2016
Identifying where big data apps make sense today
Developers can gain an advantage from identifying the most common use cases of big data apps today. Here, expert George Lawton offers three different things to keep in mind. Continue Reading
-
Feature
24 Mar 2016
Modularity thrives when microservices and SOA comes together
Many organizations think they need to make a choice between service oriented architectures and microservices. The fact is, the most modular solutions happen when microservices and SOA comes together. Continue Reading
-
Feature
23 Mar 2016
Choosing the right big data analysis tools
In order to choose the right big data analysis tools, it’s important to understand the transactional and analytical data processing requirements of your systems and choose accordingly. Continue Reading
-
News
17 Mar 2016
Why NoSQL databases are getting replaced
NoSQL databases have gained popularity by solving problems at which relational databases fail. Now graphing engines are solving the problems that are too tough for NoSQL. Continue Reading
-
Tutorial
21 Jan 2016
How to integrate Spring Cache with an In-Memory Data Grid (IMDG)
Interested in combining the efficiencies of Spring Cache with the power of an In-Memory Data Grid (IMDG). This simple tutorial demonstrates just how easy the process is. Continue Reading
-
Feature
03 Jan 2016
Simplified messaging and microservice development with PHP's PSR-7
Here we take a look at PHP's PSR-7, and how this new specification will help simplify microservice development while enhancing application messaging at the same time. Continue Reading
-
Feature
01 Jan 2016
Perfecting product migrations without customer disruption with Agile
Learn how MobiTV created a software development process for powering the future of connected TV. Continue Reading
-
Feature
02 Dec 2015
How to build an application integration framework for flexibility
Learn how MOBI Wireless created a back end infrastructure that makes it easy to implement different business workflows across service providers. Continue Reading
-
News
01 Dec 2015
How to setup a local Maven repository server for artifact hosting
This article looks at how to setup a local Maven repository, along with the functionality a local Maven repository server should provide. Criteria for choosing a private, local Maven repository are listed, along with Maven tutorials on how to setup Artifactory and Nexus. Continue Reading
-
Feature
10 Nov 2015
How collapsing the database stack improves developer productivity
Developers are reducing development time by collapsing the database stack and focusing on customer satisfaction and not on operations overhead. Here is how they are doing it. Continue Reading
-
News
15 Oct 2015
Barry Burd's guide to the best sessions to attend at JavaOne 2015
Going to JavaOne this year? Wondering which sessions to attend? Conference veteran Barry Burd is here to help guide your way through Oracle's big conference in San Francisco. Continue Reading
-
Tip
27 Aug 2015
Hortonworks optimizes Apache Hadoop performance
Hortonworks has recently introduced new products to help enhance Apache Hadoop performance. Continue Reading
-
Podcast
27 Aug 2015
Redis creator signs with vendor amid community support
How did the Redis community feel when the creator of their coveted NoSQL database signed on with a commercial vendor? TheServerSide talks to Salvatore Sanfilippo to find out. Continue Reading
-
Podcast
25 Aug 2015
The latest trends in the Hadoop project
In this podcast, Tim Hall of Hortonworks discusses the Apache Hadoop project and how it has changed since its inception. Continue Reading
-
Feature
18 May 2015
The challenge of managing distributed data can only be solved with NoSQL solutions
Managing data over large geographic areas where latency and reliability problems exist is a major challenge for relational databases, but fortunately, NoSQL databases are solving the problem of managing distributed data. Continue Reading
-
Feature
07 May 2015
A new approach to condensing data leads to a 99% compression rate
Given the enormous thirst for data, coupled with the finite existence of copper and fiber optic cables that link clients and servers together, the need for powerful compression algorithms is self-evident. Has XLABS solved the problem with a 99% rate? They just may have. Continue Reading
-
Tip
26 Mar 2015
Successfully managing software quality with growing, globally distributed teams
Successfully managing a software project is always a challenge, but when a project grows into a globally distributed development effort, application lifecycle management (ALM) becomes a real challenge. So how does Liferay, an open source, enterprise portal do it? Senior software architect Ray Auge tells us how. Continue Reading
-
Tip
23 Mar 2015
Improving software quality in every application lifecycle management (ALM) stage
Development lifecycles have become tremendously compressed, which means many stages of the application lifecycle management process are iterated over time and time again. Here are some lessons SFactory's Sorin Zaporojan learned throughout the ALM process. Continue Reading
-
Feature
18 Mar 2015
Will ObjectLayout's StructuredArrays finally solve the Java performance problem?
Java performance has greatly improved over the years, but getting true, linear scalability has always been a problem, largely due to the way data collections are handled in memory. However, new approaches to memory management are being developed, and ObjectLayout's StructuredArrays just might make it into Java 9 or 10. Continue Reading
-
Podcast
17 Feb 2015
Discussing Aerospike at DeveloperWeek 2015
Aerospike's developer discusses how the NoSQL database recently moved its IP to open source at DeveloperWeek 2015. Continue Reading
-
Feature
30 Jan 2015
Growing the demand for NoSQL technology, and non-relational solutions
While relational databases have been the stalwart of enterprise computing, more and more organizations are looking at NoSQL solutions that will free them from many of the constraints of a relational database system. Continue Reading
-
Feature
25 Aug 2014
Comparing of the cloud storage Titans: Amazon S3 versus Microsoft Azure
There are many vendors out there fighting for your cloud based storage space, with the two biggest being Microsoft Azure and Amazon's S3 offering. Here we compare the two to help you figure out which cloud storage solution is right for you. Continue Reading
-
Feature
28 Jul 2014
Top 5 Java based tools for capturing business intelligence (BI)
There are many tools out there for working with BI, but here we look at the top five Business Intelligence tools that are written using the Java language. Continue Reading
-
Feature
23 Jun 2014
How Amazon tools are solving Big Data problems with Big Data Analytics
Companies are amassing data on a massive scale these days, and new tools are need to bring Big Data Analytics to the Big Data systems many organizations are maintaining. Here we look at how Amazon and various AWS offerings are helping to do big data analysis on big data solutions. Continue Reading
-
Feature
02 Mar 2014
The three most common NoSQL mistakes you don't want to be making
More and more organizations are using NoSQL to solve various data persistence problems. But sometimes the rush to use a new technology can cause problems. Here are three common NoSQL mistakes adopters of the technology will want to avoid. Continue Reading
-
Feature
20 Jan 2014
Become a NoSQL expert: Three best books for learning polyglot persistence
The NoSQL movement has taken the industry by storm, and more and more applications are using polyglot persistence technologies. Are you up to speed on NoSQL? If not, here are three books that will make you an expert. Continue Reading
-
Tip
05 Jan 2014
With Java EE 7, your Design Patterns are dead. And your EAR is ugly too.
Adam Bien isn't without opinions when it comes to modern day enterprise programming techniques. From the use of design patterns, to the manner in which projects and modules are divided, Bien isn't without opinions when it comes to developing Java applications. Continue Reading
-
Tip
04 Oct 2013
Annotation versus XML configuration: Which JPA option to choose?
A common debate in the JPA community is whether to configure applications using an XML or annotations based approach. Here are some reasons why you might want to choose XML instead. Continue Reading
-
Tip
04 Oct 2013
Simplified ORM configuration with Spring, JPA and Hibernate path scanning
Configuring Spring, JPA, Hibernate or other ORM technologies can be a challenge. One way to simplify ORM configuration is to configure package scanning for entity classes. Continue Reading
-
Feature
03 Aug 2013
Software developers demanding resource based, RESTful APIs
Software developers are demanding APIs that are delivered in a RESTful, resource based way, and one way to do that is by building with the RESTlet framework. Continue Reading
-
Feature
01 Aug 2013
Handling the four 'V's of big data: volume, velocity, variety, and veracity
If you are about to engage in the world of big data, or are hiring a specialist to consult on your big data needs, keep in mind the four 'V's of big data: volume, velocity, variety and veracity. Continue Reading
-
Feature
14 Jul 2013
Hibernate still leads the way with search, envers and multitenancy support
A great deal of features have been added to the JPA 2.1 specification, but Hibernate still leads the way with features surrounding search, envers and multitenancy support. Continue Reading
-
Tip
30 Jun 2013
How to get the Hibernate Session from the JPA 2.0 EntityManager
This tip shows you how to get the Hibernate Session from the JPA EntityManager so you can perform functions only available from the JBoss Hibernate project. Continue Reading
-
News
24 Jun 2013
The JPA 2.0 EntityManager vs. the Hibernate Session: Which one to use?
The question for data persistence experts using JPA 2.0 is whether they should be using the EntityManager or the Hibernate Session from JBoss for ORM. Continue Reading
-
Feature
22 May 2013
Inside advice on the use of Platform as a Service in the enterprise
CloudBees founder and CEO Sacha Labourey answers tough questions and hands out practical advice about PaaS and how it works in the enterprise. Continue Reading
-
Tutorial
17 May 2013
JSR-286 development tutorial: Mastering request-response programming
This portlet programming tutorial shows how the PortletRequest and Portlet Response are used when developing JSR-286, request-response based apps. Continue Reading
-
Tutorial
16 May 2013
JSR-286 development tutorial: An introduction to portlet programming
This portlet programming tutorial is an introduction to developing JSR-286 applications that can be deployed to any standards-based portal server. Continue Reading
-
Tutorial
23 Apr 2013
How 'big data' solved the content management (CMS) problem
Content management systems that need to sift through huge amounts of data are big data problems in need of a solution. Fortunately, projects like Hadoop and MapReduce are coming to the rescue. Continue Reading
-
Feature
23 Apr 2013
Big Data Hadoop solutions with Hive, Mahout, HBase and Cassandra
As Hadoop evolves, complimentary technologies such as Hive, Mahout, HBase and Cassandra are allowing software engineers get more and more out of commodity hardware. Continue Reading
-
Feature
09 Apr 2013
Alternative JVM languages: Scala explained
Watch this video lesson to learn the benefits of exploring the JVM alternative language Scala. Continue Reading
-
Feature
08 Apr 2013
Simplified cloud-based application development with Node.js
Cloud-based application development with Node.js allows for one simple and scalable technology to be used on both the client and the server. Continue Reading
-
Tip
07 Apr 2013
BEST: Simple web service alternatives to SOAP, XML and REST
Sometimes architects over-complicate web services, but indeed, effective solutions can be created without SOA, REST and SOAP. Continue Reading
-
Tutorial
13 Mar 2013
Mobile application development tutorial
Looking for a start in developing mobile apps for existing enterprise computing systems? This mobile application development tutorial is here to help. Continue Reading
-
Tip
12 Mar 2013
Performance and troubleshooting tips for JSF 2.0 Facelet developers
JSF 2.0 has provided a variety of new configuration settings to help improve performance and aid the troubleshooting task, making the lives of software developers and quality engineers much easier. Continue Reading
-
Tip
06 Mar 2013
Effective Naming Strategies for RESTful Web Services
New descriptive languages like WADL and WSDL 2.0 are making it possible to describe the RESTful contract to client applications. However, if your RESTful web services are not named effectively, the mechanism for describing the interface may run out of steam. Continue Reading
-
Feature
21 Feb 2013
Mobile ALM guidance: Android and iOS development is not ‘business as usual’
Mobile development presents new challenges to architects and solution developers, but guidance on the topic of mobile ALM (application lifecycle management) is lacking, and the industry is looking for answers. Continue Reading
-
Feature
07 Feb 2013
Effective API development: How to create a beautiful Java API
There's an art to creating a beautiful Java API. Here we examine the art of effective API development with Layer 7's Mike Amundsen. Continue Reading
-
Feature
06 Feb 2013
How big data and distributed systems solve traditional scalability problems
The highly centralized enterprise data center is becoming a thing of the past, as organizations must embrace a more distributed model to deal with everything from content management to big data. Here we examine how technologies like Hadoop and NoSQL fit into modern distributed architectures in a way that solves scalability and performance problems. Continue Reading
-
Feature
06 Feb 2013
How to architect a modern distributed architecture
Building a distributed architecture involves many different components and many different strategies, from client server computing, to managing big data and content. Here we look at some basic strategies for tackling modern distributed architectures. Continue Reading
-
Feature
06 Feb 2013
Contrasting distributed computing with concurrent programming:
In many ways, concurrent programming and distributed programming address the same set of programming issues, but there are significant differences between the two, and architects and developers need to understand the difference. Continue Reading
-
Feature
10 Jan 2013
How NoSQL, MySQL and MongoDB worked together to solve a big-data problem
Choosing between schemaless NoSQL databases and strong-schema relational designs isn't an either-or decision, as this case study points out. When dealing with their big data problem, Craigslist decided that their MySQL servers could use a little help from MongoDB, and putting the two technologies together created a better system with greater availability, scalability and performance. Continue Reading
-
Feature
09 Jan 2013
The Craigslist Dilemma: A case study for big data and NoSQL solutions
It's hard to imagine just how many postings Craigslist has handled over the years, and if you were in charge of archiving those posts and storing them for compliance, you'd need a 'big data' solution. So how does Craigslist manage all of their data, both the incoming stuff and the stuff that needs archiving? It's a beautiful combination of MySQL, NoSQL and a little help from the people at 10Gen. Continue Reading
-
News
30 Nov 2012
The evolution of the API: A future beyond mobile and embedded systems
According to Kin Lane, APIs are moving from social media to the enterprise. Will public APIs be the key to computing in the internet of things? Continue Reading
-
Tip
16 Nov 2012
Finding the cause helps solve future application deployment issues
Application deployment issues put a black mark on successful enterprise applications. Learn to guard your applications from the most common pitfalls. Continue Reading
-
Tip
16 Nov 2012
Cloud deployment shows pros and cons for legacy applications
Legacy applications may benefit from cloud deployment, but there are a host of concerns to look at, too, when considering redeploying older applications. Continue Reading
-
Feature
18 Oct 2012
Web page performance: Removing the white flicker delay
Looking for ways to improve the performance of web page rendering and removal of the white flicker that often occurs when a web page loads? There are many tweaks and tips commonly talked about regarding web page development – from design to the final deployment of an application. However, most of the end user's time is spent on the front end, hence from the user's perspective the most promising area to look for improvement is with the web page and how speedily the web pages loads when user clicks on a link or URL. Continue Reading
-
Feature
26 Sep 2012
Modern mobile development techniques: The Y-shaped methodology
To support all of the platforms in the mobile space, Agile teams are realizing that a Y-shaped methodology is best for mobile development. Continue Reading