News Stay informed about the latest enterprise technology news and product updates.

Install and Run Apache Spark 2.x

1.Objective:

This guide contains step by step documentation of installation and setup procedure of Spark 2.x installation / configuration in standalone mode on Ubuntu OS. Standalone mode in a Spark is setting the system without any existing cluster management software (like Yarn Resource Manager / Mesos).   We have spark master and spark worker who allocate driver and executors for Spark application in Standalone mode. Once the installation is done you can process the data via creating RDD (Resilient Distributed Dataset) and running transformation and action operations.

 
2. Platform
2.1. Platform Requirements
Operating system: Ubuntu 14.04 or later, we can also use other Linux flavors like: CentOS, Redhat, etc.

Start the conversation

Send me notifications when other members comment.

Please create a username to comment.

-ADS BY GOOGLE

SearchCloudApplications

SearchSoftwareQuality

SearchHRSoftware

SearchSAP

SearchERP

Close