andykuszyk/Setting up Spark on Ubuntu in clustered environment.md

Last active December 5, 2018 19:04

Star (0) You must be signed in to star a gist
Fork (1) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/andykuszyk/11985b320f219f5f30ded08fb9d3a133.js"></script>
Save andykuszyk/11985b320f219f5f30ded08fb9d3a133 to your computer and use it in GitHub Desktop.

Download ZIP

Setting up Spark on Ubuntu in clustered environment

Raw

Setting up Spark on Ubuntu in clustered environment.md

Setting up Spark on Ubuntu in clustered environment

Getting Spark and setting up user

sudo adduser spark
su spark
cd
wget http://apache.mirror.anlx.net/spark/spark-2.2.0/spark-2.2.0-bin-hadoop2.7.tgz
tar -xvf spark~
rm *.tgz
mv spark~/ spark/

Setting up Java

sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java9-installer

Getting the master to run on startup

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment