Install Spark Cluster with shell script

Spark install script for debian and Ubuntu. but only tested in Ubuntu Server 16.04.

The script will let you setup a 3 node Spark cluster in no more than 10 minutes.

Installation in a node

sudo -s

su -

git clone https://github.com/chih7/spark-install.git

cd ./spark_install

./install-spark.sh

reboot

Done

Run as a cluster

clone the machine or install spark in other machine with the script.

note the ip address must same with the script.

in spark master machine

sudo -s

su -

vim  /usr/local/spark/conf/spark-env.sh # change  SPARK_LOCAL_IP=spark-xxxx

/usr/local/spark/sbin/start-all.sh

Done