Spark - Installation

> Database > Spark > Spark - Admin

1 - About

Spark is agnostic to the underlying cluster manager.

The installation is then cluster manager dependent .

2 - Installation Type / cluster managers

Advertising

3 - Docker

4 - Configuration

4.1 - Hdfs

To enable HDFS, set HADOOP_CONF_DIR in $SPARK_HOME/conf/spark-env.sh to a location containing the configuration files.