Spark

1 - About

Map reduce and streaming framework in memory.

RDDs and dataframe are the key concept to write spark script (driver).

See Spark - (Application|Program).

The library entry point of Spark is called a context.

2 - Spark essentials

3 - Framework

The Spark Framework consists of :

  • the core Apache Spark component
  • Spark Streaming,
  • the ML machine learning library,
  • the GraphX graphical computing library.

4 - Language

  • Scala
  • Java
  • R
  • Python

5 - Documentation / Reference

db/spark/spark.txt ยท Last modified: 2017/09/13 20:06 by gerardnico