About
How to a jar file when executing a PySpark script.
Articles Related
Possibilities
Installation directory
When starting pyspark, it had this directory in the classpath. Add your Jar there.
- site-packages\pyspark\jars\*
pyspark
With the pyspark client and the –jars option
pyspark --jars file1.jar,file2.jar
configuration
spark.jars
conf = SparkConf().set("spark.jars", "/path/to.jar")
sc = SparkContext( conf=conf)