Spark - Basics
Spark Context vs Spark Session
| Spark Context | Spark Session |
|---|---|
| Represents the connection to a Spark cluster | Introduced in Spark 2.0 |
| Coordinates task execution across the cluster | Unified entry point for interacting with Spark |
| Entry point in earlier versions of Spark (1.x) | Combines functionalities of SparkContext, SQLContext HiveContext, and StreamingContext |
| Support multiple languages (Scala, Java, Python, R) |