Lazy Evaluation in Apache Spark
- June 11, 2019
- Posted by: Ankush Thavali
- Category: Hadoop
Lazy evaluation in Spark means that the execution will not start until an action is triggered.
The Spark Lazy evaluation, users can divide into smaller operations. It reduces the number of passes on data by transformation grouping operation.
By lazy evaluation in Spark to saves the trip between driver and cluster, speed up the process.
There are two types of complexities of any operations are Time and Space complexity using Spark lazy evaluation we can overcome both complexities. The action is triggered only when the data is required.