Lazy Evaluation in Apache Spark

Breadcrumb Abstract Shape
Breadcrumb Abstract Shape
Breadcrumb Abstract Shape
Breadcrumb Abstract Shape
Breadcrumb Abstract Shape
Breadcrumb Abstract Shape
  • User AvatarKiran Dalvi
  • 11 Jun, 2019
  • 0 Comments
  • 27 Secs Read

Lazy Evaluation in Apache Spark

Lazy evaluation in Spark means that the execution will not start until an action is triggered.

The Spark Lazy evaluation, users can divide into smaller operations. It reduces the number of passes on data by transformation grouping operation.

By lazy evaluation in Spark to saves the trip between driver and cluster, speed up the process.

There are two types of complexities of any operations are Time and Space complexity using Spark lazy evaluation we can overcome both complexities. The action is triggered only when the data is required.