Spark Architecture In this section we will try and go deep inside the design and implementation of Apache Spark. Contents Overview Logical plan of a job Physical plan of a job Shuffle Process Architecture Cache and Checkpoint Broadcast Job Scheduling Fault-tolerance