In this lecture, we are going run our spark application on Amazon EMR cluster. EMR stands for Elastic map reduce. Amazon EMR cluster provides a managed Hadoop framework that makes it easy, fast, and costeffective to process vast amounts of data across dynamically scalable Amazon EC2 instances.

We can also run other popular distributed frameworks such as Apache Spark and HBase in Amazon EMR, and interact with data in other AWS data stores such as Amazon S3 and Amazon DynamoDB.