This project consists of three major steps:
- Download the gdelt csv files to AWS S3 bucket.
- Transfer the data from S3 to a MongoDB replica set with preprocessing by Spark scala.
- Explore data stored in MongoDB on AWS with four predefined queries.
The achitechture can be illustrated as :
