A code-based tutorial on setting up production grade data streams with PySpark, Optimus, Confluent Kafka, & Drill using Docker, with Cassandra (NoSQL) as storage.
(See code and README.md's in nested folders)
-
Notifications
You must be signed in to change notification settings - Fork 11
A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill using Docker and Cassandra (NoSQL DB) for storage; This allows for for fast feature engineering and data cleaning.
daddydrac/PySpark-Confluent-Kafka-Apache-Drill-
About
A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill using Docker and Cassandra (NoSQL DB) for storage; This allows for for fast feature engineering and data cleaning.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published