Build for local AWS Kinesis

Terraform Module for AWS Kinesis video stream

Real-time Twitter sentiment analysis using AWS services. Captures tweets, analyzes sentiment with Comprehend, and stores results in DynamoDB for visualization and insights into trends.

An event-streaming data pipeline from app to data lake ready for modelling

Oracle audit files to Apache Kafka/Amazon MKS/Amazon Kinesis transfer

Oracle Database Automatic Diagnostic Repository messages (alert.log & listener.log) to Apache Kafka or Amazon Kinesis transfer

Amazon Kinesis Client for Go

Developed an ETL pipeline for real-time ingestion of stock market data from the stock-market-data-manage.onrender.com API. Engineered the system to store data in Parquet format for optimized query processing and incorporated data quality checks to ensure accuracy prior to visualization.

AWS Last Mile Delivery Hyperlocal

Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelligence systems using Amazon Kinesis, S3, Athena, OpenSearch Service, and QuickSight.

Utility code for AWS Services. Sample use case could be querying data from KDS. This project is open to receive contribution.

A streaming data pipeline leveraging managed services from AWS & the serverless architecture

Voice of the Customer (VoC) to enhance customer experience with serverless architecture and sentiment analysis, using Amazon Kinesis, Amazon Athena, Amazon QuickSight, Amazon Comprehend, and ChatGPT-LLMs for sentiment analysis.

Exasol Kinesis Extension for accessing Amazon Kinesis Data Streams

Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.

Pinterest data pipeline - designing an end-to-end pipeline utilising AWS cloud technologies and Databricks for analysing real-time and historical pinterest-emulated data.

Sample scripts for Twitter data processing and storage on AWS

Shipping AWS RDS logs from s3 into a kinesis stream

Bender - Serverless ETL Framework

📠🦺 CLI tool to scale up/down AWS infrastructure based on a YAML configuration file. This easy to use tool can be helpful while testing the AWS infrastructure scaling.