"Smart-Door-Authentication-System" is a server-less, microservice driven web-based application. It builds a distributed system that authenticates people and provides them with access to a virtual door. It is designed using multiple AWS components

Custom nifi kinesis get processor

Assets GPS Tracking Serverless Architecture based on AWS IoT infrastructure, AWS CDK and MapBox GL

Proof of concept which demonstrates posting a record to an AWS Kinesis stream.

Cloud Development Kit (AWS CDK) using TypeScript, Python and Java

Pinterest data pipeline - designing an end-to-end pipeline utilising AWS cloud technologies and Databricks for analysing real-time and historical pinterest-emulated data.

Demo of running AWS Lambda and AWS Kineses locally using Localstack

Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.

Spark Stream Consumer of AWS Kinesis Stream.

AWS framework to stream, classify, index and store data

Developed an ETL pipeline for real-time ingestion of stock market data from the stock-market-data-manage.onrender.com API. Engineered the system to store data in Parquet format for optimized query processing and incorporated data quality checks to ensure accuracy prior to visualization.

Kinesis on OpenShift with Kinesalite

Backend for Slack tribute using the Serverless Framework on AWS

Simple Consent System implementation using AWS services and Python 3.

I tried work with kinesis. There are put record and read stream process in this repository. I hope, it will be helpful.

Wrapper around AWS Kinesis Producer with retry and queue logic.

Testing AWS API Gateway -> Kinesis Stream Fanout -> Lambda Functions -> Persistence Layer

Streaming data pipeline on aws, Tech session repository for hist