#

data-streaming

Here are 48 public repositories matching this topic...

DagsHub / client

DagsHub client libraries

python data-science data machine-learning ai tensorflow keras pytorch machinelearning hacktoberfest data-streaming dvc mlops hacktoberfest2023

Updated Jul 23, 2024
Python

getindata / dbt-flink-adapter

Adapter for dbt that executes dbt pipelines on Apache Flink

apache-flink dbt data-streaming streaming-analytics

Updated Mar 19, 2024
Python

eserie / wax-ml

A Python library for machine-learning and feedback loops on streaming data

python machine-learning reinforcement-learning time-series pandas xarray data-streaming jax

Updated Apr 21, 2023
Python

KentHsu / Udacity-Data-Streaming-Nanodegree

Udacity Data Streaming Nanodegree Program

spark-streaming kafka-connect apache-kafka kafka-rest-proxy data-streaming ksql faust-application

Updated Feb 20, 2021
Python

marian-nmt / sotastream

A library for data streaming and augmentation

machine-learning data-augmentation data-streaming pretraining

Updated Mar 18, 2024
Python

jaehyeon-kim / flink-demos

Apache Flink (Pyflink) and Related Projects

python docker aws kafka docker-compose flink real-time-analytics data-streaming kinesis-data-analytics pyflink

Updated Jun 10, 2024
Python

officialarijit / Fed-ReMECS-mqtt

A Federated Learning Method for Real-time Emotion State Classification from Multi-modal Streaming

realtime-framework emotion-recognition data-streaming federated-learning data-stream-classification federated-learning-algorithm federated-learning-application realtime-emotion-recognition

Updated Sep 15, 2022
Python

jlumbroso / python-random-hash

A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister. 🎲

python hash-functions hyperloglog streaming-algorithms data-streaming flajolet randomized-algorithm analytic-combinatorics analysis-of-algorithms flajolet-martin

Updated Jun 6, 2022
Python

blitzkz23 / final-project-end-to-end-banking-campaign-pipeline

Final Project for IYKRA Data Fellowship 8 Program, creating an end-to-end banking campaign pipeline using lambda architecture (providing acess to batch and stream processing)

data-engineering batch-processing data-pipeline data-streaming

Updated Mar 9, 2023
Python

zabir-nabil / picast

A lightweight fast data streaming library for raspberry pi in python.

raspberry-pi video-streaming server-client-communication data-streaming sensors-data-collection

Updated Aug 27, 2019
Python

sorieux / trino-kafka-demo

Hands-on demo for querying Kafka streams using SQL with Trino and data integration with PostgreSQL.

sql kafka postgresql sql-query data-engineering real-time-data data-streaming trino data-querying

Updated Dec 3, 2023
Python

mobility-ai

kanenorman / mobility-ai

Full Stack Machine Learning Engineer Project - Real Time Data Streaming and Predictions

python docker flask data-science machine-learning kafka postgresql data-streaming

Updated Jun 17, 2024
Python

AbdullahMu / Data-Streaming-Nanodegree-Project_02-Evaluate-Human-Balance-with-Spark-Streaming

Design data streaming architecture and API for a real-life application called the Step Trending Electronic Data Interface (STEDI). It is a working application used to assess fall risk for seniors. When a senior takes a test, they are scored using an index which reflects the likelihood of falling, and potentially sustaining an injury in the cours…

api redis base64 kafka apache-spark spark-streaming apache-kafka data-streaming spark-streaming-kafka

Updated Jun 3, 2021
Python

aymane-maghouti / Real-Time-Data-Pipeline-Using-Kafka

This project implements a real-time data pipeline using Apache Kafka, Python's psutil library for metric collection, and SQL Server for data storage. The pipeline collects metrics data from the local computer, processes it through Kafka brokers, and loads it into a SQL Server database. Additionally, a real-time dashboard is created using Power BI.

python real-time data-visualization data-collection apache-kafka powerbi data-streaming real-time-data-pipeline

Updated Oct 31, 2023
Python

jlumbroso / affirmative-sampling

Reference implementation of the Affirmative Sampling algorithm by Jérémie Lumbroso and Conrado Martínez (2022). 🍀

cardinality-estimation data-streaming random-sampling affirmative-sampling probabilistic-algorithm

Updated Jun 2, 2022
Python

the-timoye / songstreams

Streams simulated events using Kafka & Spark, from a music application to a data lake (AWS S3), and then a warehouse (AWS Redshift)

aws terraform python3 data-engineering spark-streaming dbt kafka-streams data-streaming

Updated Jul 24, 2022
Python

youheekil / Twitter-Streaming-with-Apache-Kafka-Docker-and-Python

Getting real-time twitter data with Kafka, Docker and python

python docker real-time kafka data-streaming

Updated Jun 7, 2022
Python

vhtnguyen / Kafka_Youtube-watcher

An app to keep track of Youtube videos and sends the notification to a Telegram bot to inform you if anyone comments on those

telegram-bot apache-kafka youtube-api-v3 data-streaming ksqldb

Updated Jul 23, 2023
Python

nyoungstudios / multiflow

A Python multithreading library for data processing pipelines, data streaming, etc.

python concurrency multithreading thread-pool data-streaming

Updated Dec 1, 2021
Python

darkfennertrader / Optimizing-Public-Trasportation

Udacity Data Streaming project based on Apache Kafka

postgres kafka-connect faust apache-kafka kafka-rest-proxy data-streaming data-stream-processing ksql producer-consumer-problem

Updated Mar 14, 2021
Python

Improve this page

Add a description, image, and links to the data-streaming topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-streaming topic, visit your repo's landing page and select "manage topics."