Stars
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
mllm-npu: training multimodal large language models on Ascend NPUs
Curated collection of papers in machine learning systems
🔥Highlighting the top ML papers every week.
FastFlow is a system that automatically detects CPU bottlenecks in deep learning training pipelines and resolves the bottlenecks with data pipeline offloading to remote resources .
🦜🔗 Build context-aware reasoning applications
DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphic…
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba
Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
Cross-platform, customizable ML solutions for live and streaming media.
A customized Tensorflow with partial offloading and profiling features for FastFlow project.
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch…
🚀 Build and manage real-life ML, AI, and data science projects with ease!
A complete computer science study plan to become a software engineer.
Apache OpenWhisk is an open source serverless cloud platform
Apache Nemo (Incubating) - Data Processing System for Flexible Employment With Different Deployment Characteristics
a curated list of awesome streaming frameworks, applications, etc
Cruise: A Distributed Machine Learning Framework with Automatic System Configuration
😎 Awesome lists about all kinds of interesting topics
Browsix is a Unix-like operating system for the browser.
Lightweight real-time big data streaming engine over Akka
Build highly concurrent, distributed, and resilient message-driven applications on the JVM
Platform for Internet of Things with JavaScript https://www.iotjs.net
Ultra-lightweight JavaScript engine for the Internet of Things.