Starred repositories
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
anthonix / llm.c
Forked from karpathy/llm.cLLM training in simple, raw C/HIP for AMD GPUs
ROC profiler library. Profiling with perf-counters and derived metrics.
Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
LLM Finetuning with peft
A curated list of engineering blogs
中文的C++ Template的教学指南。与知名书籍C++ Templates不同，该系列教程将C++ Templates作为一门图灵完备的语言来讲授，以求帮助读者对Meta-Programming融会贯通。(正在施工中)
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
Tiny, fast, non-dependent and fully loaded printf implementation for embedded systems. Extensive test suite passing.
A simple and easy-to-use immediate-mode gui library
Machine Learning and Computer Vision Engineer - Technical Interview Questions
A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems"
Machine Learning Interviews from FAANG, Snapchat, LinkedIn. I have offers from Snapchat, Coupang, Stitchfix etc. Blog: mlengineer.io.
Classical equations and diagrams in machine learning
Fast ML inference & training for Rust with ONNX Runtime
Faster and more precisely than Grad-CAM
A bounded multi-producer multi-consumer concurrent queue written in C++11
🚀 Build and manage real-life ML, AI, and data science projects with ease!
A JAX research toolkit for building, editing, and visualizing neural networks.
AddressSanitizer, ThreadSanitizer, MemorySanitizer
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
A Jupyter widget for annotating images with bounding boxes
♾ Infisical is the open-source secret management platform: Sync secrets across your team/infrastructure, prevent secret leaks, and manage internal PKI