A high-throughput and memory-efficient inference and serving engine for LLMs

Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models".

Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

Awesome LLM compression research papers and tools.

💯 Curated coding interview preparation materials for busy software engineers

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Acceptance rates for the major AI conferences

The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.

Refine high-quality datasets and visual AI models

Transformer related optimization, including BERT, GPT

A Gradio web UI for Large Language Models.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Source code for Twitter's Recommendation Algorithm

📚 신입 개발자로서 성장을 위한 전공 지식을 정리합니다 😊

코딩 테스트 관련 기출문항을 풀어보고 소스코드 및 설명을 업로드합니다.

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

My continuously updated Machine Learning, Probabilistic Models and Deep Learning notes and demos (2000+ slides) 我不间断更新的机器学习，概率模型和深度学习的讲义(2000+页)和视频链接

Awesome Knowledge Distillation

Fast and accurate object detection with end-to-end GPU optimization

Color palettes which are also distinguishable when printed in grayscale

<머신러닝 교과서 with 파이썬, 사이킷런, 텐서플로>의 코드 저장소

딥러닝에 목마른 사람들을 위한 PyTorch

Collection of recent methods on (deep) neural network compression and acceleration.

Pipeline FFT Implementation in Verilog HDL

C++ based maze solver, accelerated with Nvidia CUDA

Command-line program to download videos from YouTube.com and other video sites