Lists (1)
Stars
A game theoretic approach to explain the output of any machine learning model.
Developer APIs to Accelerate LLM Projects
BullMQ - Message Queue and Batch processing for NodeJS and Python based on Redis
A library for efficient similarity search and clustering of dense vectors.
⚡ Design like a pro and ship like a madman with Once UI
Run serverless workloads with fast cold starts on bare-metal servers, anywhere in the world
🏅 Collection of Kaggle Solutions and Ideas 🏅
This is the code repository and issue tracker for Tabular Editor 2.X (free, open-source version). This repository is being maintained by Daniel Otykier.
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
The goal of this project is to enable users to create cool web demos using the newly released OpenAI GPT-3 API with just a few lines of Python.
📋 A list of open LLMs available for commercial use.
Machine Learning Engineering Open Book
Making large AI models cheaper, faster and more accessible
Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
Running large language models on a single GPU for throughput-oriented scenarios.
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
A CLI that writes your git commit messages for you with AI
Turn expensive prompts into cheap fine-tuned models
[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
DSPy: The framework for programming—not prompting—foundation models
OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image genera…
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.