LLM inference in C/C++

Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.

Langflow is a low-code app builder for RAG and multi-agent AI applications. It’s Python-based and agnostic to any model, API, or database.

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

RAGChecker: A Fine-grained Framework For Diagnosing RAG

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

LlamaIndex is a data framework for your LLM applications

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

An open source implementation of CLIP.

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone

Evaluation and Tracking for LLM Experiments

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.