Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬

This repository will contain all the presentations, content, hands-on notebooks for a full day Generative AI workshop on Training, Fine-tuning Large Language Models for the DataHack Summit 2024 con…

This repository will contain the presentation and python jupyter notebooks for the DataHack Summit 2024 conference talk, Improving Real-world Retrieval Augmented Generation Systems, focusing on the…

Reference implementation for DPO (Direct Preference Optimization)

Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on tasks like multi-label classification, named entity recognition,…

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with comma…

RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker

Fast lexical search library implementing BM25 in Python using Numpy and Scipy

LangServe 🦜️🏓

LLM inference in C/C++

A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal vector embeddings.

Large Language Model Text Generation Inference

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Toolkit for attaching, training, saving and loading of new heads for transformer models

A guidance language for controlling large language models.

Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Notebooks for Large Language Models (LLMs) Specialization

DSPy: The framework for programming—not prompting—foundation models

The official Python library for the Google Gemini API

SAM with text prompt