llama2 in Julia

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

Julia package for inference and training of Llama-style language models

Comprehensive guide to generative AI projects and resources in Julia.

AIOS: LLM Agent Operating System

the AI-native open-source embedding database

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

Blazingly fast LLM inference.

A complement to pgvector for high performance, cost efficient vector search on large workloads.

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…