Instruct-tune LLaMA on consumer hardware

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

骆驼(Luotuo): Open Sourced Chinese Language Models. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Material for cuda-mode lectures

A generative agent implementation for LLaMA based models, derived from langchain's implementation.

Instruct-tune LLaMA on consumer hardware

Xorbits Example Notebooks