Stars
Meta-Llama 🦙
6 repositories
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…
Distribute and run LLMs with a single file.
llama3 implementation one matrix multiplication at a time