Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
CoderLSF committed Nov 20, 2023
1 parent e99fdfc commit 6903771
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ fast-llama is a super `HIGH`-performance inference engine for LLMs like LLaMA (*

| Feature Name | Current Support | Future Suport |
| --- | --- | --- |
| **Model Types** |LLaMA | Others LLMs like Baichuan, StableDiffusion |
| **Model Types** |LLaMA2 | Others LLMs like Baichuan, StableDiffusion |
| **Quantization** | ✅INT16, ✅INT8 | INT4 |
| **Model Formats** | ✅HuggingFace, ✅gguf(by llama.cpp), ✅flm | |
| **Systems** | ✅Linux, ✅Windows | Macbook, Android, iOS |
Expand Down

0 comments on commit 6903771

Please sign in to comment.