A project which reimplementation llama.cpp in rustformers/llm style.
Performance issue: current version only has about 30% performance of rwkv.cpp
This library was published under MIT/Apache-2.0 license. However, we strongly recommend you to cite our work/our dependencies work if you wish to reuse the code from this library.
- RWKV models: BlinkDL/RWKV-LM
- llm: rustformers/llm
- rwkv.cpp: saharNooby/rwkv.cpp
- interface design: rustformers/llm