CodeInferflow is a efficient inference engine based on Inferflow for code large language models (Code LLMs). With CodeInferflow, you can locally deploy popular code LLMs and efficiently use code completion in VSCode.
-
Updated
Jun 14, 2024 - C++
CodeInferflow is a efficient inference engine based on Inferflow for code large language models (Code LLMs). With CodeInferflow, you can locally deploy popular code LLMs and efficiently use code completion in VSCode.
Add a description, image, and links to the codellms topic page so that developers can more easily learn about it.
To associate your repository with the codellms topic, visit your repo's landing page and select "manage topics."