Skip to content

erinloy/semantic-kernel-LLamaSharp

 
 

Repository files navigation

semantic-kernel-LLamaSharp

Using LLamaSharp to implement custom TextCompletion and EmbeddingGeneration of Semantic Kernel

Basic Usage

  1. Clone this repository.
  2. Download a llama model. If you don't know which model is available, please refer to LLamaSharp Verified Models.
  3. Modify the path of model and prompt file in samples/SK_LLamaSharpWebApi/appsettings.json.
  4. Change the backend type if you want to, by modifying SK_LLamaSharpWebApi.csproj and Directory.Packages.props.
  5. Run the sample. It's recommended to run with release mode or x64 configuration.
  6. Send the request to the web api to test.

About

Custom TextCompletion using LLamaSharp

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C# 100.0%