Skip to content

xbotter/semantic-kernel-LLamaSharp

Repository files navigation

⚠️The implementation of this project has been migrated to the LlamaSharp repository, and maintenance will be continued there in the future.


semantic-kernel-LLamaSharp

Using LLamaSharp to implement custom TextCompletion and EmbeddingGeneration of Semantic Kernel

Basic Usage

  1. Clone this repository.
  2. Download a llama model. If you don't know which model is available, please refer to LLamaSharp Verified Models.
  3. Modify the path of model and prompt file in samples/SK_LLamaSharpWebApi/appsettings.json.
  4. Change the backend type if you want to, by modifying SK_LLamaSharpWebApi.csproj and Directory.Packages.props.
  5. Run the sample. It's recommended to run with release mode or x64 configuration.
  6. Send the request to the web api to test.

About

Custom TextCompletion using LLamaSharp

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages