Skip to content

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!!

License

Notifications You must be signed in to change notification settings

cmars/axum_mistral_candle

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Axum Mistral Candle

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!

Makefile

If you are using Debian/Ubuntu you should be able to get up and running with a single make init.

View make help to see all commands.

Running Server

Axum

Websocket is on localhost:3000

Leptos

Frontend is on localhost:8080

About

Chat Bot implemented in pure Rust using Mistral-7B with HuggingFace/Candle over Axum Websockets and a Leptos (Wasm) frontend!!

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Rust 93.0%
  • Makefile 5.0%
  • CSS 1.5%
  • HTML 0.5%