Skip to content

jochemstoel/llama2

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Potassium Llama V2 7B chat

This is a Potassium HTTP server, created with banana init CLI. Based on the model: meta-llama/Llama-2-7b-chat-hf.

Testing

Start a local dev server with banana dev

Run test script python test.py

Deployment

  1. Create empty repo on Github
  2. Push this repo to github
git remote add origin https://github.com/{username}/{repo-name}.git
  1. Log into Banana
  2. Select this repo to build and deploy!

About

Attempt at running llama v2 7B chat

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 81.8%
  • Dockerfile 18.2%