Skip to content

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

License

Notifications You must be signed in to change notification settings

josStorer/RWKV-Runner

Repository files navigation

RWKV Runner

This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means that every ChatGPT client is an RWKV client.

license release

English | 简体中文

Preview | Download

Features

  • RWKV model management and one-click startup
  • Fully compatible with the OpenAI API, making every ChatGPT client an RWKV client. After starting the model, open https://127.0.0.1:8000/docs to view more details.
  • Automatic dependency installation, requiring only a lightweight executable program
  • User-friendly chat interaction interface included
  • Easy-to-understand and operate parameter configuration
  • Built-in model conversion tool
  • Built-in download management and remote model inspection
  • Multilingual localization
  • Theme switching
  • Automatic updates

Todo

  • Model training functionality
  • CUDA operator int8 acceleration
  • macOS support
  • Linux support

Related Repositories:

Preview

Homepage

image

Chat

image

Configuration

image

Model Management

image

Download Management

image

Settings

image

About

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published