Changes

• frontend: update manifest (a lot of new models)
• frontend: correct Preset UI description
• frontend: add HardwareMonitor (Windows Only)
• lora finetune: fix max_epochs (#170)
• python-backend: allow message content to be empty
• python-backend: extra ChatCompletionBody params (raw, presystem)
• python-backend: add default_stop when stop is null
• webgpu: fix webgpu_server file permissions of linux and macos
• chore

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Changes

• webgpu support (AMD, Intel, Nvidia, Apple) (https://github.com/cgisky1980/ai00_rwkv_server)
• add rwkv-cuda-beta support (faster)
• add misc API (/models and /dashboard/billing/credit_grants)
• allow multiple systems
• allow completions input to be null

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

WebGPU Mode

Changes

• japanese UI
• global penalty
• allow custom user_name and assistant_name (/chat/completions API)
• update defaultConfigs

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Breaking Changes

Due to performance and bandwidth considerations, the /chat/completions and /completions API no longer return the response field. If necessary, you can still uncomment it yourself.
Please note that this is never part of the OpenAI API, it existed previously only for API development convenience. If you follow the OpenAI API specification, you will not be affected in any way.

Changes

• improve /chat/completions and /completions API performance (remove response field)
• improve default ChatCompletion stop
• improve python backend startup speed
• update defaultConfigs

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Changes

• add Composition Page (RWKV-Music)
• improve RunButton prompt
• support for stop array api params
• improve embeddings API results
• improve python backend startup speed
• add support for MIDI RWKV
• add midi api
• add CPU-120M-Music config
• improve sse fetch
• update manifest (a lot of new models)
• update presets
• remove LoraFinetunePrecision fp32
• chore

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Changes

• add Composition Page (RWKV-Music)
• improve RunButton prompt
• support for stop array api params
• improve embeddings API results
• improve python backend startup speed
• add support for MIDI RWKV
• add midi api
• add CPU-120M-Music config
• improve sse fetch
• update manifest (a lot of new models)
• update presets
• remove LoraFinetunePrecision fp32

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Changes

• fix always show Convert Failed when converting model
• fix input with array type (#96, #107)
• change chinese translation of completion

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Changes

• fix cross-device state cache exception
• training: fix data EOL format
• save conversation as txt (originally in md)

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Changes

• improve /completions api compatibility
• improve training data path compatibility
• update manifest
• update presets
• chore

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Changes

• fix jsonl data when using directory as training data
• fix loss parser
• improve error messages for training
• update logo
• extra vc check
• fix load_state_dict crash

Install

• Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
• MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
• Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
• Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples