Commits

History for

Commits on Aug 9, 2023

Fix the encoding problem of Chinese
baishihao
committedAug 9, 2023

Commits on Aug 8, 2023

support int8kv cache in llama model
wangzaijun
committedAug 8, 2023
Refactoring code for readability
wangzaijun
committedAug 8, 2023
Add error reports from sub process
llehtahw
committedAug 8, 2023
add nccl_port to startup args
wangzaijun
committedAug 8, 2023

Commits on Aug 7, 2023

fix bug: api server args batch_max_tokens auto set value, To avoid the problem of a program getting stuck
wangzaijun
committedAug 7, 2023

Commits on Jul 22, 2023

init lightllm repo
XHPlus
committedJul 22, 2023

Loading