Commits

Commits on Sep 22, 2023

feat: add download and runpod config
suhjohn
committedSep 22, 2023

Commits on Sep 21, 2023

starcoder support ppl int8kv (ModelTC#141 )

hiworldwzj
and
wangzaijun
committedSep 21, 2023

Commits on Sep 20, 2023

fix bug for qwen7b 8k length (ModelTC#140 )
hiworldwzj
committedSep 20, 2023
qwen7b to support 8k length (ModelTC#139 )

hiworldwzj
and
wangzaijun
committedSep 20, 2023

Commits on Sep 19, 2023

add stop_sequences way to stop generate tokens (ModelTC#137 )

hiworldwzj
and
wangzaijun
committedSep 19, 2023

Commits on Sep 18, 2023

add llama2_ppl model, that use ppl int8kv kernel (ModelTC#136 )
hiworldwzj
committedSep 18, 2023
Some API changes (ModelTC#125 )

yunfeng-scale
and
hiworldwzj
committedSep 18, 2023
Support Llama Multimodal (ModelTC#133 )

huochaitiantang
and
liuliang1
committedSep 18, 2023

Commits on Sep 14, 2023

add a llama_ppl model that use ppl fast decode attention kernel. (ModelTC#132 )
hiworldwzj
committedSep 14, 2023

Commits on Sep 12, 2023

[Feature] Add int8 quantize for llama. (ModelTC#112 )

Tracin
and
zhangqi3
committedSep 12, 2023
add support dynamic ntk for llama (ModelTC#127 )
hiworldwzj
committedSep 12, 2023

Commits on Sep 11, 2023

Support OpenAI-Compatible APIs (ModelTC#123 )
WANDY666
committedSep 11, 2023

Commits on Sep 8, 2023

[Support to CodeLlama] Add rope_theta to llama models (ModelTC#118 )
ChieloNewctle
committedSep 8, 2023

Commits on Sep 5, 2023

Uniform code style for utils for better readability (ModelTC#108 )
UranusSeven
committedSep 5, 2023

Commits on Aug 31, 2023

[Bug Fix] Fix bug for triton 2.1.0 llama decode kernel and add llama2 decode attention kernel. (ModelTC#113 )
hiworldwzj
committedAug 31, 2023

Commits on Aug 28, 2023

update llama attention decode kernel support for triton2.1.0, better performance (ModelTC#105 )
hiworldwzj
committedAug 28, 2023

Commits on Aug 24, 2023

fix the rotary for the chatglm2 (ModelTC#103 )
shihaobai
committedAug 24, 2023
Add id and logprob to generate_stream (ModelTC#99 )
ChieloNewctle
committedAug 24, 2023

Commits on Aug 23, 2023

Add a cn doc about how to add a new model (ModelTC#98 )
hiworldwzj
committedAug 23, 2023

Commits on Aug 22, 2023

Internlm (ModelTC#96 )

shihaobai
and
baishihao
committedAug 22, 2023
Support for NTK-aware Scaled RoPE from Environment Variables (ModelTC#93 )
singularity-s0
committedAug 22, 2023

Commits on Aug 21, 2023

Fix installer not copying all files (ModelTC#94 )
singularity-s0
committedAug 21, 2023
fix bug for aborted req (ModelTC#91 )
hiworldwzj
committedAug 21, 2023

Commits on Aug 18, 2023

Update README.md to Add support For Baichuan13B (ModelTC#87 )
hiworldwzj
committedAug 18, 2023
Refactor the code to make adding models easier. (ModelTC#86 )

committedAug 18, 2023

Commits on Aug 16, 2023

Update shield (ModelTC#77 )
llehtahw
committedAug 16, 2023
Update about discord (ModelTC#76 )
llehtahw
committedAug 16, 2023

Commits on Aug 15, 2023

fix readme.md (ModelTC#74 )
hiworldwzj
committedAug 15, 2023
Update issue templates (ModelTC#72 )
llehtahw
committedAug 15, 2023

Commits on Aug 14, 2023

fix readme (ModelTC#70 )
hiworldwzj
committedAug 14, 2023
fix readme (ModelTC#69 )
hiworldwzj
committedAug 14, 2023
Support Baichuan-7B (ModelTC#67 )
hiworldwzj
committedAug 14, 2023

Commits on Aug 12, 2023

Modify readme about container multiple GPUs usage (ModelTC#63 )
llehtahw
committedAug 12, 2023

Commits on Aug 11, 2023

fix Qwen-7b --tp 2 load weights bug (ModelTC#60 )
hiworldwzj
committedAug 11, 2023
Update dockerfile and related readme (ModelTC#59 )
llehtahw
committedAug 11, 2023