Commits

Commits on Aug 16, 2023

Update shield (ModelTC#77 )
llehtahw
committedAug 16, 2023
Update about discord (ModelTC#76 )
llehtahw
committedAug 16, 2023

Commits on Aug 15, 2023

fix readme.md (ModelTC#74 )
hiworldwzj
committedAug 15, 2023
Update issue templates (ModelTC#72 )
llehtahw
committedAug 15, 2023

Commits on Aug 14, 2023

fix readme (ModelTC#70 )
hiworldwzj
committedAug 14, 2023
fix readme (ModelTC#69 )
hiworldwzj
committedAug 14, 2023
Support Baichuan-7B (ModelTC#67 )
hiworldwzj
committedAug 14, 2023

Commits on Aug 12, 2023

Modify readme about container multiple GPUs usage (ModelTC#63 )
llehtahw
committedAug 12, 2023

Commits on Aug 11, 2023

fix Qwen-7b --tp 2 load weights bug (ModelTC#60 )
hiworldwzj
committedAug 11, 2023
Update dockerfile and related readme (ModelTC#59 )
llehtahw
committedAug 11, 2023
Refactoring the implementation of throughput analysis logs (ModelTC#58 )
hiworldwzj
committedAug 11, 2023
Add docker build action (ModelTC#51 )
llehtahw
committedAug 11, 2023
fix Qwen-7b start error (ModelTC#55 )

hiworldwzj
and
wangzaijun
committedAug 11, 2023
Add log to print average tokens throughput. (ModelTC#38 )

shanshanpt
and
llehtahw
committedAug 11, 2023
Update README.md
shihaobai
committedAug 11, 2023
update context_flashattention triton kernel to support V100 (ModelTC#53 )
hiworldwzj
committedAug 11, 2023
fix bug for start up llama2 (ModelTC#50 )
hiworldwzj
committedAug 11, 2023
Report traceback from router init process (ModelTC#49 )
llehtahw
committedAug 11, 2023

Commits on Aug 10, 2023

add support for chatglm and trust_remote_code (ModelTC#47 )

shihaobai
and
baishihao
committedAug 10, 2023
Support Qwen-7b (ModelTC#46 )

hiworldwzj
and
wangzaijun
committedAug 10, 2023
Update manager.py (ModelTC#42 )
llehtahw
committedAug 10, 2023

Commits on Aug 9, 2023

Merge pull request ModelTC#36 from shihaobai/starcoder
shihaobai
committedAug 9, 2023
Fix the encoding problem of Chinese
baishihao
committedAug 9, 2023

Commits on Aug 8, 2023

Merge pull request ModelTC#33 from shihaobai/starcoder
shihaobai
committedAug 8, 2023
add support for starcoder
baishihao
committedAug 8, 2023
Merge pull request ModelTC#32 from hiworldwzj/main
hiworldwzj
committedAug 8, 2023
support int8kv cache in llama model
wangzaijun
committedAug 8, 2023
Merge pull request ModelTC#30 from hiworldwzj/main
hiworldwzj
committedAug 8, 2023
Refactoring code for readability
wangzaijun
committedAug 8, 2023
Merge pull request ModelTC#29 from llehtahw/report-err-from-subproc
hiworldwzj
committedAug 8, 2023
Add error reports from sub process
llehtahw
committedAug 8, 2023
Merge pull request ModelTC#27 from hiworldwzj/main
hiworldwzj
committedAug 8, 2023
add nccl_port to startup args
wangzaijun
committedAug 8, 2023
Merge pull request ModelTC#24 from andy-yang-1/rope-scaling
hiworldwzj
committedAug 8, 2023
add max_sequence_length
andy-yang-1
committedAug 8, 2023