Commits

History for

Commits on Feb 2, 2024

[doc] update inference related docs from mp_size to tensor_parallel for TP (#5048 )

yundai424
and
mrwyattii
committedFeb 2, 2024

Commits on Jan 31, 2024

update inference pages to point to FastGen (#5029 )
mrwyattii
committedJan 31, 2024

Commits on Jul 13, 2023

Fix docs for checkpoints (#3955 )
loadams
committedJul 13, 2023

Commits on May 12, 2023

fix typo with docs/ (#3523 )

digger-yu
and
loadams
committedMay 12, 2023

Commits on Mar 17, 2023

Fix Broken Links (#3048 )
satpalsr
committedMar 17, 2023

Commits on Feb 15, 2023

Refactor DS inference API. No longer need replace_method. (#2831 )

awan-10
and
mrwyattii
committedFeb 15, 2023

Commits on Mar 11, 2022

Website posts and tutorial improvements (#1799 )

cli99
and
jeffra
committedMar 11, 2022

Commits on Feb 3, 2022

Fix the tensor-slicing with multi-GPU inference and kernel-injection (#1724 )
RezaYazdaniAminabadi
committedFeb 3, 2022

Commits on Jan 19, 2022

Fix inference api & add more description on inference engine tutorial (#1711 )
RezaYazdaniAminabadi
committedJan 19, 2022

Commits on Jan 3, 2022

Various small documentation text improvements (#1665 )

manuelciosici
and
jeffra
committedJan 3, 2022

Commits on Oct 1, 2021

Improve inference documentation (#1421 )
aphedges
committedOct 1, 2021

Commits on Jun 15, 2021

Fix bugs in the tutorial documentation (#1157 )
hyunwoongko
committedJun 15, 2021

Commits on May 27, 2021

fix links for inference tutorial (#1113 )
RezaYazdaniAminabadi
committedMay 27, 2021

Commits on May 24, 2021

fix inference titles and add MoQ pictures (#1092 )
RezaYazdaniAminabadi
committedMay 24, 2021
Quantization + inference release (#1091 )

committedMay 24, 2021

Loading