Commits

History for

Commits on Aug 26, 2023

server : add /detokenize endpoint (ggerganov#2802 )
BruceMacD
committedAug 26, 2023
examples : skip unnecessary external lib in server README.md how-to (ggerganov#2804 )
longregen
committedAug 26, 2023

Commits on Aug 23, 2023

server : allow json array in prompt or content for direct token input (ggerganov#2306 )
jxy
committedAug 23, 2023

Commits on Aug 21, 2023

gguf : new file format with flexible meta data (beta) (ggerganov#2398 )

committedAug 21, 2023

Commits on Aug 14, 2023

server : add --numa support (ggerganov#2524 )
TerrorJack
committedAug 14, 2023

Commits on Aug 8, 2023

Allow passing grammar to completion endpoint (ggerganov#2532 )
krasserm
committedAug 8, 2023

Commits on Aug 1, 2023

fix a typo in examples/server/README.md (ggerganov#2478 )
lvscar
committedAug 1, 2023

Commits on Jul 15, 2023

llama : add custom RoPE (ggerganov#2054 )

jxy
and
ggerganov
committedJul 15, 2023

Commits on Jul 13, 2023

Revert "Support using mmap when applying LoRA (ggerganov#2095 )" (ggerganov#2206 )
howard0su
committedJul 13, 2023

Commits on Jul 11, 2023

Support using mmap when applying LoRA (ggerganov#2095 )
howard0su
committedJul 11, 2023

Commits on Jul 6, 2023

convert : update for baichuan (ggerganov#2081 )

foldl
and
Judd
committedJul 6, 2023

Commits on Jul 5, 2023

Expose generation timings from server & update completions.js (ggerganov#2116 )

tobi
and
ggerganov
committedJul 5, 2023
Update Server Instructions (ggerganov#2113 )

jessejohnson
and
Jesse Johnson
committedJul 5, 2023
Update server instructions for web front end (ggerganov#2103 )

jessejohnson
and
Jesse Johnson
committedJul 5, 2023

Commits on Jul 4, 2023

Add an API example using server.cpp similar to OAI. (ggerganov#2009 )
jwj7140
committedJul 4, 2023

Commits on Jun 29, 2023

Use unsigned for random seed (ggerganov#2006 )

howard0su
and
ggerganov
committedJun 29, 2023

Commits on Jun 19, 2023

[Fix] Reenable server embedding endpoint (ggerganov#1937 )
SlyEcho
committedJun 19, 2023

Commits on Jun 17, 2023

Server Example Refactor and Improvements (ggerganov#1570 )

committedJun 17, 2023

Commits on Jun 15, 2023

readme : server compile flag (ggerganov#1874 )
nivibilla
committedJun 15, 2023

Commits on Jun 14, 2023

CUDA full GPU acceleration, KV cache in VRAM (ggerganov#1827 )
JohannesGaessler
committedJun 14, 2023

Commits on Jun 6, 2023

Multi GPU support, CUDA refactor, CUDA scratch buffer (ggerganov#1703 )
JohannesGaessler
committedJun 6, 2023

Commits on May 28, 2023

Only show -ngl option when relevant + other doc/arg handling updates (ggerganov#1625 )
KerfuffleV2
committedMay 28, 2023

Commits on May 21, 2023

examples : add server example with REST API (ggerganov#1443 )
FSSRepo
committedMay 21, 2023

Loading