Commits

Commits on Jun 28, 2023

feat(router): add header option to disable buffering for the generate_stream response (huggingface#498 )
rkimball
committedJun 28, 2023

Commits on Jun 26, 2023

fix(server): Do not init process group if already initialized (huggingface#388 )
Yard1
committedJun 26, 2023
feat(server): Add inference support for GPTQ (llama + falcon tested) + Quantization script (huggingface#438 )

committedJun 26, 2023

Commits on Jun 23, 2023

fix(router): add timeout on flume sends (huggingface#488 )
OlivierDehaene
committedJun 23, 2023
feat(server): Adding new ignore_rule for conversion. (huggingface#485 )
Narsil
committedJun 23, 2023
feat(server): Update convert logic. (huggingface#483 )

Narsil
and
Ubuntu
committedJun 23, 2023

Commits on Jun 20, 2023

fix(server): Fixing T5 in case the names are mixed up. (huggingface#475 )
Narsil
committedJun 20, 2023
fix(server): fix warpers on CPU (huggingface#472 )
OlivierDehaene
committedJun 20, 2023

Commits on Jun 19, 2023

feat(server): improve flash attention import errors (huggingface#465 )
OlivierDehaene
committedJun 19, 2023

Commits on Jun 16, 2023

feat(router): add ngrok integration (huggingface#453 )
OlivierDehaene
committedJun 16, 2023

Commits on Jun 12, 2023

Commits on Jun 9, 2023

feat(server): optimize dist ops (huggingface#434 )
OlivierDehaene
committedJun 9, 2023

Commits on Jun 8, 2023

feat(server): Rework model loading (huggingface#344 )

committedJun 8, 2023

Commits on Jun 5, 2023

chore: update openapi schema
OlivierDehaene
committedJun 5, 2023
feat(server): batch tokenization for flash causal lm (huggingface#411 )
OlivierDehaene
committedJun 5, 2023

Commits on Jun 2, 2023

Commits on Jun 1, 2023

Commits on May 31, 2023

v0.8.1
OlivierDehaene
committedMay 31, 2023
fix(server): fix bnb quantization for CausalLM models (huggingface#385 )
OlivierDehaene
committedMay 31, 2023
feat(server): add retry on download (huggingface#384 )
OlivierDehaene
committedMay 31, 2023
increase health checks
OlivierDehaene
committedMay 31, 2023

Commits on May 30, 2023

Commits on May 26, 2023

Fix issue when load AutoModelForSeq2SeqLM model (huggingface#370 )
CL-Shang
committedMay 26, 2023
feat(server): support vectorized warpers in flash causal lm (huggingface#317 )

OlivierDehaene
and
jlamypoirier
committedMay 26, 2023