Skip to content

Commit

Permalink
Bump to latest Oobabooga commit and added support for Mixtral
Browse files Browse the repository at this point in the history
  • Loading branch information
ashleykleynhans committed Dec 13, 2023
1 parent 26a58af commit 35fba09
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Stage 1: Base
FROM nvidia/cuda:12.1.1-cudnn8-devel-ubuntu22.04 as base

ARG OOBABOOGA_COMMIT=2694ef45a36b98efa1cb81ff2989c4eaf5d27c00
ARG OOBABOOGA_COMMIT=314a095c74a3fc318bb8349064e2501fc2be2296

SHELL ["/bin/bash", "-o", "pipefail", "-c"]
ENV DEBIAN_FRONTEND=noninteractive \
Expand Down
2 changes: 1 addition & 1 deletion nginx/template-readme.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
## Text Generation Web UI: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models

### Version 1.9.5
### Version 1.10.0

### Included in this Template

Expand Down
2 changes: 1 addition & 1 deletion scripts/start_textgen_server.sh
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

ARGS=("$@" --listen --api --listen-port 3001 --api-port 5001 --api-blocking-port 6050 --api-streaming-port 6055 --extensions api)
ARGS=("$@" --listen --api --listen-port 3001 --api-port 5001 --api-blocking-port 6050 --api-streaming-port 6055 --extensions api --trust-remote-code)

if [[ -f /workspace/text-gen-model ]];
then
Expand Down

0 comments on commit 35fba09

Please sign in to comment.