Skip to content

Commit

Permalink
Bump to latest oobabooga commit and Torch 2.1.2
Browse files Browse the repository at this point in the history
  • Loading branch information
ashleykleynhans committed Dec 21, 2023
1 parent 59ab87a commit 71422e6
Show file tree
Hide file tree
Showing 3 changed files with 8 additions and 7 deletions.
5 changes: 3 additions & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
# Stage 1: Base
FROM nvidia/cuda:12.1.1-cudnn8-devel-ubuntu22.04 as base

ARG OOBABOOGA_COMMIT=7be09836fc721e6f23cf1cc27523c92185b20d8a
ARG OOBABOOGA_COMMIT=11288d11d42f0be9a9d079c03d34c573a5cc696d
ARG TORCH_VERSION=2.1.2

SHELL ["/bin/bash", "-o", "pipefail", "-c"]
ENV DEBIAN_FRONTEND=noninteractive \
Expand Down Expand Up @@ -60,7 +61,7 @@ FROM base as setup
# Install Torch
RUN python3 -m venv /venv && \
source /venv/bin/activate && \
pip3 install --no-cache-dir torch==2.1.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 && \
pip3 install --no-cache-dir torch==${TORCH_VERSION} torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 && \
pip3 install --no-cache-dir xformers && \
deactivate

Expand Down
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@
* Python 3.10.12
* [Text Generation Web UI](
https://github.com/oobabooga/text-generation-webui)
* Torch 2.1.0
* xformers 0.0.22.post7
* Torch 2.1.2
* xformers 0.0.23.post1
* [runpodctl](https://github.com/runpod/runpodctl)
* [croc](https://github.com/schollz/croc)
* [rclone](https://rclone.org/)
Expand Down
6 changes: 3 additions & 3 deletions nginx/template-readme.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
## Text Generation Web UI: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models

### Version 1.10.1
### Version 1.10.2

### Included in this Template

Expand All @@ -10,8 +10,8 @@
* [Text Generation Web UI](
https://github.com/oobabooga/text-generation-webui)
* Text Generation API
* Torch 2.1.0
* xformers 0.0.22.post7
* Torch 2.1.2
* xformers 0.0.23.post1
* [runpodctl](https://github.com/runpod/runpodctl)
* [croc](https://github.com/schollz/croc)
* [rclone](https://rclone.org/)
Expand Down

0 comments on commit 71422e6

Please sign in to comment.