Skip to content

Commit

Permalink
Bump to latest oobabooga, bump torch to 2.2.0, bump xformers to 0.0.2…
Browse files Browse the repository at this point in the history
…4, and bump runpodctl to version 1.14.2
  • Loading branch information
ashleykleynhans committed Mar 9, 2024
1 parent fa80091 commit fd169d6
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 10 deletions.
12 changes: 6 additions & 6 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
# Stage 1: Base
FROM nvidia/cuda:12.1.1-cudnn8-devel-ubuntu22.04 as base

ARG OOBABOOGA_COMMIT=60f3d87309bd5fa8e3d77ed1fc66b25ef84db8c5
ARG TORCH_VERSION=2.1.2
ARG XFORMERS_VERSION=0.0.23.post1
ARG OOBABOOGA_COMMIT=aa0da07af012e251b4b70a1391b0acd360f796bd
ARG TORCH_VERSION=2.2.0
ARG XFORMERS_VERSION=0.0.24

SHELL ["/bin/bash", "-o", "pipefail", "-c"]
ENV DEBIAN_FRONTEND=noninteractive \
Expand Down Expand Up @@ -89,8 +89,8 @@ RUN source /venv/bin/activate && \
deactivate

# Fix broken safetensors
RUN source /venv/bin/activate && \
pip3 install -U safetensors==0.4.1
#RUN source /venv/bin/activate && \
# pip3 install -U safetensors==0.4.1

# Install rclone
RUN curl https://rclone.org/install.sh | bash
Expand Down Expand Up @@ -135,7 +135,7 @@ COPY fetch_model.py /text-generation-webui/
COPY download_model.py /text-generation-webui/

# Set template version
ENV TEMPLATE_VERSION=1.12.7
ENV TEMPLATE_VERSION=1.13.0

# Set the venv path
ENV VENV_PATH="/workspace/venvs/text-generation-webui"
Expand Down
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,8 @@
* Python 3.10.12
* [Text Generation Web UI](
https://github.com/oobabooga/text-generation-webui)
* Torch 2.1.2
* xformers 0.0.23.post1
* Torch 2.2.0
* xformers 0.0.24
* Jupyter Lab
* [runpodctl](https://github.com/runpod/runpodctl)
* [OhMyRunPod](https://github.com/kodxana/OhMyRunPod)
Expand Down Expand Up @@ -78,8 +78,8 @@ You can obviously substitute the image name and tag with your own.
Text Generation Web UI creates a log file, and you can tail the log instead of
killing the service to view the logs.

| Application | Log file |
|-----------------------|-----------------------------|
| Application | Log file |
|------------------------|-----------------------------|
| Text Generation Web UI | /workspace/logs/textgen.log |

For example:
Expand Down

0 comments on commit fd169d6

Please sign in to comment.