Skip to content

Commit

Permalink
Image server info
Browse files Browse the repository at this point in the history
  • Loading branch information
namoray committed Apr 8, 2024
1 parent 653d64d commit 4c5da0a
Showing 1 changed file with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion image_server/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,4 +30,13 @@ The Device to use for the image server (each image server can only use 1) (defau
### Some methods to use the server
- Use a 4090 with --normal-vram or --low-vram, to run everything on one machine. Have WARMUP true to prepare all models in advance
- USe an A100 or similar with --high-vram or --gpu-only, and have WARMUP true
- Use a 4090 with --high-vram/ --gpu-only, WARMUP FALSE, and only use the server with certain models. For example, use a load balancer to direct all `proteus` requests to this server, and then make another 4090 for playground, etc - depending on what you want to support.
- Use a 4090 with --high-vram/ --gpu-only, WARMUP FALSE, and only use the server with certain models. For example, use a load balancer to direct all `proteus` requests to this server, and then make another 4090 for playground, etc - depending on what you want to support.


### Running locally

Here's just an example command
```bash
docker pull corcelio/ml:image_server
docker run -p 6919:6919 -e PORT=6919 -e DEVICE=0 corcelio/ml:image_server
```

0 comments on commit 4c5da0a

Please sign in to comment.