New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Examples] Add vLLM container example #3694

Merged

romilbhardwaj merged 2 commits into master from example_vllm_docker

Jun 27, 2024

Collaborator

romilbhardwaj commented Jun 27, 2024

Using vLLM container image saves ~2 min during provisioning.

Tested (run the relevant ones):

Code formatting: bash format.sh
Any manual or new tests for this PR (please specify below)
All smoke tests: pytest tests/test_smoke.py
Relevant individual smoke tests: pytest tests/test_smoke.py::test_fill_in_the_name
Backward compatibility tests: conda deactivate; bash -i tests/backward_compatibility_tests.sh


add docker example

7db0f06

concretevitamin approved these changes

View reviewed changes


fix link

c8dcb64

romilbhardwaj merged commit a51b507 into master

20 checks passed

romilbhardwaj deleted the example_vllm_docker branch

June 27, 2024 17:34

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment