Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
073d1ed3
Unverified
Commit
073d1ed3
authored
Mar 19, 2025
by
Marc-Alexandre Côté
Committed by
GitHub
Mar 19, 2025
Browse files
[Doc] Update tip info on using latest transformers when creating a custom Dockerfile (#15070)
parent
3d446433
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
docs/source/deployment/docker.md
docs/source/deployment/docker.md
+3
-3
No files found.
docs/source/deployment/docker.md
View file @
073d1ed3
...
@@ -34,11 +34,11 @@ If you need to use those dependencies (having accepted the license terms),
...
@@ -34,11 +34,11 @@ If you need to use those dependencies (having accepted the license terms),
create a custom Dockerfile on top of the base image with an extra layer that installs them:
create a custom Dockerfile on top of the base image with an extra layer that installs them:
```
Dockerfile
```
Dockerfile
FROM
vllm/vllm-openai:v0.
7.3
FROM
vllm/vllm-openai:v0.
8.0
# e.g. install the `audio` and `video` optional dependencies
# e.g. install the `audio` and `video` optional dependencies
# NOTE: Make sure the version of vLLM matches the base image!
# NOTE: Make sure the version of vLLM matches the base image!
RUN
uv pip
install
--system
vllm[audio,video]
==
0.
7.3
RUN
uv pip
install
vllm[audio,video]
==
0.
8.0
```
```
:::
:::
...
@@ -52,7 +52,7 @@ with an extra layer that installs their code from source:
...
@@ -52,7 +52,7 @@ with an extra layer that installs their code from source:
```
Dockerfile
```
Dockerfile
FROM
vllm/vllm-openai:latest
FROM
vllm/vllm-openai:latest
RUN
uv pip
install
--system
git+https://github.com/huggingface/transformers.git
RUN
uv pip
install
git+https://github.com/huggingface/transformers.git
```
```
:::
:::
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment