[DOC] - Add docker image to Cerebrium Integration (#6510)

a38524f3 · milo157 · GitHub · 2fa4623d · a38524f3
Unverified Commit a38524f3 authored Jul 17, 2024 by milo157 Committed by GitHub Jul 17, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 3 additions and 0 deletions

docs/source/serving/deploying_with_cerebrium.rst docs/source/serving/deploying_with_cerebrium.rst +3 -0

No files found.
--- a/docs/source/serving/deploying_with_cerebrium.rst
+++ b/docs/source/serving/deploying_with_cerebrium.rst
@@ -28,6 +28,9 @@ Next, to install the required packages, add the following to your cerebrium.toml

 .. code-block:: toml

+    [cerebrium.deployment]
+    docker_base_image_url = "nvidia/cuda:12.1.1-runtime-ubuntu22.04"
+
    [cerebrium.dependencies.pip]
    vllm = "latest"