Skip to content

GitLab

Unverified Commit e06fd7d2 authored by GuanLuo's avatar GuanLuo Committed by GitHub
Browse files

fix: downgrade CUDA image use to work around PyNccl timeout in vLLM Ray use case (#1065)

parent b43c72a5
Hide whitespace changes
Inline Side-by-side
Showing with 10 additions and 2 deletions
container/Dockerfile.vllm
View file @ e06fd7d2
...@@ -2,7 +2,11 @@ ...@@ -2,7 +2,11 @@
# SPDX-License-Identifier: Apache-2.0 # SPDX-License-Identifier: Apache-2.0
ARG BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base" ARG BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base"
ARG BASE_IMAGE_TAG="25.03-cuda12.8-devel-ubuntu24.04" # FIXME: NCCL will hang with 25.03, so use 25.01 for now
# Please check https://github.com/ai-dynamo/dynamo/pull/1065
# for details and reproducer to manually test if the image
# can be updated to later versions.
ARG BASE_IMAGE_TAG="25.01-cuda12.8-devel-ubuntu24.04"
ARG RELEASE_BUILD ARG RELEASE_BUILD
ARG RUNTIME_IMAGE="nvcr.io/nvidia/cuda" ARG RUNTIME_IMAGE="nvcr.io/nvidia/cuda"
ARG RUNTIME_IMAGE_TAG="12.8.1-runtime-ubuntu24.04" ARG RUNTIME_IMAGE_TAG="12.8.1-runtime-ubuntu24.04"
......
container/build.sh
View file @ e06fd7d2
...@@ -97,7 +97,11 @@ TENSORRTLLM_PIP_WHEEL="" ...@@ -97,7 +97,11 @@ TENSORRTLLM_PIP_WHEEL=""
VLLM_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base" VLLM_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base"
VLLM_BASE_IMAGE_TAG="25.03-cuda12.8-devel-ubuntu24.04" # FIXME: NCCL will hang with 25.03, so use 25.01 for now
# Please check https://github.com/ai-dynamo/dynamo/pull/1065
# for details and reproducer to manually test if the image
# can be updated to later versions.
VLLM_BASE_IMAGE_TAG="25.01-cuda12.8-devel-ubuntu24.04"
NONE_BASE_IMAGE="ubuntu" NONE_BASE_IMAGE="ubuntu"
NONE_BASE_IMAGE_TAG="24.04" NONE_BASE_IMAGE_TAG="24.04"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment