Unverified Commit 3188c70a authored by Dillon Cullinan's avatar Dillon Cullinan Committed by GitHub
Browse files

chore: Templating Feedback Followup (#6125)


Signed-off-by: default avatarDillon Cullinan <dcullinan@nvidia.com>
parent 33ddd8fb
......@@ -2,6 +2,7 @@
# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
#}
# === BEGIN templates/trtllm_runtime.Dockerfile ===
##################################################
########## Runtime Image ########################
##################################################
......
......@@ -2,6 +2,7 @@
# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
#}
# === BEGIN templates/vllm_framework.Dockerfile ===
########################################################
########## Framework Development Image ################
########################################################
......
......@@ -2,6 +2,7 @@
# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
#}
# === BEGIN templates/vllm_runtime.Dockerfile ===
##################################################
########## Runtime Image ########################
##################################################
......
......@@ -2,6 +2,7 @@
# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
#}
# === BEGIN templates/wheel_builder.Dockerfile ===
##################################
##### Wheel Build Image ##########
##################################
......
......@@ -134,7 +134,7 @@ We are in the process of shipping pre-built docker containers that contain insta
```bash
cd $DYNAMO_ROOT
python container/render.py --framework=sglang --target=runtime --short-output
python container/render.py --framework=sglang --target=runtime --output-short-filename
docker build -t dynamo:sglang-latest -f container/rendered.Dockerfile .
```
......
......@@ -93,11 +93,11 @@ docker compose -f deploy/docker-compose.yml up -d
apt-get update && apt-get -y install git git-lfs
# On an x86 machine:
python container/render.py --framework=trtllm --target=runtime --short-output
python container/render.py --framework=trtllm --target=runtime --output-short-filename
docker build -t dynamo:trtllm-latest -f container/rendered.Dockerfile .
# On an ARM machine:
python container/render.py --framework=trtllm --target=runtime --platform=arm64 --short-output
python container/render.py --framework=trtllm --target=runtime --platform=arm64 --output-short-filename
docker build -t dynamo:trtllm-latest -f container/rendered.Dockerfile .
```
......
......@@ -74,7 +74,7 @@ docker compose -f deploy/docker-compose.yml up -d
We have public images available on [NGC Catalog](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo/artifacts). If you'd like to build your own container from source:
```bash
python container/render.py --framework=vllm --target=runtime --short-output
python container/render.py --framework=vllm --target=runtime --output-short-filename
docker build -t dynamo:vllm-latest -f container/rendered.Dockerfile .
```
......
......@@ -39,7 +39,7 @@ From the Dynamo repository root:
```bash
# Build the base Dynamo image
python container/render.py --framework=dynamo --target=runtime --short-output
python container/render.py --framework=dynamo --target=runtime --output-short-filename
docker build -f container/rendered.Dockerfile .
# Build the Triton worker image
......
......@@ -112,7 +112,7 @@ Before using these templates, ensure you have:
The deployment files currently require access to `my-registry/tensorrtllm-runtime`. If you don't have access, build and push your own image:
```bash
python container/render.py --framework=trtllm --short-output
python container/render.py --framework=trtllm --output-short-filename
docker build -f container/rendered.Dockerfile .
# Tag and push to your container registry
# Update the image references in the YAML files
......@@ -125,7 +125,7 @@ apt-get update && apt-get -y install git git-lfs
For ARM machines, use:
```bash
python container/render.py --framework=vllm --platform arm64 --short-output
python container/render.py --framework=vllm --platform arm64 --output-short-filename
docker build -f container/rendered.Dockerfile .
```
......
......@@ -102,7 +102,7 @@ Before using these templates, ensure you have:
We have public images available on [NGC Catalog](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo/artifacts). If you'd prefer to use your own registry, build and push your own image:
```bash
python container/render.py --framework=vllm --short-output
python container/render.py --framework=vllm --output-short-filename
docker build -f container/rendered.Dockerfile .
# Tag and push to your container registry
# Update the image references in the YAML files
......
......@@ -17,7 +17,7 @@ export DOCKER_SERVER=<ECR_REGISTRY>
export DOCKER_USERNAME=AWS
export DOCKER_PASSWORD="$(aws ecr get-login-password --region <ECR_REGION>)"
export IMAGE_TAG=0.3.2.1
python container/render.py --framework=dynamo --target=runtime --short-output
python container/render.py --framework=dynamo --target=runtime --output-short-filename
docker build -t dynamo:latest-vllm -f container/rendered.Dockerfile .
```
......
......@@ -126,7 +126,7 @@ We are in the process of shipping pre-built docker containers that contain insta
```bash
cd $DYNAMO_ROOT
python container/render.py --framework sglang --short-output
python container/render.py --framework sglang --output-short-filename
docker build -f container/rendered.Dockerfile -t dynamo:latest-sglang .
```
......
......@@ -80,11 +80,11 @@ docker compose -f deploy/docker-compose.yml up -d
apt-get update && apt-get -y install git git-lfs
# On an x86 machine:
python container/render.py --framework sglang --short-output
python container/render.py --framework sglang --output-short-filename
docker build -f container/rendered.Dockerfile -t dynamo:latest-trtllm .
# On an ARM machine:
python container/render.py --framework trtllm --platform arm64 --short-output
python container/render.py --framework trtllm --platform arm64 --output-short-filename
docker build -f container/rendered.Dockerfile -t dynamo:latest-trtllm .
```
......
......@@ -74,7 +74,7 @@ docker compose -f deploy/docker-compose.yml up -d
We have public images available on [NGC Catalog](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo/artifacts). If you'd like to build your own container from source:
```bash
python container/render.py --framework vllm --short-output
python container/render.py --framework vllm --output-short-filename
docker build -f container/rendered.Dockerfile -t dynamo:latest-vllm .
```
......
......@@ -43,7 +43,7 @@ The pip wheel is built through a Docker build process:
```bash
# Render and build the Docker image with KVBM enabled (from the dynamo repo root)
python container/render.py --framework=dynamo --target==runtime --short-output
python container/render.py --framework=dynamo --target==runtime --output-short-filename
docker build --build-arg ENABLE_KVBM="true" -f container/rendered.Dockerfile .
```
......
......@@ -135,7 +135,7 @@ then this test will be included in the nightly run as well.
```
- Run in container:
```bash
python container/render.py --framework=${FRAMEWORK} --target=runtime --short-output
python container/render.py --framework=${FRAMEWORK} --target=runtime --output-short-filename
docker build -t dynamo:${FRAMEWORK}-latest -f container/rendered.Dockerfile .
./container/run.sh --mount-workspace -it -- pytest
./container/run.sh --mount-workspace -it -- pytest -m [optional markers]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment