Skip to content

GitLab

"lib/llm/vscode:/vscode.git/clone" did not exist on "a2154ba5606ebda6b7f6d981c365b151f7050665"
Unverified Commit 5c8f8ffb authored by Ryan McCormick's avatar Ryan McCormick Committed by GitHub
Browse files

docs(mocker): clarify mocker image placeholder (#8274)

parent 846ce71a
Show whitespace changes
Inline Side-by-side
Showing with 15 additions and 5 deletions
examples/backends/mocker/deploy/agg.yaml
View file @ 5c8f8ffb
# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
# NOTE: There is no dedicated `mocker-runtime` image. The mocker component
# (`python3 -m dynamo.mocker`) is bundled into the standard Dynamo backend
# runtime images published on NGC (e.g. `nvcr.io/nvidia/ai-dynamo/vllm-runtime`,
# `sglang-runtime`, `tensorrtllm-runtime`). Replace `my-dynamo-image:my-tag`
# below with any of those tags, or with your own built image.
apiVersion: nvidia.com/v1alpha1
kind: DynamoGraphDeployment
metadata:
......@@ -12,7 +17,7 @@ spec:
replicas: 1
extraPodSpec:
mainContainer:
image: my-registry/mocker-runtime:my-tag
image: my-dynamo-image:my-tag
decode:
envFromSecret: hf-token-secret
componentType: worker
......@@ -20,7 +25,7 @@ spec:
replicas: 1
extraPodSpec:
mainContainer:
image: my-registry/mocker-runtime:my-tag
image: my-dynamo-image:my-tag
workingDir: /workspace
command:
- python3
......
examples/backends/mocker/deploy/disagg.yaml
View file @ 5c8f8ffb
# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
# NOTE: There is no dedicated `mocker-runtime` image. The mocker component
# (`python3 -m dynamo.mocker`) is bundled into the standard Dynamo backend
# runtime images published on NGC (e.g. `nvcr.io/nvidia/ai-dynamo/vllm-runtime`,
# `sglang-runtime`, `tensorrtllm-runtime`). Replace `my-dynamo-image:my-tag`
# below with any of those tags, or with your own built image.
apiVersion: nvidia.com/v1alpha1
kind: DynamoGraphDeployment
metadata:
......@@ -12,7 +17,7 @@ spec:
replicas: 1
extraPodSpec:
mainContainer:
image: my-registry/mocker-runtime:my-tag
image: my-dynamo-image:my-tag
prefill:
envFromSecret: hf-token-secret
componentType: worker
......@@ -20,7 +25,7 @@ spec:
replicas: 1
extraPodSpec:
mainContainer:
image: my-registry/mocker-runtime:my-tag
image: my-dynamo-image:my-tag
workingDir: /workspace
command:
- python3
......@@ -44,7 +49,7 @@ spec:
replicas: 1
extraPodSpec:
mainContainer:
image: my-registry/mocker-runtime:my-tag
image: my-dynamo-image:my-tag
workingDir: /workspace
command:
- python3
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment