Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
13d3cc13
Unverified
Commit
13d3cc13
authored
Jul 23, 2025
by
Biswa Panda
Committed by
GitHub
Jul 24, 2025
Browse files
feat: add nixl benchmark deployment instructions (#2060)
parent
cde8db30
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
61 additions
and
0 deletions
+61
-0
benchmarks/nixl/README.md
benchmarks/nixl/README.md
+32
-0
benchmarks/nixl/nixl-benchmark-deployment.yaml
benchmarks/nixl/nixl-benchmark-deployment.yaml
+29
-0
No files found.
benchmarks/nixl/README.md
0 → 100644
View file @
13d3cc13
# NIXL Benchmark Technical Documentation (Kubernetes)
This guide describes how to run the NIXL benchmark using the provided Docker image on a Kubernetes (K8s) cluster.
---
## Prerequisites
-
A running Kubernetes cluster with access to NVIDIA GPUs (e.g., using NVIDIA GPU Operator or device plugin)
-
`kubectl`
configured to access your cluster
-
deploy dynamo cloud in a namespace
---
## 1. Prepare the Kubernetes Deployment
A sample deployment YAML is provided in this repository:
`benchmarks/nixl/nixl-benchmark-deployment.yaml`
Update the image field in sample yaml to appropiate image in your registry.
You can use the
`yq`
tool to update the image field in the deployment YAML
```
bash
yq
-i
'.spec.template.spec.containers[] |= select(.name == "nixl-benchmark") .image = "your-registry/your-nixl-benchmark:your-tag"'
benchmarks/nixl/nixl-benchmark-deployment.yaml
>
nixl-benchmark-deployment.yaml
```
## 2. Deploy using kubectl
Launch using the command below:
```
bash
kubectl apply
-f
nixl-benchmark-deployment.yaml
```
\ No newline at end of file
benchmarks/nixl/nixl-benchmark-deployment.yaml
0 → 100644
View file @
13d3cc13
# SPDX-FileCopyrightText: Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
apiVersion
:
apps/v1
kind
:
Deployment
metadata
:
name
:
nixl-benchmark
spec
:
replicas
:
2
selector
:
matchLabels
:
app
:
nixl-benchmark
template
:
metadata
:
labels
:
app
:
nixl-benchmark
spec
:
imagePullSecrets
:
-
name
:
nvcrimagepullsecret
containers
:
-
name
:
nixl-benchmark
image
:
nvcr.io/nvidian/nim-llm-dev/vllm-runtime:nixlbench-e42c07a8
command
:
[
"
sh"
,
"
-c"
]
args
:
-
"
nixlbench
-etcd_endpoints
http://dynamo-platform-etcd:2379
--target_seg_type
VRAM
--initiator_seg_type
VRAM
&&
sleep
infinity"
resources
:
requests
:
nvidia.com/gpu
:
"
1"
limits
:
nvidia.com/gpu
:
"
1"
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment