Unverified Commit 8bd37c96 authored by Anant Sharma's avatar Anant Sharma Committed by GitHub
Browse files

refactor: move backend deploy, launch and slurm files from components to examples (#3849)


Signed-off-by: default avatarAnant Sharma <anants@nvidia.com>
parent 78359046
......@@ -90,7 +90,7 @@ resources:
extraPodSpec:
mainContainer:
image: my-registry/trtllm-runtime:my-tag
workingDir: /workspace/components/backends/trtllm
workingDir: /workspace/examples/backends/trtllm
args:
- "python3"
- "-m"
......@@ -168,7 +168,7 @@ Then, deploy the model using the deployment file.
Export the NAMESPACE you used in your Dynamo Cloud Installation.
```bash
cd dynamo/components/backends/trtllm/deploy
cd dynamo/examples/backends/trtllm/deploy
export DEPLOYMENT_FILE=agg.yaml
kubectl apply -f $DEPLOYMENT_FILE -n $NAMESPACE
```
......
......@@ -51,7 +51,7 @@ spec:
name: nvidia-config
mainContainer:
image: nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:my-tag
workingDir: /workspace/components/backends/trtllm
workingDir: /workspace/examples/backends/trtllm
# mount the configmap as a volume
volumeMounts:
- name: nvidia-config
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment