Unverified Commit 8bd37c96 authored by Anant Sharma's avatar Anant Sharma Committed by GitHub
Browse files

refactor: move backend deploy, launch and slurm files from components to examples (#3849)


Signed-off-by: default avatarAnant Sharma <anants@nvidia.com>
parent 78359046
...@@ -90,7 +90,7 @@ resources: ...@@ -90,7 +90,7 @@ resources:
extraPodSpec: extraPodSpec:
mainContainer: mainContainer:
image: my-registry/trtllm-runtime:my-tag image: my-registry/trtllm-runtime:my-tag
workingDir: /workspace/components/backends/trtllm workingDir: /workspace/examples/backends/trtllm
args: args:
- "python3" - "python3"
- "-m" - "-m"
...@@ -168,7 +168,7 @@ Then, deploy the model using the deployment file. ...@@ -168,7 +168,7 @@ Then, deploy the model using the deployment file.
Export the NAMESPACE you used in your Dynamo Cloud Installation. Export the NAMESPACE you used in your Dynamo Cloud Installation.
```bash ```bash
cd dynamo/components/backends/trtllm/deploy cd dynamo/examples/backends/trtllm/deploy
export DEPLOYMENT_FILE=agg.yaml export DEPLOYMENT_FILE=agg.yaml
kubectl apply -f $DEPLOYMENT_FILE -n $NAMESPACE kubectl apply -f $DEPLOYMENT_FILE -n $NAMESPACE
``` ```
......
...@@ -51,7 +51,7 @@ spec: ...@@ -51,7 +51,7 @@ spec:
name: nvidia-config name: nvidia-config
mainContainer: mainContainer:
image: nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:my-tag image: nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:my-tag
workingDir: /workspace/components/backends/trtllm workingDir: /workspace/examples/backends/trtllm
# mount the configmap as a volume # mount the configmap as a volume
volumeMounts: volumeMounts:
- name: nvidia-config - name: nvidia-config
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment