Skip to content

GitLab

Unverified Commit 9f3d1b90 authored by Julien Mancuso's avatar Julien Mancuso Committed by GitHub
Browse files

fix: fix trtllm multinode DGD (#4389) 


Signed-off-by: default avatarJulien Mancuso <jmancuso@nvidia.com>
parent ed8cd590
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
examples/backends/trtllm/deploy/disagg-multinode.yaml
View file @ 9f3d1b90
...@@ -90,6 +90,9 @@ spec: ...@@ -90,6 +90,9 @@ spec:
value: "/models" value: "/models"
services: services:
Frontend: Frontend:
volumeMounts:
- name: models
mountPoint: /models
dynamoNamespace: trtllm-disagg dynamoNamespace: trtllm-disagg
componentType: frontend componentType: frontend
replicas: 1 replicas: 1
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment