Skip to content

GitLab

Unverified Commit 50dfd3af authored by Julien Mancuso's avatar Julien Mancuso Committed by GitHub
Browse files

fix: fix backend in trtllm multinode example (#3311) 


Signed-off-by: default avatarJulien Mancuso <jmancuso@nvidia.com>
parent 8c884345
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
components/backends/trtllm/deploy/disagg-multinode.yaml
View file @ 50dfd3af
...@@ -32,7 +32,7 @@ data: ...@@ -32,7 +32,7 @@ data:
kv_cache_config: kv_cache_config:
free_gpu_memory_fraction: 0.80 free_gpu_memory_fraction: 0.80
cache_transceiver_config: cache_transceiver_config:
backend: default backend: DEFAULT
decode.yaml: | decode.yaml: |
# SPDX-FileCopyrightText: Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved. # SPDX-FileCopyrightText: Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
...@@ -60,7 +60,7 @@ data: ...@@ -60,7 +60,7 @@ data:
kv_cache_config: kv_cache_config:
free_gpu_memory_fraction: 0.80 free_gpu_memory_fraction: 0.80
cache_transceiver_config: cache_transceiver_config:
backend: default backend: DEFAULT
--- ---
apiVersion: v1 apiVersion: v1
kind: PersistentVolumeClaim kind: PersistentVolumeClaim
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment