--- # SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. # SPDX-License-Identifier: Apache-2.0 --- Advanced deployment and configuration for the `` backend. ## Deployment ### Single-Node Setup {/* Local deployment instructions */} ### Multi-Node Setup {/* Distributed deployment with TP/PP */} ### Kubernetes Deployment ```yaml # Full DGDR example ``` ## Configuration ### CLI Arguments | Argument | Type | Default | Description | |----------|------|---------|-------------| | {/* arg */} | {/* type */} | {/* default */} | {/* description */} | ### Environment Variables | Variable | Default | Description | |----------|---------|-------------| | {/* var */} | {/* default */} | {/* description */} | ### Model Configuration {/* Model-specific settings, quantization */} ## Performance Tuning ### Memory Optimization {/* KV cache sizing, batch limits */} ### Throughput Optimization {/* Concurrency, prefill/decode settings */} ## Troubleshooting ### Common Issues | Issue | Cause | Solution | |-------|-------|----------| | {/* issue */} | {/* cause */} | {/* solution */} | ### Debug Mode ```bash # Add debug command from existing docs ``` ## See Also | Document | Path | |----------|------| | ` Overview` | `./README.md` | | Backend Comparison | `../README.md` | {/* Convert to links when using template */}