Unverified Commit 1488ef2e authored by Hongkuan Zhou's avatar Hongkuan Zhou Committed by GitHub
Browse files

docs: pointers to global router (#6190)


Signed-off-by: default avatarhongkuanz <hongkuanz@nvidia.com>
parent 4f686262
......@@ -14,6 +14,7 @@ For quick start instructions, see the [Router README](README.md). This document
- [Routing Patterns](#routing-patterns)
- [Custom Routing Example: Minimizing TTFT](#custom-routing-example-minimizing-ttft)
- [KV Event Publishing for Custom Engines](#kv-event-publishing-for-custom-engines)
- [Global Router (Hierarchical Routing)](#global-router-hierarchical-routing)
## Using KvPushRouter Python API
......@@ -543,6 +544,13 @@ Each event in the payload is a dictionary with `type` field (`BlockStored`, `Blo
3. **`parent_hash` is required** for all blocks except the first in a sequence - it links blocks to enable prefix matching
## Global Router (Hierarchical Routing)
For deployments with multiple worker pools, the **Global Router** enables hierarchical routing by sitting between the frontend and local routers. It selects the appropriate pool for each request based on configurable policies, supporting disaggregated topologies where pools are tuned for different workload characteristics.
- **Component details**: [`components/src/dynamo/global_router/`](https://github.com/ai-dynamo/dynamo/tree/main/components/src/dynamo/global_router/)
- **Example**: [`examples/hierarchical_planner/`](https://github.com/ai-dynamo/dynamo/tree/main/examples/hierarchical_planner/)
## See Also
- **[Router README](README.md)**: Quick start guide for the KV Router
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment