Unverified Commit 834eea61 authored by Neal Vaidya's avatar Neal Vaidya Committed by GitHub
Browse files

docs: fix image link (#7227)


Signed-off-by: default avatarNeal Vaidya <nealv@nvidia.com>
parent 4af0f92e
...@@ -37,6 +37,7 @@ CMakeCache.txt ...@@ -37,6 +37,7 @@ CMakeCache.txt
*_pb2.py *_pb2.py
*_pb2.pyi *_pb2.pyi
*.svg *.svg
!docs/assets/**/*.svg
*pytest_report.md *pytest_report.md
*pytest_report.xml *pytest_report.xml
......
...@@ -28,7 +28,7 @@ Agentic hints are per-request metadata that the agent client (e.g. Claude Code, ...@@ -28,7 +28,7 @@ Agentic hints are per-request metadata that the agent client (e.g. Claude Code,
- **Flow:** Harness sets hints in the request → Dynamo frontend parses `nvext` into routing hints → KV router uses them for queue ordering and worker selection → backends use them for priority scheduling and cache eviction. - **Flow:** Harness sets hints in the request → Dynamo frontend parses `nvext` into routing hints → KV router uses them for queue ordering and worker selection → backends use them for priority scheduling and cache eviction.
![Agentic workflow: Harness → hints in request → Dynamo frontend → routing hints → KV router (queue order, worker choice) → backend](/assets/img/agentic-hints-workflow.svg) ![Agentic workflow: Harness → hints in request → Dynamo frontend → routing hints → KV router (queue order, worker choice) → backend](../assets/img/agentic-hints-workflow.svg)
The request body includes `nvext.agent_hints` (routing, scheduling) and `nvext.cache_control` (TTL-based pinning); the frontend passes the former to the KV router and the latter to the KV block manager for cache pinning, prefetching, and eviction. The request body includes `nvext.agent_hints` (routing, scheduling) and `nvext.cache_control` (TTL-based pinning); the frontend passes the former to the KV router and the latter to the KV block manager for cache pinning, prefetching, and eviction.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment