Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
cb2ea1be
Unverified
Commit
cb2ea1be
authored
Nov 21, 2025
by
Harry Kim
Committed by
GitHub
Nov 21, 2025
Browse files
docs: Add Recipes to ToC and bump FW Support Matrix further up (#4536)
Signed-off-by:
Harry Kim
<
harry_kim@live.com
>
parent
c61e0dd3
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
18 deletions
+10
-18
README.md
README.md
+10
-18
No files found.
README.md
View file @
cb2ea1be
...
...
@@ -22,12 +22,21 @@ limitations under the License.
[

](https://discord.gg/D92uqZRjCZ)
[

](https://deepwiki.com/ai-dynamo/dynamo)
|
**[Roadmap](https://github.com/ai-dynamo/dynamo/issues/2486)**
|
**[Support matrix](https://github.com/ai-dynamo/dynamo/blob/main/docs/reference/support-matrix.md)**
|
**[Doc
umentation
](https://docs.nvidia.com/dynamo/latest/index.html)**
|
**[Examples](https://github.com/ai-dynamo/dynamo/tree/main/examples)**
|
**[Prebuilt containers](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo)**
|
**[Design Proposals](https://github.com/ai-dynamo/enhancements)**
|
**[Blogs](https://developer.nvidia.com/blog/tag/nvidia-dynamo)**
|
**[Roadmap](https://github.com/ai-dynamo/dynamo/issues/2486)**
|
**[Support matrix](https://github.com/ai-dynamo/dynamo/blob/main/docs/reference/support-matrix.md)**
|
**[Doc
s
](https://docs.nvidia.com/dynamo/latest/index.html)**
|
**[Recipes](https://github.com/ai-dynamo/dynamo/tree/main/recipes)**
|
**[Examples](https://github.com/ai-dynamo/dynamo/tree/main/examples)**
|
**[Prebuilt containers](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo)**
|
**[Design Proposals](https://github.com/ai-dynamo/enhancements)**
|
**[Blogs](https://developer.nvidia.com/blog/tag/nvidia-dynamo)**
# NVIDIA Dynamo
High-throughput, low-latency inference framework designed for serving generative AI and reasoning models in multi-node distributed environments.
## Framework Support Matrix
| Feature |
[
vLLM
](
docs/backends/vllm/README.md
)
|
[
SGLang
](
docs/backends/sglang/README.md
)
|
[
TensorRT-LLM
](
docs/backends/trtllm/README.md
)
|
| ------------------------------------------------------------------------------------------------- | ---- | ------ | ------------ |
|
[
**Disaggregated Serving**
](
/docs/design_docs/disagg_serving.md
)
| ✅ | ✅ | ✅ |
|
[
**KV-Aware Routing**
](
/docs/router/kv_cache_routing.md
)
| ✅ | ✅ | ✅ |
|
[
**SLA-Based Planner**
](
docs/planner/sla_planner.md
)
| ✅ | ✅ | ✅ |
|
[
**KVBM**
](
docs/kvbm/kvbm_architecture.md
)
| ✅ | 🚧 | ✅ |
## Latest News
-
[
11/13] [Dynamo Office Hours Playlist
](
https://www.youtube.com/playlist?list=PL5B692fm6--tgryKu94h2Zb7jTFM3Go4X
)
...
...
@@ -56,23 +65,6 @@ Dynamo is designed to be inference engine agnostic (supports TRT-LLM, vLLM, SGLa
<img
src=
"./docs/images/frontpage-architecture.png"
alt=
"Dynamo architecture"
width=
"600"
/>
</p>
## Framework Support Matrix
| Feature | vLLM | SGLang | TensorRT-LLM |
| ------------------------------------------------------------------------------------------------- | ---- | ------ | ------------ |
|
[
**Disaggregated Serving**
](
/docs/design_docs/disagg_serving.md
)
| ✅ | ✅ | ✅ |
|
[
**Conditional Disaggregation**
](
/docs/design_docs/disagg_serving.md#conditional-disaggregation
)
| 🚧 | 🚧 | 🚧 |
|
[
**KV-Aware Routing**
](
/docs/router/kv_cache_routing.md
)
| ✅ | ✅ | ✅ |
|
[
**Load Based Planner**
](
docs/planner/load_planner.md
)
| 🚧 | 🚧 | 🚧 |
|
[
**SLA-Based Planner**
](
docs/planner/sla_planner.md
)
| ✅ | ✅ | ✅ |
|
[
**KVBM**
](
docs/kvbm/kvbm_architecture.md
)
| ✅ | 🚧 | ✅ |
To learn more about each framework and their capabilities, check out each framework's README!
-
**[vLLM](docs/backends/vllm/README.md)**
-
**[SGLang](docs/backends/sglang/README.md)**
-
**[TensorRT-LLM](docs/backends/trtllm/README.md)**
Built in Rust for performance and in Python for extensibility, Dynamo is fully open-source and driven by a transparent, OSS (Open Source Software) first development approach.
# Installation
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment