@@ -10,8 +10,7 @@ This document provides a comprehensive inventory of all Dynamo release artifacts
...
@@ -10,8 +10,7 @@ This document provides a comprehensive inventory of all Dynamo release artifacts
> **See also:** [Support Matrix](support-matrix.md) for hardware and platform compatibility | [Feature Matrix](feature-matrix.md) for backend feature support
> **See also:** [Support Matrix](support-matrix.md) for hardware and platform compatibility | [Feature Matrix](feature-matrix.md) for backend feature support
> [!Note]
Release history in this document begins at v0.6.0.
> Release history in this document begins at v0.6.0, as we expect the majority of users to be on v0.6.0 or later.
## Current Release: Dynamo v0.8.1
## Current Release: Dynamo v0.8.1
...
@@ -21,8 +20,7 @@ This document provides a comprehensive inventory of all Dynamo release artifacts
...
@@ -21,8 +20,7 @@ This document provides a comprehensive inventory of all Dynamo release artifacts
### Patch Release: v0.8.1.post1 (Jan 23, 2026)
### Patch Release: v0.8.1.post1 (Jan 23, 2026)
> [!Note]
**v0.8.1.post1** is a patch release for PyPI wheels and TRT-LLM container only (no GitHub release). All other artifacts remain at v0.8.1.
> **v0.8.1.post1** is a patch release for PyPI wheels and TRT-LLM container only. There is no GitHub release for this version. All other artifacts (vLLM/SGLang containers, Helm charts, Rust crates) remain at v0.8.1.
| Artifact | Version | Change | Link |
| Artifact | Version | Change | Link |
|----------|---------|--------|------|
|----------|---------|--------|------|
...
@@ -42,13 +40,11 @@ This document provides a comprehensive inventory of all Dynamo release artifacts
...
@@ -42,13 +40,11 @@ This document provides a comprehensive inventory of all Dynamo release artifacts
| `dynamo-frontend:0.8.1` | API gateway with Endpoint Prediction Protocol (EPP) | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/dynamo-frontend?version=0.8.1) | |
| `dynamo-frontend:0.8.1` | API gateway with Endpoint Prediction Protocol (EPP) | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/dynamo-frontend?version=0.8.1) | |
| `kubernetes-operator:0.8.1` | Kubernetes operator for Dynamo deployments | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/kubernetes-operator?version=0.8.1) | |
| `kubernetes-operator:0.8.1` | Kubernetes operator for Dynamo deployments | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/kubernetes-operator?version=0.8.1) | |
> [!Note]
\* Multimodal inference on CUDA 13 images: works on AMD64 for all backends; works on ARM64 only for TensorRT-LLM (`vllm-runtime:*-cuda13` and `sglang-runtime:*-cuda13` do not support multimodality on ARM64).
> \* Multimodality is not expected to work on ARM64 for CUDA 13 images (`vllm-runtime:*-cuda13`, `sglang-runtime:*-cuda13`). Multimodal inference works on AMD64 for these images.
### Python Wheels
### Python Wheels
> [!Important]
We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtllm]` wheel. See the [NGC container collection](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo) for supported images.
> We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtllm]` wheel. See the [NGC container collection](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo) for supported images.
This document provides the support matrix for Dynamo, including hardware, software and build instructions.
This document provides the support matrix for Dynamo, including hardware, software and build instructions.
> [!Note]
**See also:**[Release Artifacts](release-artifacts.md) for container images, wheels, Helm charts, and crates | [Feature Matrix](feature-matrix.md) for backend feature support
> **See also:** [Release Artifacts](release-artifacts.md) for container images, wheels, Helm charts, and crates | [Feature Matrix](feature-matrix.md) for backend feature support
## Backend Dependencies
## Backend Dependencies
...
@@ -22,8 +21,7 @@ The following table shows the backend framework versions included with each Dyna
...
@@ -22,8 +21,7 @@ The following table shows the backend framework versions included with each Dyna
**main (ToT)** reflects the current development branch. **v0.8.1.post1** is a patch release for PyPI wheels and TRT-LLM container only (no GitHub release).
> **main (ToT)** reflects the current development branch. **v0.8.1.post1** is a patch release for PyPI wheels and TRT-LLM container only (no GitHub release).
> [!Important]
> [!Important]
> Currently TensorRT-LLM does not support Python 3.11 so installation of the ai-dynamo[trtllm] Python wheel will fail.
> Currently TensorRT-LLM does not support Python 3.11 so installation of the ai-dynamo[trtllm] Python wheel will fail.
...
@@ -35,8 +33,7 @@ The following table shows the backend framework versions included with each Dyna
...
@@ -35,8 +33,7 @@ The following table shows the backend framework versions included with each Dyna
| **Dynamo 0.7.1** | CUDA 12.8 | CUDA 13.0 | CUDA 12.9 |
| **Dynamo 0.7.1** | CUDA 12.8 | CUDA 13.0 | CUDA 12.9 |
| **Dynamo 0.7.0** | CUDA 12.9 | CUDA 13.0 | CUDA 12.8 |
| **Dynamo 0.7.0** | CUDA 12.9 | CUDA 13.0 | CUDA 12.8 |
> [!Note]
Patch versions (e.g., v0.8.1.post1, v0.7.0.post1) have the same CUDA support as their base version.
> Patch versions (e.g., v0.8.1.post1, v0.7.0.post1) have the same CUDA support as their base version.
For detailed artifact versions and NGC links (including container images, Python wheels, Helm charts, and Rust crates), see the [Release Artifacts](release-artifacts.md) page.
For detailed artifact versions and NGC links (including container images, Python wheels, Helm charts, and Rust crates), see the [Release Artifacts](release-artifacts.md) page.
...
@@ -71,10 +68,7 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
...
@@ -71,10 +68,7 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
| **Ubuntu** | 24.04 | ARM64 | Supported |
| **Ubuntu** | 24.04 | ARM64 | Supported |
| **CentOS Stream** | 9 | x86_64 | Experimental |
| **CentOS Stream** | 9 | x86_64 | Experimental |
> [!Note]
Wheels are built using a manylinux_2_28-compatible environment and validated on CentOS Stream 9 and Ubuntu (22.04, 24.04). Compatibility with other Linux distributions is expected but not officially verified.
> Wheels are built using a manylinux_2_28-compatible environment and they have been validated on CentOS Stream 9 and Ubuntu (22.04, 24.04).
>
> Compatibility with other Linux distributions is expected but has not been officially verified yet.
> [!Caution]
> [!Caution]
> KV Block Manager is supported only with Python 3.12. Python 3.12 support is currently limited to Ubuntu 24.04.
> KV Block Manager is supported only with Python 3.12. Python 3.12 support is currently limited to Ubuntu 24.04.
...
@@ -104,8 +98,7 @@ Dynamo container images include CUDA toolkit libraries. The host machine must ha
...
@@ -104,8 +98,7 @@ Dynamo container images include CUDA toolkit libraries. The host machine must ha
For extended driver compatibility beyond the minimum versions listed above, consider using `cuda-compat` packages on the host. See [Forward Compatibility](https://docs.nvidia.com/deploy/cuda-compatibility/forward-compatibility.html) for details.
> For extended driver compatibility beyond the minimum versions listed above, consider using `cuda-compat` packages on the host. See [Forward Compatibility](https://docs.nvidia.com/deploy/cuda-compatibility/forward-compatibility.html) for details.
## Cloud Service Provider Compatibility
## Cloud Service Provider Compatibility
...
@@ -133,8 +125,7 @@ For detailed information on CUDA driver compatibility, forward compatibility, an
...
@@ -133,8 +125,7 @@ For detailed information on CUDA driver compatibility, forward compatibility, an
## Build Support
## Build Support
> [!Note]
For version-specific artifact details, installation commands, and release history, see [Release Artifacts](release-artifacts.md).
> For version-specific artifact details, installation commands, and release history, see [Release Artifacts](release-artifacts.md).
**Dynamo** currently provides build support in the following ways:
**Dynamo** currently provides build support in the following ways: