Skip to content

GitLab

Unverified Commit 3ec78ec3 authored by dagil-nvidia's avatar dagil-nvidia Committed by GitHub
Browse files

docs: update support matrix and release artifacts for v0.9.1 (#7044) 


Signed-off-by: default avatarDan Gil <dagil@nvidia.com>
parent d54af4f8
Show whitespace changes
Inline Side-by-side
Showing with 68 additions and 47 deletions
docs/reference/release-artifacts.md
View file @ 3ec78ec3
...@@ -10,15 +10,15 @@ This document provides a comprehensive inventory of all Dynamo release artifacts ...@@ -10,15 +10,15 @@ This document provides a comprehensive inventory of all Dynamo release artifacts
Release history in this document begins at v0.6.0. Release history in this document begins at v0.6.0.
## Current Release: Dynamo v0.9.0 ## Current Release: Dynamo v0.9.1
- **GitHub Release:** [v0.9.0](https://github.com/ai-dynamo/dynamo/releases/tag/v0.9.0) - **GitHub Release:** [v0.9.1](https://github.com/ai-dynamo/dynamo/releases/tag/v0.9.1)
- **Docs:** [v0.9.0](https://docs.dynamo.nvidia.com/dynamo) - **Docs:** [v0.9.1](https://docs.dynamo.nvidia.com/dynamo)
- **NGC Collection:** [ai-dynamo](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo) - **NGC Collection:** [ai-dynamo](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/collections/ai-dynamo)
### Patch Release: v0.9.0.post1 (Feb 2026) ### Previous Patch: v0.9.0.post1 (Feb 2026)
**v0.9.0.post1** is a Helm-chart-only patch release on NGC (no GitHub release). It fixes the `dynamo-platform` Helm chart which incorrectly set the operator image tag to `0.7.1` instead of `0.9.0`. Only the `dynamo-platform` chart was patched; all other artifacts remain at v0.9.0. **v0.9.0.post1** is a Helm-chart-only patch release on NGC (no GitHub release). It fixes the `dynamo-platform` Helm chart which incorrectly set the operator image tag to `0.7.1` instead of `0.9.0`. Only the `dynamo-platform` chart was patched; all other artifacts remain at v0.9.0. Users upgrading to v0.9.1 do not need this patch.
| Artifact | Version | Change | Link | | Artifact | Version | Change | Link |
|----------|---------|--------|------| |----------|---------|--------|------|
...@@ -31,13 +31,13 @@ Release history in this document begins at v0.6.0. ...@@ -31,13 +31,13 @@ Release history in this document begins at v0.6.0.
| Image:Tag | Description | Backend | CUDA | Arch | NGC | Notes | | Image:Tag | Description | Backend | CUDA | Arch | NGC | Notes |
|-----------|-------------|---------|------|------|-----|-------| |-----------|-------------|---------|------|------|-----|-------|
| `vllm-runtime:0.9.0` | Runtime container for vLLM backend | vLLM `v0.14.1` | `v12.9` | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/vllm-runtime?version=0.9.0) | | | `vllm-runtime:0.9.1` | Runtime container for vLLM backend | vLLM `v0.14.1` | `v12.9` | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/vllm-runtime?version=0.9.1) | |
| `vllm-runtime:0.9.0-cuda13` | Runtime container for vLLM backend (CUDA 13) | vLLM `v0.14.1` | `v13.0` | AMD64/ARM64* | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/vllm-runtime?version=0.9.0-cuda13) | Experimental | | `vllm-runtime:0.9.1-cuda13` | Runtime container for vLLM backend (CUDA 13) | vLLM `v0.14.1` | `v13.0` | AMD64/ARM64* | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/vllm-runtime?version=0.9.1-cuda13) | Experimental |
| `sglang-runtime:0.9.0` | Runtime container for SGLang backend | SGLang `v0.5.8` | `v12.9` | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/sglang-runtime?version=0.9.0) | | | `sglang-runtime:0.9.1` | Runtime container for SGLang backend | SGLang `v0.5.8` | `v12.9` | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/sglang-runtime?version=0.9.1) | |
| `sglang-runtime:0.9.0-cuda13` | Runtime container for SGLang backend (CUDA 13) | SGLang `v0.5.8` | `v13.0` | AMD64/ARM64* | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/sglang-runtime?version=0.9.0-cuda13) | Experimental | | `sglang-runtime:0.9.1-cuda13` | Runtime container for SGLang backend (CUDA 13) | SGLang `v0.5.8` | `v13.0` | AMD64/ARM64* | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/sglang-runtime?version=0.9.1-cuda13) | Experimental |
| `tensorrtllm-runtime:0.9.0` | Runtime container for TensorRT-LLM backend | TRT-LLM `v1.3.0rc1` | `v13.0` | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/tensorrtllm-runtime?version=0.9.0) | | | `tensorrtllm-runtime:0.9.1` | Runtime container for TensorRT-LLM backend | TRT-LLM `v1.3.0rc3` | `v13.0` | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/tensorrtllm-runtime?version=0.9.1) | |
| `dynamo-frontend:0.9.0` | API gateway with Endpoint Prediction Protocol (EPP) | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/dynamo-frontend?version=0.9.0) | | | `dynamo-frontend:0.9.1` | API gateway with Endpoint Prediction Protocol (EPP) | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/dynamo-frontend?version=0.9.1) | |
| `kubernetes-operator:0.9.0` | Kubernetes operator for Dynamo deployments | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/kubernetes-operator?version=0.9.0) | | | `kubernetes-operator:0.9.1` | Kubernetes operator for Dynamo deployments | — | — | AMD64/ARM64 | [link](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-dynamo/containers/kubernetes-operator?version=0.9.1) | |
\* Multimodal inference on CUDA 13 images: works on AMD64 for all backends; works on ARM64 only for TensorRT-LLM (`vllm-runtime:*-cuda13` and `sglang-runtime:*-cuda13` do not support multimodality on ARM64). \* Multimodal inference on CUDA 13 images: works on AMD64 for all backends; works on ARM64 only for TensorRT-LLM (`vllm-runtime:*-cuda13` and `sglang-runtime:*-cuda13` do not support multimodality on ARM64).
...@@ -47,16 +47,16 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl ...@@ -47,16 +47,16 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl
| Package | Description | Python | Platform | PyPI | | Package | Description | Python | Platform | PyPI |
|---------|-------------|--------|----------|------| |---------|-------------|--------|----------|------|
| `ai-dynamo==0.9.0` | Main package with backend integrations (vLLM, SGLang, TRT-LLM) | `3.10`–`3.12` | Linux (glibc `v2.28+`) | [link](https://pypi.org/project/ai-dynamo/0.9.0/) | | `ai-dynamo==0.9.1` | Main package with backend integrations (vLLM, SGLang, TRT-LLM) | `3.10`–`3.12` | Linux (glibc `v2.28+`) | [link](https://pypi.org/project/ai-dynamo/0.9.1/) |
| `ai-dynamo-runtime==0.9.0` | Core Python bindings for Dynamo runtime | `3.10`–`3.12` | Linux (glibc `v2.28+`) | [link](https://pypi.org/project/ai-dynamo-runtime/0.9.0/) | | `ai-dynamo-runtime==0.9.1` | Core Python bindings for Dynamo runtime | `3.10`–`3.12` | Linux (glibc `v2.28+`) | [link](https://pypi.org/project/ai-dynamo-runtime/0.9.1/) |
| `kvbm==0.9.0` | KV Block Manager for disaggregated KV cache | `3.12` | Linux (glibc `v2.28+`) | [link](https://pypi.org/project/kvbm/0.9.0/) | | `kvbm==0.9.1` | KV Block Manager for disaggregated KV cache | `3.12` | Linux (glibc `v2.28+`) | [link](https://pypi.org/project/kvbm/0.9.1/) |
### Helm Charts ### Helm Charts
| Chart | Description | NGC | | Chart | Description | NGC |
|-------|-------------|-----| |-------|-------------|-----|
| `dynamo-crds-0.9.0` | Custom Resource Definitions for Dynamo Kubernetes resources | [link](https://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-crds-0.9.0.tgz) | | `dynamo-crds-0.9.1` | Custom Resource Definitions for Dynamo Kubernetes resources | [link](https://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-crds-0.9.1.tgz) |
| `dynamo-platform-0.9.0-post1` | Platform services (etcd, NATS) for Dynamo cluster | [link](https://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-platform-0.9.0-post1.tgz) | | `dynamo-platform-0.9.1` | Platform services (etcd, NATS) for Dynamo cluster | [link](https://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-platform-0.9.1.tgz) |
> **Note:** The `dynamo-graph` Helm chart is deprecated as of v0.9.0. Use the Kubernetes operator for deployment graph management. > **Note:** The `dynamo-graph` Helm chart is deprecated as of v0.9.0. Use the Kubernetes operator for deployment graph management.
...@@ -64,13 +64,13 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl ...@@ -64,13 +64,13 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl
| Crate | Description | MSRV (Rust) | crates.io | | Crate | Description | MSRV (Rust) | crates.io |
|-------|-------------|-------------|-----------| |-------|-------------|-------------|-----------|
| `dynamo-runtime@0.9.0` | Core distributed runtime library | `v1.82` | [link](https://crates.io/crates/dynamo-runtime/0.9.0) | | `dynamo-runtime@0.9.1` | Core distributed runtime library | `v1.82` | [link](https://crates.io/crates/dynamo-runtime/0.9.1) |
| `dynamo-llm@0.9.0` | LLM inference engine | `v1.82` | [link](https://crates.io/crates/dynamo-llm/0.9.0) | | `dynamo-llm@0.9.1` | LLM inference engine | `v1.82` | [link](https://crates.io/crates/dynamo-llm/0.9.1) |
| `dynamo-async-openai@0.9.0` | Async OpenAI-compatible API client | `v1.82` | [link](https://crates.io/crates/dynamo-async-openai/0.9.0) | | `dynamo-async-openai@0.9.1` | Async OpenAI-compatible API client | `v1.82` | [link](https://crates.io/crates/dynamo-async-openai/0.9.1) |
| `dynamo-parsers@0.9.0` | Protocol parsers (SSE, JSON streaming) | `v1.82` | [link](https://crates.io/crates/dynamo-parsers/0.9.0) | | `dynamo-parsers@0.9.1` | Protocol parsers (SSE, JSON streaming) | `v1.82` | [link](https://crates.io/crates/dynamo-parsers/0.9.1) |
| `dynamo-memory@0.9.0` | Memory management utilities | `v1.82` | [link](https://crates.io/crates/dynamo-memory/0.9.0) | | `dynamo-memory@0.9.1` | Memory management utilities | `v1.82` | [link](https://crates.io/crates/dynamo-memory/0.9.1) |
| `dynamo-config@0.9.0` | Configuration management | `v1.82` | [link](https://crates.io/crates/dynamo-config/0.9.0) | | `dynamo-config@0.9.1` | Configuration management | `v1.82` | [link](https://crates.io/crates/dynamo-config/0.9.1) |
| `dynamo-tokens@0.9.0` | Tokenizer bindings for LLM inference | `v1.82` | [link](https://crates.io/crates/dynamo-tokens/0.9.0) | | `dynamo-tokens@0.9.1` | Tokenizer bindings for LLM inference | `v1.82` | [link](https://crates.io/crates/dynamo-tokens/0.9.1) |
## Quick Install Commands ## Quick Install Commands
...@@ -80,17 +80,17 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl ...@@ -80,17 +80,17 @@ We recommend using the TensorRT-LLM NGC container instead of the `ai-dynamo[trtl
```bash ```bash
# Runtime containers # Runtime containers
docker pull nvcr.io/nvidia/ai-dynamo/vllm-runtime:0.9.0 docker pull nvcr.io/nvidia/ai-dynamo/vllm-runtime:0.9.1
docker pull nvcr.io/nvidia/ai-dynamo/sglang-runtime:0.9.0 docker pull nvcr.io/nvidia/ai-dynamo/sglang-runtime:0.9.1
docker pull nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:0.9.0 docker pull nvcr.io/nvidia/ai-dynamo/tensorrtllm-runtime:0.9.1
# CUDA 13 variants (experimental) # CUDA 13 variants (experimental)
docker pull nvcr.io/nvidia/ai-dynamo/vllm-runtime:0.9.0-cuda13 docker pull nvcr.io/nvidia/ai-dynamo/vllm-runtime:0.9.1-cuda13
docker pull nvcr.io/nvidia/ai-dynamo/sglang-runtime:0.9.0-cuda13 docker pull nvcr.io/nvidia/ai-dynamo/sglang-runtime:0.9.1-cuda13
# Infrastructure containers # Infrastructure containers
docker pull nvcr.io/nvidia/ai-dynamo/dynamo-frontend:0.9.0 docker pull nvcr.io/nvidia/ai-dynamo/dynamo-frontend:0.9.1
docker pull nvcr.io/nvidia/ai-dynamo/kubernetes-operator:0.9.0 docker pull nvcr.io/nvidia/ai-dynamo/kubernetes-operator:0.9.1
``` ```
### Python Wheels (PyPI) ### Python Wheels (PyPI)
...@@ -99,16 +99,16 @@ docker pull nvcr.io/nvidia/ai-dynamo/kubernetes-operator:0.9.0 ...@@ -99,16 +99,16 @@ docker pull nvcr.io/nvidia/ai-dynamo/kubernetes-operator:0.9.0
```bash ```bash
# Install Dynamo with a specific backend (Recommended) # Install Dynamo with a specific backend (Recommended)
uv pip install "ai-dynamo[vllm]==0.9.0" uv pip install "ai-dynamo[vllm]==0.9.1"
uv pip install "ai-dynamo[sglang]==0.9.0" uv pip install "ai-dynamo[sglang]==0.9.1"
# TensorRT-LLM requires the NVIDIA PyPI index and pip # TensorRT-LLM requires the NVIDIA PyPI index and pip
pip install --pre --extra-index-url https://pypi.nvidia.com "ai-dynamo[trtllm]==0.9.0" pip install --pre --extra-index-url https://pypi.nvidia.com "ai-dynamo[trtllm]==0.9.1"
# Install Dynamo core only # Install Dynamo core only
uv pip install ai-dynamo==0.9.0 uv pip install ai-dynamo==0.9.1
# Install standalone KVBM (Python 3.12 only) # Install standalone KVBM (Python 3.12 only)
uv pip install kvbm==0.9.0 uv pip install kvbm==0.9.1
``` ```
### Helm Charts (NGC) ### Helm Charts (NGC)
...@@ -116,8 +116,8 @@ uv pip install kvbm==0.9.0 ...@@ -116,8 +116,8 @@ uv pip install kvbm==0.9.0
> For Kubernetes deployment instructions, see the [Kubernetes Installation Guide](../kubernetes/installation-guide.md). > For Kubernetes deployment instructions, see the [Kubernetes Installation Guide](../kubernetes/installation-guide.md).
```bash ```bash
helm install dynamo-crds oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-crds --version 0.9.0 helm install dynamo-crds oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-crds --version 0.9.1
helm install dynamo-platform oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-platform --version 0.9.0-post1 helm install dynamo-platform oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/dynamo-platform --version 0.9.1
``` ```
### Rust Crates (crates.io) ### Rust Crates (crates.io)
...@@ -125,13 +125,13 @@ helm install dynamo-platform oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/d ...@@ -125,13 +125,13 @@ helm install dynamo-platform oci://helm.ngc.nvidia.com/nvidia/ai-dynamo/charts/d
> For API documentation, see each crate on [docs.rs](https://docs.rs/). To build Dynamo from source, see [Building from Source](https://github.com/ai-dynamo/dynamo#building-from-source). > For API documentation, see each crate on [docs.rs](https://docs.rs/). To build Dynamo from source, see [Building from Source](https://github.com/ai-dynamo/dynamo#building-from-source).
```bash ```bash
cargo add dynamo-runtime@0.9.0 cargo add dynamo-runtime@0.9.1
cargo add dynamo-llm@0.9.0 cargo add dynamo-llm@0.9.1
cargo add dynamo-async-openai@0.9.0 cargo add dynamo-async-openai@0.9.1
cargo add dynamo-parsers@0.9.0 cargo add dynamo-parsers@0.9.1
cargo add dynamo-memory@0.9.0 cargo add dynamo-memory@0.9.1
cargo add dynamo-config@0.9.0 cargo add dynamo-config@0.9.1
cargo add dynamo-tokens@0.9.0 cargo add dynamo-tokens@0.9.1
``` ```
**CUDA and Driver Requirements:** For detailed CUDA toolkit versions and minimum driver requirements for each container image, see the [Support Matrix](support-matrix.md#cuda-and-driver-requirements). **CUDA and Driver Requirements:** For detailed CUDA toolkit versions and minimum driver requirements for each container image, see the [Support Matrix](support-matrix.md#cuda-and-driver-requirements).
...@@ -155,6 +155,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -155,6 +155,7 @@ For a complete list of known issues, refer to the release notes for each version
## Release History ## Release History
- **v0.9.1**: Updated TRT-LLM to `v1.3.0rc3`. All other backend versions unchanged from v0.9.0.
- **v0.9.0.post1**: Fixed `dynamo-platform` Helm chart operator image tag (Helm chart only, NGC) - **v0.9.0.post1**: Fixed `dynamo-platform` Helm chart operator image tag (Helm chart only, NGC)
- **v0.9.0**: Updated vLLM to `v0.14.1`, SGLang to `v0.5.8`, TRT-LLM to `v1.3.0rc1`, NIXL to `v0.9.0`. New `dynamo-tokens` Rust crate. Deprecated `dynamo-graph` Helm chart. - **v0.9.0**: Updated vLLM to `v0.14.1`, SGLang to `v0.5.8`, TRT-LLM to `v1.3.0rc1`, NIXL to `v0.9.0`. New `dynamo-tokens` Rust crate. Deprecated `dynamo-graph` Helm chart.
- **v0.8.1.post1/.post2/.post3 Patches**: Experimental patch releases updating TRT-LLM only (PyPI wheels and TRT-LLM container). No other artifacts changed. - **v0.8.1.post1/.post2/.post3 Patches**: Experimental patch releases updating TRT-LLM only (PyPI wheels and TRT-LLM container). No other artifacts changed.
...@@ -166,7 +167,8 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -166,7 +167,8 @@ For a complete list of known issues, refer to the release notes for each version
| Version | Release Date | GitHub | Docs | | Version | Release Date | GitHub | Docs |
|---------|--------------|--------|------| |---------|--------------|--------|------|
| `v0.9.0` | Feb 11, 2026 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.9.0) | [Docs](https://docs.dynamo.nvidia.com/dynamo) | | `v0.9.1` | Mar 4, 2026 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.9.1) | [Docs](https://docs.dynamo.nvidia.com/dynamo) |
| `v0.9.0` | Feb 11, 2026 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.9.0) | [Docs](https://docs.dynamo.nvidia.com/dynamo/v-0-9-0/) |
| `v0.8.1` | Jan 23, 2026 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.8.1) | [Docs](https://docs.nvidia.com/dynamo/v-0-8-1/) | | `v0.8.1` | Jan 23, 2026 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.8.1) | [Docs](https://docs.nvidia.com/dynamo/v-0-8-1/) |
| `v0.8.0` | Jan 15, 2026 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.8.0) | [Docs](https://docs.nvidia.com/dynamo/v-0-8-0/) | | `v0.8.0` | Jan 15, 2026 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.8.0) | [Docs](https://docs.nvidia.com/dynamo/v-0-8-0/) |
| `v0.7.1` | Dec 15, 2025 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.7.1) | [Docs](https://docs.nvidia.com/dynamo/v-0-7-1/) | | `v0.7.1` | Dec 15, 2025 | [Release](https://github.com/ai-dynamo/dynamo/releases/tag/v0.7.1) | [Docs](https://docs.nvidia.com/dynamo/v-0-7-1/) |
...@@ -185,6 +187,8 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -185,6 +187,8 @@ For a complete list of known issues, refer to the release notes for each version
| Image:Tag | vLLM | Arch | CUDA | Notes | | Image:Tag | vLLM | Arch | CUDA | Notes |
|-----------|------|------|------|-------| |-----------|------|------|------|-------|
| `vllm-runtime:0.9.1` | `v0.14.1` | AMD64/ARM64 | `v12.9` | |
| `vllm-runtime:0.9.1-cuda13` | `v0.14.1` | AMD64/ARM64* | `v13.0` | Experimental |
| `vllm-runtime:0.9.0` | `v0.14.1` | AMD64/ARM64 | `v12.9` | | | `vllm-runtime:0.9.0` | `v0.14.1` | AMD64/ARM64 | `v12.9` | |
| `vllm-runtime:0.9.0-cuda13` | `v0.14.1` | AMD64/ARM64* | `v13.0` | Experimental | | `vllm-runtime:0.9.0-cuda13` | `v0.14.1` | AMD64/ARM64* | `v13.0` | Experimental |
| `vllm-runtime:0.8.1` | `v0.12.0` | AMD64/ARM64 | `v12.9` | | | `vllm-runtime:0.8.1` | `v0.12.0` | AMD64/ARM64 | `v12.9` | |
...@@ -202,6 +206,8 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -202,6 +206,8 @@ For a complete list of known issues, refer to the release notes for each version
| Image:Tag | SGLang | Arch | CUDA | Notes | | Image:Tag | SGLang | Arch | CUDA | Notes |
|-----------|--------|------|------|-------| |-----------|--------|------|------|-------|
| `sglang-runtime:0.9.1` | `v0.5.8` | AMD64/ARM64 | `v12.9` | |
| `sglang-runtime:0.9.1-cuda13` | `v0.5.8` | AMD64/ARM64* | `v13.0` | Experimental |
| `sglang-runtime:0.9.0` | `v0.5.8` | AMD64/ARM64 | `v12.9` | | | `sglang-runtime:0.9.0` | `v0.5.8` | AMD64/ARM64 | `v12.9` | |
| `sglang-runtime:0.9.0-cuda13` | `v0.5.8` | AMD64/ARM64* | `v13.0` | Experimental | | `sglang-runtime:0.9.0-cuda13` | `v0.5.8` | AMD64/ARM64* | `v13.0` | Experimental |
| `sglang-runtime:0.8.1` | `v0.5.6.post2` | AMD64/ARM64 | `v12.9` | | | `sglang-runtime:0.8.1` | `v0.5.6.post2` | AMD64/ARM64 | `v12.9` | |
...@@ -219,6 +225,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -219,6 +225,7 @@ For a complete list of known issues, refer to the release notes for each version
| Image:Tag | TRT-LLM | Arch | CUDA | Notes | | Image:Tag | TRT-LLM | Arch | CUDA | Notes |
|-----------|---------|------|------|-------| |-----------|---------|------|------|-------|
| `tensorrtllm-runtime:0.9.1` | `v1.3.0rc3` | AMD64/ARM64 | `v13.0` | |
| `tensorrtllm-runtime:0.9.0` | `v1.3.0rc1` | AMD64/ARM64 | `v13.0` | | | `tensorrtllm-runtime:0.9.0` | `v1.3.0rc1` | AMD64/ARM64 | `v13.0` | |
| `tensorrtllm-runtime:0.8.1.post3` | `v1.2.0rc6.post3` | AMD64/ARM64 | `v13.0` | Patch | | `tensorrtllm-runtime:0.8.1.post3` | `v1.2.0rc6.post3` | AMD64/ARM64 | `v13.0` | Patch |
| `tensorrtllm-runtime:0.8.1.post1` | `v1.2.0rc6.post2` | AMD64/ARM64 | `v13.0` | Patch | | `tensorrtllm-runtime:0.8.1.post1` | `v1.2.0rc6.post2` | AMD64/ARM64 | `v13.0` | Patch |
...@@ -237,6 +244,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -237,6 +244,7 @@ For a complete list of known issues, refer to the release notes for each version
| Image:Tag | Arch | Notes | | Image:Tag | Arch | Notes |
|-----------|------|-------| |-----------|------|-------|
| `dynamo-frontend:0.9.1` | AMD64/ARM64 | |
| `dynamo-frontend:0.9.0` | AMD64/ARM64 | | | `dynamo-frontend:0.9.0` | AMD64/ARM64 | |
| `dynamo-frontend:0.8.1` | AMD64/ARM64 | | | `dynamo-frontend:0.8.1` | AMD64/ARM64 | |
| `dynamo-frontend:0.8.0` | AMD64/ARM64 | Initial | | `dynamo-frontend:0.8.0` | AMD64/ARM64 | Initial |
...@@ -245,6 +253,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -245,6 +253,7 @@ For a complete list of known issues, refer to the release notes for each version
| Image:Tag | Arch | Notes | | Image:Tag | Arch | Notes |
|-----------|------|-------| |-----------|------|-------|
| `kubernetes-operator:0.9.1` | AMD64/ARM64 | |
| `kubernetes-operator:0.9.0` | AMD64/ARM64 | | | `kubernetes-operator:0.9.0` | AMD64/ARM64 | |
| `kubernetes-operator:0.8.1` | AMD64/ARM64 | | | `kubernetes-operator:0.8.1` | AMD64/ARM64 | |
| `kubernetes-operator:0.8.0` | AMD64/ARM64 | | | `kubernetes-operator:0.8.0` | AMD64/ARM64 | |
...@@ -264,6 +273,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -264,6 +273,7 @@ For a complete list of known issues, refer to the release notes for each version
| Package | Python | Platform | Notes | | Package | Python | Platform | Notes |
|---------|--------|----------|-------| |---------|--------|----------|-------|
| `ai-dynamo==0.9.1` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | |
| `ai-dynamo==0.9.0` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | | | `ai-dynamo==0.9.0` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | |
| `ai-dynamo==0.8.1.post3` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post3` | | `ai-dynamo==0.8.1.post3` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post3` |
| `ai-dynamo==0.8.1.post1` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post2` | | `ai-dynamo==0.8.1.post1` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post2` |
...@@ -278,6 +288,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -278,6 +288,7 @@ For a complete list of known issues, refer to the release notes for each version
| Package | Python | Platform | Notes | | Package | Python | Platform | Notes |
|---------|--------|----------|-------| |---------|--------|----------|-------|
| `ai-dynamo-runtime==0.9.1` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | |
| `ai-dynamo-runtime==0.9.0` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | | | `ai-dynamo-runtime==0.9.0` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | |
| `ai-dynamo-runtime==0.8.1.post3` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post3` | | `ai-dynamo-runtime==0.8.1.post3` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post3` |
| `ai-dynamo-runtime==0.8.1.post1` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post2` | | `ai-dynamo-runtime==0.8.1.post1` | `3.10`–`3.12` | Linux (glibc `v2.28+`) | TRT-LLM `v1.2.0rc6.post2` |
...@@ -292,6 +303,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -292,6 +303,7 @@ For a complete list of known issues, refer to the release notes for each version
| Package | Python | Platform | Notes | | Package | Python | Platform | Notes |
|---------|--------|----------|-------| |---------|--------|----------|-------|
| `kvbm==0.9.1` | `3.12` | Linux (glibc `v2.28+`) | |
| `kvbm==0.9.0` | `3.12` | Linux (glibc `v2.28+`) | | | `kvbm==0.9.0` | `3.12` | Linux (glibc `v2.28+`) | |
| `kvbm==0.8.1` | `3.12` | Linux (glibc `v2.28+`) | | | `kvbm==0.8.1` | `3.12` | Linux (glibc `v2.28+`) | |
| `kvbm==0.8.0` | `3.12` | Linux (glibc `v2.28+`) | | | `kvbm==0.8.0` | `3.12` | Linux (glibc `v2.28+`) | |
...@@ -308,6 +320,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -308,6 +320,7 @@ For a complete list of known issues, refer to the release notes for each version
| Chart | Notes | | Chart | Notes |
|-------|-------| |-------|-------|
| `dynamo-crds-0.9.1` | |
| `dynamo-crds-0.9.0` | | | `dynamo-crds-0.9.0` | |
| `dynamo-crds-0.8.1` | | | `dynamo-crds-0.8.1` | |
| `dynamo-crds-0.8.0` | | | `dynamo-crds-0.8.0` | |
...@@ -320,6 +333,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -320,6 +333,7 @@ For a complete list of known issues, refer to the release notes for each version
| Chart | Notes | | Chart | Notes |
|-------|-------| |-------|-------|
| `dynamo-platform-0.9.1` | |
| `dynamo-platform-0.9.0-post1` | Helm fix: operator image tag | | `dynamo-platform-0.9.0-post1` | Helm fix: operator image tag |
| `dynamo-platform-0.9.0` | | | `dynamo-platform-0.9.0` | |
| `dynamo-platform-0.8.1` | | | `dynamo-platform-0.8.1` | |
...@@ -352,6 +366,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -352,6 +366,7 @@ For a complete list of known issues, refer to the release notes for each version
| Crate | MSRV (Rust) | Notes | | Crate | MSRV (Rust) | Notes |
|-------|-------------|-------| |-------|-------------|-------|
| `dynamo-runtime@0.9.1` | `v1.82` | |
| `dynamo-runtime@0.9.0` | `v1.82` | | | `dynamo-runtime@0.9.0` | `v1.82` | |
| `dynamo-runtime@0.8.1` | `v1.82` | | | `dynamo-runtime@0.8.1` | `v1.82` | |
| `dynamo-runtime@0.8.0` | `v1.82` | | | `dynamo-runtime@0.8.0` | `v1.82` | |
...@@ -364,6 +379,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -364,6 +379,7 @@ For a complete list of known issues, refer to the release notes for each version
| Crate | MSRV (Rust) | Notes | | Crate | MSRV (Rust) | Notes |
|-------|-------------|-------| |-------|-------------|-------|
| `dynamo-llm@0.9.1` | `v1.82` | |
| `dynamo-llm@0.9.0` | `v1.82` | | | `dynamo-llm@0.9.0` | `v1.82` | |
| `dynamo-llm@0.8.1` | `v1.82` | | | `dynamo-llm@0.8.1` | `v1.82` | |
| `dynamo-llm@0.8.0` | `v1.82` | | | `dynamo-llm@0.8.0` | `v1.82` | |
...@@ -376,6 +392,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -376,6 +392,7 @@ For a complete list of known issues, refer to the release notes for each version
| Crate | MSRV (Rust) | Notes | | Crate | MSRV (Rust) | Notes |
|-------|-------------|-------| |-------|-------------|-------|
| `dynamo-async-openai@0.9.1` | `v1.82` | |
| `dynamo-async-openai@0.9.0` | `v1.82` | | | `dynamo-async-openai@0.9.0` | `v1.82` | |
| `dynamo-async-openai@0.8.1` | `v1.82` | | | `dynamo-async-openai@0.8.1` | `v1.82` | |
| `dynamo-async-openai@0.8.0` | `v1.82` | | | `dynamo-async-openai@0.8.0` | `v1.82` | |
...@@ -388,6 +405,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -388,6 +405,7 @@ For a complete list of known issues, refer to the release notes for each version
| Crate | MSRV (Rust) | Notes | | Crate | MSRV (Rust) | Notes |
|-------|-------------|-------| |-------|-------------|-------|
| `dynamo-parsers@0.9.1` | `v1.82` | |
| `dynamo-parsers@0.9.0` | `v1.82` | | | `dynamo-parsers@0.9.0` | `v1.82` | |
| `dynamo-parsers@0.8.1` | `v1.82` | | | `dynamo-parsers@0.8.1` | `v1.82` | |
| `dynamo-parsers@0.8.0` | `v1.82` | | | `dynamo-parsers@0.8.0` | `v1.82` | |
...@@ -400,6 +418,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -400,6 +418,7 @@ For a complete list of known issues, refer to the release notes for each version
| Crate | MSRV (Rust) | Notes | | Crate | MSRV (Rust) | Notes |
|-------|-------------|-------| |-------|-------------|-------|
| `dynamo-memory@0.9.1` | `v1.82` | |
| `dynamo-memory@0.9.0` | `v1.82` | | | `dynamo-memory@0.9.0` | `v1.82` | |
| `dynamo-memory@0.8.1` | `v1.82` | | | `dynamo-memory@0.8.1` | `v1.82` | |
| `dynamo-memory@0.8.0` | `v1.82` | Initial | | `dynamo-memory@0.8.0` | `v1.82` | Initial |
...@@ -408,6 +427,7 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -408,6 +427,7 @@ For a complete list of known issues, refer to the release notes for each version
| Crate | MSRV (Rust) | Notes | | Crate | MSRV (Rust) | Notes |
|-------|-------------|-------| |-------|-------------|-------|
| `dynamo-config@0.9.1` | `v1.82` | |
| `dynamo-config@0.9.0` | `v1.82` | | | `dynamo-config@0.9.0` | `v1.82` | |
| `dynamo-config@0.8.1` | `v1.82` | | | `dynamo-config@0.8.1` | `v1.82` | |
| `dynamo-config@0.8.0` | `v1.82` | Initial | | `dynamo-config@0.8.0` | `v1.82` | Initial |
...@@ -416,4 +436,5 @@ For a complete list of known issues, refer to the release notes for each version ...@@ -416,4 +436,5 @@ For a complete list of known issues, refer to the release notes for each version
| Crate | MSRV (Rust) | Notes | | Crate | MSRV (Rust) | Notes |
|-------|-------------|-------| |-------|-------------|-------|
| `dynamo-tokens@0.9.1` | `v1.82` | |
| `dynamo-tokens@0.9.0` | `v1.82` | Initial | | `dynamo-tokens@0.9.0` | `v1.82` | Initial |
docs/reference/support-matrix.md
View file @ 3ec78ec3
...@@ -9,7 +9,7 @@ subtitle: Hardware, software, and build compatibility for Dynamo ...@@ -9,7 +9,7 @@ subtitle: Hardware, software, and build compatibility for Dynamo
## At a Glance ## At a Glance
**Latest stable release:** [v0.9.0](https://github.com/ai-dynamo/dynamo/releases/tag/v0.9.0) -- SGLang `0.5.8` | TensorRT-LLM `1.3.0rc1` | vLLM `0.14.1` | NIXL `0.9.0` **Latest stable release:** [v0.9.1](https://github.com/ai-dynamo/dynamo/releases/tag/v0.9.1) -- SGLang `0.5.8` | TensorRT-LLM `1.3.0rc3` | vLLM `0.14.1` | NIXL `0.9.0`
| Requirement | Supported | | Requirement | Supported |
| :--- | :--- | | :--- | :--- |
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment