Unverified Commit 67fc3b8c authored by Harrison Saturley-Hall's avatar Harrison Saturley-Hall Committed by GitHub
Browse files

chore: merge in support matrix and nixl commit hash (#944)


Signed-off-by: default avatarHarrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
Co-authored-by: default avatarAnant Sharma <anants@nvidia.com>
parent 9d643f1e
...@@ -67,7 +67,7 @@ VLLM_BASE_IMAGE_TAG="25.03-cuda12.8-devel-ubuntu24.04" ...@@ -67,7 +67,7 @@ VLLM_BASE_IMAGE_TAG="25.03-cuda12.8-devel-ubuntu24.04"
NONE_BASE_IMAGE="ubuntu" NONE_BASE_IMAGE="ubuntu"
NONE_BASE_IMAGE_TAG="24.04" NONE_BASE_IMAGE_TAG="24.04"
NIXL_COMMIT=3810b36b1ad0b647488e163f0f4e8dfc22ffabdf NIXL_COMMIT=d247e88c72db75dc00e4e37aa21ed8d99e60c27d
NIXL_REPO=ai-dynamo/nixl.git NIXL_REPO=ai-dynamo/nixl.git
get_options() { get_options() {
......
...@@ -38,23 +38,23 @@ If you are using a **GPU**, the following GPU models and architectures are suppo ...@@ -38,23 +38,23 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
## Software Compatibility ## Software Compatibility
### Runtime Dependency ### Runtime Dependency
| **Python Package** | **Version** | glibc version | | **Python Package** | **Version** | glibc version | CUDA Version |
|--------------------|---------------|----------------------| |--------------------|---------------|----------------------|--------------|
| ai-dynamo | 0.1.1 | >=2.28 | | ai-dynamo | 0.2.0 | >=2.28 | |
| ai-dynamo-runtime | 0.1.1 | >=2.28 | | ai-dynamo-runtime | 0.2.0 | >=2.28 | |
| ai-dynamo-vllm | 0.7.2.post1* | >=2.28 (recommended) | | ai-dynamo-vllm | 0.8.4* | >=2.28 (recommended) | |
| NIXL | 0.1.1 | >=2.27 | | NIXL | 0.2.0 | >=2.27 | >=11.8 |
### Build Dependency ### Build Dependency
| **Build Dependency** | **Version** | | **Build Dependency** | **Version** |
|----------------------|-------------| |----------------------|-------------|
| **Base Container** | [25.01](https://hub.docker.com/layers/nvidia/cuda/12.8.1-runtime-ubuntu24.04/images/sha256-828c4d878adcaa4265d80c95d8ec877149b49bb2419a4cf3bb6aa889bbb7ca2e) | | **Base Container** | [25.03](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/cuda-dl-base/tags) |
| **ai-dynamo-vllm** |0.7.2.post1* | | **ai-dynamo-vllm** |0.8.4* |
| **TensorRT-LLM** | 0.19.0** | | **TensorRT-LLM** | 0.19.0** |
| **NIXL** | 0.1.1 | | **NIXL** | 0.2.0 |
> **Note**: > **Note**:
> - *ai-dynamo-vllm v0.7.2.post1* is a customized patch of v0.7.2 from vLLM. > - *ai-dynamo-vllm v0.8.4 is a customized patch of v0.8.4 from vLLM.
> - **The specific version of TensorRT-LLM (planned v0.19.0) that will be supported by Dynamo is subject to change. > - **The specific version of TensorRT-LLM (planned v0.19.0) that will be supported by Dynamo is subject to change.
...@@ -62,6 +62,6 @@ If you are using a **GPU**, the following GPU models and architectures are suppo ...@@ -62,6 +62,6 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
**Dynamo** currently provides build support in the following ways: **Dynamo** currently provides build support in the following ways:
- **Wheels**: Pre-built Python wheels are only available for **x86_64 Linux**. No wheels are available for other platforms at this time. - **Wheels**: Pre-built Python wheels are only available for **x86_64 Linux**. No wheels are available for other platforms at this time.
- **Container Images**: We distribute only the source code for container images, and only **x86_64 Linux** is supported for these. Users must build the container image from source if they require it. - **Container Images**: We distribute only the source code for container images, **x86_64 Linux** and **ARM64** are supported for these. Users must build the container image from source if they require it.
Once you've confirmed that your platform and architecture are compatible, you can install **Dynamo** by following the instructions in the [Quick Start Guide](https://github.com/ai-dynamo/dynamo/blob/main/README.md#installation). Once you've confirmed that your platform and architecture are compatible, you can install **Dynamo** by following the instructions in the [Quick Start Guide](https://github.com/ai-dynamo/dynamo/blob/main/README.md#installation).
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment