Unverified Commit 67fc3b8c authored by Harrison Saturley-Hall's avatar Harrison Saturley-Hall Committed by GitHub
Browse files

chore: merge in support matrix and nixl commit hash (#944)


Signed-off-by: default avatarHarrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
Co-authored-by: default avatarAnant Sharma <anants@nvidia.com>
parent 9d643f1e
......@@ -67,7 +67,7 @@ VLLM_BASE_IMAGE_TAG="25.03-cuda12.8-devel-ubuntu24.04"
NONE_BASE_IMAGE="ubuntu"
NONE_BASE_IMAGE_TAG="24.04"
NIXL_COMMIT=3810b36b1ad0b647488e163f0f4e8dfc22ffabdf
NIXL_COMMIT=d247e88c72db75dc00e4e37aa21ed8d99e60c27d
NIXL_REPO=ai-dynamo/nixl.git
get_options() {
......
......@@ -38,23 +38,23 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
## Software Compatibility
### Runtime Dependency
| **Python Package** | **Version** | glibc version |
|--------------------|---------------|----------------------|
| ai-dynamo | 0.1.1 | >=2.28 |
| ai-dynamo-runtime | 0.1.1 | >=2.28 |
| ai-dynamo-vllm | 0.7.2.post1* | >=2.28 (recommended) |
| NIXL | 0.1.1 | >=2.27 |
| **Python Package** | **Version** | glibc version | CUDA Version |
|--------------------|---------------|----------------------|--------------|
| ai-dynamo | 0.2.0 | >=2.28 | |
| ai-dynamo-runtime | 0.2.0 | >=2.28 | |
| ai-dynamo-vllm | 0.8.4* | >=2.28 (recommended) | |
| NIXL | 0.2.0 | >=2.27 | >=11.8 |
### Build Dependency
| **Build Dependency** | **Version** |
|----------------------|-------------|
| **Base Container** | [25.01](https://hub.docker.com/layers/nvidia/cuda/12.8.1-runtime-ubuntu24.04/images/sha256-828c4d878adcaa4265d80c95d8ec877149b49bb2419a4cf3bb6aa889bbb7ca2e) |
| **ai-dynamo-vllm** |0.7.2.post1* |
| **Base Container** | [25.03](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/cuda-dl-base/tags) |
| **ai-dynamo-vllm** |0.8.4* |
| **TensorRT-LLM** | 0.19.0** |
| **NIXL** | 0.1.1 |
| **NIXL** | 0.2.0 |
> **Note**:
> - *ai-dynamo-vllm v0.7.2.post1* is a customized patch of v0.7.2 from vLLM.
> - *ai-dynamo-vllm v0.8.4 is a customized patch of v0.8.4 from vLLM.
> - **The specific version of TensorRT-LLM (planned v0.19.0) that will be supported by Dynamo is subject to change.
......@@ -62,6 +62,6 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
**Dynamo** currently provides build support in the following ways:
- **Wheels**: Pre-built Python wheels are only available for **x86_64 Linux**. No wheels are available for other platforms at this time.
- **Container Images**: We distribute only the source code for container images, and only **x86_64 Linux** is supported for these. Users must build the container image from source if they require it.
- **Container Images**: We distribute only the source code for container images, **x86_64 Linux** and **ARM64** are supported for these. Users must build the container image from source if they require it.
Once you've confirmed that your platform and architecture are compatible, you can install **Dynamo** by following the instructions in the [Quick Start Guide](https://github.com/ai-dynamo/dynamo/blob/main/README.md#installation).
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment