Skip to content

GitLab

Commit ba33b2bd authored by Dmitry Tokarev's avatar Dmitry Tokarev Committed by GitHub
Browse files

docs: proper installation steps + Ubuntu 24.04 support (#275) 


Co-authored-by: default avatarAnant Sharma <anants@nvidia.com>
parent 004b6e6a
Hide whitespace changes
Inline Side-by-side
Showing with 14 additions and 11 deletions
README.md
View file @ ba33b2bd
...@@ -36,10 +36,13 @@ Built in Rust for performance and in Python for extensibility, Dynamo is fully o ...@@ -36,10 +36,13 @@ Built in Rust for performance and in Python for extensibility, Dynamo is fully o
### Installation ### Installation
The following examples require a few system level packages. The following examples require a few system level packages.
Recommended to use Ubuntu 24.04 with a x86_64 CPU. See [support_matrix.md](support_matrix.md)
``` ```
apt-get update apt-get update
DEBIAN_FRONTEND=noninteractive apt-get install -yq python3-dev python3-pip libucx0 DEBIAN_FRONTEND=noninteractive apt-get install -yq python3-dev python3-pip python3-venv libucx0
python3 -m venv venv
source venv/bin/activate
pip install ai-dynamo[all] pip install ai-dynamo[all]
``` ```
......
support_matrix.md
View file @ ba33b2bd
...@@ -27,21 +27,21 @@ If you are using a **GPU**, the following GPU models and architectures are suppo ...@@ -27,21 +27,21 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
**Dynamo** is compatible with the following platforms: **Dynamo** is compatible with the following platforms:
| **Operating System** | **Architecture** | **Status** | | **Operating System** | **Version** | **Architecture** | **Status** |
|------------------------|--------------------|-------------------------| |----------------------|-------------|------------------|--------------|
| **Linux** | x86_64 | Supported | | **Ubuntu** | 24.04 | x86_64 | Supported |
| **Linux** | ARM64 | Experimental | | **Ubuntu** | 24.04 | ARM64 | Experimental |
> **Note**: For **Linux**, the **ARM64** support is experimental and may have limitations. > **Note**: For **Linux**, the **ARM64** support is experimental and may have limitations.
## Software Compatibility ## Software Compatibility
| **Dependency** | **Version** | | **Build Dependency** | **Version** |
|------------------|-------------| |----------------------|-------------|
|**Base Container**| 25.01 | | **Base Container** | [25.01](https://hub.docker.com/layers/nvidia/cuda/12.8.1-runtime-ubuntu24.04/images/sha256-828c4d878adcaa4265d80c95d8ec877149b49bb2419a4cf3bb6aa889bbb7ca2e) |
|**ai-dynamo-vllm**| 0.7.2* | | **ai-dynamo-vllm** | 0.7.2* |
|**TensorRT-LLM** | 0.19.0** | | **TensorRT-LLM** | 0.19.0** |
|**NIXL** | 0.1.0 | | **NIXL** | 0.1.0 |
> **Note**: > **Note**:
> - *ai-dynamo-vllm v0.7.2 is a customized patch of v0.7.2 from vLLM. > - *ai-dynamo-vllm v0.7.2 is a customized patch of v0.7.2 from vLLM.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment