Unverified Commit e8c87f17 authored by Neelay Shah's avatar Neelay Shah Committed by GitHub
Browse files

docs: Update TensorRT-LLM install prerequisites for 1.2.0rc5 (#5194)


Co-authored-by: default avatarClaude Opus 4.5 <noreply@anthropic.com>
parent c90b87e2
...@@ -235,7 +235,7 @@ It is recommended to use [NGC PyTorch Container](https://catalog.ngc.nvidia.com/ ...@@ -235,7 +235,7 @@ It is recommended to use [NGC PyTorch Container](https://catalog.ngc.nvidia.com/
> [!Note] > [!Note]
> Ensure that you select a PyTorch container image version that matches the version of TensorRT-LLM you are using. > Ensure that you select a PyTorch container image version that matches the version of TensorRT-LLM you are using.
> For example, if you are using `tensorrt-llm==1.1.0rc5`, use the PyTorch container image version `25.06`. > For example, if you are using `tensorrt-llm==1.2.0rc5`, use the PyTorch container image version `25.10`.
> To find the correct PyTorch container version for your desired `tensorrt-llm` release, visit the [TensorRT-LLM Dockerfile.multi](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docker/Dockerfile.multi) on GitHub. Switch to the branch that matches your `tensorrt-llm` version, and look for the `BASE_TAG` line to identify the recommended PyTorch container tag. > To find the correct PyTorch container version for your desired `tensorrt-llm` release, visit the [TensorRT-LLM Dockerfile.multi](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docker/Dockerfile.multi) on GitHub. Switch to the branch that matches your `tensorrt-llm` version, and look for the `BASE_TAG` line to identify the recommended PyTorch container tag.
> [!Important] > [!Important]
...@@ -244,13 +244,13 @@ It is recommended to use [NGC PyTorch Container](https://catalog.ngc.nvidia.com/ ...@@ -244,13 +244,13 @@ It is recommended to use [NGC PyTorch Container](https://catalog.ngc.nvidia.com/
### Install prerequisites ### Install prerequisites
``` ```
# Optional step: Only required for Blackwell and Grace Hopper # Optional step: Only required for non-container installations. The PyTorch 25.10 container already includes PyTorch 2.9.0 with CUDA 13.0.
uv pip install torch==2.7.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128 uv pip install torch==2.9.0 torchvision --index-url https://download.pytorch.org/whl/cu130
# Required until the trtllm version is bumped to include this pinned dependency itself
uv pip install "cuda-python>=12,<13"
sudo apt-get -y install libopenmpi-dev sudo apt-get -y install libopenmpi-dev
# Optional step: Only required for disaggregated serving
sudo apt-get -y install libzmq3-dev
``` ```
> [!Tip] > [!Tip]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment