"docs/vscode:/vscode.git/clone" did not exist on "eb0bf24e8231f40415c2fc86a5a8d4cd79a55359"
Unverified Commit 93c81420 authored by dagil-nvidia's avatar dagil-nvidia Committed by GitHub
Browse files

docs: update TensorRT-LLM commit for NIXL to v1.2.0rc2 (#4582)


Signed-off-by: default avatarDan Gil <dagil@nvidia.com>
parent 51c1b9f1
......@@ -47,7 +47,7 @@ To enable NIXL for KV cache transfer in disaggregated serving:
```bash
./container/build.sh --framework trtllm \
--tensorrtllm-git-url https://github.com/NVIDIA/TensorRT-LLM.git \
--tensorrtllm-commit main
--tensorrtllm-commit v1.2.0rc2
```
2. **Run the containerized environment:**
......
......@@ -8,7 +8,7 @@ This is an experimental feature that requires using a specific TensorRT-LLM comm
To enable it build the dynamo container with the `--tensorrtllm-commit` flag, followed by the commit hash:
```bash
./container/build.sh --framework trtllm --tensorrtllm-git-url https://github.com/NVIDIA/TensorRT-LLM.git --tensorrtllm-commit main
./container/build.sh --framework trtllm --tensorrtllm-git-url https://github.com/NVIDIA/TensorRT-LLM.git --tensorrtllm-commit v1.2.0rc2
```
## Key Features
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment