Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
4fd4d53d
Unverified
Commit
4fd4d53d
authored
May 15, 2025
by
Tanmay Verma
Committed by
GitHub
May 15, 2025
Browse files
chore: Update TensorRT-LLM version to latest (#1105)
parent
b6774b88
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
7 additions
and
3 deletions
+7
-3
container/Dockerfile.tensorrt_llm
container/Dockerfile.tensorrt_llm
+5
-1
container/build.sh
container/build.sh
+2
-2
No files found.
container/Dockerfile.tensorrt_llm
View file @
4fd4d53d
...
@@ -14,7 +14,7 @@
...
@@ -14,7 +14,7 @@
# limitations under the License.
# limitations under the License.
ARG BASE_IMAGE="nvcr.io/nvidia/pytorch"
ARG BASE_IMAGE="nvcr.io/nvidia/pytorch"
ARG BASE_IMAGE_TAG="25.0
3
-py3"
ARG BASE_IMAGE_TAG="25.0
4
-py3"
ARG RELEASE_BUILD
ARG RELEASE_BUILD
# Define general architecture ARGs for supporting both x86 and aarch64 builds.
# Define general architecture ARGs for supporting both x86 and aarch64 builds.
...
@@ -141,7 +141,11 @@ COPY --from=trtllm_wheel . /trtllm_wheel/
...
@@ -141,7 +141,11 @@ COPY --from=trtllm_wheel . /trtllm_wheel/
# TODO: Currently, ABI compatibility issues with TRTLLM wheel and NGC PyTorch prevent us
# TODO: Currently, ABI compatibility issues with TRTLLM wheel and NGC PyTorch prevent us
# from using the TRTLLM wheel in a uv venv. Once the issues are resolved, we can
# from using the TRTLLM wheel in a uv venv. Once the issues are resolved, we can
# use uv to install TensorRT-LLM wheel within the uv venv.
# use uv to install TensorRT-LLM wheel within the uv venv.
# Note: TensorRT needs to be uninstalled before installing the TRTLLM wheel
# because there might be mismatched versions of TensorRT between the NGC PyTorch
# and the TRTLLM wheel.
RUN [ -f /etc/pip/constraint.txt ] && : > /etc/pip/constraint.txt || true && \
RUN [ -f /etc/pip/constraint.txt ] && : > /etc/pip/constraint.txt || true && \
pip uninstall -y tensorrt && \
if [ "$HAS_TRTLLM_CONTEXT" = "1" ]; then \
if [ "$HAS_TRTLLM_CONTEXT" = "1" ]; then \
# Install from local wheel directory in build context
# Install from local wheel directory in build context
WHEEL_FILE=$(find /trtllm_wheel -name "*.whl" | head -n 1); \
WHEEL_FILE=$(find /trtllm_wheel -name "*.whl" | head -n 1); \
...
...
container/build.sh
View file @
4fd4d53d
...
@@ -58,7 +58,7 @@ BUILD_CONTEXT=$(dirname "$(readlink -f "$SOURCE_DIR")")
...
@@ -58,7 +58,7 @@ BUILD_CONTEXT=$(dirname "$(readlink -f "$SOURCE_DIR")")
# Base Images
# Base Images
TENSORRTLLM_BASE_IMAGE
=
nvcr.io/nvidia/pytorch
TENSORRTLLM_BASE_IMAGE
=
nvcr.io/nvidia/pytorch
TENSORRTLLM_BASE_IMAGE_TAG
=
25.0
3
-py3
TENSORRTLLM_BASE_IMAGE_TAG
=
25.0
4
-py3
# Important Note: Because of ABI compatibility issues between TensorRT-LLM and NGC PyTorch,
# Important Note: Because of ABI compatibility issues between TensorRT-LLM and NGC PyTorch,
# we need to build the TensorRT-LLM wheel from source.
# we need to build the TensorRT-LLM wheel from source.
...
@@ -88,7 +88,7 @@ TENSORRTLLM_PIP_WHEEL_DIR="/tmp/trtllm_wheel/"
...
@@ -88,7 +88,7 @@ TENSORRTLLM_PIP_WHEEL_DIR="/tmp/trtllm_wheel/"
# TensorRT-LLM commit to use for building the trtllm wheel if not provided.
# TensorRT-LLM commit to use for building the trtllm wheel if not provided.
# Important Note: This commit is not used in our CI pipeline. See the CI
# Important Note: This commit is not used in our CI pipeline. See the CI
# variables to learn how to run a pipeline with a specific commit.
# variables to learn how to run a pipeline with a specific commit.
TRTLLM_COMMIT
=
83f37614ef735d251281136c3c05b1fecf8ef68b
TRTLLM_COMMIT
=
290649b6aaed5f233b0a0adf50edc1347f8d2b14
# TensorRT-LLM PyPI index URL
# TensorRT-LLM PyPI index URL
TENSORRTLLM_INDEX_URL
=
"https://pypi.python.org/simple"
TENSORRTLLM_INDEX_URL
=
"https://pypi.python.org/simple"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment