Skip to content

GitLab

"lib/llm/vscode:/vscode.git/clone" did not exist on "38cf0f8ddb3ce4a80db0b91039cbb95bab8cbce9"
Unverified Commit f0709194 authored by Tushar Sharma's avatar Tushar Sharma Committed by GitHub
Browse files

fix: copy wheel from trtllm wheel stage (#3256) 


Signed-off-by: default avatarTushar Sharma <tusharma@nvidia.com>
parent 1a5016b0
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
container/Dockerfile.trtllm
View file @ f0709194
...@@ -181,6 +181,8 @@ ARG HAS_TRTLLM_CONTEXT ...@@ -181,6 +181,8 @@ ARG HAS_TRTLLM_CONTEXT
ARG TENSORRTLLM_PIP_WHEEL ARG TENSORRTLLM_PIP_WHEEL
ARG TENSORRTLLM_INDEX_URL ARG TENSORRTLLM_INDEX_URL
# Copy only wheel files from trtllm_wheel stage from build_context
COPY --from=trtllm_wheel /*.whl /trtllm_wheel/
# Note: TensorRT needs to be uninstalled before installing the TRTLLM wheel # Note: TensorRT needs to be uninstalled before installing the TRTLLM wheel
# because there might be mismatched versions of TensorRT between the NGC PyTorch # because there might be mismatched versions of TensorRT between the NGC PyTorch
# and the TRTLLM wheel. # and the TRTLLM wheel.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment