Skip to content

GitLab

Unverified Commit 5c48130d authored by Tanmay Verma's avatar Tanmay Verma Committed by GitHub
Browse files

fix: remove cutlass-dsl stub that crashes TRT-LLM on CUDA 13.1 (#7372)

parent bba70a41
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 1 deletion
container/templates/trtllm_runtime.Dockerfile
View file @ 5c48130d
...@@ -280,7 +280,11 @@ RUN --mount=type=bind,source=./container/deps/requirements.common.txt,target=/tm ...@@ -280,7 +280,11 @@ RUN --mount=type=bind,source=./container/deps/requirements.common.txt,target=/tm
--requirement /tmp/requirements.common.txt \ --requirement /tmp/requirements.common.txt \
--requirement /tmp/requirements.planner.txt \ --requirement /tmp/requirements.planner.txt \
--requirement /tmp/requirements.benchmark.txt \ --requirement /tmp/requirements.benchmark.txt \
cupy-cuda13x cupy-cuda13x && \
# nvidia-cutlass-dsl-libs-base==4.4.1 (transitive dep) ships a stub cute/experimental/__init__.py
# that unconditionally raises NotImplementedError, crashing TRT-LLM on import. cutlass-dsl==4.3.4
# (pinned by TRT-LLM) works without cute/experimental/. Remove the stub to fix the NotImplementedError.
rm -rf ${VIRTUAL_ENV}/lib/python${PYTHON_VERSION}/site-packages/nvidia_cutlass_dsl/python_packages/cutlass/cute/experimental/
# Copy tests, deploy and components for CI with correct ownership # Copy tests, deploy and components for CI with correct ownership
# Pattern: COPY --chmod=775 <path>; chmod g+w <path> done later as root because COPY --chmod only affects <path>/*, not <path> # Pattern: COPY --chmod=775 <path>; chmod g+w <path> done later as root because COPY --chmod only affects <path>/*, not <path>
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment