Unverified Commit 5cdd6645 authored by Lucas Wilkinson's avatar Lucas Wilkinson Committed by GitHub
Browse files

[BugFix] Fix assert in `build_for_cudagraph_capture` (#29893)


Signed-off-by: default avatarLucas Wilkinson <lwilkins@redhat.com>
parent 5f67361f
......@@ -4000,7 +4000,7 @@ class GPUModelRunner(
num_reqs=num_reqs_padded,
max_query_len=max_query_len,
ubatch_slices=ubatch_slices,
for_cudagraph_capture=True,
for_cudagraph_capture=is_graph_capturing,
)
with self.maybe_dummy_run_with_lora(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment