Skip to content

GitLab

Unverified Commit 9511a3f8 authored by Lucas Wilkinson's avatar Lucas Wilkinson Committed by GitHub
Browse files

[Bugfix] Fix AttributeError in SMControlContextManager (#35338) 


Signed-off-by: default avatarLucas Wilkinson <lwilkins@redhat.com>
parent de527e1c
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/worker/gpu_ubatch_wrapper.py
View file @ 9511a3f8
...@@ -74,7 +74,7 @@ class SMControlContextManager: ...@@ -74,7 +74,7 @@ class SMControlContextManager:
"SM control is currently only supported on CUDA" "SM control is currently only supported on CUDA"
) )
total_sms = num_compute_units(torch.cuda.current_device().index) total_sms = num_compute_units(torch.cuda.current_device())
assert comm_sms < total_sms assert comm_sms < total_sms
self.total_sms = total_sms self.total_sms = total_sms
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment