Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
f919d4cb
Unverified
Commit
f919d4cb
authored
Aug 10, 2025
by
Eugene Cheah
Committed by
GitHub
Aug 10, 2025
Browse files
[BugFix] Fix logits repetition penalty cuda check (#22592)
parent
afa5b7ca
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
vllm/_custom_ops.py
vllm/_custom_ops.py
+1
-1
No files found.
vllm/_custom_ops.py
View file @
f919d4cb
...
...
@@ -311,7 +311,7 @@ def apply_repetition_penalties(logits: torch.Tensor, prompt_mask: torch.Tensor,
output_mask: A boolean tensor indicating which tokens appear in the output.
repetition_penalties: The repetition penalties of shape (num_seqs, ).
"""
if
current_platform
.
is_cuda
()
and
logits
.
is_contiguous
():
if
logits
.
is_cuda
and
logits
.
is_contiguous
():
apply_repetition_penalties_cuda
(
logits
,
prompt_mask
,
output_mask
,
repetition_penalties
)
else
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment