Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
40218a82
Unverified
Commit
40218a82
authored
Feb 06, 2026
by
Nick Hill
Committed by
GitHub
Feb 07, 2026
Browse files
[ModelRunner V2] Revert token rank comparison difference for now (#34017)
Signed-off-by:
Nick Hill
<
nickhill123@gmail.com
>
parent
1c3b2205
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
vllm/v1/worker/gpu/sample/logprob.py
vllm/v1/worker/gpu/sample/logprob.py
+1
-1
No files found.
vllm/v1/worker/gpu/sample/logprob.py
View file @
40218a82
...
...
@@ -68,7 +68,7 @@ def _ranks_kernel(
for
i
in
range
(
0
,
vocab_size
,
BLOCK_SIZE
):
block
=
i
+
tl
.
arange
(
0
,
BLOCK_SIZE
)
logits
=
tl
.
load
(
row_ptr
+
block
,
mask
=
block
<
vocab_size
,
other
=
float
(
"-inf"
))
n
+=
tl
.
sum
((
logits
>
x
).
to
(
tl
.
int32
))
n
+=
tl
.
sum
((
logits
>
=
x
).
to
(
tl
.
int32
))
tl
.
store
(
output_ptr
+
req_idx
,
n
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment