Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e535d90d
Unverified
Commit
e535d90d
authored
Feb 01, 2026
by
Nick Hill
Committed by
GitHub
Feb 01, 2026
Browse files
[ModelRunner V2] Misc minor simplifications and optimizations (#33467)
Signed-off-by:
Nick Hill
<
nickhill123@gmail.com
>
parent
0b225fb7
Changes
21
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
6 deletions
+1
-6
vllm/v1/worker/gpu/structured_outputs.py
vllm/v1/worker/gpu/structured_outputs.py
+1
-6
No files found.
vllm/v1/worker/gpu/structured_outputs.py
View file @
e535d90d
...
@@ -10,12 +10,7 @@ from vllm.v1.worker.gpu.input_batch import InputBatch
...
@@ -10,12 +10,7 @@ from vllm.v1.worker.gpu.input_batch import InputBatch
class
StructuredOutputsWorker
:
class
StructuredOutputsWorker
:
def
__init__
(
def
__init__
(
self
,
max_num_logits
:
int
,
vocab_size
:
int
,
device
:
torch
.
device
):
self
,
max_num_logits
:
int
,
vocab_size
:
int
,
device
:
torch
.
device
,
):
self
.
logits_indices
=
torch
.
zeros
(
self
.
logits_indices
=
torch
.
zeros
(
max_num_logits
,
dtype
=
torch
.
int32
,
device
=
device
max_num_logits
,
dtype
=
torch
.
int32
,
device
=
device
)
)
...
...
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment