Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
ad388d25
Unverified
Commit
ad388d25
authored
Jan 15, 2025
by
Keyun Tong
Committed by
GitHub
Jan 15, 2025
Browse files
Type-fix: make execute_model output type optional (#12020)
parent
cbe94391
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
1 deletion
+2
-1
vllm/v1/executor/uniproc_executor.py
vllm/v1/executor/uniproc_executor.py
+1
-0
vllm/v1/worker/gpu_worker.py
vllm/v1/worker/gpu_worker.py
+1
-1
No files found.
vllm/v1/executor/uniproc_executor.py
View file @
ad388d25
...
...
@@ -70,6 +70,7 @@ class UniprocExecutor(Executor):
scheduler_output
,
)
->
ModelRunnerOutput
:
output
=
self
.
worker
.
execute_model
(
scheduler_output
)
assert
output
is
not
None
return
output
def
profile
(
self
,
is_start
:
bool
=
True
):
...
...
vllm/v1/worker/gpu_worker.py
View file @
ad388d25
...
...
@@ -200,7 +200,7 @@ class Worker:
def
execute_model
(
self
,
scheduler_output
:
"SchedulerOutput"
,
)
->
ModelRunnerOutput
:
)
->
Optional
[
ModelRunnerOutput
]
:
output
=
self
.
model_runner
.
execute_model
(
scheduler_output
)
return
output
if
self
.
rank
==
0
else
None
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment