Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
907f935d
Unverified
Commit
907f935d
authored
May 21, 2025
by
Yong Hoon Shin
Committed by
GitHub
May 21, 2025
Browse files
[V1] Fix general plugins not loaded in engine for multiproc (#18326)
Signed-off-by:
Yong Hoon Shin
<
yhshin@meta.com
>
parent
5d7f5452
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
0 deletions
+4
-0
vllm/v1/engine/core.py
vllm/v1/engine/core.py
+4
-0
No files found.
vllm/v1/engine/core.py
View file @
907f935d
...
@@ -57,6 +57,10 @@ class EngineCore:
...
@@ -57,6 +57,10 @@ class EngineCore:
executor_fail_callback
:
Optional
[
Callable
]
=
None
):
executor_fail_callback
:
Optional
[
Callable
]
=
None
):
assert
vllm_config
.
model_config
.
runner_type
!=
"pooling"
assert
vllm_config
.
model_config
.
runner_type
!=
"pooling"
# plugins need to be loaded at the engine/scheduler level too
from
vllm.plugins
import
load_general_plugins
load_general_plugins
()
self
.
vllm_config
=
vllm_config
self
.
vllm_config
=
vllm_config
logger
.
info
(
"Initializing a V1 LLM engine (v%s) with config: %s"
,
logger
.
info
(
"Initializing a V1 LLM engine (v%s) with config: %s"
,
VLLM_VERSION
,
vllm_config
)
VLLM_VERSION
,
vllm_config
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment