Skip to content

GitLab

"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "bb4337b34c13fd704d8fd1afca30e22e1dbd9da7"
Unverified Commit b3f7aacc authored by Thibault Schueller's avatar Thibault Schueller Committed by GitHub
Browse files

[V1][Minor] Restore V1 compatibility with LLMEngine class (#13090)

parent b91660dd
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 0 deletions
vllm/engine/llm_engine.py
View file @ b3f7aacc
...@@ -2084,3 +2084,8 @@ class LLMEngine: ...@@ -2084,3 +2084,8 @@ class LLMEngine:
sampling_params.logits_processors.extend(logits_processors) sampling_params.logits_processors.extend(logits_processors)
return sampling_params return sampling_params
# TODO(v1): Remove this class proxy when V1 goes default.
if envs.VLLM_USE_V1:
from vllm.v1.engine.llm_engine import LLMEngine # type: ignore
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment