Skip to content

GitLab

Unverified Commit 4b5b8a6a authored by Tyler Michael Smith's avatar Tyler Michael Smith Committed by GitHub
Browse files

[V1][Bugfix] Fix EngineCoreProc profile (#11185) 


Signed-off-by: default avatarTyler Michael Smith <tyler@neuralmagic.com>
parent 4863e5fb
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/engine/core.py
View file @ 4b5b8a6a
...@@ -321,7 +321,7 @@ class EngineCoreProc(EngineCore): ...@@ -321,7 +321,7 @@ class EngineCoreProc(EngineCore):
if isinstance(request, EngineCoreRequest): if isinstance(request, EngineCoreRequest):
self.add_request(request) self.add_request(request)
elif isinstance(request, EngineCoreProfile): elif isinstance(request, EngineCoreProfile):
self.model_executor.worker.profile(request.is_start) self.model_executor.profile(request.is_start)
else: else:
# TODO: make an EngineCoreAbort wrapper # TODO: make an EngineCoreAbort wrapper
assert isinstance(request, list) assert isinstance(request, list)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment