Skip to content

GitLab

Unverified Commit 1f6584ee authored by Kunshang Ji's avatar Kunshang Ji Committed by GitHub
Browse files

[V1] Enable profile for LLMEngine (#10665)

parent 334d64d1
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
vllm/v1/engine/llm_engine.py
View file @ 1f6584ee
...@@ -161,13 +161,13 @@ class LLMEngine: ...@@ -161,13 +161,13 @@ class LLMEngine:
# TODO(rob): Can we get rid of these? # TODO(rob): Can we get rid of these?
def get_model_config(self): def get_model_config(self):
pass return self.model_config
def start_profile(self): def start_profile(self):
pass self.engine_core.profile(True)
def stop_profile(self): def stop_profile(self):
pass self.engine_core.profile(False)
def get_tokenizer_group(self, group_type): def get_tokenizer_group(self, group_type):
pass pass
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment