Skip to content

GitLab

Unverified Commit 913df14d authored by shangmingc's avatar shangmingc Committed by GitHub
Browse files

[Bugfix] Remove unused seq_group_metadata_list from ModelInputForGPU (#12935) 


Signed-off-by: default avatarShangming Cai <caishangming@linux.alibaba.com>
parent 8a69e0e2
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
vllm/worker/model_runner.py
View file @ 913df14d
...@@ -98,7 +98,6 @@ class ModelInputForGPU(ModelRunnerInputBase): ...@@ -98,7 +98,6 @@ class ModelInputForGPU(ModelRunnerInputBase):
finished_requests_ids: Optional[List[str]] = None finished_requests_ids: Optional[List[str]] = None
virtual_engine: int = 0 virtual_engine: int = 0
async_callback: Optional[Callable] = None async_callback: Optional[Callable] = None
seq_group_metadata_list: Optional[List[SequenceGroupMetadata]] = None
scheduler_outputs: Optional[SchedulerOutputs] = None scheduler_outputs: Optional[SchedulerOutputs] = None
def as_broadcastable_tensor_dict(self) -> Dict[str, Any]: def as_broadcastable_tensor_dict(self) -> Dict[str, Any]:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment