Unverified Commit 913df14d authored by shangmingc's avatar shangmingc Committed by GitHub
Browse files

[Bugfix] Remove unused seq_group_metadata_list from ModelInputForGPU (#12935)


Signed-off-by: default avatarShangming Cai <caishangming@linux.alibaba.com>
parent 8a69e0e2
......@@ -98,7 +98,6 @@ class ModelInputForGPU(ModelRunnerInputBase):
finished_requests_ids: Optional[List[str]] = None
virtual_engine: int = 0
async_callback: Optional[Callable] = None
seq_group_metadata_list: Optional[List[SequenceGroupMetadata]] = None
scheduler_outputs: Optional[SchedulerOutputs] = None
def as_broadcastable_tensor_dict(self) -> Dict[str, Any]:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment