Unverified Commit 8baf9a0c authored by Wei Wu's avatar Wei Wu Committed by GitHub
Browse files

[Fix] Type annotation correction for UpdateWeightsFromTensorReqInput (#4532)


Co-authored-by: default avatarZhiqiang Xie <xiezhq@stanford.edu>
parent c7872985
...@@ -540,7 +540,8 @@ class UpdateWeightsFromDistributedReqOutput: ...@@ -540,7 +540,8 @@ class UpdateWeightsFromDistributedReqOutput:
@dataclass @dataclass
class UpdateWeightsFromTensorReqInput: class UpdateWeightsFromTensorReqInput:
serialized_named_tensors: bytes # indeed Dict[str, torch.Tensor] # List containing one serialized Dict[str, torch.Tensor] per TP worker
serialized_named_tensors: List[bytes]
load_format: Optional[str] load_format: Optional[str]
flush_cache: bool flush_cache: bool
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment