Skip to content

GitLab

Unverified Commit 6c6dcd86 authored by Ning Xie's avatar Ning Xie Committed by GitHub
Browse files

[MISC] correct signature for LoaderFunction (#18670) 


Signed-off-by: default avatarAndy Xie <andy.xning@gmail.com>
parent 7891fdf0
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/model_loader/weight_utils.py
View file @ 6c6dcd86
...@@ -634,7 +634,7 @@ def row_parallel_weight_loader(param: torch.Tensor, ...@@ -634,7 +634,7 @@ def row_parallel_weight_loader(param: torch.Tensor,
return default_weight_loader(param, loaded_weight) return default_weight_loader(param, loaded_weight)
LoaderFunction = Callable[[torch.Tensor, torch.Tensor], torch.Tensor] LoaderFunction = Callable[[torch.Tensor, torch.Tensor], None]
def sharded_weight_loader(shard_axis: int) -> LoaderFunction: def sharded_weight_loader(shard_axis: int) -> LoaderFunction:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment