Unverified Commit e41bf15c authored by Xerxes's avatar Xerxes Committed by GitHub
Browse files

[Chore]: qwen3-moe-type-hints-mistake (#19860)


Co-authored-by: default avatarxinnan.hou <hxn02029096@alibaba-inc.com>
parent 5aa4a015
......@@ -294,7 +294,7 @@ class Qwen3MoeDecoderLayer(nn.Module):
positions: torch.Tensor,
hidden_states: torch.Tensor,
residual: Optional[torch.Tensor],
) -> torch.Tensor:
) -> tuple[torch.Tensor, torch.Tensor]:
# Self Attention
if residual is None:
residual = hidden_states
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment