"sgl-router/src/vscode:/vscode.git/clone" did not exist on "97c382393181b2b86e6e557b754e3b1b12ad3b2a"
Unverified Commit 3566596a authored by Antony Frolov's avatar Antony Frolov Committed by GitHub
Browse files

Fix typo in RotaryEmbedding forward output type (#666)

parent 83aef842
......@@ -417,7 +417,7 @@ class RotaryEmbedding(torch.nn.Module):
kv: Optional[torch.Tensor] = None,
seqlen_offset: Union[int, torch.Tensor] = 0,
max_seqlen: Optional[int] = None,
) -> Tuple[torch.Tensor, torch.Tensor]:
) -> Union[torch.Tensor, Tuple[torch.Tensor, torch.Tensor]]:
"""
qkv: (batch, seqlen, 3, nheads, headdim) if kv is none,
else it's just q of shape (batch, seqlen, nheads, headdim)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment