Skip to content

GitLab

"test/vscode:/vscode.git/clone" did not exist on "4dd9f036d39c27b56d6f523c03eed8008b53f71d"
Unverified Commit 806a3002 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

add notice about flashinfer in sgl-kernel (#3057)

parent 0d2148ef
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
sgl-kernel/src/sgl-kernel/ops/__init__.py
View file @ 806a3002
...@@ -90,6 +90,8 @@ def rotary_embedding(positions, query, key, head_size, cos_sin_cache, is_neox): ...@@ -90,6 +90,8 @@ def rotary_embedding(positions, query, key, head_size, cos_sin_cache, is_neox):
return _rotary_embedding(positions, query, key, head_size, cos_sin_cache, is_neox) return _rotary_embedding(positions, query, key, head_size, cos_sin_cache, is_neox)
# These implementations extensively draw from and build upon the FlashInfer project https://github.com/flashinfer-ai/flashinfer
# Kudos to @yzh119
def rmsnorm( def rmsnorm(
input: torch.Tensor, input: torch.Tensor,
weight: torch.Tensor, weight: torch.Tensor,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment