first commit

34e67b1e · zhangshao · 34e67b1e · 34e67b1e · 34e67b1e · 34e67b1e
Commit 34e67b1e authored May 09, 2026 by zhangshao
20 changed files
--- a/csrc/layer_norm/ln_parallel_residual_bwd_kernels.cuh
+++ b/csrc/layer_norm/ln_parallel_residual_bwd_kernels.cuh
--- a/csrc/layer_norm/ln_parallel_residual_fwd_kernels.cuh
+++ b/csrc/layer_norm/ln_parallel_residual_fwd_kernels.cuh
--- a/csrc/layer_norm/ln_utils.cuh
+++ b/csrc/layer_norm/ln_utils.cuh
--- a/csrc/layer_norm/setup.py
+++ b/csrc/layer_norm/setup.py
--- a/csrc/layer_norm/static_switch.h
+++ b/csrc/layer_norm/static_switch.h
--- a/csrc/rotary/get_version.py
+++ b/csrc/rotary/get_version.py
--- a/csrc/rotary/rotary.cpp
+++ b/csrc/rotary/rotary.cpp
--- a/csrc/rotary/rotary_kernel.cu
+++ b/csrc/rotary/rotary_kernel.cu
--- a/csrc/rotary/setup.py
+++ b/csrc/rotary/setup.py
--- a/csrc/xentropy/README.md
+++ b/csrc/xentropy/README.md
--- a/csrc/xentropy/get_version.py
+++ b/csrc/xentropy/get_version.py
--- a/csrc/xentropy/interface.cpp
+++ b/csrc/xentropy/interface.cpp
--- a/csrc/xentropy/setup.py
+++ b/csrc/xentropy/setup.py
--- a/csrc/xentropy/xentropy_kernel.cu
+++ b/csrc/xentropy/xentropy_kernel.cu
--- a/examples/inference/README.md
+++ b/examples/inference/README.md
--- a/flash_attn/__init__.py
+++ b/flash_attn/__init__.py
--- a/flash_attn/attn_torch_function.py
+++ b/flash_attn/attn_torch_function.py
--- a/flash_attn/bert_padding.py
+++ b/flash_attn/bert_padding.py
--- a/flash_attn/bwd_preprocess.py
+++ b/flash_attn/bwd_preprocess.py
--- a/flash_attn/bwd_split_kernel.py
+++ b/flash_attn/bwd_split_kernel.py