Skip to content

GitLab

Unverified Commit ff07250e authored by YangShu's avatar YangShu Committed by GitHub
Browse files

fix typo in function mha_fwd 

as title.
parent 52fb4b72
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
csrc/flash_attn/fmha_api.cpp
View file @ ff07250e
...@@ -216,7 +216,7 @@ mha_fwd(const at::Tensor &q, // total_q x num_heads x head_size, total_q ...@@ -216,7 +216,7 @@ mha_fwd(const at::Tensor &q, // total_q x num_heads x head_size, total_q
TORCH_CHECK(k.stride(-1) == 1); TORCH_CHECK(k.stride(-1) == 1);
TORCH_CHECK(v.stride(-1) == 1); TORCH_CHECK(v.stride(-1) == 1);
TORCH_CHECK(out.stride(-1) == 1); TORCH_CHECK(out.stride(-1) == 1);
TORCH_CHECK(cu_seqlens_k.is_contiguous()); TORCH_CHECK(cu_seqlens_q.is_contiguous());
TORCH_CHECK(cu_seqlens_k.is_contiguous()); TORCH_CHECK(cu_seqlens_k.is_contiguous());
const auto sizes = q.sizes(); const auto sizes = q.sizes();
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment