Skip to content

GitLab

Unverified Commit 1d0b41be authored by Tri Dao's avatar Tri Dao Committed by GitHub
Browse files

Merge pull request #60 from 201419/patch-1 

fix typo in function mha_fwd
parents 52fb4b72 ff07250e
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
csrc/flash_attn/fmha_api.cpp
View file @ 1d0b41be
...@@ -216,7 +216,7 @@ mha_fwd(const at::Tensor &q, // total_q x num_heads x head_size, total_q ...@@ -216,7 +216,7 @@ mha_fwd(const at::Tensor &q, // total_q x num_heads x head_size, total_q
TORCH_CHECK(k.stride(-1) == 1); TORCH_CHECK(k.stride(-1) == 1);
TORCH_CHECK(v.stride(-1) == 1); TORCH_CHECK(v.stride(-1) == 1);
TORCH_CHECK(out.stride(-1) == 1); TORCH_CHECK(out.stride(-1) == 1);
TORCH_CHECK(cu_seqlens_k.is_contiguous()); TORCH_CHECK(cu_seqlens_q.is_contiguous());
TORCH_CHECK(cu_seqlens_k.is_contiguous()); TORCH_CHECK(cu_seqlens_k.is_contiguous());
const auto sizes = q.sizes(); const auto sizes = q.sizes();
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment