Unverified Commit 29b8d19c authored by drbh's avatar drbh Committed by GitHub
Browse files

fix: return the out tensor rather then the functions return value (#2361)

parent dd47a3da
......@@ -292,8 +292,7 @@ else:
)
out = torch.empty_like(q)
return flash_attn_cuda.fwd(
flash_attn_cuda.fwd(
q,
k,
v,
......@@ -309,4 +308,5 @@ else:
False,
0,
None,
)[0]
)
return out
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment