Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
fengzch-das
nunchaku
Commits
817e6c41
Commit
817e6c41
authored
Jan 07, 2026
by
fengzch
Browse files
fix:取消对saprse attention 的依赖
parent
26d89be7
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
src/SanaModel.cpp
src/SanaModel.cpp
+2
-1
No files found.
src/SanaModel.cpp
View file @
817e6c41
...
...
@@ -2,7 +2,7 @@
#include "SanaModel.h"
#include "kernels/zgemm/zgemm.h"
#include "flash_api.h"
//
#include "flash_api.h"
#include "kernels/misc_kernels.h"
// #include <nvtx3/nvToolsExt.h>
...
...
@@ -180,6 +180,7 @@ Tensor MultiHeadCrossAttention::forward(Tensor x, Tensor cond, Tensor cu_seqlens
// false)
// .front()
// .view({batch_size, num_tokens_img, num_heads * head_dim});
Tensor
attn_output
=
Tensor
::
ones
({
batch_size
*
num_tokens
,
num_heads
,
dim_head
},
Tensor
::
FP16
,
Device
::
cuda
());
std
::
cout
<<
"mha_varlen_fwd not support !!!"
<<
std
::
endl
;
// Tensor attn_output = mha_fwd(q, k, v,
// 0.0f,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment