Skip to content

GitLab

Commit 3c55c79a authored by lijian's avatar lijian
Browse files

Support hidden-dim 3072 and hidden_size 6144. 


Signed-off-by: lijian6's avatarlijian <lijian6@sugon.com>
parent 1a24c8b6
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 2 deletions
csrc/kernels/launch.cuh
View file @ 3c55c79a
......@@ -117,10 +117,14 @@ inline void LAUNCH_KERNEL_NON_COOPERATIVE(T &&config, Kern &&kernel, Args &&...a
case_macro(2048); \
case 2560: \
case_macro(2560); \
case 5120: \
case_macro(5120); \
case 3072: \
case_macro(3072); /* for gpt-oss */ \
case 4096: \
case_macro(4096); \
case 5120: \
case_macro(5120); \
case 6144: \
case_macro(6144); /* For qwen3 coder */ \
case 7168: \
case_macro(7168); \
case 8192: \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment