Skip to content

GitLab

Unverified Commit 66c0ff9e authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix: use fa3 for gemma2 (#5586)

parent 9a7e83e8
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
python/sglang/srt/utils.py
View file @ 66c0ff9e
...@@ -1930,6 +1930,7 @@ def is_fa3_default_architecture(hf_config): ...@@ -1930,6 +1930,7 @@ def is_fa3_default_architecture(hf_config):
"Llama4ForConditionalGeneration", "Llama4ForConditionalGeneration",
"LlamaForCausalLM", "LlamaForCausalLM",
"MistralForCausalLM", "MistralForCausalLM",
"Gemma2ForCausalLM",
} }
return architectures[0] in default_archs return architectures[0] in default_archs
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment