Skip to content

GitLab

Commit 9191dfaf authored by Jesse Gross's avatar Jesse Gross Committed by Jesse Gross
Browse files

llm: Enable flash attention for mistral3 by default

parent 1108d8b3
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
fs/ggml/ggml.go
View file @ 9191dfaf
...@@ -831,6 +831,7 @@ func (f GGML) FlashAttention() bool { ...@@ -831,6 +831,7 @@ func (f GGML) FlashAttention() bool {
return slices.Contains([]string{ return slices.Contains([]string{
"gemma3", "gemma3",
"gptoss", "gpt-oss", "gptoss", "gpt-oss",
"mistral3",
"qwen3", "qwen3moe", "qwen3", "qwen3moe",
"qwen3vl", "qwen3vlmoe", "qwen3vl", "qwen3vlmoe",
}, f.KV().String("general.architecture")) }, f.KV().String("general.architecture"))
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment