Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
604e43b2
Unverified
Commit
604e43b2
authored
Nov 18, 2025
by
Patrick Devine
Committed by
GitHub
Nov 18, 2025
Browse files
models: enable deepseek2 (deepseek v3.1 w/ MLA) on the new engine (#13151)
parent
53985b3c
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
0 deletions
+6
-0
fs/ggml/ggml.go
fs/ggml/ggml.go
+1
-0
model/models/deepseek2/model.go
model/models/deepseek2/model.go
+5
-0
No files found.
fs/ggml/ggml.go
View file @
604e43b2
...
...
@@ -250,6 +250,7 @@ func (kv KV) OllamaEngineRequired() bool {
"qwen3"
,
"qwen3moe"
,
"qwen3vl"
,
"qwen3vlmoe"
,
"deepseekocr"
,
"deepseek2"
,
},
kv
.
Architecture
())
}
...
...
model/models/deepseek2/model.go
View file @
604e43b2
...
...
@@ -236,6 +236,11 @@ type Model struct {
}
func
New
(
c
fs
.
Config
)
(
model
.
Model
,
error
)
{
if
c
.
Uint
(
"attention.key_length_mla"
)
==
0
{
// non-MLA models aren't yet supported
return
nil
,
model
.
ErrUnsupportedModel
}
layers
:=
make
([]
Layer
,
c
.
Uint
(
"block_count"
))
firstDenseLayerIndex
:=
int
(
c
.
Uint
(
"leading_dense_block_count"
))
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment