Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
7d25b9e1
Unverified
Commit
7d25b9e1
authored
Oct 28, 2025
by
Michael Yang
Committed by
GitHub
Oct 28, 2025
Browse files
feat(model): add qwen3vl (#12665)
parent
36d64fb5
Changes
22
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
7 additions
and
4 deletions
+7
-4
server/routes.go
server/routes.go
+4
-1
server/sched.go
server/sched.go
+3
-3
No files found.
server/routes.go
View file @
7d25b9e1
...
...
@@ -142,7 +142,10 @@ func (s *Server) scheduleRunner(ctx context.Context, name string, caps []model.C
// This model is much more capable with a larger context, so set that
// unless it would penalize performance too much
if
!
s
.
lowVRAM
&&
slices
.
Contains
([]
string
{
"gptoss"
,
"gpt-oss"
},
model
.
Config
.
ModelFamily
)
{
if
!
s
.
lowVRAM
&&
slices
.
Contains
([]
string
{
"gptoss"
,
"gpt-oss"
,
"qwen3vl"
,
"qwen3vlmoe"
,
},
model
.
Config
.
ModelFamily
)
{
opts
.
NumCtx
=
max
(
opts
.
NumCtx
,
8192
)
}
...
...
server/sched.go
View file @
7d25b9e1
...
...
@@ -390,11 +390,11 @@ func (s *Scheduler) load(req *LlmRequest, f *ggml.GGML, systemInfo ml.SystemInfo
numParallel
=
1
}
// `mllama`
is a
snowflake and uses an encoder cache which cannot be used with num_parallel > 1
// `mllama`
, `qwen3vl`, and `qwen3vlmoe` are
snowflake
s
and uses an encoder cache which cannot be used with num_parallel > 1
// ref: https://github.com/ollama/ollama/issues/4165
if
slices
.
Contains
(
req
.
model
.
Config
.
ModelFamil
ies
,
"mllama"
)
&&
numParallel
!=
1
{
if
slices
.
Contains
(
[]
string
{
"mllama"
,
"qwen3vl"
,
"qwen3vlmoe"
},
req
.
model
.
Config
.
ModelFamil
y
)
&&
numParallel
!=
1
{
numParallel
=
1
slog
.
Warn
(
"m
llama
does not currently support parallel requests"
)
slog
.
Warn
(
"m
odel architecture
does not currently support parallel requests"
,
"architecture"
,
req
.
model
.
Config
.
ModelFamily
)
}
sessionDuration
:=
envconfig
.
KeepAlive
()
...
...
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment