Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
ae4e96a2
Unverified
Commit
ae4e96a2
authored
Oct 15, 2025
by
Yan Ru Pei
Committed by
GitHub
Oct 16, 2025
Browse files
fix: mocker engines should ignore downloading weights from hf (again) (#3664)
Signed-off-by:
PeaBrane
<
yanrpei@gmail.com
>
parent
734d2f87
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
2 deletions
+6
-2
launch/dynamo-run/src/lib.rs
launch/dynamo-run/src/lib.rs
+3
-1
lib/bindings/python/rust/llm/entrypoint.rs
lib/bindings/python/rust/llm/entrypoint.rs
+3
-1
No files found.
launch/dynamo-run/src/lib.rs
View file @
ae4e96a2
...
@@ -37,7 +37,9 @@ pub async fn run(
...
@@ -37,7 +37,9 @@ pub async fn run(
}
}
Some
(
p
)
=>
{
Some
(
p
)
=>
{
// model_path might be an HF repo, not a local path. Resolve it by downloading.
// model_path might be an HF repo, not a local path. Resolve it by downloading.
Some
(
LocalModel
::
fetch
(
&
p
.display
()
.to_string
(),
false
)
.await
?
)
// Mocker only needs tokenizer, not weights
let
ignore_weights
=
matches!
(
out_opt
,
Some
(
Output
::
Mocker
));
Some
(
LocalModel
::
fetch
(
&
p
.display
()
.to_string
(),
ignore_weights
)
.await
?
)
}
}
};
};
...
...
lib/bindings/python/rust/llm/entrypoint.rs
View file @
ae4e96a2
...
@@ -215,7 +215,9 @@ pub fn make_engine<'p>(
...
@@ -215,7 +215,9 @@ pub fn make_engine<'p>(
let
local_path
=
if
model_path
.exists
()
{
let
local_path
=
if
model_path
.exists
()
{
model_path
model_path
}
else
{
}
else
{
LocalModel
::
fetch
(
&
model_path
.display
()
.to_string
(),
false
)
// Mocker only needs tokenizer, not weights
let
ignore_weights
=
matches!
(
args
.engine_type
,
EngineType
::
Mocker
);
LocalModel
::
fetch
(
&
model_path
.display
()
.to_string
(),
ignore_weights
)
.await
.await
.map_err
(
to_pyerr
)
?
.map_err
(
to_pyerr
)
?
};
};
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment