Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
c4b48d3c
Unverified
Commit
c4b48d3c
authored
Oct 02, 2025
by
ahao-anyscale
Committed by
GitHub
Oct 03, 2025
Browse files
[BUG] Reorder model config creation (#26124)
Signed-off-by:
ahao-anyscale
<
ahao@anyscale.com
>
parent
10d76548
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
vllm/engine/arg_utils.py
vllm/engine/arg_utils.py
+4
-1
No files found.
vllm/engine/arg_utils.py
View file @
c4b48d3c
...
...
@@ -1131,6 +1131,10 @@ class EngineArgs:
device_config
=
DeviceConfig
(
device
=
cast
(
Device
,
current_platform
.
device_type
))
model_config
=
self
.
create_model_config
()
self
.
model
=
model_config
.
model
self
.
tokenizer
=
model_config
.
tokenizer
(
self
.
model
,
self
.
tokenizer
,
self
.
speculative_config
)
=
maybe_override_with_speculators
(
model
=
self
.
model
,
...
...
@@ -1139,7 +1143,6 @@ class EngineArgs:
trust_remote_code
=
self
.
trust_remote_code
,
vllm_speculative_config
=
self
.
speculative_config
,
)
model_config
=
self
.
create_model_config
()
# * If VLLM_USE_V1 is unset, we enable V1 for "supported features"
# and fall back to V0 for experimental or unsupported features.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment