Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
0df4d9b0
Unverified
Commit
0df4d9b0
authored
Jul 22, 2025
by
Ning Xie
Committed by
GitHub
Jul 22, 2025
Browse files
[Misc] unify variable for LLM instance v2 (#21356)
Signed-off-by:
Andy Xie
<
andy.xning@gmail.com
>
parent
ed250545
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
tests/models/language/generation/test_gemma.py
tests/models/language/generation/test_gemma.py
+4
-4
No files found.
tests/models/language/generation/test_gemma.py
View file @
0df4d9b0
...
...
@@ -15,13 +15,13 @@ def test_dummy_loader(vllm_runner, monkeypatch, model: str) -> None:
load_format
=
"dummy"
,
)
as
llm
:
if
model
==
"google/gemma-3-4b-it"
:
normalizers
=
llm
.
model
.
collective_rpc
(
normalizers
=
llm
.
llm
.
collective_rpc
(
lambda
self
:
self
.
model_runner
.
model
.
language_model
.
model
.
normalizer
.
cpu
().
item
())
config
=
llm
.
model
.
llm_engine
.
model_config
.
hf_config
.
text_config
config
=
llm
.
llm
.
llm_engine
.
model_config
.
hf_config
.
text_config
else
:
normalizers
=
llm
.
model
.
collective_rpc
(
normalizers
=
llm
.
llm
.
collective_rpc
(
lambda
self
:
self
.
model_runner
.
model
.
model
.
normalizer
.
cpu
(
).
item
())
config
=
llm
.
model
.
llm_engine
.
model_config
.
hf_config
config
=
llm
.
llm
.
llm_engine
.
model_config
.
hf_config
assert
np
.
allclose
(
normalizers
,
config
.
hidden_size
**
0.5
,
rtol
=
2e-3
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment