Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
db100c5c
Unverified
Commit
db100c5c
authored
Nov 22, 2024
by
youkaichao
Committed by
GitHub
Nov 22, 2024
Browse files
[bugfix] fix full graph tests (#10581)
Signed-off-by:
youkaichao
<
youkaichao@gmail.com
>
parent
11fcf0e0
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
tests/compile/utils.py
tests/compile/utils.py
+2
-2
No files found.
tests/compile/utils.py
View file @
db100c5c
...
...
@@ -4,7 +4,7 @@ import torch
from
tests.quantization.utils
import
is_quant_method_supported
from
vllm
import
LLM
,
SamplingParams
from
vllm.config
import
CompilationConfig
,
CompilationLevel
from
vllm.config
import
CompilationLevel
from
vllm.platforms
import
current_platform
TEST_MODELS
=
[
...
...
@@ -85,7 +85,7 @@ def check_full_graph_support(model,
enforce_eager
=
True
,
tensor_parallel_size
=
tp_size
,
disable_custom_all_reduce
=
True
,
compilation_config
=
CompilationConfig
(
level
=
optimization_level
)
,
compilation_config
=
optimization_level
,
**
model_kwargs
)
outputs
=
llm
.
generate
(
prompts
,
sampling_params
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment