Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
643dc095
Commit
643dc095
authored
May 06, 2026
by
SAC_fanth
Browse files
[feature]w8a8量化模型默认不开启aiter
parent
ca9ce18d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
vllm/envs.py
vllm/envs.py
+2
-2
No files found.
vllm/envs.py
View file @
643dc095
...
...
@@ -167,7 +167,7 @@ if TYPE_CHECKING:
VLLM_MOE_USE_DEEP_GEMM
:
bool
=
True
VLLM_USE_DEEP_GEMM_E8M0
:
bool
=
True
VLLM_USE_DEEP_GEMM_TMA_ALIGNED_SCALES
:
bool
=
True
VLLM_USE_AITER_MOE_W8A8
:
bool
=
Tru
e
VLLM_USE_AITER_MOE_W8A8
:
bool
=
Fals
e
VLLM_DEEP_GEMM_WARMUP
:
Literal
[
"skip"
,
"full"
,
...
...
@@ -1292,7 +1292,7 @@ environment_variables: dict[str, Callable[[], Any]] = {
int
(
os
.
getenv
(
"VLLM_USE_DEEP_GEMM_TMA_ALIGNED_SCALES"
,
"1"
))
),
"VLLM_USE_AITER_MOE_W8A8"
:
lambda
:
bool
(
int
(
os
.
getenv
(
"VLLM_USE_AITER_MOE_W8A8"
,
"
1
"
))
int
(
os
.
getenv
(
"VLLM_USE_AITER_MOE_W8A8"
,
"
0
"
))
),
# DeepGemm JITs the kernels on-demand. The warmup attempts to make DeepGemm
# JIT all the required kernels before model execution so there is no
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment