Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
be81eaf6
Commit
be81eaf6
authored
Mar 16, 2026
by
xuxz
Browse files
[PD]添加VLLM_PP_LAYER_PARTITION_D控制d层切分
parent
0c5e5f88
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
0 deletions
+6
-0
vllm/envs.py
vllm/envs.py
+6
-0
No files found.
vllm/envs.py
View file @
be81eaf6
...
@@ -47,6 +47,7 @@ if TYPE_CHECKING:
...
@@ -47,6 +47,7 @@ if TYPE_CHECKING:
VLLM_TRACE_FUNCTION
:
int
=
0
VLLM_TRACE_FUNCTION
:
int
=
0
VLLM_USE_FLASHINFER_SAMPLER
:
bool
|
None
=
None
VLLM_USE_FLASHINFER_SAMPLER
:
bool
|
None
=
None
VLLM_PP_LAYER_PARTITION
:
str
|
None
=
None
VLLM_PP_LAYER_PARTITION
:
str
|
None
=
None
VLLM_PP_LAYER_PARTITION_D
:
Optional
[
str
]
=
None
VLLM_CPU_KVCACHE_SPACE
:
int
|
None
=
0
VLLM_CPU_KVCACHE_SPACE
:
int
|
None
=
0
VLLM_CPU_OMP_THREADS_BIND
:
str
=
""
VLLM_CPU_OMP_THREADS_BIND
:
str
=
""
VLLM_CPU_NUM_OF_RESERVED_CPU
:
int
|
None
=
None
VLLM_CPU_NUM_OF_RESERVED_CPU
:
int
|
None
=
None
...
@@ -754,6 +755,11 @@ environment_variables: dict[str, Callable[[], Any]] = {
...
@@ -754,6 +755,11 @@ environment_variables: dict[str, Callable[[], Any]] = {
else
None
,
else
None
,
# Pipeline stage partition strategy
# Pipeline stage partition strategy
"VLLM_PP_LAYER_PARTITION"
:
lambda
:
os
.
getenv
(
"VLLM_PP_LAYER_PARTITION"
,
None
),
"VLLM_PP_LAYER_PARTITION"
:
lambda
:
os
.
getenv
(
"VLLM_PP_LAYER_PARTITION"
,
None
),
# Pipeline stage partition strategy
"VLLM_PP_LAYER_PARTITION_D"
:
lambda
:
os
.
getenv
(
"VLLM_PP_LAYER_PARTITION_D"
,
None
),
# (CPU backend only) CPU key-value cache space.
# (CPU backend only) CPU key-value cache space.
# default is None and will be set as 4 GB
# default is None and will be set as 4 GB
"VLLM_CPU_KVCACHE_SPACE"
:
lambda
:
int
(
os
.
getenv
(
"VLLM_CPU_KVCACHE_SPACE"
,
"0"
))
"VLLM_CPU_KVCACHE_SPACE"
:
lambda
:
int
(
os
.
getenv
(
"VLLM_CPU_KVCACHE_SPACE"
,
"0"
))
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment