Skip to content

GitLab

Unverified Commit 1ec20355 authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[Bugfix] Set `VLLM_ALLREDUCE_USE_SYMM_MEM` default to False (#24696) 


Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
parent e42af78b
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/envs.py
View file @ 1ec20355
...@@ -1218,7 +1218,7 @@ environment_variables: dict[str, Callable[[], Any]] = { ...@@ -1218,7 +1218,7 @@ environment_variables: dict[str, Callable[[], Any]] = {
# Whether to use pytorch symmetric memory for allreduce # Whether to use pytorch symmetric memory for allreduce
"VLLM_ALLREDUCE_USE_SYMM_MEM": "VLLM_ALLREDUCE_USE_SYMM_MEM":
lambda: bool(int(os.getenv("VLLM_ALLREDUCE_USE_SYMM_MEM", "1"))), lambda: bool(int(os.getenv("VLLM_ALLREDUCE_USE_SYMM_MEM", "0"))),
# Allows vllm to find tuned config under customized folder # Allows vllm to find tuned config under customized folder
"VLLM_TUNED_CONFIG_FOLDER": "VLLM_TUNED_CONFIG_FOLDER":
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment