Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
1b7624bf
Unverified
Commit
1b7624bf
authored
Mar 06, 2025
by
Serena
Committed by
GitHub
Mar 05, 2025
Browse files
[misc] Add FlashMLA as a new option of VLLM_ATTENTION_BACKEND env (#14267)
parent
ac60dc7f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
0 deletions
+1
-0
vllm/envs.py
vllm/envs.py
+1
-0
No files found.
vllm/envs.py
View file @
1b7624bf
...
...
@@ -321,6 +321,7 @@ environment_variables: dict[str, Callable[[], Any]] = {
# - "XFORMERS": use XFormers
# - "ROCM_FLASH": use ROCmFlashAttention
# - "FLASHINFER": use flashinfer
# - "FLASHMLA": use FlashMLA
"VLLM_ATTENTION_BACKEND"
:
lambda
:
os
.
getenv
(
"VLLM_ATTENTION_BACKEND"
,
None
),
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment