Skip to content

GitLab

Unverified Commit 89fca671 authored by Simon Mo's avatar Simon Mo Committed by GitHub
Browse files

[V1] Default MLA to V1 (#14921) 


Signed-off-by: default avatarsimon-mo <simon.mo@hey.com>
parent d20b0c13
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 5 deletions
vllm/engine/arg_utils.py
View file @ 89fca671
......@@ -1576,10 +1576,6 @@ class EngineArgs:
#############################################################
# Experimental Features - allow users to opt in.
# MLA is is supported on V1, but off by default for now.
if model_config.use_mla and _warn_or_fallback("MLA"):
return False
# LoRA is supported on V1, but off by default for now.
if self.enable_lora and _warn_or_fallback("LORA"):
return False
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment