Skip to content

GitLab

Unverified Commit 26908554 authored by Xin Yang's avatar Xin Yang Committed by GitHub
Browse files

[Doc] Remove float32 choice from --lora-dtype (#10348) 


Signed-off-by: default avatarXin Yang <xyang19@gmail.com>
parent b311efd0
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/engine/arg_utils.py
View file @ 26908554
...@@ -601,7 +601,7 @@ class EngineArgs: ...@@ -601,7 +601,7 @@ class EngineArgs:
'--lora-dtype', '--lora-dtype',
type=str, type=str,
default=EngineArgs.lora_dtype, default=EngineArgs.lora_dtype,
choices=['auto', 'float16', 'bfloat16', 'float32'], choices=['auto', 'float16', 'bfloat16'],
help=('Data type for LoRA. If auto, will default to ' help=('Data type for LoRA. If auto, will default to '
'base model dtype.')) 'base model dtype.'))
parser.add_argument( parser.add_argument(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment