Skip to content

GitLab

Unverified Commit 14772eeb authored by Kante Yin's avatar Kante Yin Committed by GitHub
Browse files

[Bugfix] Fix flag name for `max_seq_len_to_capture` (#4935) 


Signed-off-by: default avatarkerthcet <kerthcet@gmail.com>
parent 757b62c4
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/engine/arg_utils.py
View file @ 14772eeb
...@@ -341,9 +341,9 @@ class EngineArgs: ...@@ -341,9 +341,9 @@ class EngineArgs:
help='Maximum context length covered by CUDA ' help='Maximum context length covered by CUDA '
'graphs. When a sequence has context length ' 'graphs. When a sequence has context length '
'larger than this, we fall back to eager mode. ' 'larger than this, we fall back to eager mode. '
'(DEPRECATED. Use --max-seq_len-to-capture instead' '(DEPRECATED. Use --max-seq-len-to-capture instead'
')') ')')
parser.add_argument('--max-seq_len-to-capture', parser.add_argument('--max-seq-len-to-capture',
type=int, type=int,
default=EngineArgs.max_seq_len_to_capture, default=EngineArgs.max_seq_len_to_capture,
help='Maximum sequence length covered by CUDA ' help='Maximum sequence length covered by CUDA '
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment