Skip to content

GitLab

Commit fbfb40ad authored by zhuwenwen's avatar zhuwenwen
Browse files

allow to set --enforce-eager

parent 601057c9
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/engine/arg_utils.py
View file @ fbfb40ad
...@@ -597,7 +597,7 @@ class EngineArgs: ...@@ -597,7 +597,7 @@ class EngineArgs:
'This should be a JSON string that will be ' 'This should be a JSON string that will be '
'parsed into a dictionary.') 'parsed into a dictionary.')
parser.add_argument('--enforce-eager', parser.add_argument('--enforce-eager',
# action='store_true', action='store_true',
default=True, default=True,
help='Always use eager-mode PyTorch. If False, ' help='Always use eager-mode PyTorch. If False, '
'will use eager mode and CUDA graph in hybrid ' 'will use eager mode and CUDA graph in hybrid '
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment