Skip to content

GitLab

Commit 537e2d9c authored by zhuwenwen's avatar zhuwenwen
Browse files

allow to set --enforce-eager

parent 76621631
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/engine/arg_utils.py
View file @ 537e2d9c
...@@ -564,7 +564,7 @@ class EngineArgs: ...@@ -564,7 +564,7 @@ class EngineArgs:
'This should be a JSON string that will be ' 'This should be a JSON string that will be '
'parsed into a dictionary.') 'parsed into a dictionary.')
parser.add_argument('--enforce-eager', parser.add_argument('--enforce-eager',
# action='store_true', action='store_true',
default=True, default=True,
help='Always use eager-mode PyTorch. If False, ' help='Always use eager-mode PyTorch. If False, '
'will use eager mode and CUDA graph in hybrid ' 'will use eager mode and CUDA graph in hybrid '
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment