Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
a21076ed
Unverified
Commit
a21076ed
authored
Mar 09, 2025
by
Yanyi Liu
Committed by
GitHub
Mar 09, 2025
Browse files
[Misc] Ensure out-of-tree quantization method recognize by cli args (#14328)
Signed-off-by:
liuyanyi
<
wolfsonliu@163.com
>
parent
212007b1
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
vllm/engine/arg_utils.py
vllm/engine/arg_utils.py
+4
-4
No files found.
vllm/engine/arg_utils.py
View file @
a21076ed
...
...
@@ -1478,15 +1478,15 @@ class AsyncEngineArgs(EngineArgs):
@
staticmethod
def
add_cli_args
(
parser
:
FlexibleArgumentParser
,
async_args_only
:
bool
=
False
)
->
FlexibleArgumentParser
:
# Initialize plugin to update the parser, for example, The plugin may
# adding a new kind of quantization method to --quantization argument or
# a new device to --device argument.
load_general_plugins
()
if
not
async_args_only
:
parser
=
EngineArgs
.
add_cli_args
(
parser
)
parser
.
add_argument
(
'--disable-log-requests'
,
action
=
'store_true'
,
help
=
'Disable logging requests.'
)
# Initialize plugin to update the parser, for example, The plugin may
# adding a new kind of quantization method to --quantization argument or
# a new device to --device argument.
load_general_plugins
()
from
vllm.platforms
import
current_platform
current_platform
.
pre_register_and_update
(
parser
)
return
parser
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment