Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
446c7806
Unverified
Commit
446c7806
authored
Nov 21, 2024
by
Woosuk Kwon
Committed by
GitHub
Nov 21, 2024
Browse files
[Minor] Fix line-too-long (#10563)
Signed-off-by:
Woosuk Kwon
<
woosuk.kwon@berkeley.edu
>
parent
33e0a254
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
vllm/entrypoints/llm.py
vllm/entrypoints/llm.py
+4
-4
No files found.
vllm/entrypoints/llm.py
View file @
446c7806
...
@@ -109,16 +109,16 @@ class LLM:
...
@@ -109,16 +109,16 @@ class LLM:
hf_overrides: If a dictionary, contains arguments to be forwarded to the
hf_overrides: If a dictionary, contains arguments to be forwarded to the
HuggingFace config. If a callable, it is called to update the
HuggingFace config. If a callable, it is called to update the
HuggingFace config.
HuggingFace config.
compilation_config: Either an integer or a dictionary. If it is an
integer,
compilation_config: Either an integer or a dictionary. If it is an
it is used as the level of compilation optimization. If it
is a dictionary,
integer,
it is used as the level of compilation optimization. If it
it can specify the full compilation configuration.
is a dictionary,
it can specify the full compilation configuration.
**kwargs: Arguments for :class:`~vllm.EngineArgs`. (See
**kwargs: Arguments for :class:`~vllm.EngineArgs`. (See
:ref:`engine_args`)
:ref:`engine_args`)
Note:
Note:
This class is intended to be used for offline inference. For online
This class is intended to be used for offline inference. For online
serving, use the :class:`~vllm.AsyncLLMEngine` class instead.
serving, use the :class:`~vllm.AsyncLLMEngine` class instead.
"""
# noqa
"""
DEPRECATE_LEGACY
:
ClassVar
[
bool
]
=
False
DEPRECATE_LEGACY
:
ClassVar
[
bool
]
=
False
"""A flag to toggle whether to deprecate the legacy generate/encode API."""
"""A flag to toggle whether to deprecate the legacy generate/encode API."""
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment