Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
cdca8994
Unverified
Commit
cdca8994
authored
Oct 09, 2024
by
Russell Bryant
Committed by
GitHub
Oct 09, 2024
Browse files
[CI/Build] mypy: check vllm/entrypoints (#9194)
Signed-off-by:
Russell Bryant
<
rbryant@redhat.com
>
parent
ca77dd7a
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
3 deletions
+6
-3
tools/mypy.sh
tools/mypy.sh
+1
-1
vllm/entrypoints/llm.py
vllm/entrypoints/llm.py
+5
-2
No files found.
tools/mypy.sh
View file @
cdca8994
...
...
@@ -19,7 +19,7 @@ run_mypy vllm/attention
#run_mypy vllm/core
run_mypy vllm/distributed
run_mypy vllm/engine
#
run_mypy vllm/entrypoints
run_mypy vllm/entrypoints
run_mypy vllm/executor
#run_mypy vllm/inputs
run_mypy vllm/logging
...
...
vllm/entrypoints/llm.py
View file @
cdca8994
...
...
@@ -514,10 +514,13 @@ class LLM:
# Handle multi and single conversations
if
is_list_of
(
messages
,
list
):
# messages is List[List[...]]
list_of_messages
=
messages
list_of_messages
=
cast
(
List
[
List
[
ChatCompletionMessageParam
]],
messages
)
else
:
# messages is List[...]
list_of_messages
=
[
messages
]
list_of_messages
=
[
cast
(
List
[
ChatCompletionMessageParam
],
messages
)
]
prompts
:
List
[
Union
[
TokensPrompt
,
TextPrompt
]]
=
[]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment