Skip to content

GitLab

Unverified Commit 9edd1db0 authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

[Minor] Fix type (#22347) 


Signed-off-by: default avatarWoosuk Kwon <woosuk.kwon@berkeley.edu>
parent f263a4b5
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/entrypoints/harmony_utils.py
View file @ 9edd1db0
# SPDX-License-Identifier: Apache-2.0 # SPDX-License-Identifier: Apache-2.0
# SPDX-FileCopyrightText: Copyright contributors to the vLLM project # SPDX-FileCopyrightText: Copyright contributors to the vLLM project
import datetime import datetime
from collections.abc import Iterable from collections.abc import Iterable, Sequence
from typing import Literal, Optional from typing import Literal, Optional
from openai.types.responses.tool import Tool from openai.types.responses.tool import Tool
...@@ -120,7 +120,7 @@ def parse_output_into_messages(token_ids: Iterable[int]) -> StreamableParser: ...@@ -120,7 +120,7 @@ def parse_output_into_messages(token_ids: Iterable[int]) -> StreamableParser:
def parse_chat_output( def parse_chat_output(
token_ids: list[int]) -> tuple[Optional[str], Optional[str], bool]: token_ids: Sequence[int]) -> tuple[Optional[str], Optional[str], bool]:
parser = parse_output_into_messages(token_ids) parser = parse_output_into_messages(token_ids)
output_msgs = parser.messages output_msgs = parser.messages
if len(output_msgs) == 0: if len(output_msgs) == 0:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment