Unverified Commit 22d33bac authored by Nick Hill's avatar Nick Hill Committed by GitHub
Browse files

[FrontEnd][Perf] `merge_async_iterators` fast-path for single-prompt requests (#15150)


Signed-off-by: default avatarNick Hill <nhill@redhat.com>
parent b0e96aae
...@@ -411,6 +411,11 @@ async def merge_async_iterators( ...@@ -411,6 +411,11 @@ async def merge_async_iterators(
When it yields, it yields a tuple (i, item) where i is the index of the When it yields, it yields a tuple (i, item) where i is the index of the
iterator that yields the item. iterator that yields the item.
""" """
if len(iterators) == 1:
# Fast-path single iterator case.
async for item in iterators[0]:
yield 0, item
return
loop = asyncio.get_running_loop() loop = asyncio.get_running_loop()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment