Unverified Commit 09269b31 authored by Li Wang's avatar Li Wang Committed by GitHub
Browse files

[BugFix]Fix performance serving benchmark when enable profiling (#14737)


Signed-off-by: default avatarwangli <wangli858794774@gmail.com>
parent 27b50f1f
...@@ -333,7 +333,7 @@ async def async_request_openai_chat_completions( ...@@ -333,7 +333,7 @@ async def async_request_openai_chat_completions(
) -> RequestFuncOutput: ) -> RequestFuncOutput:
api_url = request_func_input.api_url api_url = request_func_input.api_url
assert api_url.endswith( assert api_url.endswith(
"chat/completions" ("chat/completions", "profile")
), "OpenAI Chat Completions API URL must end with 'chat/completions'." ), "OpenAI Chat Completions API URL must end with 'chat/completions'."
async with aiohttp.ClientSession(trust_env=True, async with aiohttp.ClientSession(trust_env=True,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment