Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e373853e
"vscode:/vscode.git/clone" did not exist on "af9b69f977bd1166ed63c46f9ccbd3a02344ae4f"
Unverified
Commit
e373853e
authored
Jul 01, 2024
by
James Whedbee
Committed by
GitHub
Jul 01, 2024
Browse files
[Frontend] Relax api url assertion for openai benchmarking (#6046)
parent
c87ebc3e
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
benchmarks/backend_request_func.py
benchmarks/backend_request_func.py
+4
-4
No files found.
benchmarks/backend_request_func.py
View file @
e373853e
...
@@ -225,8 +225,8 @@ async def async_request_openai_completions(
...
@@ -225,8 +225,8 @@ async def async_request_openai_completions(
)
->
RequestFuncOutput
:
)
->
RequestFuncOutput
:
api_url
=
request_func_input
.
api_url
api_url
=
request_func_input
.
api_url
assert
api_url
.
endswith
(
assert
api_url
.
endswith
(
"
v1/
completions"
"completions"
),
"OpenAI Completions API URL must end with '
v1/
completions'."
),
"OpenAI Completions API URL must end with 'completions'."
async
with
aiohttp
.
ClientSession
(
timeout
=
AIOHTTP_TIMEOUT
)
as
session
:
async
with
aiohttp
.
ClientSession
(
timeout
=
AIOHTTP_TIMEOUT
)
as
session
:
assert
not
request_func_input
.
use_beam_search
assert
not
request_func_input
.
use_beam_search
...
@@ -304,8 +304,8 @@ async def async_request_openai_chat_completions(
...
@@ -304,8 +304,8 @@ async def async_request_openai_chat_completions(
)
->
RequestFuncOutput
:
)
->
RequestFuncOutput
:
api_url
=
request_func_input
.
api_url
api_url
=
request_func_input
.
api_url
assert
api_url
.
endswith
(
assert
api_url
.
endswith
(
"
v1/
chat/completions"
"chat/completions"
),
"OpenAI Chat Completions API URL must end with '
v1/
chat/completions'."
),
"OpenAI Chat Completions API URL must end with 'chat/completions'."
async
with
aiohttp
.
ClientSession
(
timeout
=
AIOHTTP_TIMEOUT
)
as
session
:
async
with
aiohttp
.
ClientSession
(
timeout
=
AIOHTTP_TIMEOUT
)
as
session
:
assert
not
request_func_input
.
use_beam_search
assert
not
request_func_input
.
use_beam_search
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment