Skip to content

GitLab

Unverified Commit bb603268 authored by zhyncs's avatar zhyncs Committed by GitHub
Browse files

[Misc] update benchmark backend for scalellm (#6018)

parent 4050d646
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
benchmarks/backend_request_func.py
View file @ bb603268
...@@ -422,4 +422,5 @@ ASYNC_REQUEST_FUNCS = { ...@@ -422,4 +422,5 @@ ASYNC_REQUEST_FUNCS = {
"openai": async_request_openai_completions, "openai": async_request_openai_completions,
"openai-chat": async_request_openai_chat_completions, "openai-chat": async_request_openai_chat_completions,
"tensorrt-llm": async_request_trt_llm, "tensorrt-llm": async_request_trt_llm,
"scalellm": async_request_openai_completions,
} }
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment