Skip to content

GitLab

Unverified Commit 0fe7c13b authored by Mingshan's avatar Mingshan Committed by GitHub
Browse files

Fix bench_serving flush cache not recognizing OPENAI_API_KEY (#4181) 


Signed-off-by: default avatarMingshan <git@brighill.com>
parent 08c4d764
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/bench_serving.py
View file @ 0fe7c13b
...@@ -1006,7 +1006,7 @@ async def benchmark( ...@@ -1006,7 +1006,7 @@ async def benchmark(
# Flush cache # Flush cache
if "sglang" in backend: if "sglang" in backend:
requests.post(base_url + "/flush_cache") requests.post(base_url + "/flush_cache", headers=get_auth_headers())
time.sleep(1.0) time.sleep(1.0)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment