Fix bench_serving flush cache not recognizing OPENAI_API_KEY (#4181)

Signed-off-by: Mingshan <git@brighill.com>

Fix bench_serving flush cache not recognizing OPENAI_API_KEY (#4181)
Signed-off-by: Mingshan <git@brighill.com>
0fe7c13b · Mingshan · GitHub · 08c4d764 · 0fe7c13b
Unverified Commit 0fe7c13b authored Mar 08, 2025 by Mingshan Committed by GitHub Mar 08, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

python/sglang/bench_serving.py python/sglang/bench_serving.py +1 -1

No files found.
--- a/python/sglang/bench_serving.py
+++ b/python/sglang/bench_serving.py
@@ -1006,7 +1006,7 @@ async def benchmark(

    # Flush cache
    if "sglang" in backend:
-        requests.post(base_url + "/flush_cache")
+        requests.post(base_url + "/flush_cache", headers=get_auth_headers())

    time.sleep(1.0)