Skip to content

GitLab

"git@developer.sourcefind.cn:renzhc/diffusers_dcu.git" did not exist on "f7cd6b87e1ee8c7909de760f22f1a6b0c6ae0592"
Unverified Commit 8a56b431 authored by Ying Sheng's avatar Ying Sheng Committed by GitHub
Browse files

[Bench] Flush cache before benchmarking (#2566)

parent e835a500
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
python/sglang/bench_serving.py
View file @ 8a56b431
...@@ -924,6 +924,7 @@ async def benchmark( ...@@ -924,6 +924,7 @@ async def benchmark(
f"are correctly specified. Error: {test_output.error}" f"are correctly specified. Error: {test_output.error}"
) )
else: else:
requests.post(base_url + "/flush_cache")
print("Initial test run completed. Starting main benchmark run...") print("Initial test run completed. Starting main benchmark run...")
time.sleep(1.5) time.sleep(1.5)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment