Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "adc01cd76ae0d9d3b2e8dde3ec6bf4086f7da046"
Unverified Commit 09798b36 authored by Lianmin Zheng's avatar Lianmin Zheng Committed by GitHub
Browse files

Fix chunked prefill size for bench_offline_throughput (#2234)

parent b79fffdc
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/server_args.py
View file @ 09798b36
...@@ -144,7 +144,7 @@ class ServerArgs: ...@@ -144,7 +144,7 @@ class ServerArgs:
if self.served_model_name is None: if self.served_model_name is None:
self.served_model_name = self.model_path self.served_model_name = self.model_path
if self.chunked_prefill_size <= 0: if self.chunked_prefill_size is not None and self.chunked_prefill_size <= 0:
# Disable chunked prefill # Disable chunked prefill
self.chunked_prefill_size = None self.chunked_prefill_size = None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment