test/srt/model/bench_llama_low_api.py · 0463f7fb52f06dcae2b10b7ca2a18a86ac135f96 · change / sglang

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

bench_llama_low_api.py 8.34 KB

Replace bench_llama_low_api.py