benchmarks/disagg_benchmarks/disagg_prefill_proxy_server.py · b2c06509e58d8afefc1b5fb0f3d91f0cc9d9f279 · OpenDAS / vllm_cscc

[P/D]Provide bucket algorithm rate limiter for proxy_server (#22643) · b2c06509

frankie authored Aug 15, 2025


Signed-off-by: frankie-ys <yongshengwang@cmbchina.com>
Signed-off-by: frankie <wangyongsheng686@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kuntai Du <kuntai@uchicago.edu>

b2c06509

disagg_prefill_proxy_server.py 6.61 KB

Replace disagg_prefill_proxy_server.py