benchmarks/disagg_benchmarks/request_queue.py · bcf253396d86c8be49f819fa0bbcd80c118d3783 · OpenDAS / vllm_cscc

[P/D]Provide bucket algorithm rate limiter for proxy_server (#22643) · b2c06509

frankie authored Aug 15, 2025


Signed-off-by: frankie-ys <yongshengwang@cmbchina.com>
Signed-off-by: frankie <wangyongsheng686@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kuntai Du <kuntai@uchicago.edu>

b2c06509

request_queue.py 1.33 KB

Replace request_queue.py