vllm/entrypoints/openai/protocol.py · 995f56236bc08300ea11fc8cd3d66029ffec8678 · OpenDAS / vllm_cscc

[Feature] Add load generation config from model (#11164) · 5aef4980

Yanyi Liu authored Dec 19, 2024


Signed-off-by: liuyanyi <wolfsonliu@163.com>
Signed-off-by: Yanyi Liu <wolfsonliu@163.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5aef4980

protocol.py 48 KB

Replace protocol.py