vllm/entrypoints/openai/serving_chat.py · 5aef49806da2e6cc8a92c948d44e8a722469135f · OpenDAS / vllm_cscc

[Feature] Add load generation config from model (#11164) · 5aef4980

Yanyi Liu authored Dec 19, 2024


Signed-off-by: liuyanyi <wolfsonliu@163.com>
Signed-off-by: Yanyi Liu <wolfsonliu@163.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5aef4980

serving_chat.py 38.5 KB

Replace serving_chat.py