Merge branch 'v0.11.0-dev_scheduler' into 'v0.11.0-dev'
修复schedule_default,schedule_split_pd,因kv cache耗尽,服务挂掉的问题 See merge request dcutoolkit/deeplearing/vllm!266
Showing
Please register or sign in to comment
修复schedule_default,schedule_split_pd,因kv cache耗尽,服务挂掉的问题 See merge request dcutoolkit/deeplearing/vllm!266