Merge branch 'v0.9.2-dev-zero-mtp' into 'v0.9.2-dev'
feat: pp mtp加入零消耗调度,加入环境变量VLLM_USE_ZERO_MTP,默认打开 See merge request dcutoolkit/deeplearing/vllm!264
Showing
This diff is collapsed.
Please register or sign in to comment
feat: pp mtp加入零消耗调度,加入环境变量VLLM_USE_ZERO_MTP,默认打开 See merge request dcutoolkit/deeplearing/vllm!264