Merge branch 'v0.9.2-dev-ds-new' into 'v0.9.2-dev-ds'
feat: pp mtp加入零消耗调度,加入环境变量VLLM_USE_ZERO_MTP,默认打开 See merge request dcutoolkit/deeplearing/vllm!277
Showing
This diff is collapsed.
Please register or sign in to comment
feat: pp mtp加入零消耗调度,加入环境变量VLLM_USE_ZERO_MTP,默认打开 See merge request dcutoolkit/deeplearing/vllm!277