csrc/quantization/w8a8/cutlass/scaled_mm_entry.cu · 308feab33f3b386a6701cc5b28337bc04fe13a9b · OpenDAS / vllm_cscc

"vllm/tool_parsers/hermes_tool_parser.py" did not exist on "f256ebe4df6757d76f1f1642d7e110268a2f8190"

[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3

Wentao Ye authored Jan 09, 2026


[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

308feab3

scaled_mm_entry.cu 18.2 KB

Replace scaled_mm_entry.cu