---
id: pr-vllm-41263
repo: vllm-project/vllm
pr: 41263
title: '[DSV4]   Fuse norm and router for low latency scenario'
author: jeejeelee
date: '2026-05-14'
url: https://github.com/vllm-project/vllm/pull/41263
source_category: upstream-code
architectures:
- sm90
tags:
- CUDA kernel
- benchmark kernel
- benchmark_test
- norm_elementwise
- sm90
techniques:
- kernel-fusion
hardware_features:
- hopper
kernel_types:
- gemm
- moe
- norm
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 0a65d46628fdc7d8e83c1111b46a078219d7d983
inclusion_reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.
changed_paths:
- CMakeLists.txt
- benchmarks/kernels/benchmark_norm_router_gemm.py
- csrc/moe/dsv4_norm_router_gemm.h
- csrc/moe/dsv4_norm_router_gemm_entry.cu
- csrc/moe/dsv4_norm_router_gemm_kernel.cu
- csrc/moe/moe_ops.h
- csrc/moe/torch_bindings.cpp
- vllm/_custom_ops.py
- vllm/model_executor/layers/fused_moe/router/norm_gate_linear.py
- vllm/model_executor/models/deepseek_v4.py
- vllm/model_executor/models/deepseek_v4_mtp.py
artifact_dir: evidence/pull-bundles/vllm/gh-41263
head_ref_oid: 9700ef135bf1aec00f7e71e9594286cad503cbb5
---
# [DSV4]   Fuse norm and router for low latency scenario

- Repository: `vllm-project/vllm`
- PR: [41263](https://github.com/vllm-project/vllm/pull/41263)
- Decision: `Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.`
- Reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.

## Changed Paths

- `CMakeLists.txt`
- `benchmarks/kernels/benchmark_norm_router_gemm.py`
- `csrc/moe/dsv4_norm_router_gemm.h`
- `csrc/moe/dsv4_norm_router_gemm_entry.cu`
- `csrc/moe/dsv4_norm_router_gemm_kernel.cu`
- `csrc/moe/moe_ops.h`
- `csrc/moe/torch_bindings.cpp`
- `vllm/_custom_ops.py`
- `vllm/model_executor/layers/fused_moe/router/norm_gate_linear.py`
- `vllm/model_executor/models/deepseek_v4.py`
- `vllm/model_executor/models/deepseek_v4_mtp.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-41263`
