---
id: pr-vllm-12222
repo: vllm-project/vllm
pr: 12222
title: '[Kernel] optimize moe_align_block_size for cuda graph and large num_experts (e.g. DeepSeek-V3)'
author: jinzhen-lin
date: '2025-01-21'
url: https://github.com/vllm-project/vllm/pull/12222
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 750f4cabfac4bfed679d95074d9550b043e3f8d5
inclusion_reason: defer
changed_paths:
- csrc/moe/moe_align_sum_kernels.cu
- vllm/config.py
artifact_dir: evidence/pull-bundles/vllm/gh-12222
head_ref_oid: 49fb02355433e2167f1ab88ec27b84f8bf287204
---
# [Kernel] optimize moe_align_block_size for cuda graph and large num_experts (e.g. DeepSeek-V3)

- Repository: `vllm-project/vllm`
- PR: [12222](https://github.com/vllm-project/vllm/pull/12222)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `csrc/moe/moe_align_sum_kernels.cu`
- `vllm/config.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-12222`
