---
id: pr-vllm-21229
repo: vllm-project/vllm
pr: 21229
title: '[Feature][Kernel]FusedMoE LoRA'
author: wcwuwc
date: '2025-10-21'
url: https://github.com/vllm-project/vllm/pull/21229
source_category: upstream-code
architectures:
- sm100
tags:
- kernel-fusion
- moe
- pipeline-stages
techniques:
- kernel-fusion
- pipeline-stages
hardware_features: []
kernel_types:
- moe
languages:
- cuda-cpp
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: 5f6cbf60d667408ef1bf3871c0b7563effa6094a
inclusion_reason: kernel file changes
changed_paths:
- .buildkite/test-pipeline.yaml
- CMakeLists.txt
- csrc/moe/moe_lora_align_sum_kernels.cu
- csrc/moe/moe_ops.h
- csrc/moe/torch_bindings.cpp
- tests/lora/conftest.py
- tests/lora/test_deepseekv2_tp.py
- tests/lora/test_fused_moe_lora_kernel.py
- tests/lora/test_gptoss.py
- tests/lora/test_moe_lora_align_sum.py
- tests/lora/test_olmoe_tp.py
- tests/lora/test_qwen3moe_tp.py
- vllm/_custom_ops.py
- vllm/lora/layers/__init__.py
- vllm/lora/layers/fused_moe.py
- vllm/lora/models.py
- vllm/lora/ops/triton_ops/__init__.py
- vllm/lora/ops/triton_ops/fused_moe_lora_op.py
- vllm/lora/punica_wrapper/punica_base.py
- vllm/lora/punica_wrapper/punica_gpu.py
- vllm/lora/utils.py
- vllm/lora/worker_manager.py
- vllm/model_executor/layers/fused_moe/fused_marlin_moe.py
- vllm/model_executor/layers/fused_moe/fused_moe.py
- vllm/model_executor/layers/fused_moe/modular_kernel.py
- vllm/model_executor/models/deepseek_v2.py
- vllm/model_executor/models/gpt_oss.py
- vllm/model_executor/models/olmoe.py
head_ref_oid: 6cba4c6799a89af40054a77d5e98023285de63cf
artifact_dir: evidence/pull-bundles/vllm/gh-21229
---
# [Feature][Kernel]FusedMoE LoRA

- Repository: `vllm-project/vllm`
- PR: [21229](https://github.com/vllm-project/vllm/pull/21229)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `.buildkite/test-pipeline.yaml`
- `CMakeLists.txt`
- `csrc/moe/moe_lora_align_sum_kernels.cu`
- `csrc/moe/moe_ops.h`
- `csrc/moe/torch_bindings.cpp`
- `tests/lora/conftest.py`
- `tests/lora/test_deepseekv2_tp.py`
- `tests/lora/test_fused_moe_lora_kernel.py`
- `tests/lora/test_gptoss.py`
- `tests/lora/test_moe_lora_align_sum.py`
- `tests/lora/test_olmoe_tp.py`
- `tests/lora/test_qwen3moe_tp.py`
- `vllm/_custom_ops.py`
- `vllm/lora/layers/__init__.py`
- `vllm/lora/layers/fused_moe.py`
- `vllm/lora/models.py`
- `vllm/lora/ops/triton_ops/__init__.py`
- `vllm/lora/ops/triton_ops/fused_moe_lora_op.py`
- `vllm/lora/punica_wrapper/punica_base.py`
- `vllm/lora/punica_wrapper/punica_gpu.py`
- `vllm/lora/utils.py`
- `vllm/lora/worker_manager.py`
- `vllm/model_executor/layers/fused_moe/fused_marlin_moe.py`
- `vllm/model_executor/layers/fused_moe/fused_moe.py`
- `vllm/model_executor/layers/fused_moe/modular_kernel.py`
- `vllm/model_executor/models/deepseek_v2.py`
- `vllm/model_executor/models/gpt_oss.py`
- `vllm/model_executor/models/olmoe.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-21229`
