---
id: pr-vllm-32195
repo: vllm-project/vllm
pr: 32195
title: Add TMA support to fused_moe_lora kernel
author: gnovack
date: '2026-03-01'
url: https://github.com/vllm-project/vllm/pull/32195
source_category: upstream-code
architectures:
- sm90
tags:
- arch_pipeline
- benchmark_test
- compiler_runtime
- moe_routing
- sm90
techniques:
- async-copy
- kernel-fusion
- pipeline-stages
hardware_features:
- hopper
- tma
kernel_types:
- compiler
- moe
- runtime
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 3ecd0bf9fccc425c015f7723b6a7730c0dda2970
inclusion_reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.
changed_paths:
- tests/lora/test_fused_moe_lora_kernel.py
- tests/lora/test_olmoe_tp.py
- vllm/lora/ops/triton_ops/fused_moe_lora_op.py
- vllm/lora/ops/triton_ops/utils.py
- vllm/triton_utils/allocation.py
artifact_dir: evidence/pull-bundles/vllm/gh-32195
head_ref_oid: 2667d93f8ec7c26f7a4e4fb9872debef66e8cd30
---
# Add TMA support to fused_moe_lora kernel

- Repository: `vllm-project/vllm`
- PR: [32195](https://github.com/vllm-project/vllm/pull/32195)
- Decision: `Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.`
- Reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.

## Changed Paths

- `tests/lora/test_fused_moe_lora_kernel.py`
- `tests/lora/test_olmoe_tp.py`
- `vllm/lora/ops/triton_ops/fused_moe_lora_op.py`
- `vllm/lora/ops/triton_ops/utils.py`
- `vllm/triton_utils/allocation.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-32195`
