---
id: pr-sglang-14105
repo: sgl-project/sglang
pr: 14105
title: '[LoRA][III] Add LoRA support for MoE layers and enable TP'
author: jonahbernard
date: '2026-03-24'
url: https://github.com/sgl-project/sglang/pull/14105
source_category: upstream-code
architectures:
- sm100
tags:
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- moe
languages:
- python
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: a32e0d57e7f04db5fa9a728b4e4ef1a2e537fe00
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/layers/moe/moe_runner/runner.py
- python/sglang/srt/lora/layers.py
- python/sglang/srt/lora/lora.py
- python/sglang/srt/lora/lora_manager.py
- python/sglang/srt/lora/lora_moe_runners.py
- python/sglang/srt/lora/mem_pool.py
- python/sglang/srt/lora/triton_ops/fused_moe_lora_kernel.py
- python/sglang/srt/lora/utils.py
- python/sglang/test/lora_utils.py
- test/registered/lora/test_lora_moe_tp_logprob_diff.py
- test/registered/lora/test_lora_moe_vllm_sgl_logprob_diff.py
head_ref_oid: c6c59b3f2090783db3cc310d9dd8146e222d3a4b
artifact_dir: evidence/pull-bundles/sglang/gh-14105
---
# [LoRA][III] Add LoRA support for MoE layers and enable TP

- Repository: `sgl-project/sglang`
- PR: [14105](https://github.com/sgl-project/sglang/pull/14105)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/layers/moe/moe_runner/runner.py`
- `python/sglang/srt/lora/layers.py`
- `python/sglang/srt/lora/lora.py`
- `python/sglang/srt/lora/lora_manager.py`
- `python/sglang/srt/lora/lora_moe_runners.py`
- `python/sglang/srt/lora/mem_pool.py`
- `python/sglang/srt/lora/triton_ops/fused_moe_lora_kernel.py`
- `python/sglang/srt/lora/utils.py`
- `python/sglang/test/lora_utils.py`
- `test/registered/lora/test_lora_moe_tp_logprob_diff.py`
- `test/registered/lora/test_lora_moe_vllm_sgl_logprob_diff.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-14105`
