---
id: pr-vllm-31104
repo: vllm-project/vllm
pr: 31104
title: '[BugFix] LoRA: Support loading base_layer of experts'
author: HollowMan6
date: '2026-01-07'
url: https://github.com/vllm-project/vllm/pull/31104
source_category: upstream-code
architectures:
- sm100
tags:
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- moe
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 482914849cf9ce61d3e0dffaa35096bb34de58f5
inclusion_reason: kernel file changes
changed_paths:
- vllm/model_executor/layers/fused_moe/layer.py
- vllm/model_executor/models/afmoe.py
- vllm/model_executor/models/bailing_moe.py
- vllm/model_executor/models/deepseek_eagle.py
- vllm/model_executor/models/deepseek_mtp.py
- vllm/model_executor/models/deepseek_v2.py
- vllm/model_executor/models/dots1.py
- vllm/model_executor/models/ernie45_moe.py
- vllm/model_executor/models/ernie45_vl_moe.py
- vllm/model_executor/models/glm4_moe.py
- vllm/model_executor/models/glm4_moe_mtp.py
- vllm/model_executor/models/gpt_oss.py
- vllm/model_executor/models/granitemoe.py
- vllm/model_executor/models/grok1.py
- vllm/model_executor/models/hunyuan_v1.py
- vllm/model_executor/models/jamba.py
- vllm/model_executor/models/kimi_linear.py
- vllm/model_executor/models/kimi_vl.py
- vllm/model_executor/models/lfm2_moe.py
- vllm/model_executor/models/llama4.py
- vllm/model_executor/models/longcat_flash.py
- vllm/model_executor/models/mimo_v2_flash.py
- vllm/model_executor/models/minimax_m2.py
- vllm/model_executor/models/mixtral.py
- vllm/model_executor/models/mllama4.py
- vllm/model_executor/models/nemotron_h.py
- vllm/model_executor/models/olmoe.py
- vllm/model_executor/models/openpangu.py
- vllm/model_executor/models/openpangu_mtp.py
- vllm/model_executor/models/phimoe.py
- vllm/model_executor/models/qwen2_moe.py
- vllm/model_executor/models/qwen3_moe.py
- vllm/model_executor/models/qwen3_next.py
- vllm/model_executor/models/qwen3_next_mtp.py
- vllm/model_executor/models/transformers/moe.py
head_ref_oid: 701b68efba00a3dd930e683ebfa269473f804205
artifact_dir: evidence/pull-bundles/vllm/gh-31104
---
# [BugFix] LoRA: Support loading base_layer of experts

- Repository: `vllm-project/vllm`
- PR: [31104](https://github.com/vllm-project/vllm/pull/31104)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `vllm/model_executor/layers/fused_moe/layer.py`
- `vllm/model_executor/models/afmoe.py`
- `vllm/model_executor/models/bailing_moe.py`
- `vllm/model_executor/models/deepseek_eagle.py`
- `vllm/model_executor/models/deepseek_mtp.py`
- `vllm/model_executor/models/deepseek_v2.py`
- `vllm/model_executor/models/dots1.py`
- `vllm/model_executor/models/ernie45_moe.py`
- `vllm/model_executor/models/ernie45_vl_moe.py`
- `vllm/model_executor/models/glm4_moe.py`
- `vllm/model_executor/models/glm4_moe_mtp.py`
- `vllm/model_executor/models/gpt_oss.py`
- `vllm/model_executor/models/granitemoe.py`
- `vllm/model_executor/models/grok1.py`
- `vllm/model_executor/models/hunyuan_v1.py`
- `vllm/model_executor/models/jamba.py`
- `vllm/model_executor/models/kimi_linear.py`
- `vllm/model_executor/models/kimi_vl.py`
- `vllm/model_executor/models/lfm2_moe.py`
- `vllm/model_executor/models/llama4.py`
- `vllm/model_executor/models/longcat_flash.py`
- `vllm/model_executor/models/mimo_v2_flash.py`
- `vllm/model_executor/models/minimax_m2.py`
- `vllm/model_executor/models/mixtral.py`
- `vllm/model_executor/models/mllama4.py`
- `vllm/model_executor/models/nemotron_h.py`
- `vllm/model_executor/models/olmoe.py`
- `vllm/model_executor/models/openpangu.py`
- `vllm/model_executor/models/openpangu_mtp.py`
- `vllm/model_executor/models/phimoe.py`
- `vllm/model_executor/models/qwen2_moe.py`
- `vllm/model_executor/models/qwen3_moe.py`
- `vllm/model_executor/models/qwen3_next.py`
- `vllm/model_executor/models/qwen3_next_mtp.py`
- `vllm/model_executor/models/transformers/moe.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-31104`
