---
id: pr-sglang-16824
repo: sgl-project/sglang
pr: 16824
title: '[Fix] `flashinfer_trtllm` `intermediate_size` assertion with Qwen3 + TP=8'
author: b8zhong
date: '2026-01-17'
url: https://github.com/sgl-project/sglang/pull/16824
source_category: upstream-code
architectures:
- sm100
tags:
- kernel-fusion
- moe
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- moe
languages:
- python
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: d36f6f043ce881d7db7b08856e217cd1250b6c2f
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/layers/moe/fused_moe_triton/layer.py
- python/sglang/srt/server_args.py
- python/sglang/srt/utils/common.py
head_ref_oid: 41847b20c3e8c9ff56ccc0fb7d3b6fc63da749fb
artifact_dir: evidence/pull-bundles/sglang/gh-16824
---
# [Fix] `flashinfer_trtllm` `intermediate_size` assertion with Qwen3 + TP=8

- Repository: `sgl-project/sglang`
- PR: [16824](https://github.com/sgl-project/sglang/pull/16824)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/layers/moe/fused_moe_triton/layer.py`
- `python/sglang/srt/server_args.py`
- `python/sglang/srt/utils/common.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-16824`
