---
id: pr-flashinfer-2238
repo: flashinfer-ai/flashinfer
pr: 2238
title: 'fix: Handle zeros in Mistral Large 3 MoE inference'
author: dbari
date: '2026-01-14'
url: https://github.com/flashinfer-ai/flashinfer/pull/2238
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 36380e2ceae41b5d75d5f0b98d26ac2a6d075e0f
inclusion_reason: defer
changed_paths:
- csrc/trtllm_fused_moe_dev_kernel.cu
- flashinfer/artifacts.py
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/BatchedGemmInterface.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/BatchedGemmOptions.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/Enums.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/GemmGatedActOptions.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/GemmOptions.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/KernelParams.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/KernelParamsDecl.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/KernelTraits.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/TmaDescriptor.h
- include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/trtllm/gen/MmaDecl.h
- tests/moe/test_trtllm_gen_fused_moe.py
- tests/moe/utils.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-2238
head_ref_oid: ed24b6547f06a82a2ef5c9614f69dc980652802d
---
# fix: Handle zeros in Mistral Large 3 MoE inference

- Repository: `flashinfer-ai/flashinfer`
- PR: [2238](https://github.com/flashinfer-ai/flashinfer/pull/2238)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `csrc/trtllm_fused_moe_dev_kernel.cu`
- `flashinfer/artifacts.py`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/BatchedGemmInterface.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/BatchedGemmOptions.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/Enums.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/GemmGatedActOptions.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/GemmOptions.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/KernelParams.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/KernelParamsDecl.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/KernelTraits.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/TmaDescriptor.h`
- `include/flashinfer/trtllm/batched_gemm/trtllmGen_bmm_export/trtllm/gen/MmaDecl.h`
- `tests/moe/test_trtllm_gen_fused_moe.py`
- `tests/moe/utils.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2238`
