---
id: pr-flashinfer-968
repo: flashinfer-ai/flashinfer
pr: 968
title: 'perf: reduce torch.library dispatch overhead'
author: yzh119
date: '2025-03-22'
url: https://github.com/flashinfer-ai/flashinfer/pull/968
source_category: upstream-code
architectures:
- sm100
tags:
- decode
- gemm
- mla
- prefill
- quantization
techniques: []
hardware_features: []
kernel_types:
- decode
- gemm
- mla
- prefill
- quantization
languages:
- python
captured_at: '2026-04-17'
status: merged
merge_sha: 86b12adf6512d914b4c11b8f7fa469e6511f75c2
inclusion_reason: kernel file changes
changed_paths:
- flashinfer/activation.py
- flashinfer/cascade.py
- flashinfer/decode.py
- flashinfer/gemm.py
- flashinfer/mla.py
- flashinfer/norm.py
- flashinfer/page.py
- flashinfer/pod.py
- flashinfer/prefill.py
- flashinfer/quantization.py
- flashinfer/rope.py
- flashinfer/sampling.py
head_ref_oid: 720a7138ef04f82fb63e1efda8317b6f1f6eddfd
artifact_dir: evidence/pull-bundles/flashinfer/gh-968
---
# perf: reduce torch.library dispatch overhead

- Repository: `flashinfer-ai/flashinfer`
- PR: [968](https://github.com/flashinfer-ai/flashinfer/pull/968)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `flashinfer/activation.py`
- `flashinfer/cascade.py`
- `flashinfer/decode.py`
- `flashinfer/gemm.py`
- `flashinfer/mla.py`
- `flashinfer/norm.py`
- `flashinfer/page.py`
- `flashinfer/pod.py`
- `flashinfer/prefill.py`
- `flashinfer/quantization.py`
- `flashinfer/rope.py`
- `flashinfer/sampling.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-968`
