---
id: pr-flashinfer-764
repo: flashinfer-ai/flashinfer
pr: 764
title: 'refactor: change to TORCH_LIBRARY'
author: youkaichao
date: '2025-02-13'
url: https://github.com/flashinfer-ai/flashinfer/pull/764
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: db602a016de0c85b6aede5047aae86db8759cbf0
inclusion_reason: defer
changed_paths:
- aot_build_utils/generate_aot_default_additional_params_header.py
- csrc/batch_decode.cu
- csrc/batch_decode_jit_pybind.cu
- csrc/batch_decode_mla_plan.cu
- csrc/batch_decode_mla_pybind.cu
- csrc/batch_decode_mla_run.cu
- csrc/batch_mla_plan.cu
- csrc/batch_mla_pybind.cu
- csrc/batch_mla_run.cu
- csrc/batch_prefill.cu
- csrc/batch_prefill_jit_pybind.cu
- csrc/batch_prefill_sm90.cu
- csrc/batch_prefill_sm90_jit_pybind.cu
- csrc/flashinfer_cascade_ops.cu
- csrc/flashinfer_gemm_ops.cu
- csrc/flashinfer_gemm_sm90_ops.cu
- csrc/flashinfer_norm_ops.cu
- csrc/flashinfer_ops.cu
- csrc/flashinfer_ops_sm90.cu
- csrc/flashinfer_page_ops.cu
- csrc/flashinfer_quantization_ops.cu
- csrc/flashinfer_rope_ops.cu
- csrc/flashinfer_sampling_ops.cu
- csrc/page.cu
- csrc/pytorch_conversion_utils.h
- csrc/pytorch_extension_utils.h
- csrc/renorm.cu
- csrc/rope.cu
- csrc/sampling.cu
- csrc/single_decode.cu
- csrc/single_decode_jit_pybind.cu
- csrc/single_prefill.cu
- csrc/single_prefill_jit_pybind.cu
- csrc/single_prefill_sm90.cu
- csrc/single_prefill_sm90_jit_pybind.cu
- flashinfer/activation.py
- flashinfer/cascade.py
- flashinfer/decode.py
- flashinfer/gemm.py
- flashinfer/jit/activation.py
- flashinfer/jit/attention.py
- flashinfer/jit/core.py
- flashinfer/norm.py
- flashinfer/page.py
- flashinfer/prefill.py
- flashinfer/quantization.py
- flashinfer/rope.py
- flashinfer/sampling.py
- include/flashinfer/attention/scheduler.cuh
- include/flashinfer/gemm/group_gemm.cuh
- include/flashinfer/gemm/group_gemm_sm90.cuh
- setup.py
- tests/test_jit_example.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-764
head_ref_oid: 6b173391c7b88c34eb23973e2e45bdc08b45452b
---
# refactor: change to TORCH_LIBRARY

- Repository: `flashinfer-ai/flashinfer`
- PR: [764](https://github.com/flashinfer-ai/flashinfer/pull/764)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `aot_build_utils/generate_aot_default_additional_params_header.py`
- `csrc/batch_decode.cu`
- `csrc/batch_decode_jit_pybind.cu`
- `csrc/batch_decode_mla_plan.cu`
- `csrc/batch_decode_mla_pybind.cu`
- `csrc/batch_decode_mla_run.cu`
- `csrc/batch_mla_plan.cu`
- `csrc/batch_mla_pybind.cu`
- `csrc/batch_mla_run.cu`
- `csrc/batch_prefill.cu`
- `csrc/batch_prefill_jit_pybind.cu`
- `csrc/batch_prefill_sm90.cu`
- `csrc/batch_prefill_sm90_jit_pybind.cu`
- `csrc/flashinfer_cascade_ops.cu`
- `csrc/flashinfer_gemm_ops.cu`
- `csrc/flashinfer_gemm_sm90_ops.cu`
- `csrc/flashinfer_norm_ops.cu`
- `csrc/flashinfer_ops.cu`
- `csrc/flashinfer_ops_sm90.cu`
- `csrc/flashinfer_page_ops.cu`
- `csrc/flashinfer_quantization_ops.cu`
- `csrc/flashinfer_rope_ops.cu`
- `csrc/flashinfer_sampling_ops.cu`
- `csrc/page.cu`
- `csrc/pytorch_conversion_utils.h`
- `csrc/pytorch_extension_utils.h`
- `csrc/renorm.cu`
- `csrc/rope.cu`
- `csrc/sampling.cu`
- `csrc/single_decode.cu`
- `csrc/single_decode_jit_pybind.cu`
- `csrc/single_prefill.cu`
- `csrc/single_prefill_jit_pybind.cu`
- `csrc/single_prefill_sm90.cu`
- `csrc/single_prefill_sm90_jit_pybind.cu`
- `flashinfer/activation.py`
- `flashinfer/cascade.py`
- `flashinfer/decode.py`
- `flashinfer/gemm.py`
- `flashinfer/jit/activation.py`
- `flashinfer/jit/attention.py`
- `flashinfer/jit/core.py`
- `flashinfer/norm.py`
- `flashinfer/page.py`
- `flashinfer/prefill.py`
- `flashinfer/quantization.py`
- `flashinfer/rope.py`
- `flashinfer/sampling.py`
- `include/flashinfer/attention/scheduler.cuh`
- `include/flashinfer/gemm/group_gemm.cuh`
- `include/flashinfer/gemm/group_gemm_sm90.cuh`
- `setup.py`
- `tests/test_jit_example.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-764`
