---
id: pr-flashinfer-1795
repo: flashinfer-ai/flashinfer
pr: 1795
title: 'refactor: cleanup codebase after tvm-ffi refactor'
author: yzh119
date: '2025-09-29'
url: https://github.com/flashinfer-ai/flashinfer/pull/1795
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: d161b567875f47f20ff564eacda56d900e6d509b
inclusion_reason: defer
changed_paths:
- csrc/batch_attention_jit_binding.cu
- csrc/batch_decode_jit_binding.cu
- csrc/batch_decode_mla_binding.cu
- csrc/batch_mla_binding.cu
- csrc/batch_mla_sm90_binding.cu
- csrc/batch_prefill_jit_binding.cu
- csrc/batch_prefill_sm90_jit_binding.cu
- csrc/cudnn_sdpa_kernel_launcher.cu
- csrc/flashinfer_cascade_binding.cu
- csrc/flashinfer_gemm_binding.cu
- csrc/flashinfer_gemm_sm90_binding.cu
- csrc/flashinfer_mla_binding.cu
- csrc/flashinfer_norm_binding.cu
- csrc/flashinfer_quantization_binding.cu
- csrc/flashinfer_rope_binding.cu
- csrc/flashinfer_sampling_binding.cu
- csrc/fmhaReduction.cu
- csrc/fmha_cutlass_sm100_binding.cu
- csrc/fused_moe/cutlass_backend/flashinfer_cutlass_fused_moe_sm100_binding.cu
- csrc/gemm_sm100_binding.cu
- csrc/gemm_sm120_binding.cu
- csrc/group_gemm_sm100_binding.cu
- csrc/group_gemm_sm120_binding.cu
- csrc/pod_jit_binding.cu
- csrc/single_decode_jit_binding.cu
- csrc/single_prefill_jit_binding.cu
- csrc/single_prefill_sm90_jit_binding.cu
- csrc/trtllm_batched_gemm_runner.cu
- csrc/trtllm_fused_moe_dev_kernel.cu
- csrc/trtllm_fused_moe_routing_deepseek.cu
- csrc/trtllm_fused_moe_routing_llama4.cu
- csrc/trtllm_fused_moe_runner.cu
- csrc/trtllm_gemm_runner.cu
- custom_backend.py
- docker/install/install_python_packages.sh
- flashinfer/cascade.py
- flashinfer/fused_moe/core.py
- flashinfer/gemm.py
- flashinfer/jit/__init__.py
- flashinfer/jit/attention/__init__.py
- flashinfer/jit/attention/modules.py
- flashinfer/jit/attention/tvm.py
- flashinfer/jit/cpp_ext.py
- flashinfer/jit/env.py
- flashinfer/jit/gemm/__init__.py
- flashinfer/jit/gemm/tvm.py
- flashinfer/mla.py
- flashinfer/norm.py
- flashinfer/quantization.py
- flashinfer/rope.py
- flashinfer/sampling.py
- include/flashinfer/exception.h
- include/flashinfer/trtllm/common.h
- include/flashinfer/trtllm/common/cudaUtils.h
- include/flashinfer/trtllm/fmha/decoder_impl_common.h
- include/flashinfer/trtllm/fmha/fmhaKernels.cuh
- include/flashinfer/trtllm/fmha/fmhaRunner.cuh
- include/flashinfer/trtllm/fmha/kernelParams.h
- include/flashinfer/trtllm/fused_moe/DevKernel.h
- pyproject.toml
- setup.py
- tests/test_batch_decode_kernels.py
- tests/test_batch_prefill_kernels.py
- tests/test_deepseek_mla.py
- tests/test_tensor_cores_decode.py
- tests/test_trtllm_allreduce_fusion.py
- tests/test_trtllm_alltoall.py
- tests/test_trtllm_gen_fused_moe.py
- tests/test_trtllm_moe_allreduce_fusion.py
- tests/test_trtllm_moe_allreduce_fusion_finalize.py
- tvm_binding/batch_decode.cu
- tvm_binding/batch_decode_customize_config.jinja
- tvm_binding/batch_decode_jit_tvm_binding.cu
- tvm_binding/batch_mla_config.jinja
- tvm_binding/batch_mla_jit_tvm_binding.cu
- tvm_binding/batch_mla_plan.cu
- tvm_binding/batch_mla_run.cu
- tvm_binding/batch_prefill.cu
- tvm_binding/batch_prefill_customize_config.jinja
- tvm_binding/batch_prefill_jit_tvm_binding.cu
- tvm_binding/batch_prefill_sm90.cu
- tvm_binding/batch_prefill_sm90_customize_config.jinja
- tvm_binding/batch_prefill_sm90_jit_tvm_binding.cu
- tvm_binding/grouped_gemm_fp8.cu
- tvm_binding/grouped_gemm_fp8_jit_tvm_binding.cu
- tvm_binding/sampling.cu
- tvm_binding/sampling_jit_tvm_binding.cu
- tvm_binding/tvm_binding_utils.h
artifact_dir: evidence/pull-bundles/flashinfer/gh-1795
head_ref_oid: c58be117c5a1a6c62b109a3e9d6ba737fa978cc1
---
# refactor: cleanup codebase after tvm-ffi refactor

- Repository: `flashinfer-ai/flashinfer`
- PR: [1795](https://github.com/flashinfer-ai/flashinfer/pull/1795)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `csrc/batch_attention_jit_binding.cu`
- `csrc/batch_decode_jit_binding.cu`
- `csrc/batch_decode_mla_binding.cu`
- `csrc/batch_mla_binding.cu`
- `csrc/batch_mla_sm90_binding.cu`
- `csrc/batch_prefill_jit_binding.cu`
- `csrc/batch_prefill_sm90_jit_binding.cu`
- `csrc/cudnn_sdpa_kernel_launcher.cu`
- `csrc/flashinfer_cascade_binding.cu`
- `csrc/flashinfer_gemm_binding.cu`
- `csrc/flashinfer_gemm_sm90_binding.cu`
- `csrc/flashinfer_mla_binding.cu`
- `csrc/flashinfer_norm_binding.cu`
- `csrc/flashinfer_quantization_binding.cu`
- `csrc/flashinfer_rope_binding.cu`
- `csrc/flashinfer_sampling_binding.cu`
- `csrc/fmhaReduction.cu`
- `csrc/fmha_cutlass_sm100_binding.cu`
- `csrc/fused_moe/cutlass_backend/flashinfer_cutlass_fused_moe_sm100_binding.cu`
- `csrc/gemm_sm100_binding.cu`
- `csrc/gemm_sm120_binding.cu`
- `csrc/group_gemm_sm100_binding.cu`
- `csrc/group_gemm_sm120_binding.cu`
- `csrc/pod_jit_binding.cu`
- `csrc/single_decode_jit_binding.cu`
- `csrc/single_prefill_jit_binding.cu`
- `csrc/single_prefill_sm90_jit_binding.cu`
- `csrc/trtllm_batched_gemm_runner.cu`
- `csrc/trtllm_fused_moe_dev_kernel.cu`
- `csrc/trtllm_fused_moe_routing_deepseek.cu`
- `csrc/trtllm_fused_moe_routing_llama4.cu`
- `csrc/trtllm_fused_moe_runner.cu`
- `csrc/trtllm_gemm_runner.cu`
- `custom_backend.py`
- `docker/install/install_python_packages.sh`
- `flashinfer/cascade.py`
- `flashinfer/fused_moe/core.py`
- `flashinfer/gemm.py`
- `flashinfer/jit/__init__.py`
- `flashinfer/jit/attention/__init__.py`
- `flashinfer/jit/attention/modules.py`
- `flashinfer/jit/attention/tvm.py`
- `flashinfer/jit/cpp_ext.py`
- `flashinfer/jit/env.py`
- `flashinfer/jit/gemm/__init__.py`
- `flashinfer/jit/gemm/tvm.py`
- `flashinfer/mla.py`
- `flashinfer/norm.py`
- `flashinfer/quantization.py`
- `flashinfer/rope.py`
- `flashinfer/sampling.py`
- `include/flashinfer/exception.h`
- `include/flashinfer/trtllm/common.h`
- `include/flashinfer/trtllm/common/cudaUtils.h`
- `include/flashinfer/trtllm/fmha/decoder_impl_common.h`
- `include/flashinfer/trtllm/fmha/fmhaKernels.cuh`
- `include/flashinfer/trtllm/fmha/fmhaRunner.cuh`
- `include/flashinfer/trtllm/fmha/kernelParams.h`
- `include/flashinfer/trtllm/fused_moe/DevKernel.h`
- `pyproject.toml`
- `setup.py`
- `tests/test_batch_decode_kernels.py`
- `tests/test_batch_prefill_kernels.py`
- `tests/test_deepseek_mla.py`
- `tests/test_tensor_cores_decode.py`
- `tests/test_trtllm_allreduce_fusion.py`
- `tests/test_trtllm_alltoall.py`
- `tests/test_trtllm_gen_fused_moe.py`
- `tests/test_trtllm_moe_allreduce_fusion.py`
- `tests/test_trtllm_moe_allreduce_fusion_finalize.py`
- `tvm_binding/batch_decode.cu`
- `tvm_binding/batch_decode_customize_config.jinja`
- `tvm_binding/batch_decode_jit_tvm_binding.cu`
- `tvm_binding/batch_mla_config.jinja`
- `tvm_binding/batch_mla_jit_tvm_binding.cu`
- `tvm_binding/batch_mla_plan.cu`
- `tvm_binding/batch_mla_run.cu`
- `tvm_binding/batch_prefill.cu`
- `tvm_binding/batch_prefill_customize_config.jinja`
- `tvm_binding/batch_prefill_jit_tvm_binding.cu`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1795`
