---
id: pr-flashinfer-1015
repo: flashinfer-ai/flashinfer
pr: 1015
title: add multi-item scoring
author: arde171
date: '2025-04-30'
url: https://github.com/flashinfer-ai/flashinfer/pull/1015
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- decode
- epilogue-fusion
- prefill
- quantization
- tile-scheduling
techniques:
- epilogue-fusion
- tile-scheduling
hardware_features: []
kernel_types:
- attention
- decode
- prefill
- quantization
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: 6c6f1a5bb7eea4fde15c1f800db3cdb5232952df
inclusion_reason: kernel file changes
changed_paths:
- aot_build_utils/generate_aot_default_additional_params_header.py
- aot_build_utils/literal_map.py
- csrc/batch_prefill_sm90.cu
- csrc/batch_prefill_sm90_customize_config.jinja
- flashinfer/decode.py
- flashinfer/jit/attention/pytorch.py
- flashinfer/jit/utils.py
- flashinfer/prefill.py
- flashinfer/sparse.py
- flashinfer/utils.py
- include/flashinfer/attention/default_prefill_params.cuh
- include/flashinfer/attention/hopper/default_params.cuh
- include/flashinfer/attention/hopper/epilogue.cuh
- include/flashinfer/attention/hopper/mainloop.cuh
- include/flashinfer/attention/hopper/mainloop_mma.cuh
- include/flashinfer/attention/hopper/prefill_sm90.cuh
- include/flashinfer/attention/hopper/quantization/epilogue.cuh
- include/flashinfer/attention/hopper/quantization/mainloop_load.cuh
- include/flashinfer/attention/hopper/quantization/mainloop_mma.cuh
- include/flashinfer/attention/hopper/quantization/mainloop_sparse_load.cuh
- include/flashinfer/attention/hopper/quantization/prefill_sm90.cuh
- include/flashinfer/attention/hopper/sparse_mainloop.cuh
- include/flashinfer/attention/hopper/tile_scheduler.cuh
- include/flashinfer/attention/hopper/variants.cuh
- include/flashinfer/attention/mask.cuh
- include/flashinfer/attention/prefill.cuh
- include/flashinfer/attention/scheduler.cuh
- include/flashinfer/utils.cuh
- setup.py
- src/flashinfer_ops.cuh
- tests/test_batch_prefill_kernels.py
- tests/test_hopper.py
- tests/test_jit_example.py
head_ref_oid: 398b7a088ad67d4f7c6a7eefbeb4a0c3a2d39fef
artifact_dir: evidence/pull-bundles/flashinfer/gh-1015
---
# add multi-item scoring

- Repository: `flashinfer-ai/flashinfer`
- PR: [1015](https://github.com/flashinfer-ai/flashinfer/pull/1015)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `aot_build_utils/generate_aot_default_additional_params_header.py`
- `aot_build_utils/literal_map.py`
- `csrc/batch_prefill_sm90.cu`
- `csrc/batch_prefill_sm90_customize_config.jinja`
- `flashinfer/decode.py`
- `flashinfer/jit/attention/pytorch.py`
- `flashinfer/jit/utils.py`
- `flashinfer/prefill.py`
- `flashinfer/sparse.py`
- `flashinfer/utils.py`
- `include/flashinfer/attention/default_prefill_params.cuh`
- `include/flashinfer/attention/hopper/default_params.cuh`
- `include/flashinfer/attention/hopper/epilogue.cuh`
- `include/flashinfer/attention/hopper/mainloop.cuh`
- `include/flashinfer/attention/hopper/mainloop_mma.cuh`
- `include/flashinfer/attention/hopper/prefill_sm90.cuh`
- `include/flashinfer/attention/hopper/quantization/epilogue.cuh`
- `include/flashinfer/attention/hopper/quantization/mainloop_load.cuh`
- `include/flashinfer/attention/hopper/quantization/mainloop_mma.cuh`
- `include/flashinfer/attention/hopper/quantization/mainloop_sparse_load.cuh`
- `include/flashinfer/attention/hopper/quantization/prefill_sm90.cuh`
- `include/flashinfer/attention/hopper/sparse_mainloop.cuh`
- `include/flashinfer/attention/hopper/tile_scheduler.cuh`
- `include/flashinfer/attention/hopper/variants.cuh`
- `include/flashinfer/attention/mask.cuh`
- `include/flashinfer/attention/prefill.cuh`
- `include/flashinfer/attention/scheduler.cuh`
- `include/flashinfer/utils.cuh`
- `setup.py`
- `src/flashinfer_ops.cuh`
- `tests/test_batch_prefill_kernels.py`
- `tests/test_hopper.py`
- `tests/test_jit_example.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1015`
