---
id: pr-sglang-17353
repo: sgl-project/sglang
pr: 17353
title: Move fa4 from sgl-kernel to jit kernel
author: BBuf
date: '2026-01-24'
url: https://github.com/sgl-project/sglang/pull/17353
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- flash-attention
- pipeline-stages
- tile-scheduling
- tma
techniques:
- pipeline-stages
- tile-scheduling
hardware_features:
- tma
kernel_types:
- attention
- flash-attention
languages:
- cute-dsl
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 3992a023e65ed68cb203fc90164a6962378f187d
inclusion_reason: kernel file changes
changed_paths:
- .github/workflows/pr-test.yml
- .pre-commit-config.yaml
- python/sglang/jit_kernel/__init__.py
- python/sglang/jit_kernel/flash_attention/cute/.flake8
- python/sglang/jit_kernel/flash_attention/cute/AUTHORS
- python/sglang/jit_kernel/flash_attention/cute/LICENSE
- python/sglang/jit_kernel/flash_attention/cute/README.md
- python/sglang/jit_kernel/flash_attention/cute/__init__.py
- python/sglang/jit_kernel/flash_attention/cute/ampere_helpers.py
- python/sglang/jit_kernel/flash_attention/cute/barrier.py
- python/sglang/jit_kernel/flash_attention/cute/benchmark.py
- python/sglang/jit_kernel/flash_attention/cute/blackwell_helpers.py
- python/sglang/jit_kernel/flash_attention/cute/block_info.py
- python/sglang/jit_kernel/flash_attention/cute/block_sparse_utils.py
- python/sglang/jit_kernel/flash_attention/cute/block_sparsity.py
- python/sglang/jit_kernel/flash_attention/cute/compute_block_sparsity.py
- python/sglang/jit_kernel/flash_attention/cute/copy_utils.py
- python/sglang/jit_kernel/flash_attention/cute/cute_dsl_utils.py
- python/sglang/jit_kernel/flash_attention/cute/fast_math.py
- python/sglang/jit_kernel/flash_attention/cute/flash_bwd.py
- python/sglang/jit_kernel/flash_attention/cute/flash_bwd_postprocess.py
- python/sglang/jit_kernel/flash_attention/cute/flash_bwd_preprocess.py
- python/sglang/jit_kernel/flash_attention/cute/flash_bwd_sm100.py
- python/sglang/jit_kernel/flash_attention/cute/flash_bwd_sm90.py
- python/sglang/jit_kernel/flash_attention/cute/flash_fwd.py
- python/sglang/jit_kernel/flash_attention/cute/flash_fwd_combine.py
- python/sglang/jit_kernel/flash_attention/cute/flash_fwd_sm100.py
- python/sglang/jit_kernel/flash_attention/cute/hopper_helpers.py
- python/sglang/jit_kernel/flash_attention/cute/interface.py
- python/sglang/jit_kernel/flash_attention/cute/mask.py
- python/sglang/jit_kernel/flash_attention/cute/mma_sm100_desc.py
- python/sglang/jit_kernel/flash_attention/cute/named_barrier.py
- python/sglang/jit_kernel/flash_attention/cute/pack_gqa.py
- python/sglang/jit_kernel/flash_attention/cute/paged_kv.py
- python/sglang/jit_kernel/flash_attention/cute/pipeline.py
- python/sglang/jit_kernel/flash_attention/cute/pyproject.toml
- python/sglang/jit_kernel/flash_attention/cute/seqlen_info.py
- python/sglang/jit_kernel/flash_attention/cute/softmax.py
- python/sglang/jit_kernel/flash_attention/cute/testing.py
- python/sglang/jit_kernel/flash_attention/cute/tile_scheduler.py
- python/sglang/jit_kernel/flash_attention/cute/utils.py
- python/sglang/jit_kernel/flash_attention_v4.py
- python/sglang/jit_kernel/tests/test_flash_attention_4.py
- python/sglang/multimodal_gen/runtime/layers/attention/backends/flash_attn.py
- python/sglang/srt/layers/attention/flashattention_backend.py
head_ref_oid: 735ada6469f1b1fadfac880f492fda75cab836d2
artifact_dir: evidence/pull-bundles/sglang/gh-17353
---
# Move fa4 from sgl-kernel to jit kernel

- Repository: `sgl-project/sglang`
- PR: [17353](https://github.com/sgl-project/sglang/pull/17353)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `.github/workflows/pr-test.yml`
- `.pre-commit-config.yaml`
- `python/sglang/jit_kernel/__init__.py`
- `python/sglang/jit_kernel/flash_attention/cute/.flake8`
- `python/sglang/jit_kernel/flash_attention/cute/AUTHORS`
- `python/sglang/jit_kernel/flash_attention/cute/LICENSE`
- `python/sglang/jit_kernel/flash_attention/cute/README.md`
- `python/sglang/jit_kernel/flash_attention/cute/__init__.py`
- `python/sglang/jit_kernel/flash_attention/cute/ampere_helpers.py`
- `python/sglang/jit_kernel/flash_attention/cute/barrier.py`
- `python/sglang/jit_kernel/flash_attention/cute/benchmark.py`
- `python/sglang/jit_kernel/flash_attention/cute/blackwell_helpers.py`
- `python/sglang/jit_kernel/flash_attention/cute/block_info.py`
- `python/sglang/jit_kernel/flash_attention/cute/block_sparse_utils.py`
- `python/sglang/jit_kernel/flash_attention/cute/block_sparsity.py`
- `python/sglang/jit_kernel/flash_attention/cute/compute_block_sparsity.py`
- `python/sglang/jit_kernel/flash_attention/cute/copy_utils.py`
- `python/sglang/jit_kernel/flash_attention/cute/cute_dsl_utils.py`
- `python/sglang/jit_kernel/flash_attention/cute/fast_math.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_bwd.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_bwd_postprocess.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_bwd_preprocess.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_bwd_sm100.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_bwd_sm90.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_fwd.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_fwd_combine.py`
- `python/sglang/jit_kernel/flash_attention/cute/flash_fwd_sm100.py`
- `python/sglang/jit_kernel/flash_attention/cute/hopper_helpers.py`
- `python/sglang/jit_kernel/flash_attention/cute/interface.py`
- `python/sglang/jit_kernel/flash_attention/cute/mask.py`
- `python/sglang/jit_kernel/flash_attention/cute/mma_sm100_desc.py`
- `python/sglang/jit_kernel/flash_attention/cute/named_barrier.py`
- `python/sglang/jit_kernel/flash_attention/cute/pack_gqa.py`
- `python/sglang/jit_kernel/flash_attention/cute/paged_kv.py`
- `python/sglang/jit_kernel/flash_attention/cute/pipeline.py`
- `python/sglang/jit_kernel/flash_attention/cute/pyproject.toml`
- `python/sglang/jit_kernel/flash_attention/cute/seqlen_info.py`
- `python/sglang/jit_kernel/flash_attention/cute/softmax.py`
- `python/sglang/jit_kernel/flash_attention/cute/testing.py`
- `python/sglang/jit_kernel/flash_attention/cute/tile_scheduler.py`
- `python/sglang/jit_kernel/flash_attention/cute/utils.py`
- `python/sglang/jit_kernel/flash_attention_v4.py`
- `python/sglang/jit_kernel/tests/test_flash_attention_4.py`
- `python/sglang/multimodal_gen/runtime/layers/attention/backends/flash_attn.py`
- `python/sglang/srt/layers/attention/flashattention_backend.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-17353`
