---
id: pr-flashinfer-1148
repo: flashinfer-ai/flashinfer
pr: 1148
title: '[fix] fix precision errors when applying causal mask on Qwen-2.5 series models'
author: happierpig
date: '2025-06-16'
url: https://github.com/flashinfer-ai/flashinfer/pull/1148
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: ff6808cc1d5a4b99bd95cdfa2aba10c2bb0072b0
inclusion_reason: defer
changed_paths:
- flashinfer/attention.py
- flashinfer/jit/attention/pytorch.py
- include/flashinfer/attention/persistent.cuh
- include/flashinfer/attention/prefill.cuh
- include/flashinfer/attention/scheduler.cuh
- tests/test_batch_attention.py
- tests/test_single_prefill.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-1148
head_ref_oid: 91e57ad9e8b87468ad2097eb67a7d79000167f0c
---
# [fix] fix precision errors when applying causal mask on Qwen-2.5 series models

- Repository: `flashinfer-ai/flashinfer`
- PR: [1148](https://github.com/flashinfer-ai/flashinfer/pull/1148)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `flashinfer/attention.py`
- `flashinfer/jit/attention/pytorch.py`
- `include/flashinfer/attention/persistent.cuh`
- `include/flashinfer/attention/prefill.cuh`
- `include/flashinfer/attention/scheduler.cuh`
- `tests/test_batch_attention.py`
- `tests/test_single_prefill.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1148`
