examples/flash_decoding/example_gqa_decode.py · 67d0b6777d8c78984e7c3a0799e1512b666bf70a · OpenDAS / tilelang

[BugFix] Fix precision issue in GQA decode when block_N exceeds seqlen/num_split (#575) · 67d0b677

徐畅 authored Jun 16, 2025

* [CI] Add flash_decoding example to CI

* Add output of ref latency

* format example_gqa_decode.py

* [BugFix] Fix precision issue in GQA decode when block_N exceeds seqlen/num_split

* format example_gqa_decode.py

67d0b677

example_gqa_decode.py 24.4 KB

Replace example_gqa_decode.py