Skip to content

GitLab

"tools/git@developer.sourcefind.cn:OpenDAS/nni.git" did not exist on "781613df62c6a6e0843ed787490d9ffe63c711dc"
Switch branch/tag
Find file BlameHistoryPermalink
  • Yu Cheng's avatar
    [Dev] Add MLA and GQA decode examples (#109) · 40faabb1
    Yu Cheng authored 
    * [CI][Test] Add test cases for tilelang transform MultiVersionBuffer and WarpSpecialized

* Relax the mismatch ratio restrictions in the flash_linear_attention and mha tests

* [Dev] Add mha backward example

* [Dev] Add mla decode example

* bug fix

* Add triton impl

* Add gqa decode example

* [Dev] Add GQA decode example

* lint

* delete unused triton example

* set default profiler to 'auto'
    40faabb1
example_mla_decode.py 12.3 KB