Skip to content

GitLab

"git@developer.sourcefind.cn:change/sglang.git" did not exist on "5e19b159b02ae1b519ce6c3a0d1e7ff04ab9fcd5"
Switch branch/tag
Find file BlameHistoryPermalink
  • Yu Cheng's avatar
    [Dev] Add MLA and GQA decode examples (#109) · 40faabb1
    Yu Cheng authored 
    * [CI][Test] Add test cases for tilelang transform MultiVersionBuffer and WarpSpecialized

* Relax the mismatch ratio restrictions in the flash_linear_attention and mha tests

* [Dev] Add mha backward example

* [Dev] Add mla decode example

* bug fix

* Add triton impl

* Add gqa decode example

* [Dev] Add GQA decode example

* lint

* delete unused triton example

* set default profiler to 'auto'
    40faabb1
example_gqa_decode.py 16.6 KB