Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • Yoach Lacombe's avatar
    Add Flash Attention 2 support to Musicgen and Musicgen Melody (#29939) · 0d04b1e2
    Yoach Lacombe authored 
    * add FA2 to o.g Musicgen

* make style

* add FA2 support to Musicgen Melody

* add generation FA2 tests to o.g Musicgen

* make style and fix copies

* add Musicgen to FA2 docs + deprecate list

* add sdpa supports to Musicgen's

* make style and fix copies

* refactor attention implementation arguments

* add Copied from to sdpa tests

* add copied form in sdpa tests melody

* add copied for FA2 generation tests

* add FA2 inference copied from

* make style
    0d04b1e2
perf_infer_gpu_one.md 22.1 KB