- 21 Aug, 2024 1 commit
-
-
LI MOU authored
[BUG] fix crash on flashinfer backend with cudagraph disabled, when attention group_size not in [1,2,4,8] (#7509)
-
- 20 Aug, 2024 1 commit
-
-
Antoni Baum authored
-
- 16 Aug, 2024 2 commits
-
-
William Lin authored
Co-authored-by:Cody Yu <hao.yu.cody@gmail.com>
-
youkaichao authored
-
- 13 Aug, 2024 1 commit
-
-
youkaichao authored
-
- 12 Aug, 2024 3 commits
-
-
jon-chuang authored
Co-authored-by: -
Woosuk Kwon authored
-
Lily Liu authored
-
- 09 Aug, 2024 2 commits
-
-
Antoni Baum authored
-
Alexander Matveev authored
-
- 07 Aug, 2024 1 commit
-
-
Lily Liu authored
-
- 06 Aug, 2024 1 commit
-
-
afeldman-nm authored
[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942) Co-authored-by:
Andrew Feldman <afeld2012@gmail.com> Co-authored-by:
Nick Hill <nickhill@us.ibm.com>
-
- 05 Aug, 2024 1 commit
-
-
Cody Yu authored
-
- 03 Aug, 2024 1 commit
-
-
Zach Zheng authored
-
- 02 Aug, 2024 1 commit
-
-
Lily Liu authored
-
- 01 Aug, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 29 Jul, 2024 1 commit
-
-
Thomas Parnell authored
Signed-off-by:Thomas Parnell <tpa@zurich.ibm.com>
-
- 27 Jul, 2024 3 commits
-
-
Woosuk Kwon authored
-
Woosuk Kwon authored
-
Joe authored
-
- 25 Jul, 2024 1 commit
-
-
Cody Yu authored
-
- 24 Jul, 2024 2 commits
-
-
Antoni Baum authored
-
Antoni Baum authored
-
- 23 Jul, 2024 2 commits
-
-
Michael Goin authored
-
Cody Yu authored
-
- 20 Jul, 2024 3 commits
-
-
Matt Wong authored
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
-
Robert Shaw authored
-
Cyrus Leung authored
-
- 18 Jul, 2024 1 commit
-
-
Noam Gat authored
[Bugfix] Update flashinfer.py with PagedAttention forwards - Fixes Gemma2 OpenAI Server Crash (#6501)
-
- 17 Jul, 2024 1 commit
-
-
Cody Yu authored
-
- 16 Jul, 2024 1 commit
-
-
Michael Goin authored
-
- 15 Jul, 2024 1 commit
-
-
Thomas Parnell authored
Signed-off-by:
-
- 13 Jul, 2024 1 commit
-
-
Thomas Parnell authored
Signed-off-by:
-
- 12 Jul, 2024 3 commits
-
-
Woosuk Kwon authored
-
Michael Goin authored
-
Lily Liu authored
-
- 08 Jul, 2024 1 commit
-
-
afeldman-nm authored
[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888) Co-authored-by:Woosuk Kwon <woosuk.kwon@berkeley.edu>
-
- 05 Jul, 2024 1 commit
-
-
JGSweets authored
-
- 04 Jul, 2024 2 commits
-
-
Lily Liu authored
Co-authored-by:Simon Mo <simon.mo@hey.com>
-
Gregory Shtrasberg authored
[ROCm][AMD][Model]Adding alibi slopes support in ROCm triton flash attention and naive flash attention (#6043) Co-authored-by:Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
-
