- 10 Sep, 2024 2 commits
-
-
Alexander Matveev authored
[Bugfix] Ensure multistep lookahead allocation is compatible with cuda graph max capture (#8340)
-
Kevin Lin authored
-
- 05 Sep, 2024 1 commit
-
-
Elfie Guo authored
-
- 31 Aug, 2024 1 commit
-
-
Pavani Majety authored
-
- 30 Aug, 2024 2 commits
-
-
Woosuk Kwon authored
-
Richard Liu authored
-
- 29 Aug, 2024 2 commits
-
-
Pavani Majety authored
[Core][Kernels] Enable FP8 KV Cache with Flashinfer backend. + BugFix for kv_cache_dtype=auto (#7985) Co-authored-by:
Simon Mo <simon.mo@hey.com> Co-authored-by:
Cody Yu <hao.yu.cody@gmail.com>
-
youkaichao authored
-
- 28 Aug, 2024 1 commit
-
-
Pavani Majety authored
Co-authored-by:
-
- 27 Aug, 2024 1 commit
-
-
Cody Yu authored
-
- 21 Aug, 2024 1 commit
-
-
LI MOU authored
[BUG] fix crash on flashinfer backend with cudagraph disabled, when attention group_size not in [1,2,4,8] (#7509)
-
- 20 Aug, 2024 1 commit
-
-
Antoni Baum authored
-
- 16 Aug, 2024 2 commits
-
-
William Lin authored
Co-authored-by: -
youkaichao authored
-
- 13 Aug, 2024 1 commit
-
-
youkaichao authored
-
- 12 Aug, 2024 3 commits
-
-
jon-chuang authored
Co-authored-by: -
Woosuk Kwon authored
-
Lily Liu authored
-
- 09 Aug, 2024 2 commits
-
-
Antoni Baum authored
-
Alexander Matveev authored
-
- 07 Aug, 2024 1 commit
-
-
Lily Liu authored
-
- 06 Aug, 2024 1 commit
-
-
afeldman-nm authored
[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942) Co-authored-by:
Andrew Feldman <afeld2012@gmail.com> Co-authored-by:
Nick Hill <nickhill@us.ibm.com>
-
- 05 Aug, 2024 1 commit
-
-
Cody Yu authored
-
- 03 Aug, 2024 1 commit
-
-
Zach Zheng authored
-
- 02 Aug, 2024 1 commit
-
-
Lily Liu authored
-
- 01 Aug, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 29 Jul, 2024 1 commit
-
-
Thomas Parnell authored
Signed-off-by:Thomas Parnell <tpa@zurich.ibm.com>
-
- 27 Jul, 2024 3 commits
-
-
Woosuk Kwon authored
-
Woosuk Kwon authored
-
Joe authored
-
- 25 Jul, 2024 1 commit
-
-
Cody Yu authored
-
- 24 Jul, 2024 2 commits
-
-
Antoni Baum authored
-
Antoni Baum authored
-
- 23 Jul, 2024 2 commits
-
-
Michael Goin authored
-
Cody Yu authored
-
- 20 Jul, 2024 3 commits
-
-
Matt Wong authored
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
-
Robert Shaw authored
-
Cyrus Leung authored
-
- 18 Jul, 2024 1 commit
-
-
Noam Gat authored
[Bugfix] Update flashinfer.py with PagedAttention forwards - Fixes Gemma2 OpenAI Server Crash (#6501)
-
- 17 Jul, 2024 1 commit
-
-
Cody Yu authored
-
