- 22 Jul, 2024 5 commits
-
-
Jiaxin Shan authored
Co-authored-by:Antoni Baum <antoni.baum@protonmail.com>
-
Cyrus Leung authored
Co-authored-by:Roger Wang <ywang@roblox.com>
-
Jae-Won Chung authored
-
Woosuk Kwon authored
-
Roger Wang authored
-
- 21 Jul, 2024 5 commits
-
-
Alexander Matveev authored
-
Isotr0py authored
-
Woosuk Kwon authored
-
sroy745 authored
[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. (#6485)
-
Cyrus Leung authored
Co-authored-by:Roger Wang <ywang@roblox.com>
-
- 20 Jul, 2024 9 commits
-
-
Robert Shaw authored
-
Michael Goin authored
-
Robert Shaw authored
-
Matt Wong authored
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
-
Robert Shaw authored
-
Cyrus Leung authored
-
Travis Johnson authored
Signed-off-by:Travis Johnson <tsjohnso@us.ibm.com>
-
Antoni Baum authored
-
Varun Sundar Rabindranath authored
Co-authored-by:Varun Sundar Rabindranth <varun@neuralmagic.com>
-
- 19 Jul, 2024 12 commits
-
-
Robert Shaw authored
-
youkaichao authored
-
Thomas Parnell authored
-
Antoni Baum authored
-
Daniele authored
-
Thomas Parnell authored
Signed-off-by:Thomas Parnell <tpa@zurich.ibm.com>
-
Woo-Yeon Lee authored
-
Cyrus Leung authored
-
Robert Shaw authored
-
Thomas Parnell authored
Signed-off-by:
Thomas Parnell <tpa@zurich.ibm.com> Co-authored-by:
Nick Hill <nickhill@us.ibm.com>
-
Nick Hill authored
Co-authored-by:Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
-
Simon Mo authored
-
- 18 Jul, 2024 9 commits
-
-
Tyler Michael Smith authored
-
Michael Goin authored
-
Robert Shaw authored
-
Woosuk Kwon authored
-
Noam Gat authored
[Bugfix] Update flashinfer.py with PagedAttention forwards - Fixes Gemma2 OpenAI Server Crash (#6501)
-
Nick Hill authored
Co-authored-by:Cyrus Leung <cyrus.tl.leung@gmail.com>
-
Cody Yu authored
-
Rui Qiao authored
Signed-off-by:
Rui Qiao <ruisearch42@gmail.com> Co-authored-by:
Stephanie Wang <swang@cs.berkeley.edu>
-
Nick Hill authored
-