- 28 Jun, 2024 1 commit
-
-
Cyrus Leung authored
Co-authored-by:ywang96 <ywang@roblox.com>
-
- 27 Jun, 2024 5 commits
-
-
Woosuk Kwon authored
-
Nick Hill authored
-
Cyrus Leung authored
-
Roger Wang authored
-
Cyrus Leung authored
-
- 24 Jun, 2024 1 commit
-
-
Isotr0py authored
-
- 22 Jun, 2024 1 commit
-
-
Jie Fu (傅杰) authored
Co-authored-by:
-
- 21 Jun, 2024 1 commit
-
-
Joshua Rosenkranz authored
Signed-off-by:
Thomas Parnell <tpa@zurich.ibm.com> Co-authored-by:
Nick Hill <nickhill@us.ibm.com> Co-authored-by:
Davis Wertheimer <Davis.Wertheimer@ibm.com>
-
- 20 Jun, 2024 1 commit
-
-
Roger Wang authored
-
- 19 Jun, 2024 1 commit
-
-
Michael Goin authored
-
- 18 Jun, 2024 3 commits
-
-
sergey-tinkoff authored
-
Chang Su authored
-
Isotr0py authored
-
- 15 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 14 Jun, 2024 1 commit
-
-
Thomas Parnell authored
Signed-off-by:
-
- 13 Jun, 2024 1 commit
-
-
Cyrus Leung authored
Co-authored-by:
-
- 10 Jun, 2024 2 commits
-
-
Cyrus Leung authored
-
Cyrus Leung authored
Co-authored-by:
-
- 08 Jun, 2024 1 commit
-
-
Michael Goin authored
-
- 07 Jun, 2024 1 commit
-
-
Calvinn Ng authored
Co-authored-by:team <calvinn.ng@ahrefs.com>
-
- 05 Jun, 2024 1 commit
-
-
Cody Yu authored
-
- 03 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 01 Jun, 2024 1 commit
-
-
chenqianfzh authored
-
- 31 May, 2024 1 commit
-
-
Cody Yu authored
-
- 27 May, 2024 2 commits
-
-
Isotr0py authored
-
Zhuohan Li authored
Co-authored-by:
rsnm2 <rshaw@neuralmagic.com> Co-authored-by:
Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
-
- 25 May, 2024 1 commit
-
-
Eric Xihui Lin authored
Co-authored-by:
beagleski <yunanzhang@microsoft.com> Co-authored-by:
bapatra <bapatra@microsoft.com> Co-authored-by:
Barun Patra <codedecde@users.noreply.github.com> Co-authored-by:
Michael Goin <michael@neuralmagic.com>
-
- 23 May, 2024 1 commit
-
-
Dipika Sikka authored
Co-authored-by:
Varun Sundar Rabindranath <varunsundar08@gmail.com> Co-authored-by:
Varun Sundar Rabindranath <varun@neuralmagic.com>
-
- 22 May, 2024 3 commits
-
-
Philipp Moritz authored
-
raywanb authored
-
Cody Yu authored
The 2nd PR for #4532. This PR supports loading FP8 kv-cache scaling factors from a FP8 checkpoint (with .kv_scale parameter).
-
- 21 May, 2024 2 commits
- 20 May, 2024 1 commit
-
-
Cyrus Leung authored
-
- 19 May, 2024 1 commit
-
-
Cyrus Leung authored
-
- 18 May, 2024 1 commit
-
-
SangBin Cho authored
Currently we need to call rotary embedding kernel for each LoRA, which makes it hard to serve multiple long context length LoRA. Add batched rotary embedding kernel and pipe it through. It replaces the rotary embedding layer to the one that is aware of multiple cos-sin-cache per scaling factors. Follow up of https://github.com/vllm-project/vllm/pull/3095/files
-
- 17 May, 2024 1 commit
-
-
eigenLiu authored
-
- 13 May, 2024 2 commits
-
-
Philipp Moritz authored
-
Woosuk Kwon authored
-
