- 09 Aug, 2024 1 commit
-
-
William Lin authored
-
- 08 Aug, 2024 1 commit
-
-
Murali Andoorveedu authored
-
- 06 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 05 Aug, 2024 1 commit
-
-
Jacob Schein authored
Co-authored-by:Jacob Schein <jacobschein@Jacobs-MacBook-Pro-2.local>
-
- 04 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 03 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 01 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 27 Jul, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 22 Jul, 2024 1 commit
-
-
Jiaxin Shan authored
Co-authored-by:Antoni Baum <antoni.baum@protonmail.com>
-
- 09 Jul, 2024 1 commit
-
-
Swapnil Parekh authored
Co-authored-by:
Swapnil Parekh <swapnilp@ibm.com> Co-authored-by:
Joe G <joseph.granados@h2o.ai> Co-authored-by:
-
- 03 Jul, 2024 1 commit
-
-
youkaichao authored
-
- 02 Jul, 2024 1 commit
-
-
Qubitium-ModelCloud authored
Co-authored-by:
Robert Shaw <rshaw@neuralmagic.com> Co-authored-by:
ZX <zx@lbx.dev>
-
- 01 Jul, 2024 1 commit
-
-
youkaichao authored
-
- 30 Jun, 2024 1 commit
-
-
SangBin Cho authored
Co-authored-by:sang <sangcho@anyscale.com>
-
- 27 Jun, 2024 2 commits
-
-
Woosuk Kwon authored
-
Cyrus Leung authored
-
- 21 Jun, 2024 2 commits
-
-
rohithkrn authored
-
Jee Li authored
Co-authored-by:
-
- 15 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 10 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 09 Jun, 2024 1 commit
-
-
bnellnm authored
-
- 07 Jun, 2024 1 commit
-
-
Antoni Baum authored
-
- 01 Jun, 2024 1 commit
-
-
Zhuohan Li authored
-
- 22 May, 2024 2 commits
-
-
raywanb authored
-
SangBin Cho authored
-
- 18 May, 2024 1 commit
-
-
SangBin Cho authored
Currently we need to call rotary embedding kernel for each LoRA, which makes it hard to serve multiple long context length LoRA. Add batched rotary embedding kernel and pipe it through. It replaces the rotary embedding layer to the one that is aware of multiple cos-sin-cache per scaling factors. Follow up of https://github.com/vllm-project/vllm/pull/3095/files
-
- 08 May, 2024 1 commit
-
-
Antoni Baum authored
-
- 07 May, 2024 1 commit
-
-
Austin Veselka authored
-
- 27 Apr, 2024 1 commit
-
-
Austin Veselka authored
Co-authored-by:
-
- 26 Apr, 2024 2 commits
-
-
Cody Yu authored
-
SangBin Cho authored
Co-authored-by:Danny Guinther <dguinther@neuralmagic.com>
-
- 25 Apr, 2024 1 commit
-
-
SangBin Cho authored
-
- 23 Apr, 2024 1 commit
-
-
SangBin Cho authored
-
- 19 Apr, 2024 1 commit
-
-
Jee Li authored
Co-authored-by:simon-mo <simon.mo@hey.com>
-
- 18 Apr, 2024 1 commit
-
-
SangBin Cho authored
Co-authored-by:SangBin Cho <sangcho@sangcho-LT93GQWG9C.local>
-
- 12 Apr, 2024 2 commits
- 11 Apr, 2024 3 commits
-
-
Antoni Baum authored
-
Antoni Baum authored
-
SangBin Cho authored
-
