- 29 Oct, 2024 1 commit
-
-
Jee Jee Li authored
Signed-off-by:Jee Jee Li <pandaleefree@gmail.com>
-
- 12 Oct, 2024 1 commit
-
-
Jee Jee Li authored
-
- 11 Oct, 2024 1 commit
-
-
Jee Jee Li authored
-
- 09 Oct, 2024 1 commit
-
-
Ahmad Fahadh Ilyas authored
-
- 04 Oct, 2024 1 commit
-
-
Cyrus Leung authored
-
- 29 Sep, 2024 1 commit
-
-
Jee Jee Li authored
-
- 23 Sep, 2024 1 commit
-
-
Jee Jee Li authored
-
- 20 Sep, 2024 1 commit
-
-
Jiaxin Shan authored
-
- 06 Sep, 2024 2 commits
-
-
Dipika Sikka authored
-
Jiaxin Shan authored
Co-authored-by:
-
- 28 Aug, 2024 1 commit
-
-
bnellnm authored
-
- 20 Aug, 2024 1 commit
-
-
Kunshang Ji authored
-
- 19 Aug, 2024 1 commit
-
-
SangBin Cho authored
-
- 16 Aug, 2024 1 commit
-
-
bnellnm authored
-
- 09 Aug, 2024 1 commit
-
-
William Lin authored
-
- 08 Aug, 2024 1 commit
-
-
Murali Andoorveedu authored
-
- 06 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 05 Aug, 2024 1 commit
-
-
Jacob Schein authored
Co-authored-by:Jacob Schein <jacobschein@Jacobs-MacBook-Pro-2.local>
-
- 04 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 03 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 01 Aug, 2024 1 commit
-
-
Jee Jee Li authored
-
- 27 Jul, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 22 Jul, 2024 1 commit
-
-
Jiaxin Shan authored
Co-authored-by:Antoni Baum <antoni.baum@protonmail.com>
-
- 09 Jul, 2024 1 commit
-
-
Swapnil Parekh authored
Co-authored-by:
Swapnil Parekh <swapnilp@ibm.com> Co-authored-by:
Joe G <joseph.granados@h2o.ai> Co-authored-by:
-
- 03 Jul, 2024 1 commit
-
-
youkaichao authored
-
- 02 Jul, 2024 1 commit
-
-
Qubitium-ModelCloud authored
Co-authored-by:
Robert Shaw <rshaw@neuralmagic.com> Co-authored-by:
ZX <zx@lbx.dev>
-
- 01 Jul, 2024 1 commit
-
-
youkaichao authored
-
- 30 Jun, 2024 1 commit
-
-
SangBin Cho authored
Co-authored-by:sang <sangcho@anyscale.com>
-
- 27 Jun, 2024 2 commits
-
-
Woosuk Kwon authored
-
Cyrus Leung authored
-
- 21 Jun, 2024 2 commits
-
-
rohithkrn authored
-
Jee Li authored
Co-authored-by:
-
- 15 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 10 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 09 Jun, 2024 1 commit
-
-
bnellnm authored
-
- 07 Jun, 2024 1 commit
-
-
Antoni Baum authored
-
- 01 Jun, 2024 1 commit
-
-
Zhuohan Li authored
-
- 22 May, 2024 2 commits
-
-
raywanb authored
-
SangBin Cho authored
-
- 18 May, 2024 1 commit
-
-
SangBin Cho authored
Currently we need to call rotary embedding kernel for each LoRA, which makes it hard to serve multiple long context length LoRA. Add batched rotary embedding kernel and pipe it through. It replaces the rotary embedding layer to the one that is aware of multiple cos-sin-cache per scaling factors. Follow up of https://github.com/vllm-project/vllm/pull/3095/files
-
