- 10 Apr, 2024 2 commits
-
-
youkaichao authored
[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)
-
Jee Li authored
-
- 09 Apr, 2024 1 commit
-
-
Cade Daniel authored
[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)
-
- 27 Mar, 2024 1 commit
-
-
Jee Li authored
-
- 26 Mar, 2024 1 commit
-
-
Jee Li authored
Co-authored-by:Antoni Baum <antoni.baum@protonmail.com>
-
- 25 Mar, 2024 1 commit
-
-
SangBin Cho authored
-
- 22 Mar, 2024 1 commit
-
-
Zhuohan Li authored
-
- 20 Mar, 2024 2 commits
-
-
Roy authored
-
SangBin Cho authored
-
- 15 Mar, 2024 1 commit
-
-
Antoni Baum authored
-
- 13 Mar, 2024 1 commit
-
-
Or Sharir authored
Add missing kernel for CodeLlama-34B on A/H100 (no tensor parallelism) when using Multi-LoRA. (#3350)
-
- 11 Mar, 2024 2 commits
-
-
Zhuohan Li authored
-
Zhuohan Li authored
-
- 10 Mar, 2024 1 commit
-
-
Terry authored
-
- 28 Feb, 2024 2 commits
-
-
Woosuk Kwon authored
-
Liangfu Chen authored
-
- 22 Feb, 2024 1 commit
-
-
Massimiliano Pronesti authored
-
- 13 Feb, 2024 1 commit
-
-
Terry authored
* add mixtral lora support * formatting * fix incorrectly ported logic * polish tests * minor fixes and refactoring * minor fixes * formatting * rename and remove redundant logic * refactoring * refactoring * minor fix * minor refactoring * fix code smell
-
- 01 Feb, 2024 1 commit
-
-
Kunshang Ji authored
Co-authored-by:
Jiang Li <jiang1.li@intel.com> Co-authored-by:
Kunshang Ji <kunshang.ji@intel.com>
-
- 23 Jan, 2024 1 commit
-
-
Antoni Baum authored
Co-authored-by:
Chen Shen <scv119@gmail.com> Co-authored-by:
Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by:
Avnish Narayan <avnish@anyscale.com>
-
