- 22 May, 2024 1 commit
-
-
Cody Yu authored
The 2nd PR for #4532. This PR supports loading FP8 kv-cache scaling factors from a FP8 checkpoint (with .kv_scale parameter).
-
- 13 May, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 26 Apr, 2024 1 commit
-
-
Cody Yu authored
-
- 25 Apr, 2024 1 commit
-
-
Isotr0py authored
Co-authored-by:Woosuk Kwon <woosuk.kwon@berkeley.edu>
-
- 16 Apr, 2024 1 commit
-
-
Antoni Baum authored
-
- 10 Apr, 2024 1 commit
-
-
youkaichao authored
[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)
-
- 05 Apr, 2024 1 commit
-
-
Isotr0py authored
-
- 25 Mar, 2024 2 commits
-
-
SangBin Cho authored
-
Woosuk Kwon authored
-
- 20 Mar, 2024 1 commit
-
-
Roy authored
-
- 11 Mar, 2024 1 commit
-
-
Zhuohan Li authored
-
- 07 Mar, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 27 Feb, 2024 1 commit
-
-
Roy authored
-
- 19 Feb, 2024 1 commit
-
-
Isotr0py authored
-
