- 22 May, 2024 1 commit
-
-
Cody Yu authored
The 2nd PR for #4532. This PR supports loading FP8 kv-cache scaling factors from a FP8 checkpoint (with .kv_scale parameter).
-
- 13 May, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 26 Apr, 2024 1 commit
-
-
Cody Yu authored
-
- 16 Apr, 2024 1 commit
-
-
Antoni Baum authored
-
- 10 Apr, 2024 1 commit
-
-
youkaichao authored
[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)
-
- 27 Mar, 2024 1 commit
-
-
Megha Agarwal authored
-
