GitLab

Co-authored-by: Simon Mo <simon.mo@hey.com>

[Core][Model] Use torch.compile to accelerate layernorm in commandr (#3985)

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

Co-authored-by: tianyi_zhao <tianyi.zhao@transwarp.io>

Co-authored-by: jpvillam <jpvillam@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)

Co-authored-by: roy <jasonailu87@gmail.com>

Co-authored-by: Egor Tolmachev <t333ga@gmail.com>

[CI/Build] fix pip cache with vllm_nccl & refactor dockerfile to build wheels (#3859)

Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>