GitLab

Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic>

[Core][Distributed] add coordinator to reduce code duplication in tp and pp (#5293)

[CI/Test] improve robustness of test by replacing del with context manager (vllm_runner) (#5357)

[CI/Test] improve robustness of test by replacing del with context manager (hf_runner) (#5347)

Co-authored-by: Roger Wang <ywang@roblox.com>

Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

[Bug fix][Core] assert num_new_tokens == 1 fails when SamplingParams.n is not 1 and max_tokens is large & Add tests for preemption (#4451)

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

[Misc] [CI/Build] Speed up block manager CPU-only unit tests ~10x by opting-out of GPU cleanup (#3783)

Co-authored-by: Simon Mo <simon.mo@hey.com>

Co-authored-by: Robert Shaw <114415538+rib-2@users.noreply.github.com>
Co-authored-by: alexm <alexm@neuralmagic.com>

Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>