GitLab

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

[ROCm][CI] Disable async scheduling on ROCm for test_structured_output[meta-llama/Meta-Llama-3.1-8B-Instruct-xgrammar-auto-speculative_config9] (#32355)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>

Signed-off-by: Ryan Rock <ryan.rock@amd.com>

Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

Signed-off-by: Josephasafg <ajgard7@gmail.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>

Signed-off-by: inkcherry <mingzhi.liu@amd.com>

[ROCm][CI][V1] Fix `nixl_connector` test failure and achieve CUDA parity in `test_async_scheduling` (#32000)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Nick Hill <nickhill123@gmail.com>

Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

Signed-off-by: Nick Hill <nickhill123@gmail.com>

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

Signed-off-by: Ryan Rock <ryan.rock@amd.com>

Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>
Signed-off-by: Lumosis <30372757+Lumosis@users.noreply.github.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Richard Zou <zou3519@gmail.com>

Signed-off-by: Nick Hill <nickhill123@gmail.com>

Signed-off-by: Kfir Toledo <kfir.toledo@ibm.com>

Signed-off-by: Wei-Yu Lin <weiyulin@google.com>
Signed-off-by: weiyu <62784299+weiyu0824@users.noreply.github.com>

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

[Attention][1/n] Remove usage of deprecated `seq_lens_cpu` and `num_computed_tokens_cpu` CommonAttentionMetadata properties (#31773)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Signed-off-by: John Calderon <jcalderon@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>