GitLab

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

[fix]1.修复medusa、scorer等并行解码单测；2.修复moe kernel单测问题，优化代码；3.修复rejection_sampler中test_compare_nonflashinfer_backend单测问题

Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>

Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: shen-shanshan <467638484@qq.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Huy Do <huydhn@gmail.com>

Signed-off-by: Noah Yoshida <noahcy117@gmail.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: shen-shanshan <467638484@qq.com>

[fix]修复开启并行解码后，在极端测试情况下，由于设置了speculative-disable-by-batch-size导致不跑并行解码导致previous_hidden_states不断增加，最终导致显存用尽服务无响应问题

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Signed-off-by: Bryan Lu <yuzhelu@amazon.com>

[Bugfix] Fix DeepSeek MTP crash when using TP1ModelRunner with CUDA graph due to shape mismatch (#14237)
Signed-off-by: pyc96 <pychen96@gmail.com>

Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>