GitLab

Signed-off-by: Mengqing Cao <cmq0113@163.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

[Feature] [Spec decode]: Enable MLPSpeculator/Medusa and `prompt_logprobs` with ChunkedPrefill (#10132)
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: wallashss <wallashss@ibm.com>
Co-authored-by: wallashss <wallashss@ibm.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2.更新medusa readme
3.解决benchmark_moe报错问题

Signed-off-by: Chendi Xue <chendi.xue@intel.com>

Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
Signed-off-by: Sourashis Roy <sroy@roblox.com>
Co-authored-by: Sourashis Roy <sroy@roblox.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

2.examples中添加medusa readme
3.修复model_runner中input_positions配置错误的笔误，解决多个模型运行失败问题

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

Signed-off-by: Abatom <abatom@163.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Signed-off-by: Wallas Santos <wallashss@ibm.com>

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. (#6485)