GitLab

Signed-off-by: mzusman <mor.zusmann@gmail.com>

[Bugfix] Fix `illegal memory access` error with chunked prefill, prefix caching, block manager v2 and xformers enabled together (#9532)
Signed-off-by: sasha0552 <admin@sasha0552.org>

Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Roger Wang <ywang@roblox.com>

Signed-off-by: mgoin <michael@neuralmagic.com>

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Signed-off-by: Went-Liang <wenteng_liang@163.com>

Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Signed-off-by: YiSheng5 <syhm@mail.ustc.edu.cn>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: YiSheng5 <syhm@mail.ustc.edu.cn>

Signed-off-by: kevin <kevin@anyscale.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Signed-off-by: Kunjan Patel <kunjanp@google.com>

Signed-off-by: Russell Bryant <rbryant@redhat.com>

Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>

Signed-off-by: yuze.zyz <yuze.zyz@alibaba-inc.com>

Signed-off-by: wangshuai09 <391746016@qq.com>