GitLab

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>

Update benchmark_serving.py to read and write json-datasets, results in UTF8, for better compatibility with Windows (#8997)

[Bugfix] Fix Token IDs Reference for MiniCPM-V When Images are Provided With No Placeholders (#8991)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>

Signed-off-by: kevin <kevin@anyscale.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

[CI][SpecDecode] Fix spec decode tests, use flash attention backend for spec decode CI tests. (#8975)

Signed-off-by: kevin <kevin@anyscale.com>

Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

Co-authored-by: Roger Wang <ywang@roblox.com>

Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: youkaichao <youkaichao@126.com>

Co-authored-by: Eduard Balzin <nfunctor@yahoo.fr>

Co-authored-by: Roger Wang <ywang@roblox.com>

Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: youkaichao <youkaichao@126.com>