GitLab

Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Varad Ahirwadkar <varad.ahirwadkar1@ibm.com>

Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

Co-authored-by: dvres <dvres@fri.uni-lj.si>

Co-authored-by: Jerzy Zagorski <jzagorsk@amazon.com>

Co-authored-by: Nick Hill <nickhill@us.ibm.com>

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>

Update benchmark_serving.py to read and write json-datasets, results in UTF8, for better compatibility with Windows (#8997)

[Bugfix] Fix Token IDs Reference for MiniCPM-V When Images are Provided With No Placeholders (#8991)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>

Signed-off-by: kevin <kevin@anyscale.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

[CI][SpecDecode] Fix spec decode tests, use flash attention backend for spec decode CI tests. (#8975)

Signed-off-by: kevin <kevin@anyscale.com>