GitLab

Co-authored-by: ywang96 <ywang@roblox.com>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>

Co-authored-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

Signed-off-by: Stephanie Wang <swang@cs.berkeley.edu>
Signed-off-by: Stephanie <swang@anyscale.com>
Co-authored-by: Stephanie <swang@anyscale.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

 [Speculative Decoding] Support draft model on different tensor-parallel size than target model (#5414)

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Davis Wertheimer <Davis.Wertheimer@ibm.com>

[Misc] Add per channel support for static activation quantization; update w8a8 schemes to share base classes (#5650)

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

[Misc] Add channel-wise quantization support for w8a8 dynamic per token activation quantization (#5542)

This PR adds basic support for OpenTelemetry distributed tracing.
It includes changes to enable tracing functionality and improve monitoring capabilities.

I've also added a markdown with print-screens to guide users how to use this feature. You can find it here

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (#5131)