GitLab

Signed-off-by: kevin <kevin@anyscale.com>

[Bugfix][CI/Build][AMD][ROCm]Fixed the cmake build bug which generate garbage on certain devices (#5641)

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Signed-off-by: kevin <kevin@anyscale.com>

[Misc] Add channel-wise quantization support for w8a8 dynamic per token activation quantization (#5542)

This PR adds basic support for OpenTelemetry distributed tracing.
It includes changes to enable tracing functionality and improve monitoring capabilities.

I've also added a markdown with print-screens to guide users how to use this feature. You can find it here

Signed-off-by: kevin <kevin@anyscale.com>

[bugfix][distributed] do not error if two processes do not agree on p2p capability (#5612)

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (#5131)

[CI] Improve the readability of performance benchmarking results and prepare for upcoming performance dashboard (#5571)

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>

Co-authored-by: Liqian Chen <liqian.chen@deeplang.ai>