GitLab

Co-authored-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

This PR adds basic support for OpenTelemetry distributed tracing.
It includes changes to enable tracing functionality and improve monitoring capabilities.

I've also added a markdown with print-screens to guide users how to use this feature. You can find it here

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>

Co-authored-by: xuhao <xuhao@cambricon.com>

Co-authored-by: Roger Wang <ywang@roblox.com>

The 2nd PR for #4532.

This PR supports loading FP8 kv-cache scaling factors from a FP8 checkpoint (with .kv_scale parameter).

Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>

Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>

[Core] add an option to log every function call to for debugging hang/crash in distributed inference (#4079)
Co-authored-by: Simon Mo <simon.mo@hey.com>

[Core] Add integrity check during initialization; add test for it (#4155)

[Core] replace narrow-usage RayWorkerVllm to general WorkerWrapper to reduce code duplication (#4024)