GitLab

Co-authored-by: simon-mo <simon.mo@hey.com>

Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>

Signed-off-by: kevin <kevin@anyscale.com>

This PR enables the fused topk_softmax kernel used in moe layer for HIP

[Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update `tensorizer` to version 2.9.0 (#4208)

Co-authored-by: miloice <jeffaw99@hotmail.com>

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>

Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>