GitLab

[kernel] add VLLM_USE_DEEPSEEK_MOE_SUM_MUL_AND to use lightop's moe_sum fusion operator for deepseek

update the default values of VLLM_USE_TRITON_CAT and VLLM_USE_LIGHT_OP to True

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>

Signed-off-by: Chenyaaang <chenyangli@google.com>

Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>

[Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward.  Add additional testing for cudagraphs. (#19717)
Signed-off-by: Bill Nell <bnell@redhat.com>

Signed-off-by: jinqinn <goodqinjin@163.com>

Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>

Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>

Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: fsx950223 <fsx950223@outlook.com>
Co-authored-by: charlifu <charlifu@amd.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>

Signed-off-by: liusiqian <liusiqian@tal.com>

Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>

Signed-off-by: yZhen <yZhen@fb.com>
Co-authored-by: yZhen <yZhen@fb.com>

Signed-off-by: Povilas Kanapickas <povilas@radix.lt>

Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

Signed-off-by: simon-mo <simon.mo@hey.com>