GitLab

[opt] 优化epsp代码, 零消耗添加epsp
update VLLM_USE_FUSED_RMS_ROPE=0 (default). for qwen3, VLLM_USE_FUSED_RMS_ROPE=1 (default)
feat(moe/marlin): Marlin W16A16 MoE 自动探测并预打包（去掉手动开关）
perf(qwen3): 融合 q/k RMSNorm + RoPE
fused_moe_fp8接入lmslim

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>

Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

Signed-off-by: Mickael Seznec <mickael@mistral.ai>