set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=1, VLLM_USE_OPT_ZEROS=1 and VLLM_USE_PP_SYNC=1
Attach a file by drag & drop or click to upload
