set USE_FUSED_RMS_QUANT=1, USE_FUSED_SILU_MUL_QUANT=1 and VLLM_SCHED_ENABLE_MINIMAL_INJECTION=1 for dpsk-v3
Attach a file by drag & drop or click to upload
