update VLLM_USE_PD_SPLIT=0 (for dspk)and VLLM_USE_PD_SPLIT=1 (for others)
Attach a file by drag & drop or click to upload