Unverified Commit 5264015d authored by Jinghui Zhang's avatar Jinghui Zhang Committed by GitHub
Browse files

[BugFix][AMD][Deepseek] fix a dtype mismatch error for deepseek running on AMD (#23864)


Signed-off-by: default avatarJinghui Zhang <jinghuizhang0804@gmail.com>
parent 98ac0cb3
......@@ -279,7 +279,7 @@ def rocm_aiter_grouped_topk(
if e_score_correction_bias is not None:
torch.ops.vllm.rocm_aiter_biased_grouped_topk(
gating_output,
e_score_correction_bias,
e_score_correction_bias.to(gating_output.dtype),
topk_weights,
topk_ids,
num_expert_group,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment