Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "9d90faf0b9ce7b312f05e3ddcc505e39242b74d2"
Unverified Commit 52cefdbf authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix: resolve the fp8 bug introduced by vLLM 0.5.5 (#1276)

parent 51c554d8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/models/deepseek_v2.py
View file @ 52cefdbf
...@@ -695,7 +695,7 @@ class DeepseekV2ForCausalLM(nn.Module): ...@@ -695,7 +695,7 @@ class DeepseekV2ForCausalLM(nn.Module):
weight_loader( weight_loader(
param, param,
loaded_weight, loaded_weight,
weight_name, name,
shard_id=shard_id, shard_id=shard_id,
expert_id=expert_id, expert_id=expert_id,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment