Skip to content

GitLab

Unverified Commit 9b080524 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix: resolve fp8 for mixtral (#1290)

parent 32a4141d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/models/mixtral.py
View file @ 9b080524
...@@ -362,7 +362,7 @@ class MixtralForCausalLM(nn.Module): ...@@ -362,7 +362,7 @@ class MixtralForCausalLM(nn.Module):
weight_loader( weight_loader(
param, param,
loaded_weight, loaded_weight,
weight_name, name,
shard_id=shard_id, shard_id=shard_id,
expert_id=expert_id, expert_id=expert_id,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment