Skip to content

GitLab

"examples/mxnet/_deprecated/gcmc/data.py" did not exist on "e3921d5decacd10636b22e9a42ea32eebda69cb9"
Unverified Commit 9b080524 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

fix: resolve fp8 for mixtral (#1290)

parent 32a4141d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/models/mixtral.py
View file @ 9b080524
......@@ -362,7 +362,7 @@ class MixtralForCausalLM(nn.Module):
weight_loader(
param,
loaded_weight,
weight_name,
name,
shard_id=shard_id,
expert_id=expert_id,
)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment