Unverified Commit 73ff872d authored by Gleb Kurchanov's avatar Gleb Kurchanov Committed by GitHub
Browse files

[Bugfix] Fix typo in Qwen3 Next model executor (#28960)


Signed-off-by: default avatarGleb Kurchanov <nepherpitou@gmail.com>
parent 468a8d72
...@@ -1154,8 +1154,8 @@ class QwenNextMixtureOfExperts(MixtureOfExperts): ...@@ -1154,8 +1154,8 @@ class QwenNextMixtureOfExperts(MixtureOfExperts):
example_moe = layer.mlp example_moe = layer.mlp
self.moe_layers.append(layer.mlp.experts) self.moe_layers.append(layer.mlp.experts)
if example_moe is None: if example_moe is None:
raise RuntimeError("No Qwen3Next layer found in the model.layers.") raise RuntimeError("No Qwen3Next layer found in the model.layers.")
# Set MoE hyperparameters # Set MoE hyperparameters
self.num_moe_layers = len(self.moe_layers) self.num_moe_layers = len(self.moe_layers)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment