Unverified Commit 0b20469c authored by Roger Wang's avatar Roger Wang Committed by GitHub
Browse files

[Bugfix] Fix weight naming in Qwen3.5 (#34313)


Signed-off-by: default avatarRoger Wang <hey@rogerw.io>
parent d7982daf
...@@ -206,7 +206,7 @@ class Qwen3_5GatedDeltaNet(Qwen3NextGatedDeltaNet): ...@@ -206,7 +206,7 @@ class Qwen3_5GatedDeltaNet(Qwen3NextGatedDeltaNet):
output_size=self.num_v_heads, output_size=self.num_v_heads,
bias=False, bias=False,
quant_config=quant_config, quant_config=quant_config,
prefix=f"{prefix}.in_proj_ba", prefix=f"{prefix}.in_proj_b",
) )
self.in_proj_a = ColumnParallelLinear( self.in_proj_a = ColumnParallelLinear(
input_size=self.hidden_size, input_size=self.hidden_size,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment