Skip to content

GitLab

Unverified Commit 34e07a65 authored by Baizhou Zhang's avatar Baizhou Zhang Committed by GitHub
Browse files

[Fix] Fix unexpected idx bug of Phi-3-small (#4728)

parent 15ddd843
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/models/phi3_small.py
View file @ 34e07a65
...@@ -301,7 +301,7 @@ class Phi3SmallModel(nn.Module): ...@@ -301,7 +301,7 @@ class Phi3SmallModel(nn.Module):
self.mup_embedding_multiplier = config.mup_embedding_multiplier self.mup_embedding_multiplier = config.mup_embedding_multiplier
self.start_layer, self.end_layer, self.layers = make_layers( self.start_layer, self.end_layer, self.layers = make_layers(
config.num_hidden_layers, config.num_hidden_layers,
lambda prefix: Phi3SmallDecoderLayer( lambda idx, prefix: Phi3SmallDecoderLayer(
config, config,
int(prefix.split(".")[-1]), int(prefix.split(".")[-1]),
quant_config, quant_config,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment