Skip to content

GitLab

Commit b078dd15 authored by Jesse Gross's avatar Jesse Gross Committed by Jesse Gross
Browse files

gemma2: Remove second call to Rows 

Looks like a merge conflict that broke the model.
parent 2ddacd75
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 2 deletions
model/models/gemma2/model.go
View file @ b078dd15
...@@ -211,8 +211,7 @@ func (m *Model) Forward(ctx ml.Context, opts input.Options) (ml.Tensor, error) { ...@@ -211,8 +211,7 @@ func (m *Model) Forward(ctx ml.Context, opts input.Options) (ml.Tensor, error) {
// final logit softcap // final logit softcap
hiddenState = hiddenState.Scale(ctx, 1.0/float64(m.Options.finalLogitSoftcap)) hiddenState = hiddenState.Scale(ctx, 1.0/float64(m.Options.finalLogitSoftcap))
hiddenState = hiddenState.Tanh(ctx) hiddenState = hiddenState.Tanh(ctx)
hiddenState = hiddenState.Scale(ctx, float64(m.Options.finalLogitSoftcap)) return hiddenState.Scale(ctx, float64(m.Options.finalLogitSoftcap)), nil
return hiddenState.Rows(ctx, outputs), nil
} }
func init() { func init() {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment