Unverified Commit e638f2ac authored by Jeffrey Morgan's avatar Jeffrey Morgan Committed by GitHub
Browse files

runner: fix shifting on llama runner (#12604)

parent 18087f2e
......@@ -162,6 +162,7 @@ func (s *Server) NewSequence(prompt string, images []llm.ImageData, params NewSe
embeddingOnly: params.embedding,
stop: params.stop,
numKeep: params.numKeep,
shift: params.shift,
}, nil
}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment