Merge pull request #979 from jmorganca/mxyng/num-keep

update default NumKeep

Merge pull request #979 from jmorganca/mxyng/num-keep
update default NumKeep
c01bbe94 · Michael Yang · GitHub · 1beb5645 · 6db3691b · c01bbe94
Unverified Commit c01bbe94 authored Nov 02, 2023 by Michael Yang Committed by GitHub Nov 02, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

api/types.go api/types.go +1 -1

No files found.
--- a/api/types.go
+++ b/api/types.go
@@ -293,7 +293,7 @@ func DefaultOptions() Options {
 	return Options{
 		// options set on request to runner
 		NumPredict:       -1,
-		NumKeep:          -1,
+		NumKeep:          0,
 		Temperature:      0.8,
 		TopK:             40,
 		TopP:             0.9,