Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
6b800aa7
Unverified
Commit
6b800aa7
authored
Jun 14, 2024
by
Jeffrey Morgan
Committed by
GitHub
Jun 14, 2024
Browse files
openai: do not set temperature to 0 when setting seed (#5045)
parent
dd7c9ebe
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
0 additions
and
4 deletions
+0
-4
docs/openai.md
docs/openai.md
+0
-1
openai/openai.go
openai/openai.go
+0
-3
No files found.
docs/openai.md
View file @
6b800aa7
...
...
@@ -104,7 +104,6 @@ curl http://localhost:11434/v1/chat/completions \
#### Notes
-
Setting
`seed`
will always set
`temperature`
to
`0`
-
`finish_reason`
will always be
`stop`
-
`usage.prompt_tokens`
will be 0 for completions where prompt evaluation is cached
...
...
openai/openai.go
View file @
6b800aa7
...
...
@@ -178,9 +178,6 @@ func fromRequest(r ChatCompletionRequest) api.ChatRequest {
if
r
.
Seed
!=
nil
{
options
[
"seed"
]
=
*
r
.
Seed
// temperature=0 is required for reproducible outputs
options
[
"temperature"
]
=
0.0
}
if
r
.
FrequencyPenalty
!=
nil
{
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment