Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
da915345
Unverified
Commit
da915345
authored
Sep 07, 2024
by
Yaroslav
Committed by
GitHub
Sep 06, 2024
Browse files
openai: don't scale temperature or frequency_penalty (#6514)
parent
8a027bc4
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
4 deletions
+4
-4
openai/openai.go
openai/openai.go
+3
-3
openai/openai_test.go
openai/openai_test.go
+1
-1
No files found.
openai/openai.go
View file @
da915345
...
...
@@ -513,7 +513,7 @@ func fromCompleteRequest(r CompletionRequest) (api.GenerateRequest, error) {
}
if
r
.
Temperature
!=
nil
{
options
[
"temperature"
]
=
*
r
.
Temperature
*
2.0
options
[
"temperature"
]
=
*
r
.
Temperature
}
else
{
options
[
"temperature"
]
=
1.0
}
...
...
@@ -522,9 +522,9 @@ func fromCompleteRequest(r CompletionRequest) (api.GenerateRequest, error) {
options
[
"seed"
]
=
*
r
.
Seed
}
options
[
"frequency_penalty"
]
=
r
.
FrequencyPenalty
*
2.0
options
[
"frequency_penalty"
]
=
r
.
FrequencyPenalty
options
[
"presence_penalty"
]
=
r
.
PresencePenalty
*
2.0
options
[
"presence_penalty"
]
=
r
.
PresencePenalty
if
r
.
TopP
!=
0.0
{
options
[
"top_p"
]
=
r
.
TopP
...
...
openai/openai_test.go
View file @
da915345
...
...
@@ -275,7 +275,7 @@ func TestCompletionsMiddleware(t *testing.T) {
Options
:
map
[
string
]
any
{
"frequency_penalty"
:
0.0
,
"presence_penalty"
:
0.0
,
"temperature"
:
1.6
,
"temperature"
:
0.8
,
"top_p"
:
1.0
,
"stop"
:
[]
any
{
"
\n
"
,
"stop"
},
},
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment