Skip to content

GitLab

"...git@developer.sourcefind.cn:OpenDAS/torchaudio.git" did not exist on "9dcc7a15b1b1d1cf9cb7fd5fa6154e6a56a01045"
Unverified Commit c03f0e3c authored by Michael Yang's avatar Michael Yang Committed by GitHub
Browse files

Merge pull request #3565 from ollama/mxyng/rope 

fix: rope
parents 1524f323 01114b45
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 0 deletions
api/types.go
View file @ c03f0e3c
...@@ -122,6 +122,11 @@ type Runner struct { ...@@ -122,6 +122,11 @@ type Runner struct {
UseMMap bool `json:"use_mmap,omitempty"` UseMMap bool `json:"use_mmap,omitempty"`
UseMLock bool `json:"use_mlock,omitempty"` UseMLock bool `json:"use_mlock,omitempty"`
NumThread int `json:"num_thread,omitempty"` NumThread int `json:"num_thread,omitempty"`
// Unused: RopeFrequencyBase is ignored. Instead the value in the model will be used
RopeFrequencyBase float32 `json:"rope_frequency_base,omitempty"`
// Unused: RopeFrequencyScale is ignored. Instead the value in the model will be used
RopeFrequencyScale float32 `json:"rope_frequency_scale,omitempty"`
} }
type EmbeddingRequest struct { type EmbeddingRequest struct {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment