Skip to content

GitLab

Commit 01114b45 authored by Michael Yang's avatar Michael Yang
Browse files

fix: rope

parent 1524f323
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 0 deletions
api/types.go
View file @ 01114b45
...@@ -122,6 +122,11 @@ type Runner struct { ...@@ -122,6 +122,11 @@ type Runner struct {
UseMMap bool `json:"use_mmap,omitempty"` UseMMap bool `json:"use_mmap,omitempty"`
UseMLock bool `json:"use_mlock,omitempty"` UseMLock bool `json:"use_mlock,omitempty"`
NumThread int `json:"num_thread,omitempty"` NumThread int `json:"num_thread,omitempty"`
// Unused: RopeFrequencyBase is ignored. Instead the value in the model will be used
RopeFrequencyBase float32 `json:"rope_frequency_base,omitempty"`
// Unused: RopeFrequencyScale is ignored. Instead the value in the model will be used
RopeFrequencyScale float32 `json:"rope_frequency_scale,omitempty"`
} }
type EmbeddingRequest struct { type EmbeddingRequest struct {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment