Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
807d0927
Commit
807d0927
authored
May 17, 2024
by
Michael Yang
Browse files
fix quantize file types
parent
f36f1d6b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
1 deletion
+8
-1
server/images.go
server/images.go
+8
-1
No files found.
server/images.go
View file @
807d0927
...
@@ -415,10 +415,17 @@ func CreateModel(ctx context.Context, name, modelFileDir, quantization string, m
...
@@ -415,10 +415,17 @@ func CreateModel(ctx context.Context, name, modelFileDir, quantization string, m
return
err
return
err
}
}
baseLayer
.
Layer
,
err
=
NewLayer
(
temp
,
baseLayer
.
Layer
.
MediaType
)
layers
,
err
:
=
parseFromFile
(
ctx
,
temp
,
""
,
fn
)
if
err
!=
nil
{
if
err
!=
nil
{
return
err
return
err
}
}
if
len
(
layers
)
!=
1
{
return
errors
.
New
(
"quantization failed"
)
}
baseLayer
.
Layer
=
layers
[
0
]
.
Layer
baseLayer
.
GGML
=
layers
[
0
]
.
GGML
}
}
}
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment