Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
6694be5e
Commit
6694be5e
authored
May 06, 2024
by
Michael Yang
Browse files
convert/llama: use WriteSeeker
parent
f5e8b207
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
8 deletions
+1
-8
convert/llama.go
convert/llama.go
+1
-8
No files found.
convert/llama.go
View file @
6694be5e
...
...
@@ -5,7 +5,6 @@ import (
"fmt"
"io"
"log/slog"
"os"
"regexp"
"strings"
...
...
@@ -159,11 +158,5 @@ func (m *LlamaModel) WriteGGUF(ws io.WriteSeeker) error {
"tokenizer.ggml.add_eos_token"
:
false
,
}
f
,
err
:=
os
.
CreateTemp
(
""
,
"ollama-gguf"
)
if
err
!=
nil
{
return
err
}
defer
f
.
Close
()
return
llm
.
NewGGUFV3
(
m
.
Params
.
ByteOrder
)
.
Encode
(
f
,
kv
,
m
.
Tensors
)
return
llm
.
NewGGUFV3
(
m
.
Params
.
ByteOrder
)
.
Encode
(
ws
,
kv
,
m
.
Tensors
)
}
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment