Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
0142660b
Commit
0142660b
authored
Jul 14, 2023
by
Michael Yang
Browse files
size_t
parent
743e957d
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
llama/llama.go
llama/llama.go
+2
-2
No files found.
llama/llama.go
View file @
0142660b
...
@@ -264,8 +264,8 @@ func (llm *llama) sample(output deque[C.llama_token], opts *C.struct_llama_sampl
...
@@ -264,8 +264,8 @@ func (llm *llama) sample(output deque[C.llama_token], opts *C.struct_llama_sampl
token
:=
C
.
llama_sample
(
token
:=
C
.
llama_sample
(
llm
.
ctx
,
llm
.
ctx
,
unsafe
.
SliceData
(
candidates
.
Data
()),
C
.
ulong
(
candidates
.
Len
()),
unsafe
.
SliceData
(
candidates
.
Data
()),
C
.
size_t
(
candidates
.
Len
()),
unsafe
.
SliceData
(
output
.
Data
()),
C
.
ulong
(
output
.
Len
()),
unsafe
.
SliceData
(
output
.
Data
()),
C
.
size_t
(
output
.
Len
()),
opts
)
opts
)
if
token
!=
C
.
llama_token_eos
()
{
if
token
!=
C
.
llama_token_eos
()
{
return
token
,
nil
return
token
,
nil
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment