Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ChatGLM3_fastllm
Commits
40dc810c
Commit
40dc810c
authored
Jan 10, 2024
by
zhouxiang
Browse files
修复api-server非流式异常
parent
253f844a
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
package/fastllm_pytools/llm.py
package/fastllm_pytools/llm.py
+1
-1
No files found.
package/fastllm_pytools/llm.py
View file @
40dc810c
...
...
@@ -216,7 +216,7 @@ class model:
return
cache_result
output_buffer_init_len
=
256
if
self
.
thread_local_obj
.
tokenizer_decode_token__output_buffer
is
None
or
self
.
thread_local_obj
.
tokenizer_decode_token__output_buffer
is
None
:
if
not
hasattr
(
self
.
thread_local_obj
,
'
tokenizer_decode_token__output_buffer
'
)
or
self
.
thread_local_obj
.
tokenizer_decode_token__output_buffer
is
None
:
self
.
thread_local_obj
.
tokenizer_decode_token__output_buffer
=
ctypes
.
create_string_buffer
(
output_buffer_init_len
)
buffer
=
self
.
thread_local_obj
.
tokenizer_decode_token__output_buffer
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment