优化int8生成速度，优化int8精度下大token数输入时性能不佳的问题，优化int8多batch效果

0e6e6b31 · zhouxiang · 4536fa79 · 4536fa79
Commit 0e6e6b31 authored Aug 30, 2023 by zhouxiang
Show whitespace changes
Inline Side-by-side

Showing with 0 additions and 0 deletions

package/fastllm_pytools/libfastllm_tools.so package/fastllm_pytools/libfastllm_tools.so +0 -0

No files found.
--- a/package/fastllm_pytools/libfastllm_tools.so
+++ b/package/fastllm_pytools/libfastllm_tools.so