GitLab

Update chat.py

Update chat.py

Update chat.py

使用长prompt时，避免rpc进程挂掉

当prompt超过cache_len的时候，rpc进程会crash掉，导致整体不可用。
这里增加一个检查，让过长的prompt在请求早期就被提前过滤掉

xxHash: fix link error due to non-position-independent code

Add missing references to ik_llama.cpp

Add PROPERTIES POSITION_INDEPENDENT_CODE option to fix the
following error:

/usr/bin/ld: ../../third_party/xxHash/libxxhash.a(xxhash.c.o):
relocation R_X86_64_32S against `.rodata' can not be used when
making a shared object; recompile with -fPIC

Trying to link a non-PIC static library libxxhash.a into a
.so shared library, which is not allowed. The object file
xxhash.c.o must be recompiled with explicit -fPIC support.

Create SECURITY.md

Update llama4.md

Update llama4.md

Update llama4.md

Update llama4.md

update llama4 tutorial

update llama4 tutorial

update llama4 tutorial

balance_serve: Add g++ to compiler list

In some OS distributions, g++ exists in the following form:

  # ls -l /usr/bin/g++*
  -rwxr-xr-x 4 root root 985784 Dec  9 12:51 /usr/bin/g++

So make sure to add g++ to the compiler list as well.

Update attention.py

Update balance-serve.md

format kvc2, delete quant_configs, move model_configs to ~/.ktransfor…

fix compile, add abi check to setup.py

Update balance-serve.md