GitLab

Add bsz_tensors param to torch linear

Feat: Add Function call support

feat(build): display limited tail of subprocesses in real time

this is a followup on #1108

chore: show cmake output in real time during build_ext

使用长prompt时，避免rpc进程挂掉

当prompt超过cache_len的时候，rpc进程会crash掉，导致整体不可用。
这里增加一个检查，让过长的prompt在请求早期就被提前过滤掉

xxHash: fix link error due to non-position-independent code

Add missing references to ik_llama.cpp

Add PROPERTIES POSITION_INDEPENDENT_CODE option to fix the
following error:

/usr/bin/ld: ../../third_party/xxHash/libxxhash.a(xxhash.c.o):
relocation R_X86_64_32S against `.rodata' can not be used when
making a shared object; recompile with -fPIC

Trying to link a non-PIC static library libxxhash.a into a
.so shared library, which is not allowed. The object file
xxhash.c.o must be recompiled with explicit -fPIC support.

otherwise cmake error messages may be suppressed, making debugging
difficult

Create SECURITY.md

Update llama4.md

Update llama4.md

Update llama4.md

Update llama4.md

update llama4 tutorial

update llama4 tutorial

update llama4 tutorial

balance_serve: Add g++ to compiler list

In some OS distributions, g++ exists in the following form:

  # ls -l /usr/bin/g++*
  -rwxr-xr-x 4 root root 985784 Dec  9 12:51 /usr/bin/g++

So make sure to add g++ to the compiler list as well.

Update attention.py

Update balance-serve.md

format kvc2, delete quant_configs, move model_configs to ~/.ktransfor…

fix compile, add abi check to setup.py