GitLab

xxHash: fix link error due to non-position-independent code

Add missing references to ik_llama.cpp

Add PROPERTIES POSITION_INDEPENDENT_CODE option to fix the
following error:

/usr/bin/ld: ../../third_party/xxHash/libxxhash.a(xxhash.c.o):
relocation R_X86_64_32S against `.rodata' can not be used when
making a shared object; recompile with -fPIC

Trying to link a non-PIC static library libxxhash.a into a
.so shared library, which is not allowed. The object file
xxhash.c.o must be recompiled with explicit -fPIC support.

Create SECURITY.md

Update llama4.md

Update llama4.md

Update llama4.md

Update llama4.md

update llama4 tutorial

update llama4 tutorial

update llama4 tutorial

balance_serve: Add g++ to compiler list

In some OS distributions, g++ exists in the following form:

  # ls -l /usr/bin/g++*
  -rwxr-xr-x 4 root root 985784 Dec  9 12:51 /usr/bin/g++

So make sure to add g++ to the compiler list as well.

Update attention.py

Update balance-serve.md

format kvc2, delete quant_configs, move model_configs to ~/.ktransfor…

fix compile, add abi check to setup.py

Update balance-serve.md

Fix TypeError when invoke KLinearCPUInfer.forward()

fix temperature=0, flashinfer sample error

Fix compile

Fix the following error:

  File "/home/aubrey/work/ktransformers/ktransformers/operators/linear.py", line 825, in forward
    y = self.generate_linear.forward(x, bsz_tensor)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: KLinearCPUInfer.forward() takes 2 positional arguments but 3 were given