GitLab

Create SECURITY.md

Update llama4.md

Update llama4.md

Update llama4.md

Update llama4.md

update llama4 tutorial

update llama4 tutorial

update llama4 tutorial

balance_serve: Add g++ to compiler list

In some OS distributions, g++ exists in the following form:

  # ls -l /usr/bin/g++*
  -rwxr-xr-x 4 root root 985784 Dec  9 12:51 /usr/bin/g++

So make sure to add g++ to the compiler list as well.

Update attention.py

Update balance-serve.md

format kvc2, delete quant_configs, move model_configs to ~/.ktransfor…

fix compile, add abi check to setup.py

Update balance-serve.md

Fix TypeError when invoke KLinearCPUInfer.forward()

fix temperature=0, flashinfer sample error

Fix compile

Fix the following error:

  File "/home/aubrey/work/ktransformers/ktransformers/operators/linear.py", line 825, in forward
    y = self.generate_linear.forward(x, bsz_tensor)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: KLinearCPUInfer.forward() takes 2 positional arguments but 3 were given

Update balance-serve.md