GitLab

[release]  Release 0.2.2rc.

[update] Update readme.

 Update README.md

📝 add benchmark.md

⚡ update git ignore add docker dev container

Feat absorb for long prefill

[feat] Support fp8 linear kernel;

musa: support bf16

Ensure backward compatibility with PyTorch 2.2

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

fix KExpertsMarlin on GPU with out CUDA Graph

support moonlight, use ktransformers/optimize/optimize_rules/Moonlight-16B-A3B.yaml

fix bf16 load, TODO: refactor cpu dequant

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

Add fp8 linear kernel;\n Add empty cache to fit in 16G VRAM; By 'wkGCaSS - 知乎 https://zhuanlan.zhihu.com/p/25491611225'

optimize CMake multi core parallel

Feat more context