@@ -22,6 +22,7 @@ Our vision for KTransformers is to serve as a flexible platform for experimentin
...
@@ -22,6 +22,7 @@ Our vision for KTransformers is to serve as a flexible platform for experimentin
<h2 id="Updates">🔥 Updates</h2>
<h2 id="Updates">🔥 Updates</h2>
***Apr 2, 2025**: Support Multi-concurrency. ([Tutorial](./en/balance-serve.md)).
***Mar 27, 2025**: Support Multi-concurrency.
***Mar 27, 2025**: Support Multi-concurrency.
***Mar 15, 2025**: Support ROCm on AMD GPU ([Tutorial](./en/ROCm.md)).
***Mar 15, 2025**: Support ROCm on AMD GPU ([Tutorial](./en/ROCm.md)).
***Mar 5, 2025**: Support unsloth 1.58/2.51 bits weights and [IQ1_S/FP8 hybrid](./en/fp8_kernel.md) weights. Support 139K [Longer Context](./en/DeepseekR1_V3_tutorial.md#v022-longer-context) for DeepSeek-V3 and R1 in 24GB VRAM.
***Mar 5, 2025**: Support unsloth 1.58/2.51 bits weights and [IQ1_S/FP8 hybrid](./en/fp8_kernel.md) weights. Support 139K [Longer Context](./en/DeepseekR1_V3_tutorial.md#v022-longer-context) for DeepSeek-V3 and R1 in 24GB VRAM.