Unverified Commit 935c28c2 authored by Mingxing Zhang's avatar Mingxing Zhang Committed by GitHub
Browse files

Update README.md

parent 01df4a6b
......@@ -26,20 +26,14 @@ Our vision for KTransformers is to serve as a flexible platform for experimentin
<h2 id="show-cases">🔥 Show Cases</h2>
<h3>GPT-4-level Local VSCode Copilot on a Desktop with only 24GB VRAM</h3>
<p align="center">
Uploading ktransformers_vs_llamacpp.mp4…
https://github.com/user-attachments/assets/38ee32c7-4280-4563-b068-78181f9c3694
</p>
- **Local 236B DeepSeek-Coder-V2:** Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM, attainable on a local desktop machine, which scores even better than GPT4-0613 in [BigCodeBench](https://huggingface.co/blog/leaderboard-bigcodebench).
<p align="center">
<picture>
<img alt="DeepSeek-Coder-V2 Score" src="https://github.com/user-attachments/assets/81efb94f-f859-4413-b6e0-d986508ad667" width=80%>
<img alt="DeepSeek-Coder-V2 Score" src="https://github.com/user-attachments/assets/6adb26bd-719a-4b77-9513-8e1b4e79b52b" width=80%>
</picture>
</p>
......@@ -47,14 +41,8 @@ Uploading ktransformers_vs_llamacpp.mp4…
- **VSCode Integration:** Wrapped into an OpenAI and Ollama compatible API for seamless integration as a backend for [Tabby](https://github.com/TabbyML/tabby) and various other frontends.
<p align="center">
<!-- <img alt="Tabby integration" src="https://XXXX.png" width=55%> -->
https://github.com/user-attachments/assets/4cf59f33-8f67-4806-a5c0-540e49bb8305
</p>
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment