"server/vscode:/vscode.git/clone" did not exist on "5bd2ab65839af4f54ba59e60ef3dd262004de456"
Unverified Commit 935c28c2 authored by Mingxing Zhang's avatar Mingxing Zhang Committed by GitHub
Browse files

Update README.md

parent 01df4a6b
...@@ -26,20 +26,14 @@ Our vision for KTransformers is to serve as a flexible platform for experimentin ...@@ -26,20 +26,14 @@ Our vision for KTransformers is to serve as a flexible platform for experimentin
<h2 id="show-cases">🔥 Show Cases</h2> <h2 id="show-cases">🔥 Show Cases</h2>
<h3>GPT-4-level Local VSCode Copilot on a Desktop with only 24GB VRAM</h3> <h3>GPT-4-level Local VSCode Copilot on a Desktop with only 24GB VRAM</h3>
<p align="center"> <p align="center">
https://github.com/user-attachments/assets/38ee32c7-4280-4563-b068-78181f9c3694
Uploading ktransformers_vs_llamacpp.mp4…
</p> </p>
- **Local 236B DeepSeek-Coder-V2:** Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM, attainable on a local desktop machine, which scores even better than GPT4-0613 in [BigCodeBench](https://huggingface.co/blog/leaderboard-bigcodebench). - **Local 236B DeepSeek-Coder-V2:** Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM, attainable on a local desktop machine, which scores even better than GPT4-0613 in [BigCodeBench](https://huggingface.co/blog/leaderboard-bigcodebench).
<p align="center"> <p align="center">
<picture> <picture>
<img alt="DeepSeek-Coder-V2 Score" src="https://github.com/user-attachments/assets/81efb94f-f859-4413-b6e0-d986508ad667" width=80%> <img alt="DeepSeek-Coder-V2 Score" src="https://github.com/user-attachments/assets/6adb26bd-719a-4b77-9513-8e1b4e79b52b" width=80%>
</picture> </picture>
</p> </p>
...@@ -47,15 +41,9 @@ Uploading ktransformers_vs_llamacpp.mp4… ...@@ -47,15 +41,9 @@ Uploading ktransformers_vs_llamacpp.mp4…
- **VSCode Integration:** Wrapped into an OpenAI and Ollama compatible API for seamless integration as a backend for [Tabby](https://github.com/TabbyML/tabby) and various other frontends. - **VSCode Integration:** Wrapped into an OpenAI and Ollama compatible API for seamless integration as a backend for [Tabby](https://github.com/TabbyML/tabby) and various other frontends.
<p align="center"> <p align="center">
<!-- <img alt="Tabby integration" src="https://XXXX.png" width=55%> -->
https://github.com/user-attachments/assets/4cf59f33-8f67-4806-a5c0-540e49bb8305 https://github.com/user-attachments/assets/4cf59f33-8f67-4806-a5c0-540e49bb8305
</p> </p>
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment