Commits · 07eb712a73e65952114d3e404b4326d0d390cedc · OpenDAS / ktransformers

"vscode:/vscode.git/clone" did not exist on "6f88cc92e9e95ccbe2fb9b41547968fbac3cef85"

24 Feb, 2025 8 commits
- Left out · 07eb712a
  lazymio authored Feb 24, 2025
  
  07eb712a
- Default values · 91062a83
  lazymio authored Feb 24, 2025
  
  91062a83
- Revert repetition_penalty as it is not in API spec · 76487c4d
  lazymio authored Feb 24, 2025
  
  76487c4d
- Also /chat/completions · 05ad2884
  lazymio authored Feb 24, 2025
  
  05ad2884
- Also allow repetition_penalty · bf36547f
  lazymio authored Feb 24, 2025
  
  bf36547f
- Allow temperature and top_p from requests · 8704c091
  lazymio authored Feb 24, 2025
  
  8704c091
- Merge pull request #638 from kvcache-ai/feat-moonlight · 4b5991e7
  Atream authored Feb 24, 2025
```
fix KExpertsMarlin on GPU with out CUDA Graph
```
  4b5991e7
- fix KExpertsMarlin on GPU with out CUDA Graph · f3276950
  Atream authored Feb 24, 2025
  
  f3276950
23 Feb, 2025 6 commits
- Merge pull request #621 from kvcache-ai/feat-moonlight · eb039b72
  Atream authored Feb 23, 2025
```
support moonlight, use ktransformers/optimize/optimize_rules/Moonlight-16B-A3B.yaml
```
  eb039b72
- update yaml · f5f6c6b9
  Atream authored Feb 23, 2025
  
  f5f6c6b9
- support Moonlight · e8e02e5c
  Atream authored Feb 23, 2025
  
  e8e02e5c
- tmp · 95d937c5
  DDong Jianwei authored Feb 23, 2025
  
  95d937c5
- Merge pull request #612 from kvcache-ai/fix-bf16-load · cdb6f896
  Atream authored Feb 23, 2025
```
fix bf16 load, TODO: refactor cpu dequant
```
  cdb6f896
- fix bf16 load, TODO: refactor cpu dequant · 036ae25a
  Atream authored Feb 23, 2025
  
  036ae25a
22 Feb, 2025 7 commits
- Merge pull request #523 from miaooo0000OOOO/main · 94ab2de3
  Atream authored Feb 22, 2025
```
optimize CMake multi core parallel
```
  94ab2de3
- Merge pull request #597 from kvcache-ai/feat-more-context · 72d09f3f
  Atream authored Feb 22, 2025
```
Feat more context
```
  72d09f3f
- fix merge bug, this branch also padding Marlin · f7f10598
  Atream authored Feb 22, 2025
  
  f7f10598
- Merge pull request #577 from JiamingMai/dev · e9089631
  Atream authored Feb 22, 2025
```
Fix the link address in the doc install.md
```
  e9089631
- Merge pull request #582 from twobob/patch-1 · 95479612
  Atream authored Feb 22, 2025
```
Adjust the installation link to the correct section of docs
```
  95479612
- Merge branch 'main' into feat-more-context · 02400967
  Atream authored Feb 22, 2025
  
  02400967
- optimize gguf dequant, save mem, support Q2_K · 5ec33d04
  Atream authored Feb 22, 2025
```
use marlin for lm_head, lm_head only calc last token for prefill
extend context window to 19K for DeepSeek-V3/R1 within 24GB VRAM
```
  5ec33d04
21 Feb, 2025 3 commits
- Update README.md · 5ed441a0
  _ authored Feb 21, 2025
  
  5ed441a0
- fix the link addresses · 45faddf6
  JiamingMai authored Feb 21, 2025
  
  45faddf6
- optimize GPU · 7e1fe256
  Atream authored Feb 21, 2025
  
  7e1fe256
20 Feb, 2025 8 commits
- Merge pull request #506 from makllama/musa · 25c5bddd
  Azure authored Feb 20, 2025
```
feat: Support Moore Threads GPU
```
  25c5bddd
- Merge pull request #550 from kvcache-ai/docker_dev · 1dd84b4a
  ZiWei Yuan authored Feb 20, 2025
```
Docker dev
```
  1dd84b4a
- ⚡ docker-iamge workflow · ed74f91a
  liam authored Feb 20, 2025
  
  ed74f91a
- Merge branch 'main' of https://github.com/kvcache-ai/ktransformers into main · a6aee1c5
  liam authored Feb 20, 2025
  
  a6aee1c5
- Merge pull request #232 from HandSonic/patch-1 · 64a00651
  ZiWei Yuan authored Feb 20, 2025
```
feat: add GitHub Actions workflow for building Docker image
```
  64a00651
- ⚡ fix .so bug · 97e1dc97
  liam authored Feb 20, 2025
  
  97e1dc97
- ⚡ fin docker-image · 574b1339
  liam authored Feb 20, 2025
  
  574b1339
- 默认并行编译 · 0cdc446a
  miaooo0000OOOO authored Feb 20, 2025
  
  0cdc446a
19 Feb, 2025 8 commits
- feat: Support Moore Threads GPU · 2207f6cd
  Xiaodong Ye authored Feb 19, 2025
```
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
```
  2207f6cd
- Merge pull request #501 from Zhoneym/main · b4fb6339
  Atream authored Feb 19, 2025
```
Necessary tips for Node.js related issues
```
  b4fb6339
- Necessary tips for Node.js related issues · c92a300b
  Zhoneym authored Feb 19, 2025
  
  c92a300b
- Merge pull request #384 from ubergarm/add-tutorial-notes · c9eb1f76
  Atream authored Feb 19, 2025
```
Add notes to DeepSeek-R1 tutorial documentation
```
  c9eb1f76
- Merge pull request #487 from kvcache-ai/clean_pr · 89f8218a
  Atream authored Feb 19, 2025
```
clean PR code and disable flashinfer
```
  89f8218a
- clean PR code and disable flashinfer · a5295183
  Atream authored Feb 19, 2025
  
  a5295183
- Merge pull request #382 from ceerRep/server-prefix-cache · cf4da5fd
  Atream authored Feb 19, 2025
```
fix server and add prefix cache for server
```
  cf4da5fd
- Merge pull request #481 from Zhoneym/main · ea75849d
  Azure authored Feb 19, 2025
```
Modify and add any incorrect or missing content in the `install.md`
```
  ea75849d