Commits · a41d2163933a55ea34ea517454b1d27f7a052037 · wqshmzh / ktransformers

01 Apr, 2025 4 commits
- change tag v0.2.4 · 56a18ad0
  dongjw authored Apr 01, 2025
  
  56a18ad0
- fix top_p = 0 bug · 5c7ed7b5
  dongjw authored Apr 01, 2025
  
  5c7ed7b5
- Fix ktransformers-server flashinfer wrapper position arg issue; · 31677181
  Azure-Tang authored Apr 01, 2025
```
Fix db position issue
```
  31677181
- rm KMoEGateDeepSeekV3, fall back to KMoEGate · 203b853c
  Azure-Tang authored Apr 01, 2025
  
  203b853c
31 Mar, 2025 2 commits
- add balance-serve, support concurrence · 25cee581
  Atream authored Mar 31, 2025
  
  25cee581
- refactor folders · 8d0292aa
  Atream authored Mar 31, 2025
  
  8d0292aa
20 Mar, 2025 4 commits
- fix params · 6d4626a5
  SkqLiao authored Mar 20, 2025
  
  6d4626a5
- Update gate.py · 633af5d2
  Atream authored Mar 20, 2025
  
  633af5d2
- use DeepSeek V3 instead of R1 for benchmarking · 8cc4df98
  SkqLiao authored Mar 20, 2025
  
  8cc4df98
- change cpu-infer due to actual cpu cores on self-hosted server. · 19c824f9
  SkqLiao authored Mar 20, 2025
  
  19c824f9
19 Mar, 2025 4 commits
- add CI/CD for human eval score benchmarking · bc369b25
  SkqLiao authored Mar 19, 2025
  
  bc369b25
- Update gate.py · b453333f
  Atream authored Mar 19, 2025
  
  b453333f
- Update gate.py · 44599229
  Atream authored Mar 19, 2025
  
  44599229
- fix-gate-compile · 11499535
  Atream authored Mar 19, 2025
  
  11499535
17 Mar, 2025 3 commits
- Update DeepSeek-V3-Chat-multi-gpu-marlin.yaml · 167506b7
  Atream authored Mar 17, 2025
  
  167506b7
- Update DeepSeek-V3-Chat-multi-gpu-fp8-linear-ggml-experts.yaml · c9a0c442
  Atream authored Mar 17, 2025
  
  c9a0c442
- 🔧 update multi-gpu-fp8-linear and multi-gpu marlin yaml · 19f058ec
  liam authored Mar 17, 2025
  
  19f058ec
16 Mar, 2025 1 commit
- Fix rocm example yaml · 85c32fdd
  Azure-Tang authored Mar 15, 2025
  
  85c32fdd
15 Mar, 2025 3 commits
- fix rocm compilation · 4a312373
  Azure-Tang authored Mar 15, 2025
  
  4a312373
- rollback-triton-prefill · 3934b9df
  Atream authored Mar 15, 2025
  
  3934b9df
- 🔖 release v0.2.3post2 · b5ef7c26
  liam authored Mar 15, 2025
  
  b5ef7c26
14 Mar, 2025 6 commits
- fix compilation · 117a8d2f
  Azure authored Mar 14, 2025
  
  117a8d2f
- local chat for cicd test · 0f1684c2
  SkqLiao authored Mar 15, 2025
  
  0f1684c2
- Update readme; Format code; Add example yaml. · e5b001d7
  Azure-Tang authored Mar 14, 2025
  
  e5b001d7
- use compile for gate, slight performance improvement · a889288f
  Atream authored Mar 14, 2025
  
  a889288f
- merge main; Add torch q8 linear · ed843741
  Azure-Tang authored Mar 14, 2025
  
  ed843741
- fix-singleton · 6f43bbe5
  Atream authored Mar 14, 2025
  
  6f43bbe5
13 Mar, 2025 1 commit
- Add vendor control · 086a9d1c
  Azure-Tang authored Mar 13, 2025
  
  086a9d1c
10 Mar, 2025 1 commit
- cpuinfer: filter repeated backend instantiation · d166fb9f
  Lander-Hatsune authored Mar 10, 2025
  
  d166fb9f
07 Mar, 2025 4 commits
- [fix] thread context bug · 08a8b553
  BITcyman authored Mar 07, 2025
  
  08a8b553
- Update __init__.py · f8c1821f
  Atream authored Mar 07, 2025
  
  f8c1821f
- fix flashinfer precision · d453c320
  Atream authored Mar 07, 2025
  
  d453c320
- [update] support openai chat completion api · 299c4dca
  BITcyman authored Mar 07, 2025
  
  299c4dca
06 Mar, 2025 1 commit
- ⚡ update compile option for avx512vpopcntdq · 8eeb6dd4
  liam authored Mar 06, 2025
  
  8eeb6dd4
05 Mar, 2025 3 commits
- fix: list models API · b2ba795c
  chenmz00 authored Mar 05, 2025
```
Fix the list models API to match the corresponding OpenAI API format.
```
  b2ba795c
- ⚡ release v0.2.3 · 848fe8ab
  liam authored Mar 05, 2025
  
  848fe8ab
- small fix about max new token · 662c1e4c
  Azure authored Mar 05, 2025
  
  662c1e4c
04 Mar, 2025 1 commit
- ⚡ add humaneval support · dc10480e
  liam authored Mar 04, 2025
  
  dc10480e
03 Mar, 2025 2 commits
- fix: wrong shape in KLinearMarlin. · 01755a60
  Yi Pan authored Mar 03, 2025
  
  01755a60
- Update __init__.py · 8963ae78
  Atream authored Mar 03, 2025
  
  8963ae78