Commits · 107e4be41791c3f888051bb64e9ff91f0dab77f0 · OpenDAS / ktransformers

10 Feb, 2025 8 commits
- ⚡ fix typo · 107e4be4
  liam authored Feb 10, 2025
  
  107e4be4
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 · 910d8c84
  liam authored Feb 10, 2025
  
  910d8c84
- ⚡ fix typo · cff68532
  liam authored Feb 10, 2025
  
  cff68532
- [feature] add flash_attn to requirements · e968fa8d
  unicornchan authored Feb 10, 2025
  
  e968fa8d
- ⚡ update v0.3 preview · fd481af1
  liam authored Feb 10, 2025
  
  fd481af1
- ⚡ improve readme · 6dd4fa0e
  liam authored Feb 10, 2025
  
  6dd4fa0e
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 · fd8037cd
  unicornchan authored Feb 10, 2025
  
  fd8037cd
- [feature] update version and github action jobs for package · c7e6d090
  unicornchan authored Feb 10, 2025
  
  c7e6d090
09 Feb, 2025 3 commits
- Small fix · 2d684ee9
  chenht2022 authored Feb 09, 2025
  
  2d684ee9
- Add V0.3-preview doc · 6b33f41d
  chenht2022 authored Feb 09, 2025
  
  6b33f41d
- ⚡ v0.2 ongoing · 098602b0
  liam authored Feb 09, 2025
  
  098602b0
08 Feb, 2025 2 commits
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3 · bf1d413b
  liam authored Feb 08, 2025
  
  bf1d413b
- ⚡ add flush print in local_chat output and change default optimize yaml of... · c18ecd7b
  liam authored Feb 08, 2025
```
⚡ add flush print in local_chat output and change default optimize yaml of deepseekv3 to single gpu
```
  c18ecd7b
07 Feb, 2025 1 commit
- support KExpertsMarlin backend · c4d9bc66
  Azure authored Feb 07, 2025
  
  c4d9bc66
06 Feb, 2025 3 commits
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3 · 0262f954
  liam authored Feb 06, 2025
  
  0262f954
- ⚡ fix moe.cpp int overflow problem · 3dca28d2
  liam authored Feb 06, 2025
  
  3dca28d2
- modify moeinfer param · 027b1126
  Azure authored Feb 06, 2025
  
  027b1126
04 Feb, 2025 2 commits
- update v3 single gpu rule yaml; · ee24a270
  Azure authored Feb 04, 2025
  
  ee24a270
- done support deepseekv3 · 907251c7
  Azure authored Feb 04, 2025
  
  907251c7
01 Feb, 2025 2 commits
- fix rope; update moegate · f748cd29
  Azure authored Feb 01, 2025
  
  f748cd29
- update rope calculation; update modeling.py; update gate for moe · f873558a
  Azure authored Feb 01, 2025
  
  f873558a
31 Jan, 2025 2 commits
- fix hard coding caused by rope dim calculation, load from config now · 5a50b346
  Azure authored Jan 31, 2025
  
  5a50b346
- support deepseekv3; runable but have precition problem · 476b1d8d
  Azure authored Jan 31, 2025
  
  476b1d8d
14 Nov, 2024 2 commits
- Merge pull request #115 from KMSorSMS/main · de7e892f
  UnicornChan authored Nov 14, 2024
```
⚡ rm opt config path default value and fix some config logic bug
```
  de7e892f
- ⚡ rm opt config path default value and fix some config logic bug · 04cebec4
  liam authored Nov 14, 2024
  
  04cebec4
06 Nov, 2024 1 commit
- Merge pull request #110 from KMSorSMS/main · dddc4203
  UnicornChan authored Nov 06, 2024
```
refactor local_chat & config setting
```
  dddc4203
04 Nov, 2024 8 commits
- ✨: finish patch · 28ae7e24
  liam authored Nov 04, 2024
  
  28ae7e24
- 🚑️:roll back transformer.py and find that it's multiple chat hsitory have minor accurate error · c2b4dc80
  liam authored Nov 01, 2024
  
  c2b4dc80
- ✨: rm sensitive info in config.yaml, add readme of makefile. support old model_path config · a148da2c
  liam authored Oct 31, 2024
  
  a148da2c
- wjh fix change · 9a2e7057
  anyanqilin authored Oct 30, 2024
  
  9a2e7057
- wjh change · a72dc6ed
  anyanqilin authored Oct 30, 2024
  
  a72dc6ed
- wjh-change · 2d67016d
  anyanqilin authored Oct 29, 2024
  
  2d67016d
- 🚑️: back transformer.py bugs version, and fix typo error in local_chat.py · 7c94df4b
  liam authored Oct 28, 2024
  
  7c94df4b
- ✨: refactor local_chat and fix message slice bug in server · dd1d8667
  liam authored Oct 21, 2024
  
  dd1d8667
30 Oct, 2024 1 commit
- Merge pull request #106 from Azure-Tang/main · a6a1cc05
  UnicornChan authored Oct 30, 2024
```
[Fix] Fix readme structure.
```
  a6a1cc05
28 Oct, 2024 2 commits
- update supported models · c7d62a67
  TangJingqi authored Oct 28, 2024
  
  c7d62a67
- fix readme · d8ddaf0e
  TangJingqi authored Oct 28, 2024
  
  d8ddaf0e
09 Oct, 2024 3 commits
- Merge pull request #99 from chenht2022/main · 43fc7f44
  Chen Hongtao authored Oct 09, 2024
```
Adapt Windows
```
  43fc7f44
- Adapt Windows · 14869b55
  chenht2022 authored Oct 09, 2024
  
  14869b55
- Merge pull request #77 from TKONIY/fix-prefill-and-generate · a81a7ffe
  UnicornChan authored Oct 09, 2024
```
Fix: Wrong type of token list returned by prefill_and_generate
```
  a81a7ffe