Commits · a8ac931fe28f92c83ca88da9ff6a0108e1ae3bc7 · OpenDAS / ktransformers

10 Feb, 2025 21 commits
- Update README.md · a8ac931f
  Atream authored Feb 10, 2025
  
  a8ac931f
- Merge pull request #124 from kvcache-ai/feat-DeepSeekV3 · cf598db9
  ZiWei Yuan authored Feb 10, 2025
```
📝 fix doc
```
  cf598db9
- 📝 fix doc · e45e757f
  liam authored Feb 10, 2025
  
  e45e757f
- Merge pull request #122 from kvcache-ai/feat-DeepSeekV3 · 7527619f
  UnicornChan authored Feb 10, 2025
```
[Feat] add support to DeepSeekV3
```
  7527619f
- Merge pull request #123 from RodriMora/add_models_endpoints · f4903d54
  UnicornChan authored Feb 10, 2025
```
Added simple /models endpoint 
```
  f4903d54
- ⚡ release v0.2.0 · 6f0fe953
  liam authored Feb 10, 2025
  
  6f0fe953
- ⚡ ready to publish · 83401dbb
  liam authored Feb 10, 2025
  
  83401dbb
- ⚡ update v3 · f892d228
  liam authored Feb 10, 2025
  
  f892d228
- ⚡ fix typo readme · aecb50f0
  liam authored Feb 10, 2025
  
  aecb50f0
- ⚡ add Summary part · 0f73f40d
  liam authored Feb 10, 2025
  
  0f73f40d
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 · 323cff15
  liam authored Feb 10, 2025
  
  323cff15
- ⚡ fix typo · 3d7dfd61
  liam authored Feb 10, 2025
  
  3d7dfd61
- [fix] fix pyproject.toml · 402b7144
  unicornchan authored Feb 10, 2025
  
  402b7144
- ⚡ fix typo · 107e4be4
  liam authored Feb 10, 2025
  
  107e4be4
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 · 910d8c84
  liam authored Feb 10, 2025
  
  910d8c84
- ⚡ fix typo · cff68532
  liam authored Feb 10, 2025
  
  cff68532
- [feature] add flash_attn to requirements · e968fa8d
  unicornchan authored Feb 10, 2025
  
  e968fa8d
- ⚡ update v0.3 preview · fd481af1
  liam authored Feb 10, 2025
  
  fd481af1
- ⚡ improve readme · 6dd4fa0e
  liam authored Feb 10, 2025
  
  6dd4fa0e
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 · fd8037cd
  unicornchan authored Feb 10, 2025
  
  fd8037cd
- [feature] update version and github action jobs for package · c7e6d090
  unicornchan authored Feb 10, 2025
  
  c7e6d090
09 Feb, 2025 3 commits
- Small fix · 2d684ee9
  chenht2022 authored Feb 09, 2025
  
  2d684ee9
- Add V0.3-preview doc · 6b33f41d
  chenht2022 authored Feb 09, 2025
  
  6b33f41d
- ⚡ v0.2 ongoing · 098602b0
  liam authored Feb 09, 2025
  
  098602b0
08 Feb, 2025 2 commits
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3 · bf1d413b
  liam authored Feb 08, 2025
  
  bf1d413b
- ⚡ add flush print in local_chat output and change default optimize yaml of... · c18ecd7b
  liam authored Feb 08, 2025
```
⚡ add flush print in local_chat output and change default optimize yaml of deepseekv3 to single gpu
```
  c18ecd7b
07 Feb, 2025 2 commits
- Added simple /models endpoint to work with frontends that don't allow bypass check like Openweb-ui · b1bff2a4
  RodriMora authored Feb 07, 2025
  
  b1bff2a4
- support KExpertsMarlin backend · c4d9bc66
  Azure authored Feb 07, 2025
  
  c4d9bc66
06 Feb, 2025 3 commits
- Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3 · 0262f954
  liam authored Feb 06, 2025
  
  0262f954
- ⚡ fix moe.cpp int overflow problem · 3dca28d2
  liam authored Feb 06, 2025
  
  3dca28d2
- modify moeinfer param · 027b1126
  Azure authored Feb 06, 2025
  
  027b1126
04 Feb, 2025 2 commits
- update v3 single gpu rule yaml; · ee24a270
  Azure authored Feb 04, 2025
  
  ee24a270
- done support deepseekv3 · 907251c7
  Azure authored Feb 04, 2025
  
  907251c7
01 Feb, 2025 2 commits
- fix rope; update moegate · f748cd29
  Azure authored Feb 01, 2025
  
  f748cd29
- update rope calculation; update modeling.py; update gate for moe · f873558a
  Azure authored Feb 01, 2025
  
  f873558a
31 Jan, 2025 2 commits
- fix hard coding caused by rope dim calculation, load from config now · 5a50b346
  Azure authored Jan 31, 2025
  
  5a50b346
- support deepseekv3; runable but have precition problem · 476b1d8d
  Azure authored Jan 31, 2025
  
  476b1d8d
14 Nov, 2024 2 commits
- Merge pull request #115 from KMSorSMS/main · de7e892f
  UnicornChan authored Nov 14, 2024
```
⚡ rm opt config path default value and fix some config logic bug
```
  de7e892f
- ⚡ rm opt config path default value and fix some config logic bug · 04cebec4
  liam authored Nov 14, 2024
  
  04cebec4
06 Nov, 2024 1 commit
- Merge pull request #110 from KMSorSMS/main · dddc4203
  UnicornChan authored Nov 06, 2024
```
refactor local_chat & config setting
```
  dddc4203