Commits · c189d55bd1d0b585933653420e90dbf4a25e2743 · wqshmzh / ktransformers

"torchvision/csrc/cuda/ps_roi_pool_kernel.cu" did not exist on "5066d7153373d9aae902c32bce1298944505edc8"

15 Feb, 2025 3 commits
- toy support for experts on GPU, no CUDA Graph · c189d55b
  Atream authored Feb 15, 2025
  
  c189d55b
- Merge pull request #307 from Azure-Tang/main · 1548c992
  Azure authored Feb 15, 2025
```
[update]  Reorganize documentation/README
```
  1548c992
- update zh readme · 227e81b0
  Azure authored Feb 15, 2025
  
  227e81b0
14 Feb, 2025 23 commits
- * Reorganize documentation/README · ef89b152
  Azure authored Feb 14, 2025
```
    * Consolidate the installation section, as it's currently too cluttered
    * Move the Multi-GPU section to the top-level structure
    * Add a **detailed** tutorial on registering extra GPU memory with Marlin
```
  ef89b152
- Merge pull request #306 from kvcache-ai/revert-305-main · b0b90270
  Azure authored Feb 15, 2025
```
Revert "[update] Reorganize documentation/README"
```
  b0b90270
- Revert "[update] Reorganize documentation/README" · 4f4ed364
  Azure authored Feb 15, 2025
  
  4f4ed364
- [update] Reorganize documentation/README · 19d4a50b
  Azure authored Feb 15, 2025
```
[update] Reorganize documentation/README
```
  19d4a50b
- fix typo and detail · 483182fc
  Azure authored Feb 14, 2025
  
  483182fc
- Reorganize documentation/README · 823b25ee
  Azure authored Feb 14, 2025
  
  823b25ee
- Merge pull request #301 from kvcache-ai/fix-cuda-graph-bug · cc8d627e
  Atream authored Feb 14, 2025
```
warm_up before capture
```
  cc8d627e
- warm_up before capture · 1946493f
  Atream authored Feb 14, 2025
  
  1946493f
- Merge pull request #295 from kvcache-ai/update-wechatgroup · cadd5507
  Atream authored Feb 14, 2025
```
Update wechatgroup
```
  cadd5507
- Add files via upload · e153d782
  Atream authored Feb 14, 2025
  
  e153d782
- Delete WeChatGrouop.png · 96e6dff7
  Atream authored Feb 14, 2025
  
  96e6dff7
- Merge pull request #294 from kvcache-ai/feat-fast-MLA · 885a91e7
  Atream authored Feb 14, 2025
```
Feat fast mla
```
  885a91e7
- linux support triton MLA kernel · 1084d4e4
  Atream authored Feb 14, 2025
  
  1084d4e4
- Merge pull request #280 from Azure-Tang/main · 67389086
  Azure authored Feb 14, 2025
```
[fix] Fix incorrect image content in the document
```
  67389086
- Fix incorrect image content in the document · 1b1f4172
  Azure authored Feb 14, 2025
  
  1b1f4172
- Merge pull request #254 from Azure-Tang/main · f4bb374e
  Azure authored Feb 14, 2025
```
[Update] Add V3/R1 8 gpu yaml example
```
  f4bb374e
- Merge branch 'kvcache-ai:main' into main · 95c81eaf
  Azure authored Feb 14, 2025
  
  95c81eaf
- Merge pull request #255 from kvcache-ai/update-wechatgroup · 0a9c5992
  Atream authored Feb 14, 2025
```
Add files via upload
```
  0a9c5992
- Add files via upload · ce721032
  Atream authored Feb 14, 2025
  
  ce721032
- add V3/R1 8 gpu yaml example · b7653b9c
  Azure authored Feb 14, 2025
  
  b7653b9c
- Merge pull request #247 from liugddx/patch-1 · e612b147
  Azure authored Feb 14, 2025
```
[Doc]Fix dead link problem
```
  e612b147
- Merge pull request #227 from hrz6976/main · ae5d9e11
  Azure authored Feb 14, 2025
```
Add a lock to server inference()
```
  ae5d9e11
- Fix dead link problem · e65be580
  Guangdong Liu authored Feb 14, 2025
  
  e65be580
13 Feb, 2025 14 commits
- init support for MLA using Attention kernel · bb35dc5b
  Atream authored Feb 13, 2025
  
  bb35dc5b
- Merge pull request #200 from devin2255/main · a456e25a
  ZiWei Yuan authored Feb 13, 2025
```
add README_ZH.md
```
  a456e25a
- edit README_ZH.md && add DeepseekR1_V3_tutorial_zh.md · d04b570f
  dhliu authored Feb 13, 2025
  
  d04b570f
- Merge pull request #230 from kvcache-ai/updata-wechatgroup-1 · aa21edd2
  Atream authored Feb 13, 2025
```
Updata wechatgroup 1
```
  aa21edd2
- Add files via upload · 5fb9d655
  Atream authored Feb 13, 2025
  
  5fb9d655
- Delete WeChatGrouop.png · ade346e0
  Atream authored Feb 13, 2025
  
  ade346e0
- Merge pull request #229 from kvcache-ai/updata-wechatgroup · 12796549
  Atream authored Feb 13, 2025
```
Add files via upload
```
  12796549
- Add files via upload · 30e8e6a3
  Atream authored Feb 13, 2025
  
  30e8e6a3
- Add a lock to server inference() · 2c3dcd97
  hrz6976 authored Feb 13, 2025
  
  2c3dcd97
- Merge pull request #224 from kvcache-ai/server_support · 76b08187
  ZiWei Yuan authored Feb 13, 2025
```
Server support
```
  76b08187
- 📝 ⚡ fix some debug output and update doc · 8d5ebe49
  liam authored Feb 13, 2025
  
  8d5ebe49
- 📝 update doc · ad2c52d7
  liam authored Feb 13, 2025
  
  ad2c52d7
- Merge pull request #220 from TensorBlock/main · 8324e7fd
  Azure authored Feb 13, 2025
```
Add optimization config for Deepseek V3/R1 with 4 GPUs
```
  8324e7fd
- 📝 add doc support and fix bug in qwen2 · c74453d8
  liam authored Feb 13, 2025
  
  c74453d8