Commits · 4f359a911580cfac6da55e2f840d8264d4fa3231 · OpenDAS / vllm_cscc

18 Aug, 2025 8 commits
- fix issue from merge · 4f359a91
  zhuwenwen authored Aug 18, 2025
  
  4f359a91
- [fix]解决v1 deepseek cudagraph模式显存占用增长 · e85207b7
  zhuwenwen authored Aug 18, 2025
  
  e85207b7
- 修改flashmla的接口 · b909d6fc
  zhuwenwen authored Aug 18, 2025
  
  b909d6fc
- 增加marlin对cache13的支持，以及新增flash mla的kvcache fp8的支持 · 22a46529
  zhuwenwen authored Aug 18, 2025
  
  22a46529
- debug and fix erro · e70b0ea0
  zhuwenwen authored Aug 18, 2025
  
  e70b0ea0
- fix mtp accept rate issu · 1555157e
  zhuwenwen authored Aug 18, 2025
  
  1555157e
- add v1 engine + deepseek r1 mtp + zero-overhead scheduler · 22a95571
  zhuwenwen authored Aug 18, 2025
  
  22a95571
- [fix]修复mtp eager模式下显存占用增加问题 · ac4cc84e
  zhuwenwen authored Aug 18, 2025
  
  ac4cc84e
13 Aug, 2025 3 commits
- add VLLM_USE_PA_PRINT_PARAM to print v1 fa size · 43e67933
  zhuwenwen authored Aug 13, 2025
  
  43e67933
- [feat]优化mtp/eagle的计算逻辑，减少第1层并行解码的计算重复（num_accepted_tokens_tensor修改暂未合入） · 4874e3e0
  zhuwenwen authored Aug 13, 2025
  
  4874e3e0
- add v1 engine zero overhead · 295dfac8
  zhuwenwen authored Aug 13, 2025
  
  295dfac8
11 Aug, 2025 4 commits
- update act_and_mul opt · fa71acd7
  zhuwenwen authored Aug 11, 2025
  
  fa71acd7
- qwen3-coder-480b bw moe configs · 4c1b8f82
  zhuwenwen authored Aug 11, 2025
  
  4c1b8f82
- add qwen3-coder-480b moe configs · 51950327
  zhuwenwen authored Aug 11, 2025
  
  51950327
- [fix]修复v1 mtp接受率低的问题 · db554c6c
  zhuwenwen authored Aug 11, 2025
```
更改默认的full _cuda_graph启动方式为false
```
  db554c6c
09 Aug, 2025 5 commits
- update lmslim · e97b3191
  zhuwenwen authored Aug 09, 2025
  
  e97b3191
- [feat]新增VLLM_USE_GLOBAL_CACHE13 设置moe使用全局变量的cache13 · 865dc64d
  zhuwenwen authored Aug 09, 2025
  
  865dc64d
- 修改增加SlimQuantW4A8Int8MoEMethod 获取intermediate_size_per_partition 支持 · 0f12f80a
  zhuwenwen authored Aug 09, 2025
  
  0f12f80a
- 修改增加lmslimquant_w4a8量化支持 · 54139f16
  zhuwenwen authored Aug 09, 2025
  
  54139f16
- Revert "update rocm Stream" · bdda5719
  zhuwenwen authored Aug 09, 2025
```
This reverts commit 236f11df.
```
  bdda5719
08 Aug, 2025 1 commit
- update fa full_cuda_graph support · 71b02b7a
  zhuwenwen authored Aug 08, 2025
  
  71b02b7a
07 Aug, 2025 3 commits
- [feat]支持mtp模型full_cuda_graph · ffe9e7db
  zhuwenwen authored Aug 07, 2025
  
  ffe9e7db
- [feat]支持mtp模型full_cuda_graph · f2218895
  zhuwenwen authored Aug 07, 2025
  
  f2218895
- update rocm Stream · 236f11df
  zhuwenwen authored Aug 07, 2025
  
  236f11df
06 Aug, 2025 7 commits
- update VLLM_FLASH_ATTN_V1 to VLLM_USE_FLASH_ATTN_PA · 77a29416
  zhuwenwen authored Aug 06, 2025
  
  77a29416
- update benchmark_throughput.py · 687b0ad7
  zhuwenwen authored Aug 06, 2025
  
  687b0ad7
- update warmup_sampling_params · 0896c8ef
  zhuwenwen authored Aug 06, 2025
  
  0896c8ef
- Revert "Revert "[feat]优化mtp相关函数返回类型"" · c17574bd
  zhuwenwen authored Aug 06, 2025
```
This reverts commit c34fa0bf.
```
  c17574bd
- Revert "Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样"" · 467490e6
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 33485749.
```
  467490e6
- Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样" · 33485749
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 93fae6b1.
```
  33485749
- Revert "[feat]优化mtp相关函数返回类型" · c34fa0bf
  zhuwenwen authored Aug 06, 2025
```
This reverts commit edc45625.
```
  c34fa0bf
05 Aug, 2025 7 commits
- [feat]优化mtp相关函数返回类型 · edc45625
  zhuwenwen authored Aug 05, 2025
  
  edc45625
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 93fae6b1
  zhuwenwen authored Aug 05, 2025
  
  93fae6b1
- add tbo on v1 engine · 3d57a0d3
  zhuwenwen authored Aug 05, 2025
  
  3d57a0d3
- update lmslim import · 87d03653
  zhuwenwen authored Aug 05, 2025
  
  87d03653
- add glm4.5 k100-ai config · 92160378
  zhuwenwen authored Aug 05, 2025
  
  92160378
- add step3-vl k100-ai config · 375fdfb0
  zhuwenwen authored Aug 05, 2025
  
  375fdfb0
- when using VLLM_FLASH_ATTN_V1, set block_size to 64 · f54639f9
  zhuwenwen authored Aug 05, 2025
  
  f54639f9
04 Aug, 2025 2 commits
- add step3-vl tuning · 33d6c159
  zhuwenwen authored Aug 04, 2025
  
  33d6c159
- add step3-vl tuning · 4e2ff6b5
  zhuwenwen authored Aug 04, 2025
  
  4e2ff6b5