Commits · cde83ab0a7539fa7aa636a8cf56c254bcf6e197e · OpenDAS / vllm_cscc

05 Sep, 2025 1 commit
- dummy_run时使用随机输入 · cde83ab0
  王敏 authored Sep 05, 2025
  
  cde83ab0
04 Sep, 2025 3 commits
- 去掉无效代码 · 4e22d272
  王敏 authored Sep 04, 2025
  
  4e22d272
- 1.优化大EP，合入grouped gemm · d997afc4
  王敏 authored Sep 04, 2025
```
2.解决mtp >1 大EP推理all gather卡住问题
```
  d997afc4
- 暂时去掉profilling标志位，避免影响其他模型 · 6f5d76dc
  王敏 authored Sep 04, 2025
  
  6f5d76dc
03 Sep, 2025 1 commit
- fix deepseek pp + mtp issue · bfffd59a
  lizhigong authored Sep 02, 2025
  
  bfffd59a
28 Aug, 2025 1 commit
- [feat]上传初版基于all2all通信的大EP代码 · d04683a4
  王敏 authored Aug 28, 2025
  
  d04683a4
27 Aug, 2025 1 commit
- when use tbo, deepseek prefill use eager · 8702264b
  lizhigong authored Aug 27, 2025
  
  8702264b
25 Aug, 2025 1 commit
- 临时上传大ep代码 · dbd0bda6
  王敏 authored Aug 25, 2025
  
  dbd0bda6
20 Aug, 2025 2 commits
- set v1 attention use fa · f7beb354
  zhuwenwen authored Aug 20, 2025
  
  f7beb354
- update value_stride_order · 716852ab
  zhuwenwen authored Aug 20, 2025
  
  716852ab
19 Aug, 2025 1 commit
- update v1 fa layout · 864c718a
  zhuwenwen authored Aug 19, 2025
  
  864c718a
18 Aug, 2025 1 commit
- [fix]解决v1 deepseek cudagraph模式显存占用增长 · 81175fe4
  王敏 authored Aug 18, 2025
  
  81175fe4
16 Aug, 2025 1 commit
- debug and fix erro · 4b4fc875
  lizhigong authored Aug 16, 2025
  
  4b4fc875
15 Aug, 2025 2 commits
- add v1 engine + deepseek r1 mtp + zero-overhead scheduler · 5dcaac2f
  lizhigong authored Aug 15, 2025
  
  5dcaac2f
- 增加marlin对cache13的支持，以及新增flash mla的kvcache fp8的支持 · 8f25283a
  yangql authored Aug 15, 2025
  
  8f25283a
14 Aug, 2025 1 commit
- remove seq_lens_tensor of v1 fa · 693d5ed4
  zhuwenwen authored Aug 14, 2025
  
  693d5ed4
13 Aug, 2025 2 commits
- add VLLM_USE_PA_PRINT_PARAM to print v1 fa size · 8a1e7a3d
  zhuwenwen authored Aug 13, 2025
  
  8a1e7a3d
- [feat]优化mtp/eagle的计算逻辑，减少第1层并行解码的计算重复 · 619eb032
  王敏 authored Aug 13, 2025
  
  619eb032
11 Aug, 2025 1 commit
- add v1 engine zero overhead · 59e80222
  lizhigong authored Aug 11, 2025
  
  59e80222
10 Aug, 2025 1 commit
- [fix]修复v1 mtp接受率低的问题 · 04b61f0e
  王敏 authored Aug 10, 2025
  
  04b61f0e
08 Aug, 2025 1 commit
- update fa full_cuda_graph support · 513f17a4
  zhuwenwen authored Aug 08, 2025
  
  513f17a4
07 Aug, 2025 3 commits
- [feat]支持mtp模型full_cuda_graph · bd58c289
  王敏 authored Aug 07, 2025
  
  bd58c289
- [feat]支持mtp模型full_cuda_graph · 89eecc55
  王敏 authored Aug 07, 2025
  
  89eecc55
- [feat]支持mtp模型full_cuda_graph · a1239b53
  王敏 authored Aug 07, 2025
  
  a1239b53
06 Aug, 2025 2 commits
- [feat]支持mtp模型full_cuda_graph · 9dd945c1
  王敏 authored Aug 06, 2025
  
  9dd945c1
- Revert "Merge remote-tracking branch 'origin/v0.9.2-dev-wm' into v0.9.2-dev" · 0c1cd0f5
  zhuwenwen authored Aug 06, 2025
```
This reverts merge request !169
```
  0c1cd0f5
05 Aug, 2025 3 commits
- [feat]优化mtp相关函数返回类型 · 7e71c143
  王敏 authored Aug 05, 2025
  
  7e71c143
- merge and debug tbo on 0.9.2 · 3f8b2afe
  lizhigong authored Aug 05, 2025
  
  3f8b2afe
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 8e0ae19d
  王敏 authored Aug 05, 2025
  
  8e0ae19d
04 Aug, 2025 1 commit
- add tbo on v1 engine · 20e75ed6
  lizhigong authored Aug 02, 2025
  
  20e75ed6
01 Aug, 2025 2 commits
- 增加w4a8相关支持修改 · 2767fc34
  gaoqiong authored Aug 01, 2025
  
  2767fc34
- [fix]避免mla中cudagraph的适配影响非并行解码的逻辑 · 0e5d399a
  王敏 authored Aug 01, 2025
  
  0e5d399a
31 Jul, 2025 3 commits
- [feat]支持v1 engine mtp cudagraph · fe393be8
  王敏 authored Jul 31, 2025
  
  fe393be8
- update common.py · 3ae77d07
  zhuwenwen authored Jul 31, 2025
  
  3ae77d07
- update common.py · ef33478d
  zhuwenwen authored Jul 31, 2025
  
  ef33478d
28 Jul, 2025 1 commit
- add v1 cpm support · 98958aed
  zhuwenwen authored Jul 28, 2025
  
  98958aed
24 Jul, 2025 2 commits
- support full_cuda_graph · 8da1c576
  zhuwenwen authored Jul 24, 2025
  
  8da1c576
- update fa v1 interface · f9408aff
  zhuwenwen authored Jul 24, 2025
  
  f9408aff
12 Jul, 2025 1 commit
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
07 Jul, 2025 1 commit
- 还原误删代码 · f0acced0
  王敏 authored Jul 07, 2025
  
  f0acced0