Commits · 2eda94c618978fcfb7eb3d8e24d7c541ec256f45 · OpenDAS / vllm_cscc

31 Dec, 2025 4 commits
- fix: chunk-prefill生成的token被错误返回 · 2c1de3fa
  jujl1 authored Dec 31, 2025
  
  2c1de3fa
- Revert "增加mtp>1的pad" · d8c36dbf
  yangql authored Dec 31, 2025
```
This reverts commit 059b1961.
```
  d8c36dbf
- 增加mtp>1的pad · 059b1961
  yangql authored Dec 31, 2025
  
  059b1961
- feat: 兼容MTP零消耗和主模型+MTP零消耗(VLLM_ZERO_OVERHEAD_ENHANCE=1)开启 · 76e22965
  jujl1 authored Dec 31, 2025
  
  76e22965
30 Dec, 2025 2 commits
- feat: 兼容MTP零消耗和主模型+MTP零消耗(VLLM_ZERO_OVERHEAD_ENHANCE=1)开启 · 8a413453
  jujl1 authored Dec 30, 2025
  
  8a413453
- fix: 解决列表访问越界 · 5208b291
  jujl1 authored Dec 30, 2025
  
  5208b291
29 Dec, 2025 6 commits
- [feat]解决deepep auto模式卡住问题 · cb64c6bc
  王敏 authored Dec 29, 2025
  
  cb64c6bc
- fix: 解决同时处理prefill和decode时的prefill请求token计数错误 · bc945a5a
  jujl1 authored Dec 24, 2025
  
  bc945a5a
- fix: support chunk-prefill and fix bug in check_stop · 96197e48
  jujl1 authored Dec 23, 2025
  
  96197e48
- feat: triton kernel 实现 update_input · 89639c96
  jujl1 authored Dec 23, 2025
  
  89639c96
- feat: 主模型+mtp提前返回 · 0936ee97
  jujl1 authored Nov 28, 2025
  
  0936ee97
- 增加mtp的pad · e60a51b4
  yangql authored Dec 29, 2025
  
  e60a51b4
24 Dec, 2025 2 commits
- [feat]解决EP开启pd_padding大输入卡住问题 · 7439b205
  王敏 authored Dec 24, 2025
  
  7439b205
- [fix]解决EP开启pd_padding大输入卡住问题 · 639a11d2
  王敏 authored Dec 24, 2025
  
  639a11d2
22 Dec, 2025 2 commits
- [fix]1.解决ep sequence parallel优化引入的mtp报错;2.解决共享专家无法和combine overlap问题 · dc01fce4
  王敏 authored Dec 22, 2025
  
  dc01fce4
- [feat]1.优化ep sequence parallel,区分主模型和mtp逻辑;2.ep sequence parallel添加cudagraph... · 62f05dde
  王敏 authored Dec 22, 2025
```
[feat]1.优化ep sequence parallel,区分主模型和mtp逻辑;2.ep sequence parallel添加cudagraph padding到tp_size;3.修复共享专家和deepep combine overlap
```
  62f05dde
18 Dec, 2025 2 commits
- [feat]合入基于deepep的大EP · 13130b89
  王敏 authored Dec 18, 2025
  
  13130b89
- [feat]优化dp attention，减少1次allgather耗时，高吞吐提升明显 · 3e386c3b
  王敏 authored Dec 18, 2025
  
  3e386c3b
09 Dec, 2025 1 commit
- [feat]零消耗适配宽松mtp · 740e060f
  王敏 authored Dec 09, 2025
  
  740e060f
27 Nov, 2025 1 commit
- [fix]解决宽松mtp1报错 · deae0a22
  王敏 authored Nov 27, 2025
  
  deae0a22
26 Nov, 2025 1 commit
- [feat]支持宽松mtp · 02b4ec43
  王敏 authored Nov 26, 2025
  
  02b4ec43
09 Oct, 2025 1 commit
- Revert "Merge branch 'v0.9.2-dev-lmcache-pd' into 'v0.9.2-dev'" · 7b30ecd8
  zhuwenwen authored Oct 09, 2025
```
This reverts merge request !219
```
  7b30ecd8
24 Sep, 2025 1 commit
- add env · c6b7a44b
  yangshj1 authored Sep 24, 2025
  
  c6b7a44b
16 Sep, 2025 1 commit
- add pd lmcache · f4fd3a96
  yangshj1 authored Sep 16, 2025
  
  f4fd3a96
04 Sep, 2025 2 commits
- fix performance issues caused by enabling TBO · 424cccfe
  lizhigong authored Sep 04, 2025
  
  424cccfe
- fix bugs in zero overhead and tbo · f6f8db81
  lizhigong authored Sep 03, 2025
  
  f6f8db81
29 Aug, 2025 1 commit
- fix bug in zero-overhead core · 7d1b0c5e
  lizhigong authored Aug 29, 2025
  
  7d1b0c5e
27 Aug, 2025 1 commit
- when use tbo, deepseek prefill use eager · 8702264b
  lizhigong authored Aug 27, 2025
  
  8702264b
25 Aug, 2025 2 commits
- fix self.drafter error · ba29eebb
  lizhigong authored Aug 25, 2025
  
  ba29eebb
- Remove the synchronization introduced by the verification logic when mtp is enabled. · 2fe2d237
  lizhigong authored Aug 25, 2025
  
  2fe2d237
18 Aug, 2025 1 commit
- fix issue from merge · 2e66885c
  lizhigong authored Aug 18, 2025
  
  2e66885c
16 Aug, 2025 2 commits
- debug and fix erro · 4b4fc875
  lizhigong authored Aug 16, 2025
  
  4b4fc875
- fix mtp accept rate issu · 4829dd84
  lizhigong authored Aug 16, 2025
  
  4829dd84
15 Aug, 2025 1 commit
- add v1 engine + deepseek r1 mtp + zero-overhead scheduler · 5dcaac2f
  lizhigong authored Aug 15, 2025
  
  5dcaac2f
11 Aug, 2025 1 commit
- add v1 engine zero overhead · 59e80222
  lizhigong authored Aug 11, 2025
  
  59e80222
10 Jul, 2025 1 commit
- fix zero overhead to support chunk prefill · a495fc3b
  zhuwenwen authored Jul 10, 2025
  
  a495fc3b
26 May, 2025 1 commit
- Update sequence.py fix assert error。 · d82fa156
  lizhg1 authored May 26, 2025
  
  d82fa156
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
09 May, 2025 1 commit
- debug on v0.8.5 · cf1d8464
  lizhigong authored May 09, 2025
  
  cf1d8464