Commits · d560429ce4945fcb615deabd8b52399f22d60777 · OpenDAS / vllm_cscc

22 Jul, 2025 2 commits
- update max_seq_len_to_capture to option int · d560429c
  zhuwenwen authored Jul 22, 2025
  
  d560429c
- update max_seq_len_to_capture to int · 988fc31c
  zhuwenwen authored Jul 22, 2025
  
  988fc31c
21 Jul, 2025 2 commits
- update max_seq_len_to_capture · 72273242
  zhuwenwen authored Jul 21, 2025
  
  72273242
- update List · 267cc5ff
  zhuwenwen authored Jul 21, 2025
  
  267cc5ff
18 Jul, 2025 4 commits
- update fused_moe.py · b1babea8
  zhuwenwen authored Jul 18, 2025
  
  b1babea8
- fix run error · 5c004388
  zhuwenwen authored Jul 18, 2025
  
  5c004388
- remove unused sgl_moe_align_block_size · fd46df33
  zhuwenwen authored Jul 18, 2025
  
  fd46df33
- Merge tag 'v0.9.2' into v0.9.2-dev · a40a133c
  zhuwenwen authored Jul 18, 2025
  
  a40a133c
17 Jul, 2025 5 commits
- add fa-pa benchmark · 1a9a61d7
  zhuwenwen authored Jul 17, 2025
  
  1a9a61d7
- update adpaptive block_size · 937a3ec1
  zhuwenwen authored Jul 17, 2025
  
  937a3ec1
- update default block_size · 4a84480f
  zhuwenwen authored Jul 17, 2025
  
  4a84480f
- set default block_size and pa · b61f7a69
  zhuwenwen authored Jul 17, 2025
  
  b61f7a69
- add VLLM_USE_PA_PRINT_PARAM to print fa-pa size · 1092a467
  zhuwenwen authored Jul 17, 2025
  
  1092a467
16 Jul, 2025 1 commit
- support rms_norm_dynamic_per_token_quant · 91feb245
  zhuwenwen authored Jul 16, 2025
  
  91feb245
15 Jul, 2025 1 commit
- 修复在fp16下的数值越界导致的精度问题 · 18f030d9
  zhuwenwen authored Jul 15, 2025
  
  18f030d9
14 Jul, 2025 3 commits
- Merge branch 'v0.9.1-dev' of http://10.16.6.30/dcutoolkit/deeplearing/vllm into v0.9.1-dev · 7bf6c98f
  zhuwenwen authored Jul 14, 2025
  
  7bf6c98f
- update blockwise_int8.py · 5d35160b
  zhuwenwen authored Jul 14, 2025
  
  5d35160b
- Merge branch 'v0.9.1-dev-wm' into 'v0.9.1-dev' · 0a9b4a7f
  zhuwenwen authored Jul 14, 2025
```
[fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错

See merge request dcutoolkit/deeplearing/vllm!158
```
  0a9b4a7f
12 Jul, 2025 4 commits
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
- remove qk contiguous · e34d3444
  zhuwenwen authored Jul 12, 2025
  
  e34d3444
- Merge remote-tracking branch 'origin/v0.9.1-dev_whl' into v0.9.1-dev · c73d2c3c
  zhuwenwen authored Jul 12, 2025
  
  c73d2c3c
- fix rmsnrom precision · ac61d69b
  wanghl6 authored Jul 12, 2025
  
  ac61d69b
11 Jul, 2025 3 commits
- Merge branch 'v0.9.1-dev_lzg' into 'v0.9.1-dev' · e522713c
  zhuwenwen authored Jul 11, 2025
```
tbo debug fix error

See merge request dcutoolkit/deeplearing/vllm!156
```
  e522713c
- tbo debug fix error · 957096ce
  lizhigong authored Jul 11, 2025
  
  957096ce
- add qk contiguous · bcf6be4c
  zhuwenwen authored Jul 11, 2025
  
  bcf6be4c
10 Jul, 2025 6 commits
- add apex rmsnorm · 3e0a595d
  zhuwenwen authored Jul 10, 2025
  
  3e0a595d
- fix zero overhead to support chunk prefill · a495fc3b
  zhuwenwen authored Jul 10, 2025
  
  a495fc3b
- add two batch overlap decude support muti-stream cuda-graph · fe1c4016
  zhuwenwen authored Jul 10, 2025
  
  fe1c4016
- update bw vdim128 · d805c59c
  zhuwenwen authored Jul 10, 2025
  
  d805c59c
- Merge branch 'v0.9.1-dev-wm' into 'v0.9.1-dev' · aad6eda8
  zhuwenwen authored Jul 10, 2025
```
[fix]修复091 v0 engine mtp报错问题

See merge request dcutoolkit/deeplearing/vllm!155
```
  aad6eda8
- [fix]修复091 v0 engine mtp报错问题 · ac182341
  王敏 authored Jul 10, 2025
  
  ac182341
09 Jul, 2025 2 commits
- [fix]修复零消耗引入的cudagraph模式数据准备cpu耗时问题 · cd6239dc
  zhuwenwen authored Jul 09, 2025
  
  cd6239dc
- Merge branch 'v0.9.1-dev-wm' into 'v0.9.1-dev' · f7be09fc
  zhuwenwen authored Jul 09, 2025
```
1.优化v1 engine mtp;2.添加v1 engine chunked prefill开关

See merge request dcutoolkit/deeplearing/vllm!152
```
  f7be09fc
07 Jul, 2025 6 commits
- 还原误删代码 · f0acced0
  王敏 authored Jul 07, 2025
  
  f0acced0
- 删掉无效代码 · ee9ee960
  王敏 authored Jul 07, 2025
  
  ee9ee960
- [feat]支持v1 engine flashmla和mtp同时开启 · ac4dedb1
  王敏 authored Jul 07, 2025
  
  ac4dedb1
- Merge remote-tracking branch 'origin/v0.9.1-dev' into v0.9.1-dev · 9e27b5e4
  王敏 authored Jul 07, 2025
  
  9e27b5e4
- 修改激活量化算子实现方式 · b2fa85ce
  zhuwenwen authored Jul 07, 2025
  
  b2fa85ce
- update vllm_flash_attn_varlen_func · ef6c0877
  zhuwenwen authored Jul 07, 2025
  
  ef6c0877
06 Jul, 2025 1 commit
- Revert "[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412)" · a5dd03c1
  simon-mo authored Jul 06, 2025
```
This reverts commit e202dd27.
```
  a5dd03c1