Commits · 94b06a944e8340a8ee07821cf234df46410e18b8 · OpenDAS / vllm_cscc

02 Aug, 2025 1 commit
- add glm4.5 config · 94b06a94
  zhuwenwen authored Aug 02, 2025
  
  94b06a94
01 Aug, 2025 13 commits
- set default block_size to 16 · 80045bf7
  zhuwenwen authored Aug 01, 2025
  
  80045bf7
- update N to N1 · 8c7075d1
  zhuwenwen authored Aug 01, 2025
  
  8c7075d1
- Merge remote-tracking branch 'origin/v0.9.2-dev-w8a8' into v0.9.2-dev · 1d36bb49
  zhuwenwen authored Aug 01, 2025
  
  1d36bb49
- 增加w4a8相关支持修改 · 2767fc34
  gaoqiong authored Aug 01, 2025
  
  2767fc34
- back to default conv layout · 5f18e876
  zhuwenwen authored Aug 01, 2025
  
  5f18e876
- Merge branch 'v0.9.2-dev' of http://10.16.6.30/dcutoolkit/deeplearing/vllm into v0.9.2-dev · a8c6fcf6
  zhuwenwen authored Aug 01, 2025
  
  a8c6fcf6
- update rocm.py · 0480314d
  zhuwenwen authored Aug 01, 2025
  
  0480314d
- [Model] Update step3 vl · 66540380
  zhuwenwen authored Aug 01, 2025
  
  66540380
- [Model] Add step3 vl · 53ffe40e
  zhuwenwen authored Aug 01, 2025
  
  53ffe40e
- Merge branch 'v0.9.2-dev-wm' into 'v0.9.2-dev' · 2db9a54d
  zhuwenwen authored Aug 01, 2025
```
[fix]避免mla中cudagraph的适配影响非并行解码的逻辑

See merge request dcutoolkit/deeplearing/vllm!165
```
  2db9a54d
- [fix]避免mla中cudagraph的适配影响非并行解码的逻辑 · 0e5d399a
  王敏 authored Aug 01, 2025
  
  0e5d399a
- update HIP_VISIBLE_DEVICES of rocm · d0cc5577
  zhuwenwen authored Aug 01, 2025
  
  d0cc5577
- Merge branch 'v0.9.2-dev-wm' into 'v0.9.2-dev' · 65e29a89
  zhuwenwen authored Aug 01, 2025
```
[feat]支持v1 engine mtp cudagraph

See merge request dcutoolkit/deeplearing/vllm!164
```
  65e29a89
31 Jul, 2025 8 commits
- [feat]支持v1 engine mtp cudagraph · fe393be8
  王敏 authored Jul 31, 2025
  
  fe393be8
- update mlp · 741dbbbb
  zhuwenwen authored Jul 31, 2025
  
  741dbbbb
- Merge remote-tracking branch 'origin/0.9.2-dev-w8a8' into v0.9.2-dev · 9d5e4dd9
  zhuwenwen authored Jul 31, 2025
  
  9d5e4dd9
- 去除多余的w4a8参数 · 961cce86
  gaoqiong authored Jul 31, 2025
  
  961cce86
- 增加fused moe文件中w4a8的相关修改 · f5a7f12c
  gaoqiong authored Jul 31, 2025
  
  f5a7f12c
- update common.py · 3ae77d07
  zhuwenwen authored Jul 31, 2025
  
  3ae77d07
- update common.py · ef33478d
  zhuwenwen authored Jul 31, 2025
  
  ef33478d
- update arg_utils.py · ffaad3df
  zhuwenwen authored Jul 31, 2025
  
  ffaad3df
30 Jul, 2025 4 commits
- Merge branch 'v0.9.2-dev-disagg' into 'v0.9.2-dev' · ffadd035
  zhuwenwen authored Jul 30, 2025
```
Merge v0.9.2-dev-disagg into v0.9.2-dev

See merge request dcutoolkit/deeplearing/vllm!163
```
  ffadd035
- Merge v0.9.2-dev-disagg into v0.9.2-dev · af27c177
  xuxz authored Jul 30, 2025
  
  af27c177
- Merge remote-tracking branch 'origin/v0.9.2-dev_yql_marlin' into v0.9.2-dev · 8f80b711
  zhuwenwen authored Jul 30, 2025
  
  8f80b711
- 解决v1cudagraph的问题以及接入fuse moe marlin_V3版本 · 9820d063
  yangql authored Jul 30, 2025
  
  9820d063
29 Jul, 2025 4 commits
- update benchmark_moe.py · cd3ed273
  zhuwenwen authored Jul 29, 2025
  
  cd3ed273
- [Misc] Clean up Aimv2 config registration in Ovis config · be0549c4
  zhuwenwen authored Jul 29, 2025
  
  be0549c4
- fix: 修复W8A8读config路径错误，删除int8_utils.py文件 · 7e5fb6fe
  jujl1 authored Jul 29, 2025
  
  7e5fb6fe
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
28 Jul, 2025 3 commits
- fix: 修复W8A8INT8读config问题 · c6187ade
  jujl1 authored Jul 28, 2025
  
  c6187ade
- 修改W4A8 以及W8A8量化量化092接口 · 7017f30c
  gaoqiong authored Jul 28, 2025
  
  7017f30c
- add v1 cpm support · 98958aed
  zhuwenwen authored Jul 28, 2025
  
  98958aed
26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
25 Jul, 2025 6 commits
- 修复block-wise的错误参数，以及增加dpsk-fp16-dtype的性能选择功能 · cb37537e
  yangql authored Jul 25, 2025
  
  cb37537e
- Merge branch 'v0.9.2-dev-wm' into 'v0.9.2-dev' · 4d479e7e
  zhuwenwen authored Jul 25, 2025
```
[fix]解决deepseek报错

See merge request dcutoolkit/deeplearing/vllm!162
```
  4d479e7e
- [fix]解决deepseek报错 · cf4c84b5
  王敏 authored Jul 25, 2025
  
  cf4c84b5
- [Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all... · b35835a1
  zhuwenwen authored Jul 25, 2025
```
[Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all cudagraph capture sizes <= max_num_seq.
```
  b35835a1
- set VLLM_USE_V1=1 · e4a84fdc
  zhuwenwen authored Jul 25, 2025
  
  e4a84fdc
- Triton-fused DeepseekScalingRotaryEmbedding · 7151fd54
  zhuwenwen authored Jul 25, 2025
  
  7151fd54