Commits · ae0ed592468800c8795b79d4968b26d5eb213d45 · OpenDAS / vllm_cscc

24 Mar, 2025 5 commits
- Merge branch 'v0.7.2-dev-wm' into 'v0.7.2-dev' · ae0ed592
  zhuwenwen authored Mar 24, 2025
```
[fix]修复fused_moe.py中fused_moe接口未初始化moe_ep_size导致的deekseek等模型报错

See merge request dcutoolkit/deeplearing/vllm!89
```
  ae0ed592
- [fix]修复fused_moe.py中fused_moe接口未初始化moe_ep_size导致的deekseek等模型报错 · 4b7f382f
  王敏 authored Mar 24, 2025
  
  4b7f382f
- update triton_mla.py · a54eca71
  zhuwenwen authored Mar 24, 2025
  
  a54eca71
- add mla tuning configs of k100-ai · 30e0b082
  zhuwenwen authored Mar 24, 2025
  
  30e0b082
- add mla tuning script and configs · 13b1dcfe
  zhuwenwen authored Mar 24, 2025
  
  13b1dcfe
18 Mar, 2025 1 commit
- update benchmarks · b95d1275
  zhuwenwen authored Mar 18, 2025
  
  b95d1275
17 Mar, 2025 1 commit
- update version · d9e67e78
  zhuwenwen authored Mar 17, 2025
  
  d9e67e78
15 Mar, 2025 12 commits
- update fused_moe.py · 8a7c4451
  zhuwenwen authored Mar 15, 2025
  
  8a7c4451
- update qwen2-vl and qwen2.5-vl layout · 37ef8dd3
  zhuwenwen authored Mar 15, 2025
  
  37ef8dd3
- set llama and qwen tn layout · b845811e
  zhuwenwen authored Mar 15, 2025
  
  b845811e
- add cust2 · 72de3bf9
  zhuwenwen authored Mar 15, 2025
  
  72de3bf9
- Merge remote-tracking branch 'origin/0.7.2-zhangshao' into v0.7.2-pa · c9d28c80
  zhuwenwen authored Mar 15, 2025
  
  c9d28c80
- 调整pa tc和非tc调用关系 · 0d2ccb8d
  zhangshao authored Mar 15, 2025
  
  0d2ccb8d
- Merge branch 'v0.7.2-dev' into v0.7.2-pa · 6a72a6b4
  zhuwenwen authored Mar 15, 2025
  
  6a72a6b4
- Merge branch 'v0.7.2-dev_yangql' into 'v0.7.2-dev' · 87351a28
  zhuwenwen authored Mar 15, 2025
```
V0.7.2 dev yangql

See merge request dcutoolkit/deeplearing/vllm!85
```
  87351a28
- 支持fusemoe对int4的scale合zero合并读取操作 · 50424a23
  yangql authored Mar 15, 2025
  
  50424a23
- 支持fusemoe对int4的scale合zero合并读取操作 · f78a0510
  yangql authored Mar 15, 2025
  
  f78a0510
- Merge remote-tracking branch 'origin/0.7.2-zhangshao' into v0.7.2-pa · 87bdb89f
  zhuwenwen authored Mar 15, 2025
  
  87bdb89f
- Merge branch 'v0.7.2-pa' of http://10.6.10.68/dcutoolkit/deeplearing/vllm into v0.7.2-pa · e6fd8fda
  zhuwenwen authored Mar 15, 2025
  
  e6fd8fda
14 Mar, 2025 5 commits
- Merge branch 'v0.7.2-dev-quant' into 'v0.7.2-dev' · 9c7191c3
  zhuwenwen authored Mar 14, 2025
```
V0.7.2 dev deepseek v3/r1 block-int8量化支持

See merge request dcutoolkit/deeplearing/vllm!83
```
  9c7191c3
- 解决bf16精度问题，解决cudagraph精度问题 · 4f8d38c8
  zhangshao authored Mar 14, 2025
  
  4f8d38c8
- 增加线性int8 gemm配置 · 268d8a77
  gaoqiong authored Mar 14, 2025
  
  268d8a77
- [feat]add gen_mla_pa_tables.py and optimize triton config configuration · 71c60bd5
  zhuwenwen authored Mar 14, 2025
  
  71c60bd5
- 增加deepseek v3 block-int8量化支持 · 92545504
  gaoqiong authored Mar 14, 2025
  
  92545504
13 Mar, 2025 3 commits
- 优化bf16精度 · b3992aad
  zhangshao authored Mar 13, 2025
  
  b3992aad
- Merge remote-tracking branch 'origin/0.7.2-zhangshao' into v0.7.2-pa · fbde1e5a
  zhuwenwen authored Mar 13, 2025
  
  fbde1e5a
- update mla to obtain the optimal configuration from config · 146eb9d3
  zhuwenwen authored Mar 13, 2025
  
  146eb9d3
12 Mar, 2025 2 commits
- Merge branch 'v0.7.2-dev-wm' into 'v0.7.2-dev' · c1370857
  zhuwenwen authored Mar 12, 2025
```
[feat]添加BW deepseek_v3 fused_moe configs

See merge request dcutoolkit/deeplearing/vllm!80
```
  c1370857
- [feat]添加BW deepseek_v3 fused_moe configs · ef27eec0
  王敏 authored Mar 12, 2025
  
  ef27eec0
11 Mar, 2025 2 commits
- Merge branch 'v0.7.2-dev-wm' into 'v0.7.2-dev' · 87fb7e7f
  zhuwenwen authored Mar 11, 2025
```
[feat]优化fused_moe tuning，上传K100_AI的configs

See merge request dcutoolkit/deeplearing/vllm!79
```
  87fb7e7f
- [feat]优化fused_moe tuning，上传K100_AI的configs · 79a9bc29
  王敏 authored Mar 11, 2025
  
  79a9bc29
06 Mar, 2025 1 commit
- update mla optest · e4a9c2cd
  zhuwenwen authored Mar 06, 2025
  
  e4a9c2cd
03 Mar, 2025 2 commits
- update triton mla · 52121d00
  zhuwenwen authored Mar 03, 2025
  
  52121d00
- 解决PA部分size计算错误的问题 · 228a714a
  zhangshao authored Mar 03, 2025
  
  228a714a
28 Feb, 2025 4 commits
- add VLLM_USE_TRITON_OPT_MLA to use optimized MLA attention · 40083064
  zhuwenwen authored Feb 28, 2025
  
  40083064
- Merge branch 'v0.7.2-dev-w8a8' into 'v0.7.2-dev' · 0a130908
  zhuwenwen authored Feb 28, 2025
```
V0.7.2 dev w8a8

See merge request dcutoolkit/deeplearing/vllm!76
```
  0a130908
- 删除vllm的w8a8 config · 6fd8c21b
  gaoqiong authored Feb 28, 2025
  
  6fd8c21b
- 修复w8a8找不到对应config的bug · 044076a1
  gaoqiong authored Feb 28, 2025
  
  044076a1
26 Feb, 2025 2 commits
- Merge branch 'v0.7.2-dev_wm' into 'v0.7.2-dev' · 6b7651af
  zhuwenwen authored Feb 26, 2025
```
[fix]修复ds3量化代码引入的报错

See merge request dcutoolkit/deeplearing/vllm!75
```
  6b7651af
- [fix]修复ds3量化代码引入的报错 · bcce8974
  王敏 authored Feb 26, 2025
  
  bcce8974