Commits · 2b47d4fa4a647cfa634f2c3b4bbc29e92e32ef72 · OpenDAS / vllm_cscc

15 Mar, 2025 1 commit
- 支持fusemoe对int4的scale合zero合并读取操作 · 2b47d4fa
  zhuwenwen authored Mar 15, 2025
  
  2b47d4fa
14 Mar, 2025 2 commits
- 增加deepseek v3 block-int8量化支持 · ba1ff372
  zhuwenwen authored Mar 14, 2025
```
增加线性int8 gemm配置
```
  ba1ff372
- [feat]add gen_mla_pa_tables.py and optimize triton config configuration · 6188d468
  zhuwenwen authored Mar 14, 2025
  
  6188d468
13 Mar, 2025 1 commit
- update mla to obtain the optimal configuration from config · eee6148a
  zhuwenwen authored Mar 13, 2025
  
  eee6148a
12 Mar, 2025 1 commit
- [feat]添加BW deepseek_v3 fused_moe configs · abac3adc
  zhuwenwen authored Mar 12, 2025
  
  abac3adc
11 Mar, 2025 2 commits
- add VLLM_USE_TRITON_OPT_MLA to use optimized MLA attention · 1ee40c4d
  zhuwenwen authored Mar 11, 2025
```
update mla optest
```
  1ee40c4d
- [feat]优化fused_moe tuning，上传K100_AI的configs · e3a0d6bb
  zhuwenwen authored Mar 11, 2025
  
  e3a0d6bb
28 Feb, 2025 1 commit
- 1. 修复w8a8找不到对应config的bug · baf7d06a
  zhuwenwen authored Feb 28, 2025
```
2. 删除vllm的w8a8 config
```
  baf7d06a
27 Feb, 2025 2 commits
- update mtp layout · c5888d31
  zhuwenwen authored Feb 27, 2025
  
  c5888d31
- Merge branch 'v0.7.2-dev' into v0.7.3-dev · 7b681c9e
  zhuwenwen authored Feb 27, 2025
  
  7b681c9e
26 Feb, 2025 8 commits
- update lmslim version · bed03c5a
  zhuwenwen authored Feb 26, 2025
  
  bed03c5a
- Merge branch '0.7.2-cudagraph' into 'v0.7.2-dev' · acdb256a
  zhuwenwen authored Feb 26, 2025
```
解决cudagraph计算错误的问题

See merge request dcutoolkit/deeplearing/vllm!72
```
  acdb256a
- 解决cudagraph计算错误的问题 · d365012a
  zhangshao authored Feb 26, 2025
  
  d365012a
- update deepseek-v2 · 96802ca0
  zhuwenwen authored Feb 26, 2025
  
  96802ca0
- add cudagraph · 4d4c6fe3
  zhuwenwen authored Feb 26, 2025
  
  4d4c6fe3
- add cudagraph · d969c150
  zhuwenwen authored Feb 26, 2025
  
  d969c150
- allow to set --enforce-eager · 537e2d9c
  zhuwenwen authored Feb 26, 2025
  
  537e2d9c
- allow to set --enforce-eager · fbfb40ad
  zhuwenwen authored Feb 26, 2025
  
  fbfb40ad
25 Feb, 2025 2 commits
- update rocm.py · 601057c9
  zhuwenwen authored Feb 25, 2025
  
  601057c9
- update version · 76621631
  zhuwenwen authored Feb 25, 2025
  
  76621631
22 Feb, 2025 4 commits
- Merge branch 'v0.7.2-dev' into v0.7.3-dev · b72de6bd
  zhuwenwen authored Feb 22, 2025
  
  b72de6bd
- update qwen2_vl nn lyaout · 437e6aef
  zhuwenwen authored Feb 22, 2025
  
  437e6aef
- set enforce eager · 7f881746
  zhuwenwen authored Feb 22, 2025
  
  7f881746
- support qwen2_5-vl · 0a89b8a3
  zhuwenwen authored Feb 22, 2025
  
  0a89b8a3
21 Feb, 2025 1 commit
- Merge tag 'v0.7.3' into v0.7.3-dev · ec5e299c
  zhuwenwen authored Feb 21, 2025
  
  ec5e299c
20 Feb, 2025 15 commits
- [Bugfix] Fix deepseekv3 grouped topk error (#13474) · ed6e9075
  chenxiaobing authored Feb 20, 2025
```
Signed-off-by: Chen-XiaoBing <chenxb002@whu.edu.cn>
```
  ed6e9075
- Merge similar examples in `offline_inference` into single `basic` example (#12737) · 992e5c3d
  Harry Mellor authored Feb 20, 2025
  
  992e5c3d
- [Kernel] LoRA - Refactor sgmv kernels (#13110) · b69692a2
  Varun Sundar Rabindranath authored Feb 20, 2025
  
  b69692a2
- [2/n][ci] S3: Use full model path (#13564) · a64a8443
  Kevin H. Luu authored Feb 20, 2025
```
Signed-off-by: <>
```
  a64a8443
- [ci] Fix spec decode test (#13600) · aa1e62d0
  Kevin H. Luu authored Feb 20, 2025
  
  aa1e62d0
- 适配deepseekv3\v2 moe awq的推理支持 · 47bd229c
  yangql authored Feb 20, 2025
  
  47bd229c
- [CI/Build] Use uv in the Dockerfile (#13566) · 497bc831
  Michael Goin authored Feb 20, 2025
  
  497bc831
- [API Server] Add port number range validation (#13506) · 3738e6fa
  Yuan Tang authored Feb 20, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  3738e6fa
- [ROCm] MI300A compile targets deprecation (#13560) · 0023cd2b
  Gregory Shtrasberg authored Feb 20, 2025
  
  0023cd2b
- [Misc] add mm_processor_kwargs to extra_body for Qwen2.5-VL (#13533) · 041e2947
  燃 authored Feb 20, 2025
  
  041e2947
- [Misc] Warn if the vLLM version can't be retrieved (#13501) · 96216678
  Alex Brooks authored Feb 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
```
  96216678
- skip fp8 fusion · 4a734b9d
  zhuwenwen authored Feb 20, 2025
  
  4a734b9d
- [bugfix] spec decode worker get tp group only when initialized (#13578) · 8c755c3b
  Simon Mo authored Feb 19, 2025
  
  8c755c3b
- [core] add sleep and wake up endpoint and v1 support (#12987) · ba811639
  youkaichao authored Feb 20, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: cennn <2523403608@qq.com>
Co-authored-by: cennn <2523403608@qq.com>
```
  ba811639
- [ROCm][MoE] mi300 mixtral8x7B perf for specific BS (#13577) · 0d243f2a
  Divakar Verma authored Feb 19, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  0d243f2a