Commits · 564cbe7ac8129f22d62fcc49eb7552eb4dfe565d · OpenDAS / vllm_cscc

"tests/benchmarks/test_bench_startup.py" did not exist on "d6953beb91da4e9c99be4c0a1304a2d24189535c"

19 Jan, 2026 1 commit
- remove SUPPORT_MOE_MARLIN_W16A16 · 564cbe7a
  zhuwenwen authored Jan 19, 2026
  
  564cbe7a
16 Jan, 2026 1 commit
- add SUPPORT_MOE_MARLIN_W16A16 to use moe marlin on bw · cabf690f
  zhuwenwen authored Jan 16, 2026
  
  cabf690f
07 Nov, 2025 2 commits
- the prefix cache interface implemented using fa on kme · 651e756b
  zhuwenwen authored Nov 07, 2025
  
  651e756b
- feat: w8a8_marlin 接入，通过-q slimquant_marlin开启，优化w4a8_marlin代码 · 944a8aab
  zhuwenwen authored Nov 07, 2025
  
  944a8aab
04 Nov, 2025 1 commit
- the prefix cache interface implemented using fa on kme · 4886cbdb
  zhuwenwen authored Nov 04, 2025
  
  4886cbdb
03 Nov, 2025 1 commit
- feat: w8a8_marlin 接入，通过-q slimquant_marlin开启，优化w4a8_marlin代码 · dd64aebf
  jujl1 authored Nov 01, 2025
  
  dd64aebf
24 Oct, 2025 1 commit

add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD · c2e6f453

zhuwenwen authored Oct 24, 2025

support prefix cache on kme
fix the error in test_moe caused by moe align not supporting 511 and 211
multi-modal switching to torch implementation on z100l&k100

c2e6f453

23 Oct, 2025 1 commit

support prefix cache on kme · 6f1db287

zhuwenwen authored Oct 23, 2025

fix the error in test_moe caused by moe align not supporting 511
multi-modal switching to torch implementation on z100l&k100

6f1db287

30 Sep, 2025 1 commit
- fix Z100L&K100 precision error · 9e5ec696
  zhuwenwen authored Sep 30, 2025
  
  9e5ec696
29 Sep, 2025 1 commit
- when v1 is set to block_size 16, switch to triton implementation · e470f6a1
  zhuwenwen authored Sep 29, 2025
  
  e470f6a1
16 Sep, 2025 1 commit
- 添加mori ep · 1a56d6cb
  王敏 authored Sep 16, 2025
  
  1a56d6cb
01 Sep, 2025 1 commit
- add dca and sparse attention support on rocm · 12112a4d
  zhuwenwen authored Sep 01, 2025
  
  12112a4d
27 Aug, 2025 1 commit
- feat: w4a8 marlin合入主分支, 通过-q slimquant_w4a8_marlin 可以启用 · 533d4c72
  jujl1 authored Aug 27, 2025
  
  533d4c72
20 Aug, 2025 1 commit
- set v1 attention use fa · f7beb354
  zhuwenwen authored Aug 20, 2025
  
  f7beb354
07 Aug, 2025 1 commit
- 修改增加lmslimquant_w4a8量化支持 · 8b1e4ef0
  gaoqiong authored Aug 07, 2025
  
  8b1e4ef0
06 Aug, 2025 1 commit
- update VLLM_FLASH_ATTN_V1 to VLLM_USE_FLASH_ATTN_PA · 88dbf92c
  zhuwenwen authored Aug 06, 2025
  
  88dbf92c
01 Aug, 2025 2 commits
- update rocm.py · 0480314d
  zhuwenwen authored Aug 01, 2025
  
  0480314d
- update HIP_VISIBLE_DEVICES of rocm · d0cc5577
  zhuwenwen authored Aug 01, 2025
  
  d0cc5577
26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
06 Jul, 2025 3 commits
- Revert "[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412)" · a5dd03c1
  simon-mo authored Jul 06, 2025
```
This reverts commit e202dd27.
```
  a5dd03c1
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
- [V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e202dd27
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
04 Jul, 2025 1 commit
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
03 Jul, 2025 1 commit
- update VLLM_FLASH_ATTN_BACKEND to VLLM_FLASH_ATTN_V1 · 64fc5a29
  zhuwenwen authored Jul 03, 2025
  
  64fc5a29
02 Jul, 2025 1 commit
- [UT][intel GPU] use current_platform instead of device hardcode in v1 tests (#20169) · a0389e05
  Liangliang Ma authored Jul 02, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  a0389e05
01 Jul, 2025 2 commits
- [BugFix][V1][ROCm] Triton MLA uses V0 backend on V1 engine (#19067) · 96453cfa
  TY-AMD authored Jul 01, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  96453cfa
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
27 Jun, 2025 1 commit
- 1.临时解决gemm调用到blaslt问题 · 6d172ab4
  王敏 authored Jun 27, 2025
```
2.支持设置v1的chunked_prefill开关
```
  6d172ab4
26 Jun, 2025 2 commits
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
- [Bugfix] Allow `CUDA_VISIBLE_DEVICES=''` in `Platform.device_id_to_physical_device_id` (#18979) · 65397e40
  Seiji Eicher authored Jun 26, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  65397e40
25 Jun, 2025 1 commit
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
20 Jun, 2025 1 commit
- [Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583) · 5e666f72
  kourosh hakhamaneshi authored Jun 19, 2025
  
  5e666f72
19 Jun, 2025 1 commit
- Fix FA2 fallback for Blackwell V1 (#19781) · 36239f79
  Michael Goin authored Jun 19, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  36239f79
18 Jun, 2025 2 commits

[Hardware][AMD] integrate aiter chunked prefill into vllm (#18596) · 8b6e1d63

Zzz9990 authored Jun 18, 2025


Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: fsx950223 <fsx950223@outlook.com>
Co-authored-by: charlifu <charlifu@amd.com>

8b6e1d63

[Platform] Allow platform use V1 Engine by default (#19792) · 257ab954
wangxiyuan authored Jun 18, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
257ab954

17 Jun, 2025 1 commit
- [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) · a44b1c95
  Charlie Fu authored Jun 17, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  a44b1c95
16 Jun, 2025 1 commit
- [Misc] Remove duplicate multiproc method setting for CPU platform (#19649) · a5e7242d
  Isotr0py authored Jun 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  a5e7242d
13 Jun, 2025 1 commit
- [CPU] Refine default config for the CPU backend (#19539) · 64587211
  Li, Jiang authored Jun 13, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  64587211
12 Jun, 2025 1 commit
- [Bugfix][V1] Allow manual FlashAttention for Blackwell (#19492) · af09b3f0
  Michael Goin authored Jun 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  af09b3f0