Commits · a99300bda69edba0082a9038143ecd66de4d078b · OpenDAS / vllm_cscc

01 Sep, 2025 1 commit
- add dca and sparse attention support on rocm · 1faa2c78
  zhuwenwen authored Sep 01, 2025
  
  1faa2c78
31 Aug, 2025 1 commit
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
29 Aug, 2025 1 commit
- [CPU] Enable data parallel for CPU backend (#23903) · ad39106b
  Li, Jiang authored Aug 29, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  ad39106b
27 Aug, 2025 2 commits
- feat: w4a8 marlin合入主分支, 通过-q slimquant_w4a8_marlin 可以启用 · 5d891ae1
  zhuwenwen authored Aug 27, 2025
  
  5d891ae1
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
25 Aug, 2025 1 commit
- [XPU] Delay BF16 check to worker init for spawn compatibility (#22979) · 8a044754
  Chaojun Zhang authored Aug 26, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  8a044754
23 Aug, 2025 1 commit

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d

Daifeng Li authored Aug 23, 2025


Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

fa78de9d

22 Aug, 2025 2 commits
- update v1 fa layout and set v1 attention use fa · 981f8370
  zhuwenwen authored Aug 22, 2025
  
  981f8370
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
19 Aug, 2025 3 commits
- [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) · 78dba404
  Nikhil Suryawanshi authored Aug 19, 2025
```
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
```
  78dba404
- [TPU] make ptxla not imported when using tpu_commons (#23081) · e9d6a3db
  Chengji Yao authored Aug 18, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
```
  e9d6a3db
- [V0 Deprecation] Remove V0 FlashInfer attention backend (#22776) · 14006840
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  14006840
18 Aug, 2025 1 commit
- [Misc] refactor function name (#23029) · 08d5f711
  Ning Xie authored Aug 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  08d5f711
16 Aug, 2025 1 commit
- [XPU]avoid circular import during XPU init (#23017) · 7caec10e
  Kunshang Ji authored Aug 16, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7caec10e
15 Aug, 2025 1 commit

[Core] Allow full cudagraph with separate attention routines and orthogonal to... · 74f441f4

fhl2000 authored Aug 15, 2025


[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

74f441f4

14 Aug, 2025 1 commit

[Bugfix] use flash attn on sm90 (#22933) · 39cd09dc

Yongye Zhu authored Aug 14, 2025


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

39cd09dc

13 Aug, 2025 2 commits
- [Bugfix] Fix default enable for CUTLASS MLA on SM100 (#22738) · b1361c72
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b1361c72
- [V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6
  Woosuk Kwon authored Aug 12, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  71683ca6
12 Aug, 2025 1 commit
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
09 Aug, 2025 1 commit
- 修改增加lmslimquant_w4a8量化支持 · 54139f16
  zhuwenwen authored Aug 09, 2025
  
  54139f16
06 Aug, 2025 2 commits

update VLLM_FLASH_ATTN_V1 to VLLM_USE_FLASH_ATTN_PA · 77a29416
zhuwenwen authored Aug 06, 2025

77a29416

[ROCm] Add attention sink to use_rocm_custom_paged_attention (#22329) · 98a3a810

Woosuk Kwon authored Aug 05, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

98a3a810

05 Aug, 2025 1 commit
- [V1] port xformers backend to v1 (#21342) · 469b3ffa
  Giancarlo Delfin authored Aug 05, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  469b3ffa
04 Aug, 2025 1 commit
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
02 Aug, 2025 1 commit

[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL... · d3a6f212

vllmellm authored Aug 02, 2025


[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL models on ROCm platform. (#22069)
Signed-off-by: tjtanaavllm <tunjian.tan@amd.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: tjtanaavllm <tunjian.tan@amd.com>

d3a6f212

01 Aug, 2025 1 commit
- update rocm.py · 386e5c47
  zhuwenwen authored Aug 01, 2025
  
  386e5c47
31 Jul, 2025 2 commits
- update unused code · 3de379de
  zhuwenwen authored Jul 31, 2025
  
  3de379de
- [UX] Rename CUTLASS_MLA_VLLM_V1 to CUTLASS_MLA (#21966) · 61445453
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  61445453
30 Jul, 2025 2 commits
- [TPU] Support Pathways in vLLM (#21417) · 8f0d5167
  wenxindongwork authored Jul 30, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  8f0d5167
- [XPU] use `ZE_AFFINITY_MASK` for device select on xpu (#21815) · 05cbbe20
  Kunshang Ji authored Jul 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  05cbbe20
28 Jul, 2025 1 commit

[XPU] IPEX-optimized Punica Wrapper on XPU (#21703) · ec261b02

Chaojun Zhang authored Jul 29, 2025


Signed-off-by: chzhang <chaojun.zhang@intel.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ec261b02

27 Jul, 2025 1 commit

[Attention] Make CutlassMLA the default backend for SM100 (blackwell) (#21626) · 8f605ee3

Alexander Matveev authored Jul 27, 2025


Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

8f605ee3

26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
23 Jul, 2025 1 commit
- [Bugfix][CUDA] fixes CUDA FP8 kv cache dtype supported (#21420) · 2dec7c1a
  elvischenv authored Jul 23, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  2dec7c1a
22 Jul, 2025 2 commits

[Misc] DeepEPHighThroughtput - Enable Inductor pass (#21311) · 8425f785

Varun Sundar Rabindranath authored Jul 22, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

8425f785

Fix kv_cache_dtype handling for out-of-tree HPU plugin (#21302) · c17231e8

Konrad Zawora authored Jul 22, 2025


Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>

c17231e8

21 Jul, 2025 1 commit
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
20 Jul, 2025 1 commit
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 2 commits
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d