Commits · fce10dbed5441b4f918b23a2b63aae72bc00a2f6 · OpenDAS / vllm_cscc

27 Aug, 2025 1 commit
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
25 Aug, 2025 1 commit
- [XPU] Delay BF16 check to worker init for spawn compatibility (#22979) · 8a044754
  Chaojun Zhang authored Aug 26, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  8a044754
23 Aug, 2025 1 commit

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d

Daifeng Li authored Aug 23, 2025


Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

fa78de9d

22 Aug, 2025 1 commit
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
19 Aug, 2025 3 commits
- [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) · 78dba404
  Nikhil Suryawanshi authored Aug 19, 2025
```
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
```
  78dba404
- [TPU] make ptxla not imported when using tpu_commons (#23081) · e9d6a3db
  Chengji Yao authored Aug 18, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
```
  e9d6a3db
- [V0 Deprecation] Remove V0 FlashInfer attention backend (#22776) · 14006840
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  14006840
18 Aug, 2025 1 commit
- [Misc] refactor function name (#23029) · 08d5f711
  Ning Xie authored Aug 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  08d5f711
16 Aug, 2025 1 commit
- [XPU]avoid circular import during XPU init (#23017) · 7caec10e
  Kunshang Ji authored Aug 16, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7caec10e
15 Aug, 2025 1 commit

[Core] Allow full cudagraph with separate attention routines and orthogonal to... · 74f441f4

fhl2000 authored Aug 15, 2025


[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

74f441f4

14 Aug, 2025 1 commit

[Bugfix] use flash attn on sm90 (#22933) · 39cd09dc

Yongye Zhu authored Aug 14, 2025


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

39cd09dc

13 Aug, 2025 2 commits
- [Bugfix] Fix default enable for CUTLASS MLA on SM100 (#22738) · b1361c72
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b1361c72
- [V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6
  Woosuk Kwon authored Aug 12, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  71683ca6
12 Aug, 2025 1 commit
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
06 Aug, 2025 1 commit

[ROCm] Add attention sink to use_rocm_custom_paged_attention (#22329) · 98a3a810

Woosuk Kwon authored Aug 05, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

98a3a810

05 Aug, 2025 1 commit
- [V1] port xformers backend to v1 (#21342) · 469b3ffa
  Giancarlo Delfin authored Aug 05, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  469b3ffa
04 Aug, 2025 1 commit
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
02 Aug, 2025 1 commit

[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL... · d3a6f212

vllmellm authored Aug 02, 2025


[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL models on ROCm platform. (#22069)
Signed-off-by: tjtanaavllm <tunjian.tan@amd.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: tjtanaavllm <tunjian.tan@amd.com>

d3a6f212

31 Jul, 2025 1 commit
- [UX] Rename CUTLASS_MLA_VLLM_V1 to CUTLASS_MLA (#21966) · 61445453
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  61445453
30 Jul, 2025 2 commits
- [TPU] Support Pathways in vLLM (#21417) · 8f0d5167
  wenxindongwork authored Jul 30, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  8f0d5167
- [XPU] use `ZE_AFFINITY_MASK` for device select on xpu (#21815) · 05cbbe20
  Kunshang Ji authored Jul 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  05cbbe20
28 Jul, 2025 1 commit

[XPU] IPEX-optimized Punica Wrapper on XPU (#21703) · ec261b02

Chaojun Zhang authored Jul 29, 2025


Signed-off-by: chzhang <chaojun.zhang@intel.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ec261b02

27 Jul, 2025 1 commit

[Attention] Make CutlassMLA the default backend for SM100 (blackwell) (#21626) · 8f605ee3

Alexander Matveev authored Jul 27, 2025


Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

8f605ee3

23 Jul, 2025 1 commit
- [Bugfix][CUDA] fixes CUDA FP8 kv cache dtype supported (#21420) · 2dec7c1a
  elvischenv authored Jul 23, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  2dec7c1a
22 Jul, 2025 2 commits

[Misc] DeepEPHighThroughtput - Enable Inductor pass (#21311) · 8425f785

Varun Sundar Rabindranath authored Jul 22, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

8425f785

Fix kv_cache_dtype handling for out-of-tree HPU plugin (#21302) · c17231e8

Konrad Zawora authored Jul 22, 2025


Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>

c17231e8

21 Jul, 2025 1 commit
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
20 Jul, 2025 1 commit
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 3 commits
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
- [V0 Deprecation] Remove V0 Spec Decode workers (#21152) · dd572c0a
  Woosuk Kwon authored Jul 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dd572c0a
18 Jul, 2025 1 commit
- [Misc] Do not print async output warning for v1 (#21151) · 54cf1cae
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  54cf1cae
17 Jul, 2025 1 commit
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
15 Jul, 2025 1 commit
- SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) · 8cdc3712
  Alexander Matveev authored Jul 14, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  8cdc3712
14 Jul, 2025 1 commit
- [Misc] Log the reason for falling back to FlexAttention (#20699) · e8cc53af
  Cyrus Leung authored Jul 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e8cc53af
12 Jul, 2025 1 commit
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
11 Jul, 2025 1 commit

[Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a

Pavani Majety authored Jul 11, 2025


Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

7bd4c37a

10 Jul, 2025 3 commits
- [ROCm][Regression] Remove tensor creation that harms performance on ROCm (#20741) · 5b8366b6
  Gregory Shtrasberg authored Jul 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5b8366b6
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- [BugFix] Fix `VllmConfig()` construction on all platforms (#20695) · ffbcc9e7
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ffbcc9e7