Commits · 969b4da3a6ab737f72cb33db502b4c0bb70d4139 · OpenDAS / vllm_cscc

23 Sep, 2025 3 commits
- [V0 Deprecation] Remove placeholder attn (#25510) · 969b4da3
  Thomas Parnell authored Sep 24, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  969b4da3
- [V1][Kernel] Add triton implementation for `reshape_and_cache_flash` (#24503) · 100b630a
  Burkhard Ringlein authored Sep 23, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chih-Chieh Yang <chih.chieh.yang@ibm.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  100b630a
- [Bugfix] Remove contiguous output req for context parallel MLA (#25414) · 78237e43
  Michael Goin authored Sep 22, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  78237e43
22 Sep, 2025 2 commits
- [Misc] Remove unused encoder-decoder error strings (#25374) · 417a164a
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  417a164a
- [V0 Deprecation] Remove `MultiModalPlaceholderMap` (#25366) · f92d9526
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f92d9526
21 Sep, 2025 3 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328) · 1cd885bd
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1cd885bd
- [V0 Deprecation] Remove V0 core (#25321) · c99db8c8
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c99db8c8
20 Sep, 2025 2 commits

[BUG FIX][NON-CUDA]quick fix to avoid call cudagraph_unsafe in attention (#25298) · 6c5f82e5
Chendi.Xue authored Sep 19, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
6c5f82e5

[torch.compile] CUDAGraph Inductor partition integration (#24281) · 8945b001

Boyuan Feng authored Sep 19, 2025


Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Signed-off-by: boyuanfeng <boyuan@meta.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8945b001

19 Sep, 2025 3 commits
- Optimize triton unified attention performance for sliding window attention (#24390) · a2a5f79e
  qizixi authored Sep 19, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  a2a5f79e
- Encoder model support for the Transformers backend (#25174) · 12aed7e4
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  12aed7e4
- [bugfix] fix MHA for models like OpenGVLab/InternVL3_5-38B (#25146) · a684c012
  Yan Ma authored Sep 19, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a684c012
18 Sep, 2025 2 commits
- [Kernel] Decouple Tile Size from Block Size in Triton Unified Attention Kernel (#21197) · 01a583fe
  jvlunteren authored Sep 18, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  01a583fe
- [XPU] Whisper model support on XPU Platform (#25123) · 3bc18127
  Chaojun Zhang authored Sep 18, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  3bc18127
17 Sep, 2025 1 commit

Aiter mha fp8 fix (#24991) · 1a456c7c

Douglas Lehr authored Sep 17, 2025


Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>

1a456c7c

16 Sep, 2025 2 commits
- Directly get max encoder len from VLLM config in V1 (#24866) · cd1f885b
  Sugar authored Sep 17, 2025
```
Signed-off-by: Sugar-zsg <952242923@qq.com>
```
  cd1f885b
- [Bug] Fix `is_flashmla_supported` Check Error (#24774) · b42566f4
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42566f4
15 Sep, 2025 1 commit
- [USAGE] Improve error handling for weight initialization in Unquantized… (#20321) · b834b4cb
  Rafael Marcelino Koike authored Sep 15, 2025
```
Signed-off-by: Rafael Marcelino Koike <rafael.koike@oracle.com>
Signed-off-by: Rafael Koike <koike.rafael@gmail.com>
```
  b834b4cb
12 Sep, 2025 3 commits
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
- [Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
  Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  72fc8aa4
11 Sep, 2025 3 commits

[Bugfix] Fix incorrect import of CacheConfig (#24631) · 6aeb1dab
Cyrus Leung authored Sep 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6aeb1dab

[Model] New model support for Motif-1-Tiny (#23414) · 9bd831f5

TaehyunKim authored Sep 11, 2025


Signed-off-by: ca1207 <ca1207zzz@gmail.com>
Signed-off-by: TaehyunKim <73943231+ca1207@users.noreply.github.com>
Co-authored-by: WyldeCat <skan1543@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9bd831f5

[Bugfix] Add missing VIT backend dispatch on CPU (#24623) · 29799dda
Li, Jiang authored Sep 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
29799dda

10 Sep, 2025 3 commits

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767) · 9a161307

Gregory Shtrasberg authored Sep 10, 2025


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9a161307

[v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
37e8182b

Feature/vit attention unification# 23880 (#23978) · 6cbd4190

baonudesifeizhai authored Sep 10, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

6cbd4190

09 Sep, 2025 1 commit

[Feature] Disallow FlashMLA on Blackwell (#24521) · 15de5ff9

Wentao Ye authored Sep 09, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

15de5ff9

08 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
07 Sep, 2025 1 commit
- [attention][DCP] use AttentionImpl.need_to_return_lse_for_decode (#24372) · 558f0907
  youkaichao authored Sep 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  558f0907
06 Sep, 2025 2 commits

[V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4172235a

[Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e

yzds authored Sep 06, 2025


Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>

ac201a0e

04 Sep, 2025 3 commits

[Doc]: fix typos in Python comments (#24173) · 83609ca9

Didier Durand authored Sep 04, 2025


Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

83609ca9

[XPU] support Triton Attention backend on Intel GPU (#24149) · 16ded21e
Kunshang Ji authored Sep 04, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
16ded21e

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- [Bugfix] Fixing division by zero in triton_attn if query_heads/kv_heads > 16 (#23424) · 6d80ae83
  Burkhard Ringlein authored Sep 03, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
```
  6d80ae83
02 Sep, 2025 1 commit
- [AMD][Kernel][Bugfix] Cast offsets tensor bn to tl.int64 to avoid GPU segfault (#23692) · 457e4719
  rasmith authored Sep 02, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  457e4719
27 Aug, 2025 1 commit
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
26 Aug, 2025 1 commit

[Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8

Hyogeun Oh (오효근) authored Aug 27, 2025

Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

730d0ac8